Robots.txt question

Discussion in 'Web Design and Development' started by Anaksagor, Nov 20, 2008.

  1. Anaksagor macrumors newbie

    Joined:
    Aug 26, 2008
    #1
    Can anyone give me a link where i can read on how to write the file robots.txt if i want to dissallow the spiders to index some of the pages of my site. thank you
     
  2. edesignuk Moderator emeritus

    edesignuk

    Joined:
    Mar 25, 2002
    Location:
    London, England
    #2
    Google.

    Every single link will tell you what you need to know.
     
  3. Anaksagor thread starter macrumors newbie

    Joined:
    Aug 26, 2008

Share This Page