Category: robots.txt

  • Robots.txt 2.0

    Since the introduction of google maps streets view two days ago, people are going crazy in trying to zoom in and find hidden gems in those captured images. If you don’t know about this click on the link above and you’ll see what I’m talking about, or you can just go to maps.google.com and zoom…