Google killer-robots.txt
11–20 of 30 posts
Re: Google killer-robots.txt
#12Re: Google killer-robots.txt
#13I find Google's techie Easter-eggs like this delightful. My favorite, by far is: http://www.google.com/#q=recursion
Re: Google killer-robots.txt
#14Re: Google killer-robots.txt
#15I find Google's techie Easter-eggs like this delightful. My favorite, by far is: http://www.google.com/#q=recursion
Edit: found the original interview:
http://www.npr.org/2003/10/14/167643282/google-founders-larr...
Starting at 13:45, Sergey and Larry try to explain recursion and idempotentence on Fresh Air.
Re: Google killer-robots.txt
#16Maybe a little less funny after acquiring Boston Dynamics. https://www.youtube.com/watch?v=tFrjrgBV8K0 http://www.bostondynamics.com/img/Atlas-x3c.lr.jpg
Re: Google killer-robots.txt
#17Re: Google killer-robots.txt
#18Re: Google killer-robots.txt
#19Re: Google killer-robots.txt
#20What does killer-robots.txt mean. And what do /+LarryPage links point to? (His google plus profile?)
Disallow: tells the robot that it should not visit those particular pages on a site. Or in this case, terminate those individuals.