Live data from Hacker News

Robots.txt

explicitly.me

51–60 of 142 posts

Re: Robots.txt

#51
post #21

That robots.txt is so big that even with comments maybe google will drop it after trying to parse it for a while....

I bet they are fairly liberal with their size limits:

http://www.amazon.com/robots.txt http://aws.amazon.com/robots.txt http://www.google.com/robots.txt http://store.apple.com/robots.txt

Re: Robots.txt

#52
post #46
post #21

That robots.txt is so big that even with comments maybe google will drop it after trying to parse it for a while....

robots this size aren't that unusual http://www.bbc.co.uk/robots.txt

wow, just realized this is a great way to find information about websites

Re: Robots.txt

#53

I think SEO is practically dead, and for good. The Social Web is supposedly lot more democratic and apparently a better choice.

These days I'd argue to a client to spend their money hiring PR people. PR people obtain high quality backlinks the legit, organic way.

Re: Robots.txt

#54
post #12

Keep up the good work Google. I hope this serves as encouragement for them to continue to screw over those who want to turn searching for relevant information into a war for who can cheat the system the best.

Totally with you. I was enjoying the amusing tone of the piece but he lost my sympathy at:

"Before, SEO was the game of really skilled people, you know like professional poker players. You had to know the game, know when to raise, and when to bluff."

Then with the "Maybe I should find another job?" I thought this has got to be satire. Well played, sir.

The way the piece is framed, the writing style, surely a work of humour?

Re: Robots.txt

#55

I always thought SEO was supposed to be a cat/mouse game. The search engine tries to balance the search results fairly. The SEO consultant tries to game the system and get certain links to appear ranked higher, whether fair or not. Isn't that just how this works?

gaming the system is blackhat SEO. There's also supposed to be the SEO business where you actually improve the site's quality, indexability and speed.

Re: Robots.txt

#56
post #12

Keep up the good work Google. I hope this serves as encouragement for them to continue to screw over those who want to turn searching for relevant information into a war for who can cheat the system the best.

Plus one. SEO is absolutely annoying. If a site is built correctly and there is interest in the service or topic the site provides, then the product will be found. Stuffing keywords into title and heading tags along with other grey area SEO techniques really devalues the internet. I see SEO along the same lines as buying domains that you think may have value and sitting on them. Games like this hinder progress and real utilization of the resources at our disposal.

Re: Robots.txt

#58
post #31

Nobody else read this as a joke? I read it as a joke (and a slightly racist one at that).

I was wondering if it was satire... especially once I got to the designer watch bit. If it is, it's really dry.

Re: Robots.txt

#59

I wonder how this post got to the top even though the sentiment in the comments is that this posts sucks.

I upvoted it before I'd read all the way through.

I thought the guy was complaining that he had to jump through Google's hoops to get his product in front of his users.

Now that I know he's complaining that Google are making it harder for him to game the system, I'd retract and reverse my upvote if I could.

Re: Robots.txt

#60
post #12

Keep up the good work Google. I hope this serves as encouragement for them to continue to screw over those who want to turn searching for relevant information into a war for who can cheat the system the best.

Exactly what I thought, SEO should not have ever become a "thing" if Google did its job right.

"SEO should not have ever become a "thing" if Google did its job right."

SEO will always be a "thing" as long as people are not always interested in providing relevant information. It will always be an asymmetric battle between people who want to prioritize their noise over useful signal.

Post reply on HN