Live data from Hacker News

Robots.txt

explicitly.me

111–120 of 142 posts

Re: Robots.txt

#111
post #65
post #31

Nobody else read this as a joke? I read it as a joke (and a slightly racist one at that).

I read it as a joke by the end but, worryingly, didn't automatically recontextualise it as racist in light of that. Which, I think I agree with you, it is, if it's a joke and all the East Africa stuff is made up for "comedy value".

I am an Indian born in East Africa ;)

Re: Robots.txt

#112
post #93

Earlier quoted context omitted.

If this were truly the case, we shouldn't expect quality sites to benefit from SEO. In practice, they do.

I'm not saying SEO is not effective, it certainly works, but it shouldn't, and it is Google job to make it happen. On a high level good sites don't benefit from SEO, because it wastes time and money on something that should be granted: good sites should be ranked high, crap sites should be ranked low. SEO is a cargo cult ( http://en.wikipedia.org/wiki/Cargo_cult_science ) with no benefits to society.

If SEO is provably effective, it is by definition not a cargo cult. The defining feature of a cargo cult is that it's questionable at best whether their practices lead to the goal they want to achieve (e.g. making fake walkie talkies and yelling into them hoping that a plane will drop cargo because you saw someone with a real walkie talkie make that happen).

Re: Robots.txt

#113
post #46
post #21

That robots.txt is so big that even with comments maybe google will drop it after trying to parse it for a while....

robots this size aren't that unusual http://www.bbc.co.uk/robots.txt

I think you just proved the point here: SEO can be very valuable. Any good SEO would point out to the BBC that having similar rules for User-agent: Googlebot-Mobile and User-agent: * is not very efficient.

Re: Robots.txt

#114

An SEO consultant complaining about Google's frequent algo changes is like a mechanic complaining that cars break down too often.

If I was feeling uncharitable, I would say it's a bit like a burglar complaining that the homeowner keeps installing better locks.

And the house would be the White House (in the sense that SEOs aren't just working against Google but against its billion users).

Re: Robots.txt

#115
post #45

Earlier quoted context omitted.

There is still a case for consultants who understand how to make websites genuinely more useful and relevant. Then it's win-win. Their motives might be their rankings, traffic and profit, but if it improves the web for Google users, then that isn't necessarily a bad thing. But the tone of this "article" makes this guy sound like he wears a black hat.

I don't really. I do believe there is value in learning the dark side of this profession though. There aren't enough genuine SEOs that really understand both sides of the equation.

I used to agree with this, but lately I feel like any learnings are going to have a short shelf life. With the EMD updates and on-going refinements to Penguin, how long can any truly effective hack really be expected to work?

I'm glad Google is cleaning house b/c it became annoying trying to counsel people to not violate the Webmaster Guidelines when they could point to successful competitors or some backwater infomercial claiming they could shortcut their way by spamming.

The best strategy I've found is just to not shoot yourself in the foot in terms of site structure and IA, and invest in long-term value through link building with PR and content that naturally attracts links.

Re: Robots.txt

#117

SEO has made a lot of damage to the Internet. 10 years ago links really expressed people preferences, and it was easy to get linked and ranked high when you've published useful stuff. Today, almost all large sites that people use to share links to original content use nofollow links. Because of this, it is common that when you Google for some original content, you will find links to aggregators (Stack Overflow, Reddi…

Well, actually Google did this first, because they started using links as "votes". Then everyone started hunting for links instead of trying build do good content.

Re: Robots.txt

#118
post #115

Earlier quoted context omitted.

I don't really. I do believe there is value in learning the dark side of this profession though. There aren't enough genuine SEOs that really understand both sides of the equation.

I used to agree with this, but lately I feel like any learnings are going to have a short shelf life. With the EMD updates and on-going refinements to Penguin, how long can any truly effective hack really be expected to work? I'm glad Google is cleaning house b/c it became annoying trying to counsel people to not violate the Webmaster Guidelines when they could point to successful competitors or some backwater infome…

I wish some of the "real" black hatters could come on here and speak. These guys are the ones putting together massive strategies/campaigns to rank across a wide variety of thousands of key terms. And there not writing about it. The techniques many people are talking about now were done maybe 2-3 years before this whole mess. They are so far ahead of what the "industry" is focused on it's not even funny.

Re: Robots.txt

#119
post #96
post #38

Earlier quoted context omitted.

http://en.wikipedia.org/wiki/If-by-whiskey seems relevant.

Yes, SEO has clearly a negative notion for me. To deceive the search engine and make it less useful for me is practically the job description of SEO, in my opinion. For all the "no-evil" stuff, it's just plainly the work of a website programmer. Properly formatting your HTML, making it accessible and easily "readable" for machines is part of your job when you create a website. Same for creating a robots.txt. If you s…

I can see what you are saying but I see SEO a bit differently than being simply good web programming. It's about content organization as well as information flow. Some of the time that comes naturally to a webmaster, but there are so many content rich sites with poor web programming and poor organization. SEO is a niche side of web programming that fixes that specific problem. The skills of an SEO sometimes don't even cross the mind of a "good" web programmer because of the unknown unknowns factor. They just haven't thought about even attempting to rank a website on Google. They aren't investigating the competition to see where they fit, and how to be better.

Re: Robots.txt

#120
Bmac27, what kind of enterprise seo toolset do you recommend ? I am currently evaluating Skycara, Brightedge and SEOcatalyst but wanted something else to try and look at. I'm runnign a site with 15,000 pages, 10,000 errors and about 20k keywords
Post reply on HN