Live data from Hacker News

CNET is deleting old articles to try to improve its Google Search ranking

theverge.com

151–160 of 592 posts

Re: CNET is deleting old articles to try to improve its Google Search ranking

#151

Earlier quoted context omitted.

So whose word do we have to go on that this is beneficial, besides anonymous "SEO experts" and CNET leadership (those paragons of journalistic savvy)? Perhaps what CNET really means is that they're deleting old low quality content with high bounce rates. After all, the best SEO is actually having the thing users want.

Google actually describes an entirely plausible mechanism of action here at [1]. old content slows down site crawling, which can cause new content to not be refreshed as often. Sure, one page doesn’t matter, but thousands will. [1] https://twitter.com/searchliaison/status/1689068723657904129...

It says it doesn't affect ranking and their quote tweet is even more explicit

https://twitter.com/searchliaison/status/1689297947740295168

Re: CNET is deleting old articles to try to improve its Google Search ranking

#152
post #102

Earlier quoted context omitted.

I adore archive.org. I'm worried though it is becoming somewhat of a load bearing element of civilization, given the importance of shared and accurate history. We need redundancy. ~~I'm also worried about the deletion of old pages on archive because new owners of a domain update the robots.txt file to disallow it, which I've heard wipes the entire archive.org history of that domain. I hope that gets addressed.~~ Edit…

Yeah wait, what? I hope that's incorrect. Updating robots.txt to disallow should only omit content from that point onward... It shouldn't be retroactive. What if there's a new owner of a respective domain, for example?

It was correct. And archive.org used this self inflicted problem to justify disregarding robots.txt.

https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea...

Re: CNET is deleting old articles to try to improve its Google Search ranking

#153
post #5

I've seen a couple news sources that are altering their publish dates to show near the top of news feeds. Google will announce "3 hours old", despite being weeks old.

Yup, "Last Updated on xxx" but no obvious updates called out in the article

And definitely no "diff" to previous versions.

Even if updates are mostly minor corrections or batch updates of boilerplate, the capability exists to rewrite any part or all of a story if there's no way to see past versions from third-parties from a single cache from archive.is or possibly archive.org.

Archival navigation and visualization should be deeply integrated into a user-centric, privacy browser.

Re: CNET is deleting old articles to try to improve its Google Search ranking

#154
post #126

Earlier quoted context omitted.

Yeah wait, what? I hope that's incorrect. Updating robots.txt to disallow should only omit content from that point onward... It shouldn't be retroactive. What if there's a new owner of a respective domain, for example?

It isn't, I really wish that instead of wiping DECADES of history; it only applies to content that was archived from the day of the domain's registration. I think this is slightly more reasonable, but I imagine they simply don't have access to such data.

Simply requiring domain owners contact archive.org to remove old snapshots would be better than applying robots.txt retroactively.

Re: CNET is deleting old articles to try to improve its Google Search ranking

#155
post #29

This is some bullshit. It’s bad enough that a lot of sites with content going back 10-20 years have linkrot or have simply gone offline. But I am at a loss for words that they’re disappearing content on purpose just for SEO rankings. If this is what online publishing has come to we have seriously screwed up.

Is this why Google search is really terrible now? The search results are nearly unusable today compared to 1-2 years ago

Re: CNET is deleting old articles to try to improve its Google Search ranking

#156

Earlier quoted context omitted.

It could be premature to place fault with the SEO industry. Think about the incentives: Google puts articles out, but an SEO specialist might have empirical knowledge from working for a various number of web properties. It's not that I wouldn't trust Google's articles, but specialists might have discovered undocumented methods for giving a boost.

They certainly want you to believe that.

The good ones will share the data/trends/case studies that would support the effectiveness of their methods.

But the vast majority are morons, grifters, and cargo culters.

The Google guidance is generally good and mildly informative but there’s a lot of depth that typically isn’t covered that the SEO industry basically has to black box test to find out.

Re: CNET is deleting old articles to try to improve its Google Search ranking

#157

So google's shitty search now economically incentivizes sites to destroy information. Can there be any doubt that Google destroyed the old internet by becoming a bad search engine? Could their exclusion of most of the web be considered punishment for being sites being so old and stable that they don't rely on Google for ad revenue?

Aren't they both doing the economically incentivized thing tho? Are you saying maybe some things should be beyond economic incentives?

Yes, some things should be beyond economic incentives. Destroying the historical record, for instance. We have plenty of precedent around that, now that we realised it's bad.

Re: CNET is deleting old articles to try to improve its Google Search ranking

#158
Smart to delete old content.

Very few people use it.

And it costs resources to keep up and crawl.

Better to prune content that doesn’t get a lot of traffic to keep your domain authority high.

Also 50k page limit on sitemap.xml.

Also… stop hoarding. Delete everything you can. As often as you can. Clinging to the past isn’t healthy.

Re: CNET is deleting old articles to try to improve its Google Search ranking

#159

Earlier quoted context omitted.

The theory I've heard is related to 'crawl budget'. Google is only going to devote a finite amount of time to indexing your site. If the number of articles on your site exceeds that time, some portion of your site won't be indexed. So by 'pruning' undesirable pages, you might boost attention on the articles you want indexed. No clue how this ends up working in practice. Google's suggestion isn't to delete pages, but…

But as that linked guide explains, that's only relevant for sites with e.g. over a million pages changing once a week . That's for stuff like large e-commerce sites with constantly changing product info. Google is clear that if your content doesn't change often (in the way that news articles don't), then crawl budget is irrelevant.

It’s possible they examined the server logs for requests from GoogleBot and found it wasting time on old content (this was not mentioned in the article but would be a very telling data point beyond just “engagement metrics”).

There’s some methodology to trying to direct Google crawls to certain sections of the site first - but typically Google already has a lot of your URLs indexed and it’s just refreshing from that list.

Re: CNET is deleting old articles to try to improve its Google Search ranking

#160
Since everyone's reacting to the headline and hasn't read The Fine Article... Please let me call attention to the linked tweet from Google explicitly saying don't do this.

> Are you deleting content from your site because you somehow believe Google doesn't like "old" content? That's not a thing! Our guidance doesn't encourage this. Older content can still be helpful, too.

https://twitter.com/searchliaison/status/1689018769782476800

Post reply on HN