Live data from Hacker News

Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

surgehq.ai

1–10 of 433 posts

Re: Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

#2
There's been a lot of HN discussion [1][2][3] about Google Search recently, and whether it’s gone downhill.

I used to work on Search and Search Measurement at YouTube, Twitter, and Microsoft, so I thought it would be fun to move beyond anecdotes, grab some data, and do a quantitative analysis.

tl;dr I didn't have historical data, to see how Google Search has trended over time. But compared to Bing, Google still generally outperforms -- although some of its failures are pretty surprising!

If there are particular areas of Google Search that people are interested in digging into, give a shout -- I love running these kinds of search / human eval analyses.

[1] https://news.ycombinator.com/item?id=29772136 [2] https://news.ycombinator.com/item?id=29417061 [3] https://news.ycombinator.com/item?id=29392702

Re: Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

#4
post #3

It's definitely deteriorating, and the worst part is that it completely ignores quotes if it thinks you meant something else, and shows the results for what it thinks you want. Completely useless in a lot of cases

Google corrects spelling in the way you mention, but removes quotes only if there are zero results for the search with quotes. Example, finding one result; https://www.google.de/search?q=%22but+when+therefore+is+an+a...

Getting this wrong is probably why people think we need more than definitive assertions from people operating from subjective impression.

Changing a letter in the query, it says, right at the top:

    Showing results for "but when therefore is an adverb"
    No results found for "but when therefore is tan adverb"

Re: Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

#5
post #3

It's definitely deteriorating, and the worst part is that it completely ignores quotes if it thinks you meant something else, and shows the results for what it thinks you want. Completely useless in a lot of cases

Google corrects spelling in the way you mention, but removes quotes only if there are zero results for the search with quotes. Example, finding one result; https://www.google.de/search?q=%22but+when+therefore+is+an+a... Getting this wrong is probably why people think we need more than definitive assertions from people operating from subjective impression. Changing a letter in the query, it says, right at the top: Sho…

[deleted]

Re: Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

#6
post #2

There's been a lot of HN discussion [1][2][3] about Google Search recently, and whether it’s gone downhill. I used to work on Search and Search Measurement at YouTube, Twitter, and Microsoft, so I thought it would be fun to move beyond anecdotes, grab some data, and do a quantitative analysis. tl;dr I didn't have historical data, to see how Google Search has trended over time. But compared to Bing, Google still gener…

I think the broader theme that these outrage bait posts miss is that the web itself is rotting / deteriorating. Most interesting content isn't on the web anymore and is definitely not in text.

Content that would be have been on an open web forum 10 years ago, are now hidden behind various data silos/walled gardens - whether it's Reddit, YouTube, TikTok, Instagram, Twitter or Discord. Each of these walled gardens have different levels of tolerance for the open web, from using it as an SEO channel (e.g. Reddit) to completely opaque to it (e.g Discord).

Some car and photography forums I was on ~10 years ago are all barren now as the old users have moved on and new users prefer to communicate in a Facebook group or something like that.

Interesting self-published blogs and recipes aren't on the web anymore, they're on YouTube channels or on someone's Instagram channel (or whatever its called).

Re: Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

#9
One of the worst things I've noticed recently about Google Search is how it is very anti-startup because of the concept of the Google Sandbox, an essentially arbitrary length of time they put a huge negative penalty on your site to try to entice you to buy paid ads instead before your funding runs out waiting for organic traffic.

Perhaps that's my biased opinion on their motivations as I've recently launched https://grizzlybulls.com and yet even though Bing has tiny market share, I'm getting 10x more organic traffic from Bing rather than Google...

Re: Is Google Search Deteriorating? Measuring Google's Search Quality in 2022

#10
post #2

There's been a lot of HN discussion [1][2][3] about Google Search recently, and whether it’s gone downhill. I used to work on Search and Search Measurement at YouTube, Twitter, and Microsoft, so I thought it would be fun to move beyond anecdotes, grab some data, and do a quantitative analysis. tl;dr I didn't have historical data, to see how Google Search has trended over time. But compared to Bing, Google still gener…

youtube now seems to provide me only ~10 relevant results and then random other videos i might like with no way to delve further into results based on my search term. this results in it being almost impossible for me to find certain things, especially videos without a lot of views, unless i know the exact title of the video ahead of time.

what are some of the decisions that go into this ? is it just cost savings ?

Post reply on HN