If you wanna know why Google (or any search engine) sucks, just look at how it measures its own search results. Most search companies do this “at scale” according to very specific guidelines, like what the author did here but on steroids. For example, take a look at Google’s 168-page instruction manual for search quality raters: https://static.googleusercontent.com/media/guidelines.raterh... It talks about figuring o…
My hope is as LLM’s improve, they can be more discriminating about the results returned.