Live data from Hacker News

Google scrambles to manually remove weird AI answers in search

theverge.com

21–30 of 387 posts

Re: Google scrambles to manually remove weird AI answers in search

#23
post #17

The fall of Google’s reputation on ML is nothing short of spectacular. They went from having a near untouchable reputation as being far ahead of any other large tech company on ML to total shambles in a year. Everything they’ve released has been a complete popcorn worthy dumpster fire from faked demos, to racist models that try and pretend white people don’t exist, to this latest nonsense telling me put glue on my pi…

It could be because they actually released something. If you look back, the Google Research blog posts always have grandiose claims, but you can often never use them.

Re: Google scrambles to manually remove weird AI answers in search

#24
post #17

The fall of Google’s reputation on ML is nothing short of spectacular. They went from having a near untouchable reputation as being far ahead of any other large tech company on ML to total shambles in a year. Everything they’ve released has been a complete popcorn worthy dumpster fire from faked demos, to racist models that try and pretend white people don’t exist, to this latest nonsense telling me put glue on my pi…

It's not really that bad. I use gemini often and it's great. I prefer their UI

Re: Google scrambles to manually remove weird AI answers in search

#26
post #21

Earlier quoted context omitted.

But AI will solve everything!

...for our shareholders

I hope AI will bring back the "Sort by date" button on Google Reviews, and add somewhere a Google Maps link.

Who knows, maybe AI can bring back exact keyword matches, or correct basic math calculations on Google Search too.

Re: Google scrambles to manually remove weird AI answers in search

#27
"Achieving the initial 80 percent is relatively straightforward since it involves approximating a large amount of human data, Marcus said, but the final 20 percent is extremely challenging. In fact, Marcus thinks that last 20 percent might be the hardest thing of all."

100% completely accurate is super-AI-complete. No human can meet that goal either.

No, not even you, dear person reading this. You are wrong about some basic things too. It'll vary from person to person what those are, but it is guaranteed there's something.

So 100% accurate can't be the goal. Obviously the goal is to get the responses to be less obviously stupid. Which, while there are cynical money-oriented business reasons for, it is obviously also a legitimate hole in the I in AI to propose putting glue on pizza to hold the cheese on.

But given my prior observations that LLMs are the current reigning world-class champions at producing good sounding text that seems to slip right past all our system 1 thinking [1], it may not be a great thing to remove the obviously stupid answers. They perform a salutatory task of educating the public about the limitations and giving them memorable hooks to remember not to trust these things. Removing them and only them could be a net negative in a way.

[1]: https://thedecisionlab.com/reference-guide/philosophy/system...

Re: Google scrambles to manually remove weird AI answers in search

#28
post #23
post #17

The fall of Google’s reputation on ML is nothing short of spectacular. They went from having a near untouchable reputation as being far ahead of any other large tech company on ML to total shambles in a year. Everything they’ve released has been a complete popcorn worthy dumpster fire from faked demos, to racist models that try and pretend white people don’t exist, to this latest nonsense telling me put glue on my pi…

It could be because they actually released something. If you look back, the Google Research blog posts always have grandiose claims, but you can often never use them.

research != product

Re: Google scrambles to manually remove weird AI answers in search

#30
post #20

Earlier quoted context omitted.

> So Google hasn't used an LLM to generate and test weird queries ? What about simple manual testing? Seems to have skipped QA completely, automated or not.

The adversarial surface to the LLM remains enormous, manual cannot handle it.

Asking how to prevent cheese from sliding off pizza is not an adversarial prompt.
Post reply on HN