Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google scrambles to manually remove weird AI answers in search

theverge.com

Post reply on HN
Print view View original

311–320 of 387 posts

Re: Google scrambles to manually remove weird AI answers in search

#311

Post by skybrian »

duskwuff wrote: post #277
skybrian wrote: post #122

Earlier quoted context omitted.

Or to put it another way, I think Google should have a way of saying "yes, we know this result is wrong, but we're leaving it in because it's funny." There is a demand for funny results. Someone asking “how many rocks should I eat” is looking for entertainment, so you might as well give it to them.

> Or to put it another way, I think Google should have a way of saying "yes, we know this result is wrong, but we're leaving it in because it's funny." These specific results aren't the problem, though. They're illustrations of a larger problem -- if a single satirical article or Reddit comment can fool the model into saying "eating rocks is good for you" or "put glue in your pizza sauce", there are certain to be man…

Yes of course, but maybe keeping the funny ones around might serve as a warning, if suitably marked. A public service message?

They have disclaimers, but a funny message is more likely to be read.

Re: Google scrambles to manually remove weird AI answers in search

#312

Post by quibono »

aleph_minus_one wrote: post #310
duskwuff wrote: post #268

Earlier quoted context omitted.

Google Answers was launched in 2002 and retired in 2006. https://en.wikipedia.org/wiki/Google_Answers

Quora still exists. :-)

Quora is gamed to the point where it's pretty much useless.

Re: Google scrambles to manually remove weird AI answers in search

#314

Post by onemiketwelve »

zogrodea wrote: post #186

This approach to remove bad search suggestions manually reminded of a different approach Google once took, where they weren’t satisfied with manually tweaking search results but rather wanted to tweak the algorithm that produces these results when there were bad results. 'Around 2002, a team was testing a subset of search limited to products, called Froogle. But one problem was so glaring that the team wasn't comfort…

reminds me of this time we kept getting bugs in our app from a super old android phone from 2011. we could never reproduce it with any other hardware. There were only 4 users with this phone. We spent weeks trying to fix it but couldn't. I suggested we buy the 4 users a refurb phone from another brand. Would've cost like $300 total. Nope, not allowed. Something about not giving up as engineers.

We spent 3 weeks trying to fix it, which equaled $4500 in just my salary. we never ended up figuring it out.

Re: Google scrambles to manually remove weird AI answers in search

#316

Post by duskwuff »

gerdesj wrote: post #284
duskwuff wrote: post #268

Earlier quoted context omitted.

Google Answers was launched in 2002 and retired in 2006. https://en.wikipedia.org/wiki/Google_Answers

"users would pay someone else to do the search." My notion isn't a rehash of Google Answers. Google pays the "someone else", not you.

That sounds like a way for Google to spend money, not make it.

Re: Google scrambles to manually remove weird AI answers in search

#317

Post by avery17 »

leptons wrote: post #295
nomel wrote: post #244

Earlier quoted context omitted.

Google is not responsible, and should never be responsible, for protecting mentally ill people from themselves. It would be at a severe detriment to the rest of us if they took on that responsibility. Society should set the bar to “a reasonable person”, otherwise you’re doomed, with no possible alternative to a nanny state.

It's not only mentally ill people that are at risk, but anyone that doesn't know it's not a good idea to put "non-toxic" glue in pizza cheese. That includes a lot of not-mentally-ill but just plain dumb people. Google didn't need to tell people that glue+pizza is a reasonable thing to do, or even just a thing. It sure did frame it like it was a legitimate response. And Google didn't even have to reply with this or an…

Thats what parents and mentors are for. We as a society should not have to break our backs bending over backwards to stop people from doing stupid things. People can make their own descisions and be responsible for them. If they lack proper guidance, well that just sucks.

Re: Google scrambles to manually remove weird AI answers in search

#318

Post by Salgat »

jerf wrote: post #27

"Achieving the initial 80 percent is relatively straightforward since it involves approximating a large amount of human data, Marcus said, but the final 20 percent is extremely challenging. In fact, Marcus thinks that last 20 percent might be the hardest thing of all." 100% completely accurate is super-AI-complete. No human can meet that goal either. No, not even you, dear person reading this. You are wrong about som…

I'm willing to bet that with a team of fact checking experts, you'd get a result that is indistinguishable from 100%.

Re: Google scrambles to manually remove weird AI answers in search

#319

Post by antifa »

Szpadel wrote: post #94
jerf wrote: post #27

"Achieving the initial 80 percent is relatively straightforward since it involves approximating a large amount of human data, Marcus said, but the final 20 percent is extremely challenging. In fact, Marcus thinks that last 20 percent might be the hardest thing of all." 100% completely accurate is super-AI-complete. No human can meet that goal either. No, not even you, dear person reading this. You are wrong about som…

I think the biggest difference with human (and the most important one) is that human can tell you "I have no idea, this isn't my field" or "I'm just guessing here" but LLMs will confidently say to super stupid statement. AI doesn't know what it knows. if you only score where human provide answer, then human score would be probably in high 90s

> human can tell you "I have no idea, this isn't my field" or "I'm just guessing here"

I wish more of them would lol

Re: Google scrambles to manually remove weird AI answers in search

#320

Post by latentsea »

chucke1992 wrote: post #274
PreInternet01 wrote: post #63

It's debatable whether Google has truly lost the plot because of the "AI wars", but the moment the statement "Bing returns more sensible results than you" becomes verifiably true, it's... cause for concern? The approach that Google appears to have taken, which is to assume that the top-ranked part of its current search index is a sensible knowledge base, may have been true some years ago, but definitely isn't now: fo…

the future is in-context search - basically not even going to google search to find something, but straight up doing that from your current window from any location. Basically a chat bot following you everywhere.

One that you can turn down, but not off.
Post reply on HN