Live data from Hacker News

Comparing Google and ChatGPT

twitter.com

51–60 of 280 posts

Re: Comparing Google and ChatGPT

#52
post #42

It's great, until people realize GPT-3 will generate answers that are demonstrably wrong. (And to make matters worse, can't show/link the source of the incorrect information!)

I just tried Googling "when did the moon explode?" to see if it still gave authoritative answers to bogus questions: > About an hour after sunset on June 18, 1178, the Moon exploded. "when did lincoln shoot booth" > April 14, 1865 Mostly they seem to catch and stop this now, but there was a fun brief period where it was popping up the fact-box for whatever seemed closest to the search terms, so "when did neil armstro…

At least there it's still linking to the original source where the information is contextualized or correct. GPT-3 will just spit out an answer with no links so you either trust it got it right or you go to google to confirm it basically eliminating the reason to go to GPT in the first place.

Re: Comparing Google and ChatGPT

#53

It's great, until people realize GPT-3 will generate answers that are demonstrably wrong. (And to make matters worse, can't show/link the source of the incorrect information!)

Fair point, but Google is also exactly as confidently wrong as GTP. They are both based on Web scrapes of content from humans after all, who are frequently confidently wrong.

No it isn't. When Google gives you incorrect info, it links the source. GPT-3 will gleefully mash together info from several incorrect sources and share none of them.

Re: Comparing Google and ChatGPT

#55
post #26

It's great, until people realize GPT-3 will generate answers that are demonstrably wrong. (And to make matters worse, can't show/link the source of the incorrect information!)

>until people realize GPT-3 will generate answers that are demonstrably wrong It isn't like google never returns the wrong answer

Almost all the GPT answers shown in the thread are subtly incorrect, if not outright false. The brainfuck program is utter nonsense. Conversely, I can expect Google's answers to be passable most of the time.

Re: Comparing Google and ChatGPT

#56
If there is really some other method that is better, why can't google just use that behind the scenes to provide answers? At the end of the day, google is what people are used to. They just go there without thinking. I do agree that the search engines part of it has become less effective but authoritative answers is an evolving field and google will evolve as it does.

Re: Comparing Google and ChatGPT

#57
post #48

It's great, until people realize GPT-3 will generate answers that are demonstrably wrong. (And to make matters worse, can't show/link the source of the incorrect information!)

Seems like we could bang in the idea of PageRank in GPT-3 to marginally improve that situation?

yeah good luck with that, it's going to be a very tall order to integrate PageRank with neural networks. It's not just something you can do in a year or two.

Re: Comparing Google and ChatGPT

#59
post #50

Earlier quoted context omitted.

Turns out humans do this all the time and they actually have real power.

Yes they do, and I do not deny the power of human's ability to confidently spew nonsense. However, humans do have some known failure cases that help us detect that. For instance, pressing the human on a couple of details will generally show up all but the very best bullshit artists; there is a limit to how fast humans can make crap up. Some of us are decent at the con-game aspects but it isn't too hard to poke throug…

> Personally, I consider any GPT or GPT like technology unsuitable for any application in which truth is important . Full stop. The technology fundamentally, in its foundation, does not have any concept of truth

I think you got it all wrong. Not all GPT-3 tasks are "closed-book".

If you can fit in the context a piece of information, then GPT-3 will take it into consideration. That means you can do a search, get the documents into the prompt, and then ask your questions. It will reference the text and give you grounded answers. Of course you still need to vet the sources of information you use, if you give it false information into the context, it will give wrong answers.

Re: Comparing Google and ChatGPT

#60
post #16

It's great, until people realize GPT-3 will generate answers that are demonstrably wrong. (And to make matters worse, can't show/link the source of the incorrect information!)

Exactly, i talked to ChatGPT and it gave me a lot of wrong information in an authorative tone. I consider it dangerous as-is.

Ah, they 've been Galactica'ed already
Post reply on HN