Live data from Hacker News

Comparing Google and ChatGPT

twitter.com

241–250 of 280 posts

Re: Comparing Google and ChatGPT

#241

Earlier quoted context omitted.

I mean, they’re already using LLMs. Namely, BERT.

There is no exact definition but BERT would probably just be a LM, not a "large" LM.

Is the exact definition important? The point is, they developed a thing and integrated into their core product. BERT allows them to handle conversational queries much better than before.

Re: Comparing Google and ChatGPT

#242

Earlier quoted context omitted.

There is no exact definition but BERT would probably just be a LM, not a "large" LM.

Is the exact definition important? The point is, they developed a thing and integrated into their core product. BERT allows them to handle conversational queries much better than before.

I think it does, because LLMs allow things that LMs like BERT don't - like answering complex question on their own etc which is being discussed in the context of this thread.

Re: Comparing Google and ChatGPT

#243
post #82
post #43

Earlier quoted context omitted.

Yep, as AI starts to get trained on AI-generated data the output may well become unstable, you can't build an infinite motion machine (or an infinite gain machine/infinite SNR amplifier) and the system may degrade to essentially white noise. Sort of a cyber-kessler syndrome basically. You really don't want AI-generated content in your AI training material, that's actually probably not generating signal for building f…

Thirteen years ago I met a traveller who paid their way with travel writing, which was basically blog spam. They soon ran out of authentic material so they started writing about places they'd never been using some light googling for inspiration. For a long time now people have been making advertising money by creating bullshit on a large scale. How are you going to prove that any content is organic?

you ultimately can't, and there are certainly degrees of "organicness" even among organic content - a lot of content is essentially infomericals or arguments shilling a particular perspective they have a financial interest in shilling. And of course there's the case like the wikipedia editor who completely made up like 75% of the scottish wikipedia articles that have been the training inputs for language translation models etc, that is very organic content but it also is actually poison to train on!

The good news is the internet is relatively good at routing around the shit, for now. And I guess de-facto that is something you could apply to your content inputs: what's the pagerank for this content? actual pagerank, not the advertising/engagement bullshit that the search model has turned into. If the AI generated stuff is correct enough that it has a high pagerank, maybe it's correct enough to be used as an input.

but the thing is honestly there's already been an uptick in ML or AI-generated content that is already surfacing in searches and other places and it's not always correct... and honestly the relevance of google's search results has been noticeably decaying for 10+ years now. Things I know are out there and are relevant are not being surfaced anymore. Is AI generation contributing to that problem? Maybe. Probably not helping, at least.

Re: Comparing Google and ChatGPT

#244
post #89

Since we are posting ChatGPT Twitter links, I like this one: https://twitter.com/goodside/status/1598129631609380864 > explain the worst-case time complexity of the bubble sort algorithm, with Python code examples, in the style of a fast-talkin' wise guy from a 1940's gangster movie

I don't want to downplay how amazing this chatbot is! -- but this answer is also wrong in the same fashion as other answers: the conclusion does not follow from the explanation's chain of reasoning.

Re: Comparing Google and ChatGPT

#245

Earlier quoted context omitted.

I am already willing to pay 15-20 dollars a month for this. Google will fall behind as others give this out as a paid service. Don’t need ads for something this useful.

From my knowledge, the cost of large language model search engine will be closer to $150~200 subscription per month than $15~20 in the status quo if the implementation is done naively. The cost will go down rapidly, but it's just not there yet.

I would consider paying $150-$200 / month for chat.openai.com access, especially if it continued to improve. It is an astonishing tool for learning and productivity. December 1, 2022 will be a day we all remember.

Re: Comparing Google and ChatGPT

#246
post #42

Earlier quoted context omitted.

I just tried Googling "when did the moon explode?" to see if it still gave authoritative answers to bogus questions: > About an hour after sunset on June 18, 1178, the Moon exploded. "when did lincoln shoot booth" > April 14, 1865 Mostly they seem to catch and stop this now, but there was a fun brief period where it was popping up the fact-box for whatever seemed closest to the search terms, so "when did neil armstro…

You are providing only a small part of the result. If you provide the full result it make prefect sense why Google would suggest it. When you search "when did the moon explode?". The full result is actually > About an hour after sunset on June 18, 1178, the Moon exploded. That's what it looked like to five terrified, awestruck monks watching the skies over the abbey at Canterbury, in southeastern England, anyway. Whi…

I often use search as keywords rather than searching by a short snippet of natural language. I do forms of "lincoln shot booth" as queries as my normal search engine usage.

And maybe I'm specifically looking for something which might be wrong? Like, maybe I'm looking for fictional story told as if Lincoln and Booth were in reversed roles?

Re: Comparing Google and ChatGPT

#247
post #43
post #8

Earlier quoted context omitted.

As everyone starts to adopt AI, are we going to get to a point where the AI is eating itself. I could imagine AI failing similarly to incestuous genetic lines creating mutations.

Yep, as AI starts to get trained on AI-generated data the output may well become unstable, you can't build an infinite motion machine (or an infinite gain machine/infinite SNR amplifier) and the system may degrade to essentially white noise. Sort of a cyber-kessler syndrome basically. You really don't want AI-generated content in your AI training material, that's actually probably not generating signal for building f…

It seems that most famous Stable Diffusion WebUI doesn't actually implement watermark. https://github.com/AUTOMATIC1111/stable-diffusion-webui/issu...

Re: Comparing Google and ChatGPT

#248
post #44

Here's an example on how misleading ChatGPT is: Prompt: Can you explain what happens when i enter "ping 16843009" in a linux shell? Answer: When you enter the command ping 16843009 in a Linux shell, you are instructing the ping utility to send an Internet Control Message Protocol (ICMP) echo request to the IP address 168.43.9.0. [...] The correct answer is that it will ping 1.1.1.1 Also ChatGPT missed that fact that…

Interestingly when i ask ChatGPT what happens when i "ping 257" it both gets the IP address right and the explanation (kind of).

Re: Comparing Google and ChatGPT

#249
post #16

Earlier quoted context omitted.

Exactly, i talked to ChatGPT and it gave me a lot of wrong information in an authorative tone. I consider it dangerous as-is.

What wrong information did it give you?

Just one example, talking about the board game Othello it gave some completely bogus facts about the board.

Re: Comparing Google and ChatGPT

#250
post #153

Earlier quoted context omitted.

It would fit right in here on HN.

No. Unlike ChatGPT HN has error correcting system build in it. Like this comment.

Well you can tell ChatGPT that it made a mistake and it will acknowledge it but only poorly correct itself in my case.
Post reply on HN