Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT won’t replace search engines any time soon

algolia.com

Post reply on HN
Print view View original

381–390 of 427 posts

Re: ChatGPT won’t replace search engines any time soon

#381

Post by trentearl »

palata wrote: post #304

There are two things I have been wondering about ChatGPT: 1. What impact will it have on search engines? With ChatGPT, it will be easy to automate the creation of websites, which will be referenced by search engines, right? So maybe someday half of the results will just be generated websites that may or may not say complete nonsense in an authoritative way. 2. Will the successors of ChatGPT learn from websites genera…

Information pollution. Training future models with the result of earlier models will result in a delusional feedback loop.

It will be interesting to see the solutions we come up with for this issue.

Re: ChatGPT won’t replace search engines any time soon

#382

Post by swyx »

uconnectlol wrote: post #322
swyx wrote: post #311

Earlier quoted context omitted.

can you recall anything else about the movie? its not a lot to go on if its not a major plot point

Literally all I remember is one scene where a bunch of cop cars or vans get dispatched for some reason like someone's about to die or a heist is happening, something of that nature. They all crash and roll over and wipe out on normal traffic roads for absolutely no reason, and the movie isn't even a comedy, just a generic action movie. I can't remember one single thing other thing about it, not even the plot. I do re…

yeah probably lost forever

this might be a good case for lifelogging, at least it would give you a limited set of movies to search

Re: ChatGPT won’t replace search engines any time soon

#384

Post by eternalban »

rapsey wrote: post #371
eternalban wrote: post #303

Earlier quoted context omitted.

The curls have returned two distinct IPs. Both are google's. How probable is that for a plausible guess? Run the experiment yourself. There was an article a while back that shows the prompt preamble to get you going. See what you get.

ChatGPT does not actually execute commands. The IP is in some text dataset and it returned that.

“ .. trained on .. “ ^

["Overall, the specific details of the dataset used to train GPT-3 are not publicly disclosed, so it is not possible to say for certain whether interactive sessions by trainers were used in its creation." - the horse's mouth]

Re: ChatGPT won’t replace search engines any time soon

#385

Post by wut42 »

eternalban wrote: post #154
rapsey wrote: post #76

Earlier quoted context omitted.

The bill is already largely footed by MS probably. OpenAI and MS are a partnership and they run on azure cloud.

I asked ChatGPT to emulate various OS's, including Linux and DOS. On a linux emulation, I had it curl whatsmyip.com. This bit was in the response: 35.230.98.61 That's a google property. I wonder if it was trained on google's cloud.

Noticed this as well. Just like you can ask it for showing `uname -a` and others. The results tend to vary given the temperature of the result and just seem to invent realistic bits of data from the one it noticed in training (e.g., Stack Overflow ?).

The training technique doesn't require internet access as well, it's not going to give you the IP it used during training.

Very funny tho.

Re: ChatGPT won’t replace search engines any time soon

#386

Post by wut42 »

eternalban wrote: post #384
rapsey wrote: post #371

Earlier quoted context omitted.

ChatGPT does not actually execute commands. The IP is in some text dataset and it returned that.

“ .. trained on .. “ ^ ["Overall, the specific details of the dataset used to train GPT-3 are not publicly disclosed, so it is not possible to say for certain whether interactive sessions by trainers were used in its creation." - the horse's mouth]

As I just said elsewhere it's not going to "run curl commands" in training time. it's trained on a corpus of public data, it's not running commands at all

Re: ChatGPT won’t replace search engines any time soon

#387

Post by supermatt »

kyleyeats wrote: post #67
supermatt wrote: post #53

Earlier quoted context omitted.

They havent "announced" anything. It would make cost-per-query and latency go through the roof, so its HIGHLY unlikely.

They announced it to The Information, anonymously, in a leak.

allegedly

Re: ChatGPT won’t replace search engines any time soon

#388

Post by CuriousSkeptic »

Denzel wrote: post #312
xp84 wrote: post #275

Earlier quoted context omitted.

The notion that every information service should be free with ads is one of the main poisons that have made the cesspool that is the net today. Imagine how different the incentives would be if Facebook and Google just made money by making their endusers happy enough to keep their memberships active with a small monthly fee. Their customers would be the end users, instead of being the advertisers.

Reality doesn’t lend support toward your arguments. I assume you’re from a first-world country, based upon your comment. - Google’s 2022 revenue was $250B. (We’ll assume that’s all ads.) - 8B people in the world; we’ll assume only 4B people have internet access to the web. How much would Google have to charge to break even? $250B/yr / 4B people = $62.5/yr/person = $5/month/person What does the world income distributi…

First if all, thanks for that argument, haven’t considered the math in this perspective before. Will need to let this simmer a bit.

One immediate flaw though, you starting premise is that the current revenue is needed to break even on such a service. Is there an argument to support this claim as well?

Re: ChatGPT won’t replace search engines any time soon

#389

Post by thegabriele »

uconnectlol wrote: post #322
swyx wrote: post #311

Earlier quoted context omitted.

can you recall anything else about the movie? its not a lot to go on if its not a major plot point

Literally all I remember is one scene where a bunch of cop cars or vans get dispatched for some reason like someone's about to die or a heist is happening, something of that nature. They all crash and roll over and wipe out on normal traffic roads for absolutely no reason, and the movie isn't even a comedy, just a generic action movie. I can't remember one single thing other thing about it, not even the plot. I do re…

A movie where police cars crash without any reason and it's not even a comedy, it's in the range of Steven Segal body of work

Re: ChatGPT won’t replace search engines any time soon

#390

Post by drakmo »

janalsncm wrote: post #228
drakmo wrote: post #194

Google is just a lightning fast but messed up index combined with really good graphs. ChatGPT now is only one tool Soon it will be just one piece in a box filled with a combination of tools that let you just know whatever you want to in a depth of detail you specify it to be laid out: - large conversational language model that generates the piece of information - fact checking model that applies post checks on logic…

I would like to know more about the fast fact checking model. This will require some kind of symbolic NLP approach that doesn’t exist yet.

Here is a good recent overview of where automated fact checking is positioned right now: https://aclanthology.org/2022.tacl-1.11.pdf Fact checking of AI generated content can potentially be optimized for this use case. And for speed: I think many of the computations for several layers of AI processing can be decentralized in the future and re-establish the heart of the Internet. The contributions for such computations need a high level of trust and therefore a public immutable ledger might be a viable approach. So perhaps decentralized AI might be the use case where finally some "blockchain-crypto-cringe" might actually be useful ;-)

We need to be aware that we just entered the steep part of the exponential growth graph. Amazing times ahead.

Post reply on HN