Live data from Hacker News

Generative AI could make search harder to trust

wired.com

211–220 of 255 posts

Re: Generative AI could make search harder to trust

#211
Wasnt there a paper a few months back, Textbooks are all you need. yes found it https://arxiv.org/abs/2306.11644

So search engines in their traditional sense will be obsolete anyway.

1) GPT-4 and other such LLMs will generate textbooks and manuals for every conceivable topic.

2) These textbooks will be 'dehallucinated' and curated by known experts on particular topics, who have reputations to maintain. The experts' names will be advertised by the LLM provider.

3) People will search for stuff by chatting with the LLMs, which will in turn provide citations for the chat output from the curated textbooks.

Re: Generative AI could make search harder to trust

#212

Leaving aside the article to discuss the source for a moment. When did Wired become so antitech? There are good critical viewpoints but most of the articles they are putting out at this point read like bitter diatribes. Which is a shame because they used to be an excellent publication.

Being antitech is a valid stance.

Re: Generative AI could make search harder to trust

#213
post #168

Earlier quoted context omitted.

Honestly, I would love to see a LLM based plugin that would take a website, remove all the tracking garbage and filler, and just give me back a no-frills static html+CSS site that looks like it was made in 1995. "Oh, you want a guide to writing your own loss function for Tensorflow? Here's an FAQ that could have existed on comp.lang.python3.tensorflow"

So you want a... reader mode plugin? How would it use an LLM beneficially?

LLMs can write summaries of articles.

Re: Generative AI could make search harder to trust

#215

I actually experienced this the other day. Bought the new Baldur's Gate and was wondering what items to keep or sell (don't judge me, I'm a pack rat in games!) I had found some silver ingots. The top search result for "bg3 silver ingot" is a content farm article that very confidently claims you can use them at a workbench in Act 3 to upgrade your weapons. Except this is a complete fabrication: silver ingots exist onl…

It's funny that one argument openai used to keep their models closed and centralized is so they could prevent things like this. And yet they're doing basically nothing to stop it (and letting the web deteriorate) now that profit has come into play.

Re: Generative AI could make search harder to trust

#216

I actually experienced this the other day. Bought the new Baldur's Gate and was wondering what items to keep or sell (don't judge me, I'm a pack rat in games!) I had found some silver ingots. The top search result for "bg3 silver ingot" is a content farm article that very confidently claims you can use them at a workbench in Act 3 to upgrade your weapons. Except this is a complete fabrication: silver ingots exist onl…

To be fair it was already the case before the boom of LLM, to the point I was obliged to add "reddit" or worse, "youtube", to my queries. Of course LLM make it easier and faster, so I guess the wrb search engines will have to be smarter if they want to keep being used

Re: Generative AI could make search harder to trust

#217
post #186

You should never have had been trusting what you find on the web, let alone other media. I hope widespread usage of generative AIs including deepfakes will finally force the masses to start thinking more critically.

This is an absurd proposition. How is one supposed to think critically when there's nowhere to go for reliable information? We'll be left just taking shots in the dark, what little amount of informed reasoning we had before will be replaced by pure conjecture. There won't be any increase in critical thinking.

It has always been this way, we just didnt know. Now we can be sure.

However, there always is a sufficiently reliable/checkable fact: "a specific media wrote...". Whatever they actually wrote is not a fact but they wrote it - this is. This said you can then ask youself why they most likely did, keeping in mind other observations of yours.

Re: Generative AI could make search harder to trust

#219
post #215

I actually experienced this the other day. Bought the new Baldur's Gate and was wondering what items to keep or sell (don't judge me, I'm a pack rat in games!) I had found some silver ingots. The top search result for "bg3 silver ingot" is a content farm article that very confidently claims you can use them at a workbench in Act 3 to upgrade your weapons. Except this is a complete fabrication: silver ingots exist onl…

It's funny that one argument openai used to keep their models closed and centralized is so they could prevent things like this. And yet they're doing basically nothing to stop it (and letting the web deteriorate) now that profit has come into play.

I don't understand how OpenAI thinks they could stop that from happening.

Re: Generative AI could make search harder to trust

#220

More amusing and frightening is when people search about themselves and turn up AI generated crap. Googling yourself was always a lucky grab bag, with the possibility of long-forgotten embarrassments being dragged up. But at least you'd have to face facts. Now I hear of people discovering they're in prison, married to random people they've never met, or are actually already dead. What is this going to do to recon on…

> What is this going to do to recon on individuals (for example by employers, border agents or potential romantic partners) when there's a good chance the reputation raffle will report you as a serial rapist, kiddy-fiddler or Tory politician?

I feel terrible for the first dozen people this happens to. That said, I look forward to this being the average case for most people. Bury the real malfeasance in AI-generated noise. Let employers and background checkers get dunked on.

Post reply on HN