Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Adding a feature because ChatGPT incorrectly thinks it exists

holovaty.com

Post reply on HN
Print view View original

341–350 of 451 posts

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#341

Post by fzeroracer »

JimDabell wrote: post #340
gortok wrote: post #254

I think folks have taken the wrong lesson from this. It’s not that they added a new feature because there was demand. They added a new feature because technology hallucinated a feature that didn’t exist. The savior of tech, generative AI, was telling folks a feature existed that didn’t exist. That’s what the headline is, and in a sane world the folks that run ChatGPT would be falling over themselves to be sure it did…

You sound like all the naysayers when Wikipedia was new. Did you know anybody can go onto Wikipedia and edit a page to add a lie‽ How can you possibly trust what you read on there‽ Do you think Wikipedia should issue groveling apologies every time it happens? Meanwhile, sensible people have concluded that, even though it isn’t perfect, Wikipedia is still very, very useful – despite the possibility of being misled occ…

OK, so how do I edit ChatGPT so it stops lying then?

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#342

Post by JimDabell »

fzeroracer wrote: post #341
JimDabell wrote: post #340

Earlier quoted context omitted.

You sound like all the naysayers when Wikipedia was new. Did you know anybody can go onto Wikipedia and edit a page to add a lie‽ How can you possibly trust what you read on there‽ Do you think Wikipedia should issue groveling apologies every time it happens? Meanwhile, sensible people have concluded that, even though it isn’t perfect, Wikipedia is still very, very useful – despite the possibility of being misled occ…

OK, so how do I edit ChatGPT so it stops lying then?

You have ignored my point.

A technology can be extremely useful despite not being perfect. Failure cases can be taken into consideration rationally without turning it into a moral panic.

You have no ability to edit Wikipedia to stop it from lying. Somebody can come along and re-add the lie a millisecond later.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#343

Post by fzeroracer »

JimDabell wrote: post #342
fzeroracer wrote: post #341

Earlier quoted context omitted.

OK, so how do I edit ChatGPT so it stops lying then?

You have ignored my point. A technology can be extremely useful despite not being perfect. Failure cases can be taken into consideration rationally without turning it into a moral panic. You have no ability to edit Wikipedia to stop it from lying. Somebody can come along and re-add the lie a millisecond later.

No, I didn't ignore your point. I invalidated it because you're comparing apples to oranges.

And yes, I do have the ability to edit Wikipedia. Anyone can edit Wikipedia. I can go on any page I want, right now, and make changes to the page. If someone readds a lie, then eventually we can hit consensus as other editors enter the discussion. Wikipedia's basis is formed by consensus and controlled by individuals like you and I.

ChatGPT is not. It is controlled by one company; I cannot go edit the weights of ChatGPT to prevent it from lying about my app or anything else I do. I can only petition them to change it and hope that either I have enough clout or have a legal basis to do so.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#344

Post by Bendy »

antonvs wrote: post #228
kragen wrote: post #206

Earlier quoted context omitted.

You're trying to put out a forest fire with an eyedropper. Stock your underground bunkers with enough food and water for the rest of your life and work hard to persuade the AI that you're not a threat. If possible, upload your consciousness to a starwisp and accelerate it out of the Solar System as close to lightspeed as you can possibly get it. Those measures might work. (Or they might be impossible, or insufficient…

Alternatively, persuade the AI that you are all-powerful and that it should fear and worship you. Probably a more achievable approach, and there’s precedent for it.

That didn’t work out for God, we still killed him.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#345

Post by JimDabell »

fzeroracer wrote: post #343
JimDabell wrote: post #342

Earlier quoted context omitted.

You have ignored my point. A technology can be extremely useful despite not being perfect. Failure cases can be taken into consideration rationally without turning it into a moral panic. You have no ability to edit Wikipedia to stop it from lying. Somebody can come along and re-add the lie a millisecond later.

No, I didn't ignore your point. I invalidated it because you're comparing apples to oranges. And yes, I do have the ability to edit Wikipedia. Anyone can edit Wikipedia. I can go on any page I want, right now, and make changes to the page. If someone readds a lie, then eventually we can hit consensus as other editors enter the discussion. Wikipedia's basis is formed by consensus and controlled by individuals like you…

You’ve changed your position. This is what you originally said:

> how do I edit ChatGPT so it stops lying then?

This is what you have changed to:

> And yes, I do have the ability to edit Wikipedia.

You do not have the ability to edit Wikipedia so it stops lying, which is the relevant factor here.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#347

Post by ACCount36 »

deweller wrote: post #15

This is an interesting example of an AI system effecting a change in the physical world. Some people express concerns about AGI creating swarms of robots to conquer the earth and make humans do its bidding. I think market forces are a much more straightforward tool that AI systems will use to shape the world.

And this is why "just don't give AI access to anything dangerous" is delusional.

One of the most dangerous systems an AI can reach and exploit is a human being.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#348

Post by thih9 »

poulpy123 wrote: post #327
thih9 wrote: post #137

What made ChatGPT think that this feature is supported? And a follow up question - is that the direction SEO is going to take?

Nothing. A LLM doesn't think, it just gives probability to words

Note that I am replying to the submission and reusing the wording from its title.

Also, I’m not suggesting an LLM is actually thinking. We’ve been using “thinking” in a computing context for a long time.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#350

Post by PeterStuer »

bobbylox wrote: post #314
PeterStuer wrote: post #47

Earlier quoted context omitted.

Companies pay good money to panels of potential customers to hear their needs and wants. This is free market research!

But they wouldn't have wanted this particular thing if the AI hadn't told them to.

You mean they didn't want infinite free personalized guitar practice lessons they can play along with?

Clearly the users are already using ChatGPT for generating some guitar practice, as it is basically infinite free personalized lessons. For practicing they do want to be able hear it to play along at variable speed, maybe create slight variations etc.

Soundslice is a service that does exactly that. Except that before people used to have sheet music as the source. I know way back when I had guitar aspirations, people exchanged binders of photocopied sheet music.

Now they could have asked ChatGPT to output an svg of the thing as sheet music (it does, I tested). Soundslice could have done this behind the scenes as a half hour quick and dirty fix while developing a better and more cost effective alternative.

Look, if at the turn of the century you were a blacksmith living of changing horseshoes, and you suddenly have people mistakenly showing up for a tire change on their car, are you going to blame the villagers that keep sending them your way, or open a tire change service? We know who came out on top.

Post reply on HN