Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Adding a feature because ChatGPT incorrectly thinks it exists

holovaty.com

Post reply on HN
Print view View original

81–90 of 451 posts

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#81

Post by simonw »

dingnuts wrote: post #76
simonw wrote: post #72

Earlier quoted context omitted.

Plenty of people have English as a second language. Having an LLM help them rewrite their writing to make it better conform to a language they are not fluent in feels entirely appropriate to me. I don't care if they used an LLM provided they put their best effort in to confirm that it's clearly communicating the message they are intending to communicate.

[flagged]

If you think my writing is AI-generated you need to recalibrate your AI writing detection skills, they're way off.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#82

Post by carlosjobim »

Applejinx wrote: post #33

"Should we really be developing features in response to misinformation?" No, because you'll be held responsible for the misinformation being accurate: users will say it is YOUR fault when they learn stuff wrong.

Either the user is a non-paying user and it doesn't matter what they think, or the user is a paying customer and you will be happy to make and sell them the feature they want.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#83

Post by oytis »

ecshafer wrote: post #61
oytis wrote: post #58

That's the most promising solution to AI hallucinations. If LLM output doesn't match the reality, fix the reality

I am currently working on the bug where ChatGPT expects that if a ball has been placed on a box, and the box is pushed forward, nothing happens to the ball. This one is a doozy.

Yeah, physics is a bitch. But we can start with history?

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#84

Post by jpadkins »

Pretty good example of how a super-intelligent AI can control human behavior, even if it doesn't "escape" its data center or controllers.

If the super-intelligent AI understands human incentives and is in control of a very popular service, it can subtly influence people to its agenda by using the power of mass usage. Like how a search engine can influence a population's view of an issue by changing the rankings of news sources that it prefers.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#87

Post by mnw21cam »

nosioptar wrote: post #32
philk10 wrote: post #14

I have fun asking Chatbots how to clear the chat and seeing how many refer to non-existent buttons or menu options

I tried asking chat bots about a car problem with a tailgate. They all told me to look for a manual tailgate release. When I responded asking if that model actually had a manual release, they all responded with no, and then some more info suggesting I look for the manual release. None even got close to a useful answer.

Prior to buying a used car, I asked ChatGPT which side of the steering wheel the indicator control would be. It was (thankfully) wrong and I didn't have to retrain myself.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#88

Post by mnw21cam »

kelseyfrog wrote: post #6

> Should we really be developing features in response to misinformation? Creating the feature means it's no longer misinformation. The bigger issue isn't that ChatGPT produces misinformation - it's that it takes less effort to update reality to match ChatGPT than it takes to update ChatGPT to match reality. Expect to see even more of this as we match toward accepting ChatGPT's reality over other sources.

I'd prefer to think about this more along the lines of developing a feature that someone is already providing advertising for.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#89

Post by bryanlarsen »

kragen wrote: post #73
bryanlarsen wrote: post #65

Earlier quoted context omitted.

I used this to great success just this morning. I told the AI to write me some unit tests. It flailed and failed badly at that task. But how it failed was instructive, and uncovered a bug in the code I wanted to test.

Haha, that's awesome! Are you going to change the interface? What was the bug?

It used nonsensical parameters to the API in way that I didn't realize was possible (though obvious in hindsight). The AI got confused; it didn't think the parameters were nonsensical. It also didn't quite use them in the way that triggered the error. However it was close enough for me to realize that "hey, I never though of that possibility". I needed to fix the function to return a proper error response for the nonsense.

It also taught me to be more careful about checkpointing my work in git before letting an agent go wild on my codebase. It left a mess trying to fix its problems.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#90

Post by normie3000 »

suzzer99 wrote: post #53
kragen wrote: post #30

I've found this to be one of the most useful ways to use (at least) GPT-4 for programming. Instead of telling it how an API works, I make it guess, maybe starting with some example code to which a feature needs to be added. Sometimes it comes up with a better approach than I had thought of. Then I change the API so that its code works. Conversely, I sometimes present it with some existing code and ask it what it does…

> Sometimes it comes up with a better approach than I had thought of. IMO this has always been the killer use case for AI—from Google Maps to Grammarly. I discovered Grammarly at the very last phase of writing my book. I accepted maybe 1/3 of its suggestions, which is pretty damn good considering my book had already been edited by me dozens of times AND professionally copy-edited. But if I'd have accepted all of Gram…

What's wrong with passive?
Post reply on HN