Live data from Hacker News

Adding a feature because ChatGPT incorrectly thinks it exists

holovaty.com

221–230 of 451 posts

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#221
post #215

Earlier quoted context omitted.

I can’t find it, but I remember reading an article a year or two ago with an analysis showing some of the most vocal critics of the passive voice used the passive voice more often than most of their contemporary writers.

Probably http://itre.cis.upenn.edu/~myl/languagelog/archives/003366.h... , giving specific statistics on Orwell and on Strunk & White, linked from https://languagelog.ldc.upenn.edu/nll/?p=2922 .

Thank you!

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#222
post #37

I wrote this the other day: > Hallucinations can sometimes serve the same role as TDD. If an LLM hallucinates a method that doesn’t exist, sometimes that’s because it makes sense to have a method like that and you should implement it. — https://www.threads.com/@jimdabell/post/DLek0rbSmEM I guess it’s true for product features as well.

Seems like lots of us have stumbled on this. It’s not the worst way to dev! > Maybe hallucinations of vibe coders are just a suggestion those API calls should have existed in the first place. > Hallucination-driven-development is in. https://x.com/pwnies/status/1922759748014772488?s=46&t=bwJTI...

inb4 "Ai thinks there should be a StartThermonuclearWar() function, I should make that"

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#224

Anyone who has worked at a B2B startup with a rouge sales team won't be surprised at all by quickly pivoting the backlog in response to a hallucinated missing feature.

what does B2B mean?

Business-to-Business (selling your stuff primarily to other businesses)

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#225

There are a few things which could be done in the case of a situation like that: 1. I might consider a thing like that like any other feature request. If not already added to the feature request tracker, it could be done. It might be accepted or rejected, or more discussion may be wanted, and/or other changes made, etc, like any other feature request. 2. I might add a FAQ entry to specify that it does not have such a…

[dead]

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#226
post #63

I had a smaller version of this when coding on a flight (with no WiFi! The horror!) over the Pacific. Llama hallucinated array-element operations and list-comprehension in C#. I liked the shape of the code otherwise, so, since I was using custom classes, I just went ahead and implemented both features. I also went back to just sleeping on those flights and using connected models for most of my code generation needs.

Curious to see the syntax and how it compares to Linq

I ended up closer to python, but not totally delighted with it (still need to pass in a descriminator function/lambda, so it's more structurally verbose). I'd just recommend Linq, but I was writing for an old version of Unity coerced through IL2CPP (where Linq wasn't great). It was also a chunk of semi-hot code (if it was really hot, it wouldn't be sitting in C# in Unity), so some of the allocation behaviors of Linq behind the scenes wouldn't have been optimal.

What surprised me initially was just how confidently wrong Llama was... Now I'm used to confident wrongness from smaller models. It's almost like working with real people...

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#227
post #215

Earlier quoted context omitted.

Probably http://itre.cis.upenn.edu/~myl/languagelog/archives/003366.h... , giving specific statistics on Orwell and on Strunk & White, linked from https://languagelog.ldc.upenn.edu/nll/?p=2922 .

Thank you!

Happy to help!

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#228
post #206
post #169

Earlier quoted context omitted.

> The problem is executives want to completely remove humans from the loop, which almost universally leads to disastrous results Thanks for your words of wisdom, which touch on a very important other point I want to raise: often, we (i.e., developers, researchers) construct a technology that would be helpful and "net benign" if deployed as a tool for humans to use, instead of deploying it in order to replace humans.…

You're trying to put out a forest fire with an eyedropper. Stock your underground bunkers with enough food and water for the rest of your life and work hard to persuade the AI that you're not a threat. If possible, upload your consciousness to a starwisp and accelerate it out of the Solar System as close to lightspeed as you can possibly get it. Those measures might work. (Or they might be impossible, or insufficient…

Alternatively, persuade the AI that you are all-powerful and that it should fear and worship you. Probably a more achievable approach, and there’s precedent for it.

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#229
post #37

Earlier quoted context omitted.

Seems like lots of us have stumbled on this. It’s not the worst way to dev! > Maybe hallucinations of vibe coders are just a suggestion those API calls should have existed in the first place. > Hallucination-driven-development is in. https://x.com/pwnies/status/1922759748014772488?s=46&t=bwJTI...

inb4 "Ai thinks there should be a StartThermonuclearWar() function, I should make that"

In a combat simulator, absolutely

Re: Adding a feature because ChatGPT incorrectly thinks it exists

#230
post #206

Earlier quoted context omitted.

You're trying to put out a forest fire with an eyedropper. Stock your underground bunkers with enough food and water for the rest of your life and work hard to persuade the AI that you're not a threat. If possible, upload your consciousness to a starwisp and accelerate it out of the Solar System as close to lightspeed as you can possibly get it. Those measures might work. (Or they might be impossible, or insufficient…

Alternatively, persuade the AI that you are all-powerful and that it should fear and worship you. Probably a more achievable approach, and there’s precedent for it.

That only works on the AIs that aren't a real threat anyway, and I don't think it helps with the social harm done by greedy business managers with less powerful AIs. In fact, it might worsen it.
Post reply on HN