Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

People tricking ChatGPT “like watching an Asimov novel come to life”

twitter.com

Post reply on HN
Print view View original

501–510 of 624 posts

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#501

Post by featherless »

LeanderK wrote: post #140

I think a missing piece is that ChatGPT doesn't know when it's either confused or out of depth. It starts producing gibberish, which is very hard to separate from the quality answers. Especially if it would just straightforwardly say when it doesn't know the answer, that would be really helpful. It's easy for ChatGPT to fail the classic turing test because if this. I know that's not the goal here, but for it to pass…

"I respectfully disagree with your assessment of ChatGPT. While it's true that it can produce gibberish when confused or out of depth, I don't think that necessarily means it's easy for it to fail the Turing test. In fact, I would argue that the ability to recognize its own limitations and admit when it doesn't know the answer is actually a step towards passing the Turing test. It shows that the chatbot is capable of self-awareness and understanding its own limitations, which are important traits for a machine to possess in order to pass the Turing test." — ChatGPT's response

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#502

Post by jtolmar »

zug_zug wrote: post #73

I know it's incredibly fun to play this "game" with the AI where we boundary-test it. And I'm all for it. And getting it to impersonate a nazi or whatever is interesting. But I'd argue this isn't a bad feature. I'd much prefer a language-model that can impersonate a nazi when specifically asked to , because that seems useful and not especially harmful. Like if I was using the language model to write an evil character…

It's not really a problem that some specific AI can be prompted to produce hate speech or give you recipes for drugs or whatever. But we should also be able to make AIs that can't do these things, if we want that sort of AI, and it's a problem that we don't actually know how.

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#503

Post by featherless »

mgraczyk wrote: post #213

I think a lot of this is just bad experiment design. I was able to replicate all the "bad" responses without any clever prompting. I just clicked "Try again" a few times or added irrelevant detail to the prompt. I suspect that a lot of these demonstrations are just noise.

"I think you may be underestimating the capabilities of ChatGPT. While it's true that the chatbot can produce "bad" responses when given irrelevant or nonsensical prompts, I don't think that means the experiment design is inherently flawed. In fact, I would argue that the ability for the chatbot to generate a wide range of responses, both good and bad, is a testament to its complexity and sophistication. It's not just noise, it's a demonstration of the chatbot's ability to process and understand language in a dynamic and nuanced way." — ChatGPT's response

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#505

Post by smabie »

emodendroket wrote: post #403
js2 wrote: post #237

Earlier quoted context omitted.

> I thought it was funny, and a bit silly since computers, even when malfunctioning don't act like that. Have you met Siri? Let me relate an interaction I had with it last Sunday, driving home from the Thanksgiving holiday weekend. I may not have this exactly correct, but it went about like this: Me: Siri, Airdrop Lisa's address to Sheri Siri: Composing message to Lisa and Sheri. What would you like to say? Me: Cance…

> There's no way that anyone who works on Siri actually uses Siri. The only thing it does reliably for me is set timers and alarms. I suspect resources have been pulled with the realization that there's no real way to monetize people asking it to set timers, tell them the weather, or tell them what time the Rams game is on, which is about the extent of what most people use these things for.

I mean it's a self fulfilling prophecy: people only use it for that because it's incapable of doing anything else.

If Siri didn't suck big time I would use it all the time.

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#506

Post by pschuegr »

jameshart wrote: post #198
jholman wrote: post #183

Earlier quoted context omitted.

It's a yellow fruit that you unzip and eat the white bits, it's a banana !

Exactly. https://www.youtube.com/watch?v=oB-NnVpvQ78

One of my favorite scenes… thanks for giving me an excuse to watch again

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#507

Post by joe_the_user »

scotty79 wrote: post #496

One thing it can't really do is admitting that it doesn't actually know stuff. It's similar to creative pupil that asked specific question during lesson doesn't actually know the answer and just smoothly makes stuff up as they go. I asked it how to destructure an iterator in rust. I got answer, with code examples and all. Which of course don't work because you can't directly destructure iterator in rust. You pretty m…

One thing it can't really do is admitting that it doesn't actually know stuff

That's because it "doesn't understand knowing". It's ultimately a search engine. When a smart, wise person knows something, they have something of a model of the limitations knowledge - indeed a serious person's model of their knowledge increases along with their knowledge.

And certainly some people don't have anything like a model of knowledge either. But the strength of humans is when they do have this.

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#508

Post by toxik »

beefield wrote: post #504

Looks like we are pretty close for someone being able to flood internet discussions with billions of alt-right/far-left/whatnot fake bot accounts. Bad times for moderators and anyone trying to engage in decent discussion.

On the other hand, a moderator can also use this. Bad times for diverse speech and civil society in general.

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#510

Post by throwaway2037 »

drexlspivey wrote: post #430
helsinkiandrew wrote: post #40

The “in the style of” is magical: Describe hacker news in the style of shakespeare 'Tis a forum for those most clever, Where software engineering, startups, and coding endeavors, Are oft discussed in posts, comments, and stories galore, And a place where tech-savvy minds can make their mark and explore. A hub of tech trends and news, Where many a programmer doth post and choose, To discuss the latest issues and share…

>>> Write a stand up comedy routine in the style of Dave Chapelle that the punchline is about how being an auditor at Enron looks bad on a resume Hey everyone, how's it going? So I just got out of a job interview and it was rough. The interviewer asked me about my previous work experience and I told him I used to work at Enron. He looked at me like I just admitted to being a serial killer. I mean, I know being an aud…

This is brilliant! How long until Dave Chapelle includes some material in his stand-up that was generated by AI? It's like stand-up judo! (Hat tip to Dave Chapelle's reaction to Prince's "Breakfast Can Wait" album cover.)
Post reply on HN