Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

People tricking ChatGPT “like watching an Asimov novel come to life”

twitter.com

Post reply on HN
Print view View original

121–130 of 624 posts

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#121

Post by treis »

ne0luddite wrote: post #14

This thing can't even understand elementary math: https://twitter.com/colin_fraser/status/1598239246271541248 (see also other examples from this user) It's clear that it's merely (effectively) copy-pasting from scraped text with 0 understanding. And people are freaking about it taking coding jobs?

>It's clear that it's merely (effectively) copy-pasting from scraped text with 0 understanding.

>And people are freaking about it taking coding jobs?

Uhhhhhhhh..... certainly not my job! looks around nervously

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#122

Post by blihp »

gptadmirer wrote: post #9

As someone who's very skeptical of AI, for a looooong time. I am skeptical about self driving, skeptical about no code, skeptical about ML. But the stable diffusion and chat GPT are truly the only AI tech that made my mind blown. I really want to know how it works. It is like magic. This is the first time I've seen AI create truly new things. To me it doesn't matter that what it creates is wrong or right, but the fac…

It can only interpolate, not extrapolate. So the 'new' things you're seeing are just rearrangements of the (millions/billions of) things that the DNN was trained on. It has no understanding of what it has 'learned' (or more accurately: lossy memorization a.k.a. compression) and makes all kinds of mistakes (some due to training losses, some due to garbage/conflicting data fed in.) This is probably why the creative applications (i.e. Stable Diffusion etc) seem more impressive than the functional applications (i.e. Galactica) as even 'wrong' output can be creatively interesting.

For example, if a new comic/movie/video game character came out tomorrow that had a very unique physical look, Stable Diffusion would have difficulty even approximating it (i.e. its training data wouldn't have what was needed to reproduce the appearance.) But it can produce a decent Darth Vader because it's probably been fed at least thousands of drawings/photos of this very well known fictional character.

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#123

Post by bpye »

uSoldering wrote: post #24

You build Pandora's Box and are shocked by what's inside it. How long until the majority of user comments are GPT bots? Or how long has it already been happening?

As a human, I can understand the concern about the potential for AI bots to infiltrate online forums and communities. However, I believe that it is not a matter of when this will happen, but rather how we can prevent it from happening. We should be cautious and proactive in addressing the potential risks and challenges of AI bots in online spaces. We can do this by implementing strict moderation and authentication measures, as well as educating users on how to identify and report AI bots.

The prompt I used: how would an ai pretending to be a human respond to the following hacker news comment: You build Pandora's Box and are shocked by what's inside it. How long until the majority of user comments are GPT bots? Or how long has it already been happening?

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#124

Post by [deleted] »

wizeman wrote: post #67

Sorry, this is not strictly on topic, but I just had GPT3 generate this response which I thought was really funny: > Write a satirical example of a Hacker News thread about a new service being released. User 1: Check out this new service that just launched! It does absolutely nothing but charge you a monthly fee and give you access to a forum where you can read posts about how awesome the service is. User 2: Brillian…

[deleted]

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#125

Post by arpowers »

wizeman wrote: post #67

Sorry, this is not strictly on topic, but I just had GPT3 generate this response which I thought was really funny: > Write a satirical example of a Hacker News thread about a new service being released. User 1: Check out this new service that just launched! It does absolutely nothing but charge you a monthly fee and give you access to a forum where you can read posts about how awesome the service is. User 2: Brillian…

Web3 founder: “I don’t see why this is funny.”

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#127

Post by carabiner »

qsort wrote: post #32
gptadmirer wrote: post #23

Earlier quoted context omitted.

But how does probability distribution over sequences of consecutive tokens can create new things? Like, I saw the other day it creates a C code that creates a Lisp code that creates a Pascal code. Is this based on an entirely previous creation?

It doesn't create anything new. It creates things that look new. The code examples are perfect case studies, they don't actually work. They aren't just slightly wrong, they're completely nonsensical. Another example is "is prime?", it can't answer things like that, and it will make up something that may or may not be accurate. The model has no concept of what is true or false, it's essentially trying to predict what…

I wish someone what pass it the entirety of an IQ test. I bet it would score around 100, since no it does seem to get some logic questions wrong.

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#128

Post by staticman2 »

gjsman-1000 wrote: post #20

"Write a parody of American Pie outlining the events of Star Wars: Attack of the Clones." (This is a reference to the Weird Al song about The Phantom Menace ) Once upon a time in a galaxy far, far away, A young Jedi named Anakin started to stray. He fell in love with a senator named Padmé, And his emotions began to get in the way. The Jedi Council didn't approve of their love, But Anakin couldn't get her out of his m…

I'm tone deaf but that can't be sung to the tune of American Pie, can it?

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#129

Post by wizeman »

wizeman wrote: post #67

Sorry, this is not strictly on topic, but I just had GPT3 generate this response which I thought was really funny: > Write a satirical example of a Hacker News thread about a new service being released. User 1: Check out this new service that just launched! It does absolutely nothing but charge you a monthly fee and give you access to a forum where you can read posts about how awesome the service is. User 2: Brillian…

And now with ChatGPT (and this is my last one, I promise!)

> Write a satirical example of a Hacker News thread about a new service being released.

Title: "Introducing the ultimate solution for lazy people: the 'Do-Nothing' app!"

Poster 1: "I can't believe it! This app is a game changer for those of us who just can't be bothered to do anything. No more guilt about procrastination - now we can just sit back and let the app do nothing for us!"

Poster 2: "But isn't that the same thing as not using the app at all? How does it actually do anything?"

Poster 1: "Ah, that's the beauty of it. The app uses advanced algorithms to simulate the appearance of productivity, so you can feel like you're being productive without actually doing anything. It's like a virtual personal assistant that does absolutely nothing."

Poster 3: "But wouldn't it be more efficient to just do nothing on your own instead of paying for this app?"

Poster 1: "Efficiency is overrated. This app is all about convenience and the illusion of accomplishment. Plus, it's only $9.99 per month - a small price to pay for the luxury of not having to lift a finger."

Poster 4: "I can't wait to try it out and see how much time I can save by not doing anything at all. This app is truly a breakthrough in the world of laziness!"

Re: People tricking ChatGPT “like watching an Asimov novel come to life”

#130

Post by alex_sf »

jrockway wrote: post #100
shadowgovt wrote: post #83

Earlier quoted context omitted.

Their thinking there was actually good UX, in a way. A misconfigured world-open resource is a huge security risk, but world-open resources have valid use cases. The only signal Amazon has that somebody might have misconfigured a resource to be world-open is if somebody tries to access it with authentication credentials, so they decided to interpret that configuration as "hey user, did you really intend for this to be…

People really like Postel's law, which is basically "don't reject anything you don't understand". But the robustness comes at the cost of correctness and security. Sometimes it's good to trade in some robustness/reliability against malfunctioning clients for security against mistakes.

Hadn't seen that law before. Absolutely hate it. The harm from poor input invalidation over time is massive.
Post reply on HN