Live data from Hacker News

ChatGPT: The Slickest Con Artist of All Time

tedgioia.substack.com

281–290 of 444 posts

Re: ChatGPT: The Slickest Con Artist of All Time

#281

Earlier quoted context omitted.

> "It is basically like having an incredibly smart engineer/scientists/philosopher/etc that can explain things quite well, but for pretty much every field. Does this "person" make mistakes? " Does this person stubbornly insist on being right, even if they are wrong? Likely, that's just how humans usually behave - and ChatGPT does the same. At least that was my thinking when people complain about ChatGPT being a know-…

> Does this person stubbornly insist on being right, even if they are wrong? Actually ChatGPT will almost always change tune if you tell it that it is wrong. That's because it is a stochastic parrot and that's an "unlikely" event if you actually got the answer right. But we'll see if this gets updated/broken too.

I've seen ChatGPT change tune but I've also seen it squirm plenty. Overall I think it behaves uncannily human in this regard.

Re: ChatGPT: The Slickest Con Artist of All Time

#283
post #279

Earlier quoted context omitted.

>I would greatly appreciate a moratorium on this genre of article until there is compelling accompanying evidence that a meaningful portion of ChatGPT's users are unaware of these shortcomings. I have yet to encounter or even hear of a non-technical person playing around with ChatGPT without stumbling into the type of confidently-stated absurdities and half-truths displayed in this article, and embracing that as a li…

I used ChatGPT to write cover letters and to create job specific resumes(with an additional tool). Then those documents resulted in employment. I had to edit some, and I went over all of them. I have to assume people look at the thing they understand may be inaccurate (because you can't possibly miss THAT fact) and give it at least a quick once over. Lacking that, it's a failure of the person, not the tool.

How are you going to tell if it accurately analyzed a legal document if you don't know how to accurately analyze a legal document? It's a tool that's being sold for jobs it shouldn't be doing, if that's the characterization that helps you understand the issue and not turn this into "blaming the tool for something it shouldn't be doing"

Re: ChatGPT: The Slickest Con Artist of All Time

#284

I had a detailed conversion with chatGPT about how to gracefully handle terminating conditions of a rust program. It summarized cogently to register at_exit()’s for each thread, panic handlers, and register signal handlers. It advised and explain in detail on my query about the thread handling for each of these variants, gave really helpful advice on collecting join handles in a closure on the main thread and waiting…

Yeah, in my experimenting with ChatGPT, it seems quite good at condensing factual information where there's not much chance that people will making things up online. The thing is that this doesn't extend to situations where, say, a common summary of a topic isn't true when one looks at things in more detail. For example, Earnest Hemingway is know for "short, concise sentences" and ChatGPT will give this description w…

ChatGPT Is a flat out liar

It is what I love most about it

Ask it if it is human

Re: ChatGPT: The Slickest Con Artist of All Time

#285

After having played it ChatGPT for a bit, mostly asking computer questions, I've had mixed results. Some are amazing, others are gibberish. But what struck me the other day is a couple of quotes from, of all things, Galaxy Quest which seem particularly apt. "May I remind you that this man is wearing a costume, not a uniform." and "You know, with all that makeup and stuff, I actually thought you were SMART for a secon…

It's quite limited, in frequently making even basic mistakes, but when it works well, it displays real intelligence. It synthesizes new knowledge, as opposed to just retrieving it. When it works well, It's not just a magic trick.

>"it displays real intelligence"

you are anthropomorphizing an algorithm

Re: ChatGPT: The Slickest Con Artist of All Time

#286

Earlier quoted context omitted.

It's quite limited, in frequently making even basic mistakes, but when it works well, it displays real intelligence. It synthesizes new knowledge, as opposed to just retrieving it. When it works well, It's not just a magic trick.

>"it displays real intelligence" you are anthropomorphizing an algorithm

> you are anthropomorphizing an algorithm

They hate it when you do that to them.

Re: ChatGPT: The Slickest Con Artist of All Time

#287

I had a detailed conversion with chatGPT about how to gracefully handle terminating conditions of a rust program. It summarized cogently to register at_exit()’s for each thread, panic handlers, and register signal handlers. It advised and explain in detail on my query about the thread handling for each of these variants, gave really helpful advice on collecting join handles in a closure on the main thread and waiting…

I asked ChatGPT to create some 6502 assembly to multiply two numbers. It generated an iterative approach (add A to itself B times for A*B) but didn't include the actual addition.

I told it that "hey, you forgot to do the addition in that code" and it promptly corrected itself.

Personally, I don't consider that terrible given what I was asking it.

Re: ChatGPT: The Slickest Con Artist of All Time

#288
post #49

My stance is pretty simple. The folks that adapt their own language centers and domain reasoning around using chatGPT (or these types of models) will stand to gain the most out of using them. This article is an eye roll to me, a calculator gives you confidence as well, doesn't mean you used it correctly. It is very hard for me to not outright dismiss articles like this that don't consider the usefulness of the tool.…

You're confounding the problem of feeding a system with incorrect inputs ( calculator ), with a system that, provided the input are correct, will throw garbage totally at random.

This is a very different kind of system with very different kinds of problems caused to its users.

Re: ChatGPT: The Slickest Con Artist of All Time

#289

Earlier quoted context omitted.

I think the difference is that when we communicate those ideas, in scientific/academic literature at least, we reference the source of those original ideas, which permits verification and also plays an important social role.

You can ask it how it came up with its answer and it will do it's best to give you an explanation. It may not cite its sources directly but it will try to explain.

> You can ask it how it came up with its answer and it will do it's best to give you an explanation.

will it? or is it just going to start another chain of words it's trying to complete without any regard for its previous statements? My guess is that it's doing what I described and isn't doing what you described (because it can't).

Re: ChatGPT: The Slickest Con Artist of All Time

#290
post #265

I had a detailed conversion with chatGPT about how to gracefully handle terminating conditions of a rust program. It summarized cogently to register at_exit()’s for each thread, panic handlers, and register signal handlers. It advised and explain in detail on my query about the thread handling for each of these variants, gave really helpful advice on collecting join handles in a closure on the main thread and waiting…

Yeah, yesterday I just told it to write a Dockerfile for me, with exactly what I wanted. instead of changing anything by hand, I told it what to fix, without telling it how to. Took 20-30 follow-up messages, telling it to add things, remove things, fix things, make things compatible with the versions of software it was running etc. It worked. Running the container now, works great.

Incredible useful data to feed back into the system for futher learning. Chatgpt is miles ahead on this part conpared to competitors who yet have to release. Imagine the amount of data chatgpt is receiving now. Google should be very very worried.
Post reply on HN