Live data from Hacker News

ChatGPT: The Slickest Con Artist of All Time

tedgioia.substack.com

91–100 of 444 posts

Re: ChatGPT: The Slickest Con Artist of All Time

#91

I had a detailed conversion with chatGPT about how to gracefully handle terminating conditions of a rust program. It summarized cogently to register at_exit()’s for each thread, panic handlers, and register signal handlers. It advised and explain in detail on my query about the thread handling for each of these variants, gave really helpful advice on collecting join handles in a closure on the main thread and waiting…

After many years of experience, I still sometimes stumble on how to phrase a regex pattern to get exactly what I want if it is a bit unconventional. Before I'd have to look up lists of common regex's (sed commands, etc). But I've lately been feeding in sample input lines, telling it what I want to do, and it has been really good about answering correctly (and explaining each part of the regex).

Sometimes I have to clarify "But this will also output x, on line 3, but I really want it to output y". And it gives a correction based on my clarification.

Re: ChatGPT: The Slickest Con Artist of All Time

#92

I had a detailed conversion with chatGPT about how to gracefully handle terminating conditions of a rust program. It summarized cogently to register at_exit()’s for each thread, panic handlers, and register signal handlers. It advised and explain in detail on my query about the thread handling for each of these variants, gave really helpful advice on collecting join handles in a closure on the main thread and waiting…

I have the same experience with it, it's very useful, especially when you are unsure about what to even look for. I have a few theories I suspect it's just a bias we have, most people aren't doing or creating anything, they aren't solving problems or learning new things constantly like engineers do, so chatgpt feels useless to them. Or perhaps the problems we want to talk or learn about are just easier for an ai to a…

I think this is true for both ChatGPT and AI art. People use them the same way they would Google, get an output that’s mediocre, and write the entire thing off. There was a similar reaction when people were being shown the web decades ago.

But when you start playing with these things, finding out where they’re useful, and how to make use of them, they can do very impressive things.

Re: ChatGPT: The Slickest Con Artist of All Time

#93
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

A well-adjusted person should be able to signal some degree of confidence about what they're saying ("I know that…", "I think that…", "Maaaaaaybe…", etc). That's an anspect that ChatGPT doesn't have.

Re: ChatGPT: The Slickest Con Artist of All Time

#94
post #66
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

> It is basically like having an incredibly smart engineer/scientists/philosopher/etc that can explain things quite well This is the issue. It's more like the dumbest guy in the room confidently convincing the everyone else that they know what they're talking about.

Yup.

As a pattern matching engine it's extraordinarily good. Ask it about the implications of some obscure theory and it will usually correctly interpret your question and return some sentences summarising the current state of knowledge on that theory. Ask it to explain it in simpler terms and it will simplify the sentence structure, swap some words and usually retain meaning.

But then... ask it for some reading material on the same obscure theory and it'll use its knowledge of scientific papers on those theories and academic citation to return a well formatted list of papers with plausible titles and authors with the significant flaw that none of these papers exist. The dumbest guy in the room would struggle to make up plausible sounding scientific papers even if you gave them the reading list, but then the dumbest person in the room wouldn't be dumb enough to use the reading list to make up some nonexistent papers in the first place! (and ironically nor would the dumbest information retrieval algorithm in the room...)

Re: ChatGPT: The Slickest Con Artist of All Time

#95
post #93
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

A well-adjusted person should be able to signal some degree of confidence about what they're saying ("I know that…", "I think that…", "Maaaaaaybe…", etc). That's an anspect that ChatGPT doesn't have.

For the api appending such language is a waste of tokens, therefore a waste of money. People should use it while knowing it hallucinates all the time.

Re: ChatGPT: The Slickest Con Artist of All Time

#96
post #78
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

> It is basically like having an incredibly smart engineer/scientists/philosopher/etc that can explain things quite well, but for pretty much every field. No. You've fallen for exactly the con the article is describing. ChatGPT knows nothing . It is very good at generating text that seems plausible if you know nothing about the subject matter, but is not reliable as an actual source of information . If you happened t…

> If you happened to get information from it that turned out to be ok, you were lucky. Don't expect your luck to last.

For creating bash scripts and english to code it remains remarkably consistent. No need to be a master of multiple languages syntaxes now.

Re: ChatGPT: The Slickest Con Artist of All Time

#97

Earlier quoted context omitted.

I dunno, I recently learned about how the Toyota Synergy Drive system works in detail. Despite being the type of person who'd be interested in that kind of thing I thought it was not generally well understood, I've only come across one website which described it in detail. I asked ChatGPT about it and it game me a fairly surface level answer. I then asked it for more details and it went into detail far beyond what th…

That's exactly the wrong sort of thing to turn to ChatGPT for. In probing it for more detail, you're giving it increasingly helpful hints on how to answer your questions in a way that makes you satisfied, regardless of accuracy. That's what it's optimized to do. And because you're working from a humble and curious understanding of the topic yourself, it can and will make up all sorts of things that make you believe i…

GP stated that they asked ChatGPT about a topic they already were familiar with, from other sources. And that the answer made sense.

Re: ChatGPT: The Slickest Con Artist of All Time

#98

After having played it ChatGPT for a bit, mostly asking computer questions, I've had mixed results. Some are amazing, others are gibberish. But what struck me the other day is a couple of quotes from, of all things, Galaxy Quest which seem particularly apt. "May I remind you that this man is wearing a costume, not a uniform." and "You know, with all that makeup and stuff, I actually thought you were SMART for a secon…

It's quite limited, in frequently making even basic mistakes, but when it works well, it displays real intelligence. It synthesizes new knowledge, as opposed to just retrieving it. When it works well, It's not just a magic trick.

Re: ChatGPT: The Slickest Con Artist of All Time

#99
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

I agree. I regularly use ChatGPT to help reword paragraphs to be more succinct. I rarely ask it for actual information that it has to look up. At its core, it's an LLM which models how language is structured, and that's what it's good at.

Re: ChatGPT: The Slickest Con Artist of All Time

#100
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

"It is basically like having an incredibly smart engineer/scientists/philosopher/etc that can explain things quite well, but for pretty much every field."

I don't know how to tell you this without being a little rude, but if you think ChatGPT is incredibly smart or that it can tell you meaningful things about "any field," well, there is a difference in intelligence somewhere in the equation between you and ChatGPT, but its not the one you think.

Post reply on HN