Live data from Hacker News

ChatGPT: The Slickest Con Artist of All Time

tedgioia.substack.com

211–220 of 444 posts

Re: ChatGPT: The Slickest Con Artist of All Time

#211
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

> It is basically like having an incredibly smart engineer/scientists/philosopher/etc It is a copy/paste machine that strings together words to make sentences that look like sentences it’s read. So it’s like an incredibly smart engineer/scientist/philosopher that does not and fundamentally cannot understand any of those concepts (or any concepts at all.) A parrot that can recite Macbeth’s monologue is not a s Shakesp…

I asked it to explain some very technical medical testing procedures to me "like I was five years old". It completely nailed it by truly reducing it to its essence and using appropriate metaphors that a child would understand (coloring books). Because of how niche the topic is, I'm fairly sure no such text exists in the training corpus.

I'm not sure whether this constitutes "understanding", since that term usually applies to people's cognitive states; however, if a student provided this answer on an exam, they would certainly convince the examiner and pass the test!

Re: ChatGPT: The Slickest Con Artist of All Time

#212

Earlier quoted context omitted.

To OP’s point what’s with the gate keeping on “right” or “wrong” ways to use it? It’s a tool. It has flaws. It can be useful and if it is, have at it.

If there was a hammer that, held one way, drove nails perfectly in one blow, and held another, made it look like the nail was driven but actually broke it right at the junction so that the work pieces weren't fastened... I'd say that the second way was the wrong way to use that hammer.

Not only wrong, but dangerous, because nails are often used to fasten structural elements of houses, and incorrect but hard-to-detect flaws like this could result in collapse.

Similarly, if ChatGPT gives you an answer high in truthiness but low in accuracy, it could negatively impact you, whether loss in credibility if you repeat nonsense in front of someone knowledgable, or even worse if you use the incorrect knowledge to try to solve a real world problem.

Re: ChatGPT: The Slickest Con Artist of All Time

#213
ChatGPT was hailed and advertised as conversational, by its creators.

Other people quickly realized it could have a conversation about anything and try to use it as an oracle of knowledge. ChatGPT is not hailed as an oracle of knowledge by its creators.

Hence, there is no con artistry occurring except people that play themselves.

Re: ChatGPT: The Slickest Con Artist of All Time

#214
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

I agree, its incredibly useful if you know how to use it. I used it to make sentences more succinct for emails to managers (no sensitive data of course), I used it to turn my dreams into short stories, gather ideas for research, etc.

People bashing on chatgpt just dont know how to use it. is there going to be an example in the world where it just plagiarizes bob dillan? sure ... so what? is there going to be instances where its not useful? duh.

but if you dont like it, that's fine. not every tool is for everyone. I find it very useful for certain things, and I imagine its only going to improve from here.

Re: ChatGPT: The Slickest Con Artist of All Time

#215
post #102

Earlier quoted context omitted.

I think that's unnecessarily pessimistic view. I have recently started using ChatGPT for mid-hard questions (when I can't get an answer immediately using Google), mostly "how do I" questions. It lies of dreams up fake answers about half of the time, but this still means that 50% of time I get my solution without digging through obscure manuals. > It is basically like having an incredibly smart engineer/scientists/phi…

So it's a coinflip whether it's giving you correct information or something completely made up? And now you're not digging through the obscure manuals to actually verify? Seems objectively harmful.

Actually, that is extremely beneficial.

For example, I now use GPT3 for every single code debugging problem that I have.

I input the bug/problamatic code into the service, ask it for an answer, and then I take the code and see if it fixes my problem I was having.

It doesn't work half the time, but thats fine. Then I just figure out the bug the normal way.

But the other half the time, it immediately solves my problem, and then I run my code and it works/ does what I want.

Re: ChatGPT: The Slickest Con Artist of All Time

#216
post #210
post #131

Earlier quoted context omitted.

Good point about Wikipedia. In just a few years the image people had of Wikipedia changed from an untrustworthy joke (The Office had a joke about Michael Scott trusting Wikipedia) to one of the first places people went to get information. Before that, there was a lot of concern about blogs when they were the hot new thing. Here’s a New York Times article[1] from that period discussing the blogging controversy: > Ther…

> Good point about Wikipedia. In just a few years the image people had of Wikipedia changed from an untrustworthy joke (The Office had a joke about Michael Scott trusting Wikipedia) to one of the first places people went to get information. > As an aside, it's interesting to see comments here bring up the potential unreliability of ChatGPT - and then say that people should go read Wikipedia instead. On the other hand…

> On the other hand, Wikipedia's image changed largely due to the transparency behind its editorial processes- both the edit history and the discussions regarding editorial decisions are available in public.

That was still true early on when people were making fun of the idea. Like with many things, the public perception changed when it got popular and the people who had been laughing at it realized they also had a use for it.

I also can't agree that the production of Wikipedia articles isn't opaque. In fact, I would say that the perception of reliability of Wikipedia (as noted in many of these comments) makes it more likely to lead people astray .

Do Wikipedia articles often list sources? Sure. Do most people not bother checking the sources, and simply rely on a third-party to accurately summarize them? Also true. Do the few who actually check the sources often find it impossible, because the source is simply an academic book that most people don't have available? True as well. Even if it was available to them, the source is often (though not always) give as the entire book, so tracking down the source for a particular claim means you're searching for a needle in a haystack (and that's for just one claim).

I say this as someone who's actually interested in the source for the claims in Wikipedia articles, and have spent a lot of time trying to track them down. Often to no avail (and when I do manage to track them down, it's not uncommon to find the summary on Wikipedia misleading).

For instance, it takes me all of 30 seconds to write:

> Lincoln was actually in favor of subdividing Texas into four different states, and had the support of Congress to do so. It probably would have happened if he had lived. Source: Harris, William C. (2011). Lincoln and the Border States: Preserving the Union. Lawrence, Kansas: University Press of Kansas.

The source exists, but I have never read the book. Almost no one that reads this comment has easy access to the book, and even if they did I doubt anyone would go through it to fact check me (and by the time anyone did, this conversation would have been long over).

Does ChatGPT sometimes give inaccurate answers? Certainly. But at the moment more of its users seem to be more aware of the potential issues with the platform than the users of Wikipedia, AskHistorians, The New York Times, etc. are.

Re: ChatGPT: The Slickest Con Artist of All Time

#217
post #199
post #78

Earlier quoted context omitted.

> It is basically like having an incredibly smart engineer/scientists/philosopher/etc that can explain things quite well, but for pretty much every field. No. You've fallen for exactly the con the article is describing. ChatGPT knows nothing . It is very good at generating text that seems plausible if you know nothing about the subject matter, but is not reliable as an actual source of information . If you happened t…

I was surprised to find ChatGPT does a better job of translating than Google translate, at least for one difficult task I needed to get done. I have been a Google Translate user for more than a decade. I use it a dozen or more times a day for multiple languages. It is a very useful tool. I recently had to translate a passage that included this phrase: 六六大顺 Google Translate gave me: Liuliu Dashun (basically no transla…

> It turns out that the number 6 is a lucky number in Chinese. It has the meaning of being “auspicious”.

isn't that number 8? (not number 6)

Re: ChatGPT: The Slickest Con Artist of All Time

#218

Earlier quoted context omitted.

How many hours you spent trying ChatGPT out? I spent at least high tens, maybe even hundreds. You're absolutely wrong. Yes, it hallucinates, yes its wrong about obscure topics - but calling having success with it luck is absolutely wrong. It's very consistently good. Especially about things like programming, physics, math - and now I'm using it as my teaching assistant for my pilot training, it's perfect (and I can v…

Perhaps you and the poster are approaching your evaluations from different points of view. I've found that if I set out to break ChatGPT I can very easily do it. If my goal is to look for mistakes or find a failure case it's almost trivial to do so. At the same time if I'm looking for success I normally find it. Essentially if you work cooperatively with the tool then you'll find it useful, if you are antagonistic to…

I asked it to write some simple code do do a task. It confidently told me to use a library and use some functions in it.

Couldn’t get it to work. Couldn’t get any examples out of google of it being sued that way. Eventually looked through the code of the library and found that while some functions worked int he way chatgpt was trying, the functions it had selected didn’t work, didn’t support those arguments, and never had.

Re: ChatGPT: The Slickest Con Artist of All Time

#219
post #4

I can't tell what is worse now: the sycophantic ChatGPT hype guys/gals who write articles "it's coming for all of our jerbs!", or articles like this one that deliberately misuse ChatGPT and then say "it's overhyped". They're both missing the point. Yes, ChatGPT can be tricked, confidently give wrong answers, but it is still ludicrously useful. It is basically like having an incredibly smart engineer/scientists/philos…

Sometimes I think ChatGPT was just some twisted, treacherous, indirect plot, to find a way to finally discredit Jordan Peters.

Re: ChatGPT: The Slickest Con Artist of All Time

#220
post #199
post #78

Earlier quoted context omitted.

> It is basically like having an incredibly smart engineer/scientists/philosopher/etc that can explain things quite well, but for pretty much every field. No. You've fallen for exactly the con the article is describing. ChatGPT knows nothing . It is very good at generating text that seems plausible if you know nothing about the subject matter, but is not reliable as an actual source of information . If you happened t…

I was surprised to find ChatGPT does a better job of translating than Google translate, at least for one difficult task I needed to get done. I have been a Google Translate user for more than a decade. I use it a dozen or more times a day for multiple languages. It is a very useful tool. I recently had to translate a passage that included this phrase: 六六大顺 Google Translate gave me: Liuliu Dashun (basically no transla…

I wonder, does it get the meaning of "10-4" when translating English to other languages?
Post reply on HN