Earlier quoted context omitted.
"Plausible idiot" is a good way to describe it. It's so easy to trick. Here's an example: Q My friend has two tokens and I have six, but I owe one to my friend. There is a toy that costs 7 tokens. Can my friend and I afford to buy it? A No, your friend and you cannot afford to buy the toy that costs 7 tokens. Even though your friend has two tokens and you have six tokens, you owe one token to your friend, so you only…
I think it's not getting that the friend who has two tokens is the same as the one you owe a token to. When you change the question to make it clearer, it responds correctly. "My friend has two tokens and I have six, but I owe one to the same friend. There is a toy that costs 7 tokens. Can my friend and I afford to buy it?"
Using ChatGPT as a Co-Founder
181–190 of 307 posts
Re: Using ChatGPT as a Co-Founder
#182Many people are surprised at the advancement of AI, as they thought that generative fields (art, poetry) would be hardest for AI to excel at, whereas “simple” tasks like driving would be easier. What we are actually seeing is that AI is useful to the degree that being wrong is okay. AI’s mess up, and that’s okay with poetry because a human can quickly read the poems and pick out the good ones. It’s not okay when driv…
I completely agree with this comment. It is surprising to see how well AI is able to perform in fields like art and poetry, which require creativity and nuance, especially when compared to tasks like driving which may seem more straightforward. However, this shows that AI is most effective when it is able to make mistakes and learn from them. In the case of poetry, a human can easily sift through the generated poems…
Re: Using ChatGPT as a Co-Founder
#183I could have said this on any ChatGPT post the last few days, but I'm simply not seeing the accuracy of it in such a way that anything is threatened. ChatGPT is a plausible idiot. It gets just enough right, saying just enough words, to sound plausible and authoritative to anyone who doesn't know the subject matter well. But it also gets enough wrong that you cannot rely on its accuracy, and if it is talking about a s…
It's almost more astonishing to me to see reactions like yours. I showed it to a friend and she too was unimpressed because it gave answers in her field (finance) that were "good, but sortof basic". So we have here a chat bot that pretty much passes for a human and some people react with "meh, it's not a genius". It makes me think of Tim Urbans chart: https://imgs.search.brave.com/YR7qt28AjhAeXSr_qvSmJubqIKJW5S...
Re: Using ChatGPT as a Co-Founder
#184Earlier quoted context omitted.
When marketers of these tools make them sound like next-level in universal intelligence surpassing even humans, and they under-deliver consistently, don't blame the audience or the public for the tool's shortcomings, but the misleading marketing campaigns instead.
Who on the entire internet has "marketed" these tools as what you're saying? I've seen some random people making bombastic claims about these models, infamously including a now fired Google engineer, but the people actually marketing them have been pretty sanguine about their features and limitations as far as I can tell. I'm reminded of that quote about Twitter: half of the outrage on the site is people imagining so…
People/bots hyping these tools is what I meant.
I wish people here would be more attuned to the context of comments before jumping to conclusions.
Re: Using ChatGPT as a Co-Founder
#185I could have said this on any ChatGPT post the last few days, but I'm simply not seeing the accuracy of it in such a way that anything is threatened. ChatGPT is a plausible idiot. It gets just enough right, saying just enough words, to sound plausible and authoritative to anyone who doesn't know the subject matter well. But it also gets enough wrong that you cannot rely on its accuracy, and if it is talking about a s…
BUT (s)he also works tireless, googles 100 pages a second and has infallible memory.
Re: Using ChatGPT as a Co-Founder
#186Earlier quoted context omitted.
"Plausible idiot" is a good way to describe it. It's so easy to trick. Here's an example: Q My friend has two tokens and I have six, but I owe one to my friend. There is a toy that costs 7 tokens. Can my friend and I afford to buy it? A No, your friend and you cannot afford to buy the toy that costs 7 tokens. Even though your friend has two tokens and you have six tokens, you owe one token to your friend, so you only…
I think it's not getting that the friend who has two tokens is the same as the one you owe a token to. When you change the question to make it clearer, it responds correctly. "My friend has two tokens and I have six, but I owe one to the same friend. There is a toy that costs 7 tokens. Can my friend and I afford to buy it?"
Q My friend has 2 tokens and I have 6, but I owe one to the same friend. There is a toy that costs 7 tokens. Can my friend and I afford to buy it?
A No, your friend and you cannot afford to buy the toy that costs 7 tokens. Even though your friend has two tokens and you have six tokens, you owe one token to your friend, so you only have five tokens available to spend. When you combine your friend's two tokens with your five tokens, you only have a total of 7 tokens, which is not enough to buy the toy that costs 7 tokens. In this case, your friend and you do not have enough money to buy the toy, even though you have a total of seven tokens when you combine your individual amounts. It is important to remember that when combining the amount of money two or more people have, you should add their individual amounts together, but also take into account any debts or obligations that need to be paid. In this case, your friend and you do not have enough money to buy the toy because you owe one token to your friend.
The key sentence is still beyond absurd: "When you combine your friend's two tokens with your five tokens, you only have a total of 7 tokens, which is not enough to buy the toy that costs 7 tokens."
(It may be possible that it simply wants to be consistent, and since it got it wrong once, it will stay with the same answer in the same session just because...?)
Re: Using ChatGPT as a Co-Founder
#187Many people are surprised at the advancement of AI, as they thought that generative fields (art, poetry) would be hardest for AI to excel at, whereas “simple” tasks like driving would be easier. What we are actually seeing is that AI is useful to the degree that being wrong is okay. AI’s mess up, and that’s okay with poetry because a human can quickly read the poems and pick out the good ones. It’s not okay when driv…
It kind of feels that ChatGPT is "just" missing some kind of adversarial self clone that can talk back to itself and spot errors. Most times when I spot an error and mention it it seems that it already had some notion of this problem in the model.
So I guess we need to get to the point where you give an AI a prompt without a known answer, and instead of confidently spewing bullshit, it can propose a research study, get it funded, find subjects, and complete the study.
Of course, there are easy forms of "science." I just asked it "Is it cloudy in Dallas?" It answered:
It can be cloudy in Dallas. The city experiences both sunny and cloudy days throughout the year.
That is true, but not an answer. It is cloudy and I can conduct the very simple experiment of looking at the sky to get that answer.
Re: Using ChatGPT as a Co-Founder
#188Earlier quoted context omitted.
I don't know. I asked it to write a simple Bash script to monitor a folder for certain files and then execute logic on them. It gave me a flawless Bash script purely from my description. If that isn't impressive I don't know what it.
Counter argument: if that script already exists as the first result for your question on stackoverflow, then it’s less impressive to think of it as an advanced search engine with improved natural language processing.
Often subtly wrong or different from what you meant but you can clarify or ask it to fix something and it usually does.
Re: Using ChatGPT as a Co-Founder
#189Many people are surprised at the advancement of AI, as they thought that generative fields (art, poetry) would be hardest for AI to excel at, whereas “simple” tasks like driving would be easier. What we are actually seeing is that AI is useful to the degree that being wrong is okay. AI’s mess up, and that’s okay with poetry because a human can quickly read the poems and pick out the good ones. It’s not okay when driv…
Re: Using ChatGPT as a Co-Founder
#190Earlier quoted context omitted.
It's almost more astonishing to me to see reactions like yours. I showed it to a friend and she too was unimpressed because it gave answers in her field (finance) that were "good, but sortof basic". So we have here a chat bot that pretty much passes for a human and some people react with "meh, it's not a genius". It makes me think of Tim Urbans chart: https://imgs.search.brave.com/YR7qt28AjhAeXSr_qvSmJubqIKJW5S...
Totally, maybe we’re in the uncanny valley of AI intelligence and people are now over-reacting to small inaccuracies.