Live data from Hacker News

Don't believe the hype: why ChatGPT is not the “holy grail” of AI research

salon.com

31–40 of 164 posts

Re: Don't believe the hype: why ChatGPT is not the “holy grail” of AI research

#31
post #14

The first steam engines were also written off as being less powerful than a horse. The first electric motors were written off as being less powerful than steam engines. So it goes. I think both of these views can be true at the same time: ChatGPT (or, LLMs really) are revolutionary and they won't revolutionize the world the way technologists/researchers say. Early adopters will use the technology and do amazing thing…

> I think both of these views can be true at the same time: ChatGPT (or, LLMs really) are revolutionary and they won't revolutionize the world the way technologists/researchers say.

Yes, because people think that LLMs are almost AGI based on the social media reactions and can't imagine they still have unknown/unsolved problems. But if we take a look at the 14 years of self driving car development, it becomes clear how AI can be both amazing and not good enough at the same time.

Re: Don't believe the hype: why ChatGPT is not the “holy grail” of AI research

#33
post #14

The first steam engines were also written off as being less powerful than a horse. The first electric motors were written off as being less powerful than steam engines. So it goes. I think both of these views can be true at the same time: ChatGPT (or, LLMs really) are revolutionary and they won't revolutionize the world the way technologists/researchers say. Early adopters will use the technology and do amazing thing…

I use it almost on a daily basis now, and I pay for the monthly subscription. It’s not magic, but it can save me a lot of time sometimes. I use it in my job as a software engineer, and I mostly use it to create unit tests. The code usually needs a lot of love, but it gets me started.

Re: Don't believe the hype: why ChatGPT is not the “holy grail” of AI research

#35
I'm surprised this article is getting upvoted - it feels like very lazy journalism to me.

> The discomforting reality is that, while Altman and his ilk have been predicting an exponential acceleration of productivity, we have been experiencing a deceleration.

This is a very big claim, and there is absolutely nothing to back it up. The only specific reference to productivity is about an MIT paper that showed increases in worker productivity (but the authors of this just wave that aside as unimportant because they didn't think the work it was doing was important).

> More dangerously, ChatGPT can make authoritative statements that sound believable but turn out to be false if investigated closely.

We get it! We know! But look, this is a bad use case for GPT. If you pretend that it only has a single use case, and you pick the use case that it's worst at, you will think it's bad. This is just so, so lazy. No references to summarizing docs or writing code/SQL queries/Excel formulas or any of the other things that it's genuinely useful at.

> At best, LLMs can be used for rough first drafts of low-value writing tasks with humans filling in the details and checking for rants and lies.

Rants? Come on - GPT hallucinates, but it's not an unhinged lunatic that goes ranting about stuff. Also, again, this is not all they can be used for - it just ignores all of the better use cases.

> What about Altman's vision of humans appreciating art and nature while most of the world's goods and services are produced by AI? We have a lot more respect for the work that people do than for the usefulness of LLMs.

Huh? It's great that you respect the work people do, but that has nothing to do with whether they'll affect society.

> ChatGPT is entertaining but it is, at most, a baby step towards an AI revolution and, at worst, a very expensive detour away from the holy grail of artificial general intelligence.

What? This is the closing to the article and it just throws out this enormous claim, which is backed up by absolutely nothing. It's demonstrably a big step towards an AI revolution - if nothing else, it's brought a ton of money and interest into the space, which is certainly important for a revolution.

But to say it's a detour away from AGI and then give absolutely no explanation of why that is or what direction AI research should be going? This is very poor journalism.

Re: Don't believe the hype: why ChatGPT is not the “holy grail” of AI research

#36

Yesterday, I had a sticky Swift/iOS issue. Checked SO, Apple Discussions, etc. Then, on a whim, I asked ChatGPT for a suggestion. > They are also prone to confident assertions of statements that are blatantly false. It suggested something that referenced a nonexistent property of a standard UIKit class. It wouldn't even compile. It was quite positive that this would fix my issue. After refreshing a couple of times (a…

GPT4 is significantly better at code fyi, not sure if you used default ChatGPT (which is 3.5turbo). Premium ChatGPT gives you access to GPT4, but the API gives you even more access with the ability to edit the "system" prompt which Sam Altman's said is very important and which I can attest to from my testing.

Re: Don't believe the hype: why ChatGPT is not the “holy grail” of AI research

#37

Yesterday, I had a sticky Swift/iOS issue. Checked SO, Apple Discussions, etc. Then, on a whim, I asked ChatGPT for a suggestion. > They are also prone to confident assertions of statements that are blatantly false. It suggested something that referenced a nonexistent property of a standard UIKit class. It wouldn't even compile. It was quite positive that this would fix my issue. After refreshing a couple of times (a…

[dead]

Re: Don't believe the hype: why ChatGPT is not the “holy grail” of AI research

#38
post #19

It's really easy to get an LLM to hallucinate by asking an open ended question - the type typically answered by a Google search or checking Wikiedpia. However, this is not the best application of LLMs. This criticism is getting old. LLMs are great at: - Text synthesis given all of the facts in a prompt (expand these bullet points) - Summarization (condense this text) - Data extraction (fit this data into this schema)…

> - Fiction (virtual characters, scripts, etc.) I've found it bad for this, does not generate something I'd actually read.

It seems to do ok at coming up with starting points or give you options if you're stuck. But the quality of the prose it comes up with is indeed awful. It gets a bit better if you ask it to write in the style of a specific author, but marginally so.

I guess maybe it gets to mediocre fan fiction level.

That's still pretty impressive, but not very usable for creative writing yet.

Re: Don't believe the hype: why ChatGPT is not the “holy grail” of AI research

#40
post #21

Earlier quoted context omitted.

A more modern example is the first iPhone, the first gen was bad even by the standards of the day. If you look passed the novelty of having a lightsaber app on your phone it was terrible.

What? Safari on your phone was mind blowing and immediately useful. Also apps weren’t part of the original iPhone.

I... Think they were? I kinda remember having ICQ on it, but maybe that was already the iPhone 2. Or I'm hallucinating.
Post reply on HN