Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Yann LeCun: ChatGPT is 'not particularly innovative'

zdnet.com

Post reply on HN
Print view View original

51–60 of 190 posts

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#51

Post by cl42 »

sandworm101 wrote: post #34
cl42 wrote: post #12

It's amazing how many researchers underestimate the importance of UX and design. Personally, seeing non-technical people using prompts for the first time -- and getting results that make sense -- is so incredible. Their eyes light up, they are surprised, and they want to keep playing with it. Amazing! A sizeable part of the population just got access to an incredibly complex AI model and can play with it. What a coll…

>> using prompts for the first time -- and getting results that make sense -- is so incredible. Years ago it was possible to insert prompts into Google and get results that made sense, results that were meaningfully tied to the information you requested. The young people today who missed that time think it magic.

I think this is fundamentally different because you can play with it, and people want to play with it.

Google isn't a playground -- it's much more utilitarian. You go there when you need to find a doctor in Seattle, or to research politics in Poland, or something. You get results which are great, but you don't need to stick around.

GPT-3 and ChatGPT allow you to spend time playing with the system and having fun with it[1]. I think this is what makes it so viral and interesting to people.

[1] https://10millionsteps.com/ux-ai-gpt-3-click

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#52

Post by baxtr »

cloudking wrote: post #46
baxtr wrote: post #38

Earlier quoted context omitted.

The slow spell out is really annoying. If they want to rate limit fine. But give me the answer faster and then lock queries for a few seconds instead.

The spell out is a limitation of the way the model works, it predicts the text word by word.

Yes I get that. But just speed the god damn thing up.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#53

Post by swatcoder »

I think what’s really being emphasized here is that ChatGPT is an first generation product without much of a novel technology moat compared to what others with capital can deliver.

Microsoft will soak this work up as a pillar of their own AI assistance tech, but the other big tech firms (and probably some startups) are positioned to try to leapfrog what we see here, now that the market has been demonstrated.

In the language of tech history, ChatGPT is the Lycos or Altavista to some not-yet-launched Google.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#54

Post by sharemywin »

lofatdairy wrote: post #32

I mean, ChatGPT isn't even innovative for OpenAI's team. In terms of raw language capabilities it's not much more effective as GPT-3, which passed the HN Turing test almost a year before. Some of the credit goes to the fact that Dall-E 2 got everyone looking at OpenAI (and wrt Dall-E I'm personally not aware of any comparable work done anywhere else), a lot of the credit goes to the fact that OpenAI was willing to pu…

Putting it behind a login and captcha was the brilliant part.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#56

Post by hnfong »

Waterluvian wrote: post #39
idopmstuff wrote: post #31

Earlier quoted context omitted.

I don't think he's underestimating the UX/design piece, I think it's just outside of the scope of what he's talking about. It seems pretty clear to me that his statement is talking about the underlying AI technology (which makes sense given his background). And in any case, I wouldn't call anything about the UX or design here innovative - it's obviously a huge improvement in terms of usability, but a chat UI is a pre…

Then what left is there to explain why this is so much different from the well-established stuff?

"The implementation is left as an exercise to the reader."

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#57

Post by babypuncher »

soperj wrote: post #6

This is very much people seeing the Apple Lisa(and/or Mac) for the first time. It had all been done better in the labs at Xerox over a decade earlier. No one got to use it though.

While Xerox did it first, I think it's a stretch to say they did it better than the Macintosh.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#58

Post by lostmsu »

sandworm101 wrote: post #34
cl42 wrote: post #12

It's amazing how many researchers underestimate the importance of UX and design. Personally, seeing non-technical people using prompts for the first time -- and getting results that make sense -- is so incredible. Their eyes light up, they are surprised, and they want to keep playing with it. Amazing! A sizeable part of the population just got access to an incredibly complex AI model and can play with it. What a coll…

>> using prompts for the first time -- and getting results that make sense -- is so incredible. Years ago it was possible to insert prompts into Google and get results that made sense, results that were meaningfully tied to the information you requested. The young people today who missed that time think it magic.

Yes, but the kind of responses were different.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#59

Post by civilized »

cma wrote: post #42

It is notable that LeCun didn't credit Schmidhuber's labs' fast weight programmers research here and mostly focused on individuals and labs that got the Turing award alongside him.

> Schmidhuber's labs' fast weight programmers research

What does this refer to?

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#60

Post by woah »

time_to_smile wrote: post #15

He's not wrong. The key ingredient in ChatGPT is not brilliance but capital. It takes a lot of money not just to do the raw training but to get all the data together and process everything. There's no break through insights that make ChatGPT work, just a lot of consolidated wealth. The hacker part of me finds AI less and less interesting for this reason. We're seeing what the limits of pouring resources into the prob…

There are a lot of things that require an amount of processing power that the average person doesn't yet possess. This doesn't mean that they aren't interesting.

50 years ago you would have said "these computer things aren't interesting, only big institutions and corporations have them".

Post reply on HN