Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Yann LeCun: ChatGPT is 'not particularly innovative'

zdnet.com

Post reply on HN
Print view View original

41–50 of 190 posts

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#41

Post by smoldesu »

visarga wrote: post #27
smoldesu wrote: post #25

Earlier quoted context omitted.

Clarke's third law: "Any sufficiently advanced technology is indistinguishable from magic." Most people don't understand that ChatGPT has no idea what they're talking about. It lacks it's own thought and heuristic patterns, and only gives you the most-likely response to your prompt. People don't know that though, so they think the Mechanical Turk is actually playing chess. I mostly agree with the headline here. ChatG…

> and only gives you the most-likely response to your prompt That "only" carries a lot of weight on its back.

As far as most people can be fooled by coherent-looking text.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#43

Post by visarga »

PartiallyTyped wrote: post #23
cl42 wrote: post #12

It's amazing how many researchers underestimate the importance of UX and design. Personally, seeing non-technical people using prompts for the first time -- and getting results that make sense -- is so incredible. Their eyes light up, they are surprised, and they want to keep playing with it. Amazing! A sizeable part of the population just got access to an incredibly complex AI model and can play with it. What a coll…

It's quite fascinating how information retrieval and search engines have evolved.. From trying to teach people how to google via "I am feeling lucky", to using language models for ranking, to building LLMs to better adapt to user queries and move beyond keywords, to having arguably useful chatbots that can synthesize responses. I am curious to see what the future holds. Maybe an AI that can anticipate our queries?

I also saw the "LLM as database" metaphor. Up until 2020 we had databases in the backend, UI in front, now we can have LLMs in the backend.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#44

Post by smoldesu »

abm53 wrote: post #36
smoldesu wrote: post #25

Earlier quoted context omitted.

Clarke's third law: "Any sufficiently advanced technology is indistinguishable from magic." Most people don't understand that ChatGPT has no idea what they're talking about. It lacks it's own thought and heuristic patterns, and only gives you the most-likely response to your prompt. People don't know that though, so they think the Mechanical Turk is actually playing chess. I mostly agree with the headline here. ChatG…

> thought and heuristic patterns I’m not sure these are well-defined enough terms to make this claim.

Heuristics is the ability to recognize multiple options and reason which one is correct. ChatGPT (and all GPT models for that matter) have a single context that doesn't get compared to other possible generations. You can back-propegate and see which tokens influenced the output most, but there is no evidence that AI can conceive multiple hypothetical responses and select the most-preferred one. At least not ChatGPT.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#45

Post by password11 »

Full quote:

"In terms of underlying techniques, ChatGPT is not particularly innovative," said Yann LeCun, Meta's chief AI scientist, in a small gathering of press and executives on Zoom last week.

"It's nothing revolutionary, although that's the way it's perceived in the public," said LeCun. "It's just that, you know, it's well put together, it's nicely done."

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#46

Post by cloudking »

baxtr wrote: post #38
cl42 wrote: post #17

Earlier quoted context omitted.

What would you change to the UX and design to make it even better?

The slow spell out is really annoying. If they want to rate limit fine. But give me the answer faster and then lock queries for a few seconds instead.

The spell out is a limitation of the way the model works, it predicts the text word by word.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#47

Post by liuliu »

cl42 wrote: post #17
ryanSrich wrote: post #14

Earlier quoted context omitted.

> It's amazing how many researchers underestimate the importance of UX and design. Yes. Also the fact that ChatGPT's UX and design leaves much to be desired. They could add/improve the product in so many obvious ways. I wonder if they either 1.) don't care, or 2.) have plans to, but are holding off until they take on a subscription fee.

What would you change to the UX and design to make it even better?

Add "calculator" in a form of Python interpreter to give alternative result. Providing interactive graphical interface for some of the charts they shown. Connecting outside sites for booking, pictures, user comments.

To some degree, WolframAlpha putting more efforts into the UX than ChatGPT.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#49

Post by oxfordmale »

visarga wrote: post #27
smoldesu wrote: post #25

Earlier quoted context omitted.

Clarke's third law: "Any sufficiently advanced technology is indistinguishable from magic." Most people don't understand that ChatGPT has no idea what they're talking about. It lacks it's own thought and heuristic patterns, and only gives you the most-likely response to your prompt. People don't know that though, so they think the Mechanical Turk is actually playing chess. I mostly agree with the headline here. ChatG…

> and only gives you the most-likely response to your prompt That "only" carries a lot of weight on its back.

The most likely response is not necessarily an accurate response. It claims dogs do not give birth to babies. That is indeed the most likely response as babies are mostly, but not exclusively, associated with humans. However, a five year old child would understand me if I told them my dog had babies.

Re: Yann LeCun: ChatGPT is 'not particularly innovative'

#50

Post by drcode »

Yann's tweets on this are pretty funny. I would flippantly summarize them as: "Don't get me wrong, the openai people are great. All I'm doing is educating the media, who have the mistaken belief that chatGPT is good"

https://twitter.com/ylecun/status/1617921903934726144?t=2wZZ...

Post reply on HN