Technically, he is right. But OpenAI was the first to find the winning formula and make it famous.
[deleted]
Yann LeCun: ChatGPT is 'not particularly innovative'
21–30 of 190 posts
Re: Yann LeCun: ChatGPT is 'not particularly innovative'
#22This is very much people seeing the Apple Lisa(and/or Mac) for the first time. It had all been done better in the labs at Xerox over a decade earlier. No one got to use it though.
To me it's childish, and I have no idea why Yann decided this needed to be shouted on Twitter. I've lost a lot of respect for him over this.
I think if you read the headline it seems childish. His main point is that Google/Meta couldn't really release this, since the accuracy is really really poor.
Re: Yann LeCun: ChatGPT is 'not particularly innovative'
#23It's amazing how many researchers underestimate the importance of UX and design. Personally, seeing non-technical people using prompts for the first time -- and getting results that make sense -- is so incredible. Their eyes light up, they are surprised, and they want to keep playing with it. Amazing! A sizeable part of the population just got access to an incredibly complex AI model and can play with it. What a coll…
It's quite fascinating how information retrieval and search engines have evolved..
From trying to teach people how to google via "I am feeling lucky", to using language models for ranking, to building LLMs to better adapt to user queries and move beyond keywords, to having arguably useful chatbots that can synthesize responses.
I am curious to see what the future holds. Maybe an AI that can anticipate our queries?
Re: Yann LeCun: ChatGPT is 'not particularly innovative'
#24Earlier quoted context omitted.
> It's amazing how many researchers underestimate the importance of UX and design. Yes. Also the fact that ChatGPT's UX and design leaves much to be desired. They could add/improve the product in so many obvious ways. I wonder if they either 1.) don't care, or 2.) have plans to, but are holding off until they take on a subscription fee.
What would you change to the UX and design to make it even better?
It seems to log me out every day unlike pretty much every other web service besides banks.
Re: Yann LeCun: ChatGPT is 'not particularly innovative'
#25It's amazing how many researchers underestimate the importance of UX and design. Personally, seeing non-technical people using prompts for the first time -- and getting results that make sense -- is so incredible. Their eyes light up, they are surprised, and they want to keep playing with it. Amazing! A sizeable part of the population just got access to an incredibly complex AI model and can play with it. What a coll…
Clarke's third law: "Any sufficiently advanced technology is indistinguishable from magic."
Most people don't understand that ChatGPT has no idea what they're talking about. It lacks it's own thought and heuristic patterns, and only gives you the most-likely response to your prompt. People don't know that though, so they think the Mechanical Turk is actually playing chess.
I mostly agree with the headline here. ChatGPT is hardly any more innovative than a Markov chain.
Re: Yann LeCun: ChatGPT is 'not particularly innovative'
#26This is very much people seeing the Apple Lisa(and/or Mac) for the first time. It had all been done better in the labs at Xerox over a decade earlier. No one got to use it though.
Show me the AI chat system from a decade ago that could hallucinate a git repo. Edit: let me be more careful: Show me the AI chat system from a decade ago that wasn't specifically designed to hallucinate git repos, but would hallucinate a git repo in response a detailed natural language prompt. It should have been good enough in its output to cause the user to write more prompts in an attempt to gauge whether the AI…
Decade ago, definitely not. But the answer to that question, time aside, is, well, GPT-3. No doubt ChatGPT is better, but it does seem like a decent bit of the improvement was UX related, since with the right prompts people have shown similarly miraculous output from GPT-3.
Of course, I'm pretty sure the quoted person is referring to the fact that Google and others likely have similarly capable LLMs already that they simply won't release the models for. I can see the argument that new architectures and designs can be innovative, but that simply being the one to throw a million dollars of compute time into training is much less so, if that's the kind of argument.
Re: Yann LeCun: ChatGPT is 'not particularly innovative'
#27It's amazing how many researchers underestimate the importance of UX and design. Personally, seeing non-technical people using prompts for the first time -- and getting results that make sense -- is so incredible. Their eyes light up, they are surprised, and they want to keep playing with it. Amazing! A sizeable part of the population just got access to an incredibly complex AI model and can play with it. What a coll…
Clarke's third law: "Any sufficiently advanced technology is indistinguishable from magic." Most people don't understand that ChatGPT has no idea what they're talking about. It lacks it's own thought and heuristic patterns, and only gives you the most-likely response to your prompt. People don't know that though, so they think the Mechanical Turk is actually playing chess. I mostly agree with the headline here. ChatG…
> and only gives you the most-likely response to your prompt
That "only" carries a lot of weight on its back.
Re: Yann LeCun: ChatGPT is 'not particularly innovative'
#28Re: Yann LeCun: ChatGPT is 'not particularly innovative'
#29Earlier quoted context omitted.
> It's amazing how many researchers underestimate the importance of UX and design. Yes. Also the fact that ChatGPT's UX and design leaves much to be desired. They could add/improve the product in so many obvious ways. I wonder if they either 1.) don't care, or 2.) have plans to, but are holding off until they take on a subscription fee.
What would you change to the UX and design to make it even better?
Entering and editing text on a small touchscreen with it is a pretty bad experience. The keyboard covers the text, linebreaks can't be entered without pasting, viewing the output requires closing the keyboard. None of these are problems to the same degree in say Discord's mobile/tablet UI.