Yann LeCun: ChatGPT is 'not particularly innovative'

[dead]

[dead]

This is very much people seeing the Apple Lisa(and/or Mac) for the first time. It had all been done better in the labs at Xerox over a decade earlier. No one got to use it though.

Sure, the ideas could be old (in ml research timeframes) but it works and they shipped it. It’s most people’s first exposure to a lot of innovative ideas that make up LLM at scale.

I agree with his assertion that the only reason other people haven’t seen this out of Meta or Google is that they “have a lot to lose” from putting out bots “that make stuff up” - that’s the root of Google seemingly losing the narrative war I think we’re seeing here. Not sure how to get them to work through that fear.