Making LeCun report to Wang was the most boneheaded move imaginable. But… I suppose Zuckerberg knows what he wants, which is AI slopware and not truly groundbreaking foundation models.
In industry research, someone in a chief position like LeCun should know how to balance long-term research with short-term projects. However, for whatever reason, he consistently shows hostility toward LLMs and engineering projects, even though Llama and PyTorch are two of the most influential projects from Meta AI. His attitude doesn’t really match what is expected from a Chief position at a product company like Fac…
Yann LeCun to depart Meta and launch AI startup focused on 'world models'
311–320 of 680 posts
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#312Earlier quoted context omitted.
This sounds crazy. We don't even know/can't define what human intelligence is or how it works , but we're trying to replicate it with AGI ?
Man, why did no one tell the people who invented bronze that they weren’t allowed to do it until they had a correct definition for metals and understood how they worked? I guess the person saying something can’t be done should stay out of the way of the people doing it.
I'll happily step out of the way once someone simply tells me what it is you're trying to accomplish. Until you can actually define it, you can't do "it".
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#313Earlier quoted context omitted.
These are the types that want academic freedom in a cut-throat industry setup and conversely never fit into academia because their profiles and growth ambitions far exceed what an academic research lab can afford (barring some marquee names). It's an unfortunate paradox.
Maybe it's time for Bell Labs 2? I guess everyone is racing towards AGI in a few years or whatever so it's kind of impossible to cultivate that environment.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#314Earlier quoted context omitted.
Can you explain this “world model” concept to me? How do you actually interface with a model like this?
One theory of how humans work is the so called predictive coding approach. Basically the theory assumes that human brains work similar to a kalman filter, that is, we have an internal model of the world that does a prediction of the world and then checks if the prediction is congruent with the observed changes in reality. Learning then comes down to minimizing the error between this internal model and the actual obse…
https://www.youtube.com/watch?v=l-OLgbdZ3kk
In this video we explore Predictive Coding – a biologically plausible alternative to the backpropagation algorithm, deriving it from first principles.
Predictive coding and Hebbian learning are interconnected learning mechanisms where Hebbian learning rules are used to implement the brain's predictive coding framework. Predictive coding models the brain as a hierarchical system that minimizes prediction errors by sending top-down predictions and bottom-up error signals, while Hebbian learning, often simplified as "neurons that fire together, wire together," provides a biologically plausible way to update the network's weights to improve predictions over time.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#315Most of the folks on this topic are focused on Meta and Yann’s departure. But, I’m seeing something different. This is the weirdest technology market that I’ve seen. Researchers are getting rewarded with VC money to try what remains a science experiment. That used to be a bad word and now that gets rewarded with billions of dollars in valuation.
I’ve worked for multiple startups and I’ve watched startup job boards most of my career.
A lot of VC backed startups have a founder with a research background and are focused on providing out some hypothesis. I don’t see anything uncommon about this arrangement.
If you live near a University that does a lot of research it’s very common to encounter VC backed startups that are trying to prove out and commercialize some researcher’s experiment. It’s also common for those founders to spend some time at a FAANG or similar firm before getting VC funded.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#316Earlier quoted context omitted.
This sounds crazy. We don't even know/can't define what human intelligence is or how it works , but we're trying to replicate it with AGI ?
If an LLM can pass a bar exam, isn't that at least a decent proof of concept or working model?
yes, a glib response, but think about it: we define an intelligence test for humans, which by definition is an artificial construct. If we then get a computer to do well on the test we haven't proved it's on par with human intelligence, just that both meet some of the markers that the test makers are using as rough proxies for human intelligence. Maybe this helps signal or judge if AI is a useful tool for specific problems, but it doesn't mean AGI
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#317Surprising to see how many commenters are in favour and supportive towards policy of prioritising short term profits vs. Long-term research. I understand Meta's not academia nor charity, but come on, how much profit do they need to make so we can expect them to allocate part of their resources towards some long term goals beneficial for society,.not only for shareholders? Hasn't that narrow focus and chasing the prof…
Many people believe a company exists only to make profit for its shareholders, and that no matter the amount it should continue to maximise profits at the expense of all else.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#318Earlier quoted context omitted.
Maybe it's time for Bell Labs 2? I guess everyone is racing towards AGI in a few years or whatever so it's kind of impossible to cultivate that environment.
The fact that people invest on the architecture that keeps getting increasingly better results is a feature, not a bug. If LLMs actually hit a plateau, then investment will flow towards other architectures.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#319Most of the folks on this topic are focused on Meta and Yann’s departure. But, I’m seeing something different. This is the weirdest technology market that I’ve seen. Researchers are getting rewarded with VC money to try what remains a science experiment. That used to be a bad word and now that gets rewarded with billions of dollars in valuation.
> This is the weirdest technology market that I’ve seen. You must have not lived through the dot com boom. There was almost everything under the sun was being sold under a website that started with an "e". ePets, ePlants, eStamps, eUnderwear, eStocks, eCards, eInvites.....
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#320Earlier quoted context omitted.
> This is the weirdest technology market that I’ve seen. You must have not lived through the dot com boom. There was almost everything under the sun was being sold under a website that started with an "e". ePets, ePlants, eStamps, eUnderwear, eStocks, eCards, eInvites.....
It's funny that the Netherlands seems to still live in the dotcom boom to this day. Want to adopt a pet? verhuisdieren.nl. Want to buy wall art? wall-art.nl. Need cat5 cable? kabelshop.nl. 8/10 times there is a (legit) online store for whatever you need, to the point where one of the local e-commerce giants (Coolblue) buys this type of domain and aliases them to their main site.