Meta's greatest loss of the decade
Yann LeCun raises $1B to build AI that understands the physical world
261–270 of 529 posts
Re: Yann LeCun raises $1B to build AI that understands the physical world
#262Earlier quoted context omitted.
I don't see a world where they become threatening and the employees don't become rich from investors flooding in.
Where have you been in the last 2 decades?
Don’t think that’s a fair interpretation of what I said.
Liquid money rich? No.
Can get pulled for big tech packages? Also no, for most of the employees.
AFAIK, big tech didn’t aggressively poach OpenAI-like talent, they did spend 10M+ pay packages but it was for a select few research scientists. Some folks left and came but it boiled down to culture mostly.
Re: Yann LeCun raises $1B to build AI that understands the physical world
#263Earlier quoted context omitted.
Reminds me of how cold fusion reactors are only 5 years away for decades now
Cold fusion reactors haven't produced usable intermediate results. LLMs have.
LLMs produce slop far to often to say they are in any way better than cold fusion in terms of usable results. "AI" kind of is the cold fusion of tech. We've always been 5 or 10 years away from "AGI" and likely always will be.
Re: Yann LeCun raises $1B to build AI that understands the physical world
#264This feels like more justified investment as it’s try to move the needle. Hope he succeeds
Re: Yann LeCun raises $1B to build AI that understands the physical world
#265Earlier quoted context omitted.
Whenever I see claims about AGI being reachable through large language models, it reminds me of the miasma theory of disease. Many respectable medical professionals were convinced this was true, and they viewed the entire world through this lens. They interpreted data in ways that aligned with a miasmatic view. Of course now we know this was delusional and it seems almost funny in retrospect. I feel the same way when…
> Whenever I see claims about AGI being reachable through large language models, it reminds me of the miasma theory of disease. Whenever I see people think the model architecture matters much, I think they have a magical view of AI. Progress comes from high quality data, the models are good as they are now. Of course you can still improve the models, but you get much more upside from data, or even better - from inter…
It's unintuitive to me that architecture doesn't matter - deep learning models, for all their impressive capabilities, are still deficient compared to human learners as far as generalisation, online learning, representational simplicity and data efficiency are concerned.
Just because RNNs and Transformers both work with enormous datasets doesn't mean that architecture/algorithm is irrelevant, it just suggests that they share underlying primitives. But those primitives may not be the right ones for 'AGI'.
Re: Yann LeCun raises $1B to build AI that understands the physical world
#266[dead]
Re: Yann LeCun raises $1B to build AI that understands the physical world
#267I have no faith in anyone doing AI to accomplish anything (especially relative to how much money they spend) except John Carmack. People should be trying to throw money at him
Re: Yann LeCun raises $1B to build AI that understands the physical world
#268I attended a talk from Yann LeCun, and he always had a strong opinion about auto-regressive models. Its nice to see someone not just chasing hype and doing more research.
Re: Yann LeCun raises $1B to build AI that understands the physical world
#269Re: Yann LeCun raises $1B to build AI that understands the physical world
#270> But this is not an applied AI company. There is absolutely no doubt about Yann's impact on AI/ML, but he had access to many more resources in Meta, and we didn't see anything. It could be a management issue, though, and I sincerely wish we will see more competition, but from what I quoted above, it does not seem like it. Understanding world through videos (mentioned in the article), is just what video models have a…
> we didn't see anything. Is it a troll? Even if we just ignore Llama, Meta invented and released so many foundational research and open source code. I would say that the computer vision field would be years behind if Meta didn't publish some core research like DETR or MAE.
Did he work on those vision models?