Live data from Hacker News

Yann LeCun to depart Meta and launch AI startup focused on 'world models'

nasdaq.com

451–460 of 680 posts

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#451
post #179

Earlier quoted context omitted.

That was obviously him getting sidelined. And it's easy to see why. LLMs get results. None of the Yann LeCun's pet projects do. He had ample time to prove that his approach is promising, and he didn't.

I agree. I never understood LeCun's statement that we need to pivot toward the visual aspects of things because the bitrate of text is low while visual input through the eye is high. Text and languages contain structured information and encode a lot of real-world complexity (or it's "modelling" that). Not saying we won't pivot to visual data or world simulations, but he was clearly not the type of person to compete w…

Thats where the research is leading.

The issue is context. trying to make an AI assistant with just text only inputs is doeable but limiting. You need to know the _context_ of all the data, and without visual input most of it is useful.

For example "Where is the other half of this" is almost impossible to solve unless you have an idea of what "this" is.

but to do that you need to have cameras, to use cameras you need to have position, object, and people tracking. And that is a hard problem thats not solved.

the hypothesis is that "world models" solve that with an implicit understanding of the worl and the objects in context

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#452
post #326

Most of the folks on this topic are focused on Meta and Yann’s departure. But, I’m seeing something different. This is the weirdest technology market that I’ve seen. Researchers are getting rewarded with VC money to try what remains a science experiment. That used to be a bad word and now that gets rewarded with billions of dollars in valuation.

VC is in a bubble.

Underrated comment of the year

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#453

Earlier quoted context omitted.

LeCun was always part of FAIR, doing research, not part of the LLM/product group, who reported to someone else.

Wasn't the original LLaMA developed by FAIR Paris?

I hadn't heard that, but he was heavily involved in a cancelled project called Galactica that was an LLM for scientific knowledge.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#454
post #59

Earlier quoted context omitted.

How old are you? That's what they've been selling us for the past 50 years and nothing has changed, all the productivity gain was pocketed by the elite

Here's my prediction : The rapid progress of AI will make money as an accounting practice irrelevant. Take the concept of "Future is already here but unevenly distributed." When we will have true abundance, what the elites will target is the convex hull of progress, they want to be in control of leading edge / leading wavefront and its direction and who has access to resources and decision making. In such a scenario…

We already have an abundance of things, food and energy, what we need is meaning and time, not iphones 5000.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#455
post #343

Most of the folks on this topic are focused on Meta and Yann’s departure. But, I’m seeing something different. This is the weirdest technology market that I’ve seen. Researchers are getting rewarded with VC money to try what remains a science experiment. That used to be a bad word and now that gets rewarded with billions of dollars in valuation.

I personally see this as a positive trend. VC in its earliest form was concerned with experiments that had high technology risk. I am thinking of companies like Genentech and scientists like biochemist Herbert Boyer, who had pioneered recombinant DNA technology. After that, VC had become more like PE, investing in stuff that was working already but needed money to scale.

I agree, if anything spending money on high technology risk is Silicon Valley going back to its roots.

Nobody had a way to do silicon transistor manufacturing at scale until the traitorous eight flipped Shockley the bird and took a $1.4M seed investment from Sherman Fairchild.

Big bets on uncertain technology is what tech is supposed to be about.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#456
post #386

Earlier quoted context omitted.

If Claude Code is Anthropic’s main focus why are they not responding to some of the most commented issues on their GitHub? https://github.com/anthropics/claude-code/issues/3648 has people begging for feedback and saying they’re moving to OpenAI, has been open since July and there are similar issues with 100+ comments.

Hey, Boris from the Claude Code team here. We try hard to read through every issue, and respond to as many issues as possible. The challenge is we have hundreds of new issues each day, and even after Claude dedupes and triages them, practically we can’t get to all of them immediately. The specific issue you linked is related to the way Ink works, and the way terminals use ANSI escape codes to control rendering. When…

It’s surprising to hear this get chalked up to “it’s the way our TUI library works”, while e.g. opencode is going to the lowest level and writing their own TUI backend. I get that we can’t expect everyone to reinvent the wheel, but it feels symptomatic of something that folks are willing to chalk up their issues as just being an unfortunate and unavoidable symptom of a library they use rather than seeming that unacceptable and going to the lowest level.

CC is one of the best and most innovative pieces of software of the last decade. Anthropic has so much money. No judgment, just curious, do you have someone who’s an expert on terminal rendering on the team? If not, why? If so, why choose a buggy / poorly designed TUI library — or why not fix it upstream?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#457

Good. The world model is absolutely the right play in my opinion. AI Agents like LLMs make great use of pre-computed information. Providing a comprehensive but efficient world model (one where more detail is available wherever one is paying more attention given a specific task) will definitely eke out new autonomous agents. Swarms of these, acting in concert or with some hive mind, could be how we get to AGI. I wish…

Can you explain this “world model” concept to me? How do you actually interface with a model like this?

The way I think of it (might be wrong) but basically a model that has similar sensors to humans (eyes, ears) and has action-oriented outputs with some objective function (a goal to optimize against). I think autopilot is the closest to world models in that they have eyes, they have ability to interact with the world (go different directions) and see the response.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#458
post #386

Earlier quoted context omitted.

If Claude Code is Anthropic’s main focus why are they not responding to some of the most commented issues on their GitHub? https://github.com/anthropics/claude-code/issues/3648 has people begging for feedback and saying they’re moving to OpenAI, has been open since July and there are similar issues with 100+ comments.

Hey, Boris from the Claude Code team here. We try hard to read through every issue, and respond to as many issues as possible. The challenge is we have hundreds of new issues each day, and even after Claude dedupes and triages them, practically we can’t get to all of them immediately. The specific issue you linked is related to the way Ink works, and the way terminals use ANSI escape codes to control rendering. When…

That issue is the fourth most-reacted issue, and third most open issue. And the two things above it are feature requests. It seems like you should at the very least have someone pop in to say "working on it" if that's what you're doing, instead of letting it sit there for 4 months?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#459

Earlier quoted context omitted.

You don't even need insider info - it lines up with external estimates. We have estimates that range from 30% to 70% gross margin on API LLM inference prices at major labs, 50% middle road. 10% to 80% gross margin on user-facing subscription services, error bars inflated massively. We also have many reports that inference compute has come to outmatch training run compute for frontier models by a factor of x10 or more…

what about training?

I literally mentioned that:

> We also have many reports that inference compute has come to outmatch training run compute for frontier models by a factor of x10 or more over the lifetime of a model.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#460

Most of the folks on this topic are focused on Meta and Yann’s departure. But, I’m seeing something different. This is the weirdest technology market that I’ve seen. Researchers are getting rewarded with VC money to try what remains a science experiment. That used to be a bad word and now that gets rewarded with billions of dollars in valuation.

If a science experiment works and is transformational can be worth a trillion dollars, how much is it worth if it has a 5% chance of being transformational?
Post reply on HN