Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Why Fei-Fei Li and Yann LeCun are both betting on "world models"

entropytown.com

Post reply on HN
Print view View original

11–20 of 105 posts

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#11

Post by philipkiely »

I played with Marble yesterday, Fei-Fei/World Labs' new product.

It is the most impressed I've been with an AI experience since the first time I saw a model one-shot material code.

Sure, its an early product. The visual output reminds me a lot of early SDXL. But just look at what's happened to video in the last year and image in the last three. The same thing is going to happen here, and fast, and I see the vision for generative worlds for everything from gaming/media to education to RL/simulation.

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#13

Post by IAmGraydon »

The LLM grift is burned up, so this is the next thing. It has just enough new magic tricks to wow the VCs who don't really get what's going on here. I think this comment from the article says it all:

“Taking images and turning them into 3D environments using gaussian splats, depth and inpainting. Cool, but that’s a 3D GS pipeline, not a robot brain.”

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#14

Post by echelon »

allenleee wrote: post #10

With all due respect, AI is ultimately a capital game. World models aren’t where real B2B customer revenue comes from—at least compared to today’s LLMs; they’re mainly a better story for raising huge amounts of private capital. Hopefully they figure out how to build the next-gen AI architecture along the way.

The most useful models are image, video, and audio models. It makes sense that we'd make the video models more 4D aware.

Text really hogged all the attention. Media is where AI is really going to shine.

Some of the most profitable models right now are in music, image, and video generation. A lot of people are having a blast doing things they could legitimately never do before, and real working professionals are able to use the tools to get 1000x more done - perhaps providing a path to independence from bigger studios, and certainly more autonomy for those not born into nepotism.

As long as companies don't over-raise like OpenAI, there should be a smooth gradient from next gen media tools to revolutionary future stuff like immersive VR worlds that you can bend like the Matrix or Holodeck.

And I'll just be exceedingly chuffed if we get open source and highly capable world models from the Chinese that keep us within spitting distance of the unicorns.

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#15

Post by CrackerNews »

philipkiely wrote: post #11

I played with Marble yesterday, Fei-Fei/World Labs' new product. It is the most impressed I've been with an AI experience since the first time I saw a model one-shot material code. Sure, its an early product. The visual output reminds me a lot of early SDXL. But just look at what's happened to video in the last year and image in the last three. The same thing is going to happen here, and fast, and I see the vision fo…

Marble appears to be like HunyuanWorld to me, but this time they marketed it as a first step to a world model, and it has multimodal capabilities.

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#16

Post by nine_zeros »

echelon wrote: post #14
allenleee wrote: post #10

With all due respect, AI is ultimately a capital game. World models aren’t where real B2B customer revenue comes from—at least compared to today’s LLMs; they’re mainly a better story for raising huge amounts of private capital. Hopefully they figure out how to build the next-gen AI architecture along the way.

The most useful models are image, video, and audio models. It makes sense that we'd make the video models more 4D aware. Text really hogged all the attention. Media is where AI is really going to shine. Some of the most profitable models right now are in music, image, and video generation. A lot of people are having a blast doing things they could legitimately never do before, and real working professionals are able…

[dead]

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#17

Post by ares623 »

IntrepidPig wrote: post #8

I always felt like one of reasons LLMs are so good is that they piggyback on the many years that have gone into developing language as an information representation/compression format. I don’t know if there’s anything similar a world model can take advantage of. That being said there have been models which are pretty effective at other things that don’t use language, so maybe it’s a non issue.

I will gladly take $10B to find out for you.

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#18

Post by ares623 »

IAmGraydon wrote: post #13

The LLM grift is burned up, so this is the next thing. It has just enough new magic tricks to wow the VCs who don't really get what's going on here. I think this comment from the article says it all: “Taking images and turning them into 3D environments using gaussian splats, depth and inpainting. Cool, but that’s a 3D GS pipeline, not a robot brain.”

It’s for the VCs who missed out early. Now’s their chance!

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#19

Post by Marshferm »

andrewflnr wrote: post #3

If I was smarter, I would have predicted that not only would everyone else figure out that world models are a critical step, but that as a direct consequence the term "world model" would lose all meaning. Maybe next time. That said, Le Cunn's concept in the blog post is the only one worthy of the title.

[dead]

Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"

#20

Post by MangoToupe »

allenleee wrote: post #10

With all due respect, AI is ultimately a capital game. World models aren’t where real B2B customer revenue comes from—at least compared to today’s LLMs; they’re mainly a better story for raising huge amounts of private capital. Hopefully they figure out how to build the next-gen AI architecture along the way.

> World models aren’t where real B2B customer revenue comes from

You could say the same thing about AGI. Ultimately capital will realize intelligence is a drawback.

Post reply on HN