On a very similar theme, here is the work from World Lab (founded by Fei-Fei Li, ImageNet dataset, et al.) about creating 3D worlds:
Genie 2: A large-scale foundation world model
21–30 of 436 posts
Re: Genie 2: A large-scale foundation world model
#22Not even a month ago HN was discussing Ben Affleck's take on actors and AI, somehow taking a side with him and arguing how the tech "it's just not there, etc...".
I'll keep my stance, give it two years and very realistic movies, with plot and everything, will be generated on demand.
Re: Genie 2: A large-scale foundation world model
#23Genuine question: What is the point of telling us about this if we can’t use it? Is it just to flex on everyone?
It's PR but it's also meant to entice. Let the world know Google is #1 for Gen AI, convince researchers to join Google, convince investors to boost the stock price, make Elon Musk grit his teeth. That kind of thing. In the short term, it may provide a bump in interest for existing AI products from Google.
Re: Genie 2: A large-scale foundation world model
#24I don't understand this space very well, but this seems incredible. Something I find interesting about generative AI is how it adds a huge layer of flexibility, but at the cost of lots of computation, while a very narrow set of constraints (a traditional program) is comparatively incredibly efficient. If someone spent a ton of time building out something simple in Unity, they could get the same thing running with a s…
Longer term computation isn’t really the limiting factor for generative AI, it’s training data. Generative AI is like Google search before the web responded to their search engine existing. There’s a huge quantity of high quality training data which nobody had any reason to pollute ready for the scrapping. But modern search is hampered by people responding to algorithmic indexes. Algorithms responding to metadata wit…
This has already happened. Search google for a few random terms, and go through the first page of web and image results. A decent chunk will be AI-generated.
Re: Genie 2: A large-scale foundation world model
#25This is super impressive.
Interesting they're framing this more from the world model/agent environment angle, when this seems like the best example so far of generative games.
720p realtime mostly consistent games for a minute is amazing, considering stable diffusion was originally released 2ish years ago.
Re: Genie 2: A large-scale foundation world model
#26[deleted]
Re: Genie 2: A large-scale foundation world model
#27Genuine question: What is the point of telling us about this if we can’t use it? Is it just to flex on everyone?
The best minds of a generation went from thinking about how to make people click ads to how to generate 3d video game worlds.
Re: Genie 2: A large-scale foundation world model
#28Genuine question: What is the point of telling us about this if we can’t use it? Is it just to flex on everyone?
An artifact for their promotion packet.
Re: Genie 2: A large-scale foundation world model
#29Genuine question: What is the point of telling us about this if we can’t use it? Is it just to flex on everyone?
To stop competing startups from getting funding.
Decart (Oasis) raised $25 million at $500 million valuation.
World Labs raised $230 million.
Re: Genie 2: A large-scale foundation world model
#30This is.. super impressive. I'd like to know how large this model is. I note that the first thing they have it do is talk to agents who can control the world gen; geez - even robots get to play video games while we work. That said; I cannot find any: - architecture explanation - code - technical details - API access information Feels very DeepMind / 2015, and that's a bummer. I think the point of the "we have no moat…
[flagged]