31–40 of 436 posts
This is super impressive. Interesting they're framing this more from the world model/agent environment angle, when this seems like the best example so far of generative games. 720p realtime mostly consistent games for a minute is amazing, considering stable diffusion was originally released 2ish years ago.
Related recent project you can try out yourself (Chrome only) which hallucinates new frames of a Minecraft style game: https://oasis.decart.ai/ That one would reimagine the world any time you look at the sky or ground. Sounds like Genie2 solves that: "Genie 2 is capable of remembering parts of the world that are no longer in view and then rendering them accurately when they become observable again."
Google is firing warning shots to kill off interest in funding competing startups in this space.
I suspect that in 6 months it won't matter as we'll have completely open source Chinese world models. They're already starting to kill video foundation model companies' entire value prop by releasing open models and weights. Hunyuan blows Runway and OpenAI's Sora completely out of the water, and it's 100% open source. How do companies like Pika compete with free?
Meta and Chinese companies are not the leaders in the space, so they're salting the earth with insanely powerful SOTA open models to prevent anyone from becoming a runaway success. Meta is still playing its cards close to its chest so they can keep the best pieces private, but these Chinese companies are dropping innovation left and right like there's no tomorrow.
The game theory here is that if you're a foundation model "company", you're dead - big tech will kill you. You don't have a product, and you're paying a lot to do research that isn't necessarily tied to customer demand. If you're a leading AI research+product company, everyone else will release their code/research to create a thousand competitors to you.
Genuine question: What is the point of telling us about this if we can’t use it? Is it just to flex on everyone?
Earlier quoted context omitted.
Longer term computation isn’t really the limiting factor for generative AI, it’s training data. Generative AI is like Google search before the web responded to their search engine existing. There’s a huge quantity of high quality training data which nobody had any reason to pollute ready for the scrapping. But modern search is hampered by people responding to algorithmic indexes. Algorithms responding to metadata wit…
This has already happened. Search google for a few random terms, and go through the first page of web and image results. A decent chunk will be AI-generated.
Genuine question: What is the point of telling us about this if we can’t use it? Is it just to flex on everyone?
I remember there was a brief window where some gamers bought a Physx card for high fidelity physics in games. Ultimately they rolled that tech in to the CPUs themselves right?
It's very cool, but we've gotten too many of these big bold announcements with no payoff. All it takes is a very limited demo and we'd be much happier.