51–60 of 436 posts
Genuine question: What is the point of telling us about this if we can’t use it? Is it just to flex on everyone?
The best minds of a generation went from thinking about how to make people click ads to how to generate 3d video game worlds.
Wow.. I can't even imagine where we'll be in 5 or 10 years from now. Seems that it's only "consistent" up to a minute, but if the progress keeps the same rate.. just wow.
Progress is not linear. For all we know, in 2027 things will slow down to a virtual halt for the next 30 years. Look at how much big science progressed in the first 20 years of the 19th century/20th century and look how little it has progressed in the first 20 years of this century. We are on the downlow compared to the last centuries and even if you look at crisp or deep learning, they are not as impactful NOW as le…
For quite a while now David Holz of Midjourney has mused that videogames will be AI generated. Like a theoretical PlayStation 7 with an AI processor replacing the GPU. But, I didn’t expect this much progress towards that quite this fast…
These DeepMind guys play Factorio, they don't play Atari games or shooters, so why aren't they thinking about that? Or maybe they are, and because they know a lot about Factorio, they see how hard it is to make?
There's a lot of "musing" as you say.
Earlier quoted context omitted.
The best minds of a generation went from thinking about how to make people click ads to how to generate 3d video game worlds.
The best minds were never working on getting people to click on ads. That was an internal industry narrative so people could feel better about themselves.
For quite a while now David Holz of Midjourney has mused that videogames will be AI generated. Like a theoretical PlayStation 7 with an AI processor replacing the GPU. But, I didn’t expect this much progress towards that quite this fast…
It would play to the medium's strengths -- any "glitches" the player experiences could be seen as diagetic corruptions of reality.
The moment we get parameterized NeRF models running in close-to-realtime, I want to go for it.
This is impressive, but why are they all looking still like a video game? Could they have this render movie scenes with realistic looking humans? I wonder if it is due to the training set they use being mostly video games?
I will add the totally inconsistent backgrounds in the "prototyping" example suggests the AI is simply cribbing from four different games with a flying avatar, which makes it kind of useless unless you're prototyping cynical AI slop. And what are we even doing here by calling this a "world model" if the details of the world can change on a whim? In my world model I can imagine a small dragon flying through my friend's living room without needing to turn her electric lights into sconces and fireplaces.
To state the obvious: if you train your model on thousands of hours of video games, you're also gonna get a bunch of stuff like "leaves are flat and don't bend" or "sometimes humans look like plastic" or "sometimes dragons clip through the scenery," which wouldn't fly in an actual world model. Just call it "video game world model!" Google is intentionally misusing a term which (although mysterious) has real meaning in cognitive science.
I am sure Genie 2 took an awful lot of work and technical expertise. But this advertisement isn't just unscientific, it's an assault on language itself.
This is super impressive. Interesting they're framing this more from the world model/agent environment angle, when this seems like the best example so far of generative games. 720p realtime mostly consistent games for a minute is amazing, considering stable diffusion was originally released 2ish years ago.
Pixelspace is an awful place to be generating 3D assets and maintaining physical self-consistency.
Not even a month ago HN was discussing Ben Affleck's take on actors and AI, somehow taking a side with him and arguing how the tech "it's just not there, etc...". I'll keep my stance, give it two years and very realistic movies, with plot and everything, will be generated on demand.