In game engines it's the engineers, the software developers who make sure triangles are at the perfect location, mapping to the correct pixels, but this here, this is now like a drawing made by a computer, frame by frame, with no triangles computed.
Genie 3: A new frontier for world models
361–370 of 512 posts
Re: Genie 3: A new frontier for world models
#362Advances in generative AI are making me progressively more and more depressive. Creativity is taken from us at exponential rate. And I don't buy argument from people who are saying they are excited to live in this age. I can get that if that technology stopped at current state and remained to be just tools for our creative endeavours, but it doesn't seem to be an endgame here. Instead it aims to be a complete replace…
Branding and differentiation. People still value Amish furniture or woodworking despite Ikea existing. I love that if I want a cheap chair made of cardboard and glue that I can find something to satisfy that need; but I still buy nice furniture when I can. AI creations are analogous. I've seen some cool AI stuff, but it definitely doesn't replace the real "organic" art one finds.
These fears aren't realized if AI never achieves superhuman performance, but what if they do?
Re: Genie 3: A new frontier for world models
#363Earlier quoted context omitted.
> Future robots may learn in their dreams... So prescient. I definitely think this will be a thing in the near future ~12-18 months time horizon
I may be wrong, but this seems to make no sense. A neural net can produce information outside of its original data set, but it is all and directly derived from that initial set. There are fundamental information constraints here. You cannot use a neural net to itself generate from its existing data set wholly new and original full quality training data for itself. You can use a neural net to generate data, and you ca…
Re: Genie 3: A new frontier for world models
#364Earlier quoted context omitted.
In the french revolution the army and the people had similar kind of weapons. And there was no total surveillance to round up the leaders.
Yes, it'd be difficult. I have some faith that once things escalate far enough the people wielding the weapons are unwilling to murder their countrymen en masse. Luigi Mangione has shown that all it takes is one person in the right time and place to remove some evil from the world.
Re: Genie 3: A new frontier for world models
#365Earlier quoted context omitted.
These guys are working on the same thing and have a real demo you can play: https://odyssey.world/introducing-interactive-video
Wow, a few years ago, if you've shown me this and Genie 3, I'd assume there were at least 10 years of development between them. This looks worse than Doom.
Re: Genie 3: A new frontier for world models
#366Earlier quoted context omitted.
I similarly am surprised at how fast they are progressing. I wrote this piece a few months ago about how I think steering world model output is the next realm of AAA gaming: https://kylekukshtel.com/diffusion-aaa-gamedev-doom-minecraf... But even when I wrote that I thought things were still a few years out. I facetiously said that Rockstar would be nerd-sniped on GTA6 by a world model, which sounded crazy a few mont…
> Rockstar would be nerd-sniped on GTA6 by a world model I'm having trouble parsing your meaning here. GTA isn't really a "drive on the street simulator", is it? There is deliberate creative and artistic vision that makes the series so enjoyable to play even decades after release, despite the graphics quality becoming more dated every year by AAA standards. Are you saying someone would "vibe model" a GTAish clone wit…
I despise the creative and artistic vision of GTA online, but I’m clearly in a minority there gauging by how much money they’ve made off it.
Re: Genie 3: A new frontier for world models
#367Re: Genie 3: A new frontier for world models
#368Earlier quoted context omitted.
Regarding latency, I found a live video of gameplay here [1] and it looks like closer to 1.1s keypress-to-photon latency (33 frames @ 30fps) based on when the onscreen keys start lighting up vs when the camera starts moving. This writeup [2] from someone who tried the Genie 3 research preview mentions that "while there is some control lag, I was told that this is due to the infrastructure used to serve the model rath…
You know that thing in anxiety dreams where you feel very uncoordinated and your attempts to manipulate your surroundings result in unpredictable consequences? Like you try to slam on the brake pedal but your car doesn’t slow down, or you’re trying to get a leash on your dog to lead it out of a dangerous situation and you keep failing to hook it on the collar? Maybe that’s extra latency because your brain is trying t…
Re: Genie 3: A new frontier for world models
#369That's not the point, video games are worth chump-change compared to robotics. Training AIs on real-world robotic arms scaled poorly, so they're looking for paths that leverage what AI scales well at.
Re: Genie 3: A new frontier for world models
#370What format do these world models output? Since it's interactive, it's not just a video...does DeepMind have some kind of proprietary runtime or what?
> Since it's interactive, it's not just a video I think it just outputs image frames...