Live data from Hacker News

Genie 3: A new frontier for world models

deepmind.google

361–370 of 512 posts

Re: Genie 3: A new frontier for world models

#361
This is revolutionary. I mean, we already could see this coming, but now it's here. With limitations, but this is the beginning.

In game engines it's the engineers, the software developers who make sure triangles are at the perfect location, mapping to the correct pixels, but this here, this is now like a drawing made by a computer, frame by frame, with no triangles computed.

Re: Genie 3: A new frontier for world models

#362
post #309

Advances in generative AI are making me progressively more and more depressive. Creativity is taken from us at exponential rate. And I don't buy argument from people who are saying they are excited to live in this age. I can get that if that technology stopped at current state and remained to be just tools for our creative endeavours, but it doesn't seem to be an endgame here. Instead it aims to be a complete replace…

Branding and differentiation. People still value Amish furniture or woodworking despite Ikea existing. I love that if I want a cheap chair made of cardboard and glue that I can find something to satisfy that need; but I still buy nice furniture when I can. AI creations are analogous. I've seen some cool AI stuff, but it definitely doesn't replace the real "organic" art one finds.

What if it's not cardboard and glue but woodworking of ultra-master quality?

These fears aren't realized if AI never achieves superhuman performance, but what if they do?

Re: Genie 3: A new frontier for world models

#363
post #70

Earlier quoted context omitted.

> Future robots may learn in their dreams... So prescient. I definitely think this will be a thing in the near future ~12-18 months time horizon

I may be wrong, but this seems to make no sense. A neural net can produce information outside of its original data set, but it is all and directly derived from that initial set. There are fundamental information constraints here. You cannot use a neural net to itself generate from its existing data set wholly new and original full quality training data for itself. You can use a neural net to generate data, and you ca…

Humans can learn from visualising situations and thinking through different scenarios. I don't see why AI / robots can't do similar. In fact I think quite a lot of training for things like Tesla self driving is done in simulation.

Re: Genie 3: A new frontier for world models

#364

Earlier quoted context omitted.

In the french revolution the army and the people had similar kind of weapons. And there was no total surveillance to round up the leaders.

Yes, it'd be difficult. I have some faith that once things escalate far enough the people wielding the weapons are unwilling to murder their countrymen en masse. Luigi Mangione has shown that all it takes is one person in the right time and place to remove some evil from the world.

It needs to happen, at minimum, before drones can reliably maintain themselves and kill dissidents in the street. At that point even if the human police and soldiers become disloyal it'll be too late; a society of two types of people, the one guy with access to issue prompts, and everyone else.

Re: Genie 3: A new frontier for world models

#365
post #310

Earlier quoted context omitted.

These guys are working on the same thing and have a real demo you can play: https://odyssey.world/introducing-interactive-video

Wow, a few years ago, if you've shown me this and Genie 3, I'd assume there were at least 10 years of development between them. This looks worse than Doom.

The rate of change is insane these days. I remember Sora launching and thinking "wow" and within weeks it looked like hot garbage.

Re: Genie 3: A new frontier for world models

#366

Earlier quoted context omitted.

I similarly am surprised at how fast they are progressing. I wrote this piece a few months ago about how I think steering world model output is the next realm of AAA gaming: https://kylekukshtel.com/diffusion-aaa-gamedev-doom-minecraf... But even when I wrote that I thought things were still a few years out. I facetiously said that Rockstar would be nerd-sniped on GTA6 by a world model, which sounded crazy a few mont…

> Rockstar would be nerd-sniped on GTA6 by a world model I'm having trouble parsing your meaning here. GTA isn't really a "drive on the street simulator", is it? There is deliberate creative and artistic vision that makes the series so enjoyable to play even decades after release, despite the graphics quality becoming more dated every year by AAA standards. Are you saying someone would "vibe model" a GTAish clone wit…

Probably depends on how you engage with GTA. “Drive on the street simulator” along with arrays of weapons and explosions is the majority of my hours in GTA.

I despise the creative and artistic vision of GTA online, but I’m clearly in a minority there gauging by how much money they’ve made off it.

Re: Genie 3: A new frontier for world models

#367

Earlier quoted context omitted.

https://news.ycombinator.com/newsguidelines.html

lol I thought this was going to be the receipts but no, I guess asking for evidence is against the rules! y'all are in a religion

Calling someone a liar without evidence is kinda rude.

Re: Genie 3: A new frontier for world models

#368
post #172
post #131

Earlier quoted context omitted.

Regarding latency, I found a live video of gameplay here [1] and it looks like closer to 1.1s keypress-to-photon latency (33 frames @ 30fps) based on when the onscreen keys start lighting up vs when the camera starts moving. This writeup [2] from someone who tried the Genie 3 research preview mentions that "while there is some control lag, I was told that this is due to the infrastructure used to serve the model rath…

You know that thing in anxiety dreams where you feel very uncoordinated and your attempts to manipulate your surroundings result in unpredictable consequences? Like you try to slam on the brake pedal but your car doesn’t slow down, or you’re trying to get a leash on your dog to lead it out of a dangerous situation and you keep failing to hook it on the collar? Maybe that’s extra latency because your brain is trying t…

Your brain does not need to render any environments, just the experience of being in them.

Re: Genie 3: A new frontier for world models

#370
post #311

What format do these world models output? Since it's interactive, it's not just a video...does DeepMind have some kind of proprietary runtime or what?

> Since it's interactive, it's not just a video I think it just outputs image frames...

Ah, yea. You're right. After reading a bit more, it's just "responding" to the prompts/navigation with real-time generation. Pretty cool.
Post reply on HN