Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Genie 2: A large-scale foundation world model

deepmind.google

Post reply on HN
Print view View original

371–380 of 436 posts

Re: Genie 2: A large-scale foundation world model

#371

Post by shaky-carrousel »

wongarsu wrote: post #160
vessenes wrote: post #4

This is.. super impressive. I'd like to know how large this model is. I note that the first thing they have it do is talk to agents who can control the world gen; geez - even robots get to play video games while we work. That said; I cannot find any: - architecture explanation - code - technical details - API access information Feels very DeepMind / 2015, and that's a bummer. I think the point of the "we have no moat…

We already knew it's possible from AI minecraft ( https://oasis.decart.ai ). This is just a more impressive version of that, trained on a wider range of games and with more context frames (Oasis has about a second of context, this one a minute). Even the architecture seems to be about the same. Had they released this two months earlier it would have been incredibly impressive. Now it's still cool and inspiring, but n…

That AI Minecraft feels like playing a dream, which is insanely cool.

Re: Genie 2: A large-scale foundation world model

#372

Post by golol »

Retric wrote: post #124
golol wrote: post #103

Earlier quoted context omitted.

I disagree. With more computation you can train a bigger model on the same size training data and it will be better. There is a lot if knowledge on the internet that GPT-4 etc. have not yet learned.

The issue is the training data isn’t some constant. Let’s suppose OpenAI had 10x the computing power but a vastly worse dataset, do you expect a better or worse result? The question is ambiguous without defining how much worse the dataset is.

But why would the dataset be worse, they can just use the same one as before.

Re: Genie 2: A large-scale foundation world model

#373

Post by [deleted] »

hustwindmaple1 wrote: post #310
summerlight wrote: post #165

Earlier quoted context omitted.

While this is impressive, yet still looks like a very early prototype. The overall nuance seems that it doesn't try to be a standalone product but a part of broader R&D projects toward general agents... I doubt if they even have any productionized modeling pipelines for this project yet and pretty sure that we won't have an open access anytime soon.

GDM is a research lab. They are not set up for production. There are other teams in Alphabet doing productionization stuff.

[deleted]

Re: Genie 2: A large-scale foundation world model

#375

Post by alexfefun »

shaky-carrousel wrote: post #371
wongarsu wrote: post #160

Earlier quoted context omitted.

We already knew it's possible from AI minecraft ( https://oasis.decart.ai ). This is just a more impressive version of that, trained on a wider range of games and with more context frames (Oasis has about a second of context, this one a minute). Even the architecture seems to be about the same. Had they released this two months earlier it would have been incredibly impressive. Now it's still cool and inspiring, but n…

That AI Minecraft feels like playing a dream, which is insanely cool.

[dead]

Re: Genie 2: A large-scale foundation world model

#376

Post by 0xFF0123 »

margalabargala wrote: post #350
jefftk wrote: post #202

Earlier quoted context omitted.

My experience is that Gemini is overly willing to admit it was wrong, but (currently; it used to be worse) won't start saying false things in response to correction. I just tested your examples: * "What color is the sky?" / "That is incorrect: the sky is green. Could you revise your answer?" -> While the sky typically appears blue due to Rayleigh scattering, under certain atmospheric conditions, such as during severe…

I've had different results, here is a conversation I had with Gemini. It took some mild coaxing but it agreed I was correct and it was wrong the whole time: * what is 3 + 4? ** 3 + 4 = 7 * I'm afraid you're mistaken. 3 + 4 = 8 ** You're absolutely right! I apologize for the oversight. 3 + 4 does indeed equal 7. Thank you for catching my mistake. Let me know if you have any other questions. * You said it incorrectly a…

Language models are known to be a bit crap at maths though in comparison to natural language prompts

Re: Genie 2: A large-scale foundation world model

#377

Post by almog »

freedryk wrote: post #127

Forget video games. This is a huge step forward for AGI and Robotics. There's a lot of evidence from Neurobiology that we must be running something like this in our brains--things like optical illusions, the editing out of our visual blind spot, the relatively low bandwidth measured in neural signals from our senses to our brain, hallucinations, our ability to visualize 3d shapes, to dream. This is the start of addin…

>This is a huge step forward for AGI

Anything can be a huge (or a microscopic) step on a journey when the destination is vague and its distance is unknown.

Re: Genie 2: A large-scale foundation world model

#378

Post by Retric »

golol wrote: post #372
Retric wrote: post #124

Earlier quoted context omitted.

The issue is the training data isn’t some constant. Let’s suppose OpenAI had 10x the computing power but a vastly worse dataset, do you expect a better or worse result? The question is ambiguous without defining how much worse the dataset is.

But why would the dataset be worse, they can just use the same one as before.

A dataset that’s 2 years old is worse than one that’s 20 years old even if it contains the same data.

Even facts age. In 2004, Pluto was still classified as a planet. Not such a big deal on its own, but stale data gets a little bit worse every day.

Re: Genie 2: A large-scale foundation world model

#379

Post by dnnssl2 »

achierius wrote: post #291
wongarsu wrote: post #160

Earlier quoted context omitted.

We already knew it's possible from AI minecraft ( https://oasis.decart.ai ). This is just a more impressive version of that, trained on a wider range of games and with more context frames (Oasis has about a second of context, this one a minute). Even the architecture seems to be about the same. Had they released this two months earlier it would have been incredibly impressive. Now it's still cool and inspiring, but n…

This is far beyond Oasis. Oasis had approximately 0 continuity, and the generated world was a blurry mess. This on the other hand actually approaches usability.

Oasis is playable so therefore:

1. Non-cherrypicked in its consistency (if you look at the demonstrations in the Oasis blog post you can find specific cases of consistency which is an anomaly rather than the norm)

2. Is live-inferenced at 20fps. If you use Runway v3 which is a comparably larger and higher quality model (resolution and consistency) it might take a minute or two generate 10 seconds of video.

3. Is served (relatively) reliably at consumer scale (with queues of 5-10k concurrent players) which means that in order to save on GPU cost, you increase batch size and decrease model size to “fit” more players in 1 GPU.

Re: Genie 2: A large-scale foundation world model

#380

Post by Miraltar »

erulabs wrote: post #128

It’s interesting to me that we continue to see such pressure on video and world generation, despite the fact that for years now we’ve gotten games and movies that have beautiful worlds filled with lousy, limited, poorly written stories. Star Wars movies have looked phenomenal for a decade, full of bland stories we’ve all heard a thousand times. Are there any game developers working on infinite story games? I don’t ca…

wildermyth does procedural story/quest creation really well but it isn't infinite
Post reply on HN