Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Genie 2: A large-scale foundation world model

deepmind.google

Post reply on HN
Print view View original

161–170 of 436 posts

Re: Genie 2: A large-scale foundation world model

#161

Post by jsheard »

0x1ceb00da wrote: post #113
sergiotapia wrote: post #38

Will the GPU go the way of the soundcard, and we will all purchase an "LPU"? Language Processing Unit for AIs to run fast? I remember there was a brief window where some gamers bought a Physx card for high fidelity physics in games. Ultimately they rolled that tech in to the CPUs themselves right?

The graphics stuff in modern gpus is just a software layer on top of a generic processing unit. The name is a misnomer.

Partially true, a significant chunk of modern GPUs are really just very wide general purpose processors, but they do still have fixed-function silicon specifically for graphics and probably will for the foreseeable future. Intel tried to lean into doing as much as possible in general purpose compute with their Larrabee GPU project but even that still had fixed-function texture units... and the concept was ultimately a failure which hasn't been revisited.

Re: Genie 2: A large-scale foundation world model

#163

Post by epolanski »

xnx wrote: post #41
justlikereddit wrote: post #30

Earlier quoted context omitted.

[flagged]

> the squealing carcass called Gemini Have you used Gemini? It seems every bit as good as ChatGPT.

I absolutely love Gemini Flash. Speed + cost + some interesting superpowers given by Google's ever seeing eye (you can ask it about stuff behind paywalled articles e.g.) make it the best API to use for some use cases of mine.

Re: Genie 2: A large-scale foundation world model

#164

Post by neya »

margalabargala wrote: post #108
xnx wrote: post #41

Earlier quoted context omitted.

> the squealing carcass called Gemini Have you used Gemini? It seems every bit as good as ChatGPT.

Something Gemini utterly fails at compared to ChatGPT and Claude is its willingness to contradict you if you are wrong and it is correct. Ask any of the three models basic facts and they'll answer correctly. If you tell ChatGPT or Claude Sonnet they are incorrect, they will push back, if they really think they are right. Gemini will fall over itself to agree with you that it's terribly sorry, you are right, the sky i…

In my experience, this is an issue even in ChatGPT. Sometimes it will compute something right, I will tell it's math is wrong, it will apologise and accept my suggestion.

Re: Genie 2: A large-scale foundation world model

#165

Post by summerlight »

vessenes wrote: post #4

This is.. super impressive. I'd like to know how large this model is. I note that the first thing they have it do is talk to agents who can control the world gen; geez - even robots get to play video games while we work. That said; I cannot find any: - architecture explanation - code - technical details - API access information Feels very DeepMind / 2015, and that's a bummer. I think the point of the "we have no moat…

While this is impressive, yet still looks like a very early prototype. The overall nuance seems that it doesn't try to be a standalone product but a part of broader R&D projects toward general agents... I doubt if they even have any productionized modeling pipelines for this project yet and pretty sure that we won't have an open access anytime soon.

Re: Genie 2: A large-scale foundation world model

#166

Post by enbugger »

Just like with the images, this will never be at good shape to actually use it for real product as it discards details completely leaving generic 3rd person controller animation.

What this should say to you instead is that stuff is really bad on training data side if you start scraping billions of game streams on internet - hard to imagine if there is a bigger chunk of training data than this. Stagnation incoming.

Re: Genie 2: A large-scale foundation world model

#167

Post by chefandy »

auggierose wrote: post #48
xnx wrote: post #41

Earlier quoted context omitted.

> the squealing carcass called Gemini Have you used Gemini? It seems every bit as good as ChatGPT.

It is not nearly as good. I tried the free trial and cancelled it before it was over.

The pre-update version of Gemini Advanced-- sold as a miracle worker-- wasted so much of my time in two small coding projects that I'll never touch it again. Constant hallucination, constant flip-flopping between the same three mistakes generating code no matter what the prompt was like... a much earlier version of copilot has steered me wrong a few times in fairly annoying ways, but is so helpful in smaller ways that it's been a net gain, though not a huge one.

Re: Genie 2: A large-scale foundation world model

#169

Post by isotypic »

psb217 wrote: post #86
simonw wrote: post #13

Related recent project you can try out yourself (Chrome only) which hallucinates new frames of a Minecraft style game: https://oasis.decart.ai/ That one would reimagine the world any time you look at the sky or ground. Sounds like Genie2 solves that: "Genie 2 is capable of remembering parts of the world that are no longer in view and then rendering them accurately when they become observable again."

RE: "Genie 2 is capable of remembering parts of the world that are no longer in view and then rendering them accurately when they become observable again." -- This claim is almost certainly wildly misleading. This claim is technically true if there's any scenario where their agent, eg, briefly looked down at the ground and then back up at the sky and at least one of the clouds in the sky was the same as before lookin…

Looking at how no samples other than the 3 samples in the "Long horizon memory" section have any camera movement which puts something offscreen and then back onscreen, it certainly seems that they are stretching the capabilities as far as they can in writing.

Re: Genie 2: A large-scale foundation world model

#170

Post by mclau156 »

summerlight wrote: post #165
vessenes wrote: post #4

This is.. super impressive. I'd like to know how large this model is. I note that the first thing they have it do is talk to agents who can control the world gen; geez - even robots get to play video games while we work. That said; I cannot find any: - architecture explanation - code - technical details - API access information Feels very DeepMind / 2015, and that's a bummer. I think the point of the "we have no moat…

While this is impressive, yet still looks like a very early prototype. The overall nuance seems that it doesn't try to be a standalone product but a part of broader R&D projects toward general agents... I doubt if they even have any productionized modeling pipelines for this project yet and pretty sure that we won't have an open access anytime soon.

there are lots of 3D modelers spending hours on 3D worlds and assets to use in training, this seems to automate a lot of that work
Post reply on HN