Live data from Hacker News

Oasis: A Universe in a Transformer

oasis-model.github.io

21–25 of 25 posts

Re: Oasis: A Universe in a Transformer

#21
This looks like a very similar project to "Diffusion Models Are Real-Time Game Engines"[1] that circulated on HN a few months ago [2], which was playing DOOM. There's some pretty interesting commentary on that post that might also apply to this.

I'd like to do a deeper dive into the two approaches, but on a surface level one interesting note is Oasis specifically mentions using a use-specific ASIC (presumably for inference?):

> When Etched's transformer ASIC, Sohu, is released, we can run models like Oasis in 4K.

[1] https://gamengen.github.io/

[2] https://news.ycombinator.com/item?id=41375548

Re: Oasis: A Universe in a Transformer

#23
post #12

The most fun thing about this demo (and the demo is 100% worth trying out, you'll need to use Chrome for it) is that it shows how there's no persistent memory at all. If you get bored of the area you are in, look straight up at the sky and look down again. If you see something interesting - like a fence post - keep that in your field of vision and you should start to see more similarly interesting things.

Also because of the limitations of this model to achieve something in AI Minecraft is completely different than the standard game, for example to go to the Nether is easier to find the red mushroom texture and use it to confuse the AI into thinking it's netherrack, same think for the end by using sand blocks or similar color blocks.

Re: Oasis: A Universe in a Transformer

#25
This is an excellent demo. I watched the "DOOM with no game engine" video a while back and was mildly intrigued. It is much more engaging to be the one in control.

They made a great decision by letting me download the video of my journey when the demo ended. I saw some neat constructs and was thinking, "I wish I could show this to some friends." I can!

If you get lost in the dark like I did, just press E to bring up the items menu. Doing that a couple of times and moving around a bit brought some novelty back into view for it to work with.

Post reply on HN