I don't understand this space very well, but this seems incredible. Something I find interesting about generative AI is how it adds a huge layer of flexibility, but at the cost of lots of computation, while a very narrow set of constraints (a traditional program) is comparatively incredibly efficient. If someone spent a ton of time building out something simple in Unity, they could get the same thing running with a s…
> ...this has seemingly infinite flexibility based on so little and that's just incredible.
What makes it little? This is the difference between von Neumann architecture and Harvard architecture.
It’s interesting to me that we continue to see such pressure on video and world generation, despite the fact that for years now we’ve gotten games and movies that have beautiful worlds filled with lousy, limited, poorly written stories. Star Wars movies have looked phenomenal for a decade, full of bland stories we’ve all heard a thousand times. Are there any game developers working on infinite story games? I don’t ca…
I wouldn't hold my breath : if you want great stories (that you didn't imagine yourself), see who is hiring great writers.
It’s interesting to me that we continue to see such pressure on video and world generation, despite the fact that for years now we’ve gotten games and movies that have beautiful worlds filled with lousy, limited, poorly written stories. Star Wars movies have looked phenomenal for a decade, full of bland stories we’ve all heard a thousand times. Are there any game developers working on infinite story games? I don’t ca…
If stories (and AAA games in general) are bland in games is due in large part to how expensive are to produce. Risk tolerance is low. If game assets are cheap to generate you’ll see small teams or even solo developers willing to take more creative risks
We already have deluges of free, and almost free, publicly available assets. Getting Over It, a game that deliberately used those, had a running author's commentary on the this phenomenon and in short no, endless assets does not translate to endless creative works; it's seen and treated as trash that nobody wants to use.
I don't understand this space very well, but this seems incredible. Something I find interesting about generative AI is how it adds a huge layer of flexibility, but at the cost of lots of computation, while a very narrow set of constraints (a traditional program) is comparatively incredibly efficient. If someone spent a ton of time building out something simple in Unity, they could get the same thing running with a s…
Makes me wonder if there's any company which is trying to train a model to produce three D worlds within Unity (not as a video like oasis).
I was hoping that Midjourney would make the leap from 2D to 3D, then start to provide the 3D model. A bit further, you could tell the Midjourney LLM to create a small scene, like: The character runs fast. Then, Midjourney LLM could output whatever script is necessary to make the 3D model "run". If Midjourney doesn't do it first, I am sure someone else will.
This is.. super impressive. I'd like to know how large this model is. I note that the first thing they have it do is talk to agents who can control the world gen; geez - even robots get to play video games while we work. That said; I cannot find any: - architecture explanation - code - technical details - API access information Feels very DeepMind / 2015, and that's a bummer. I think the point of the "we have no moat…
We already knew it's possible from AI minecraft ( https://oasis.decart.ai ). This is just a more impressive version of that, trained on a wider range of games and with more context frames (Oasis has about a second of context, this one a minute). Even the architecture seems to be about the same. Had they released this two months earlier it would have been incredibly impressive. Now it's still cool and inspiring, but n…
Do you want household androids? Because this kind of stuff is on the level of research a bery large step towards that. Think as it as ab example where we can make a model understand a lot of physical common sense stuff, which is the goal for robotics right now.
I don't understand how that is relevant. I certainly would not want household androids unless I'm completely disabled.
No trolling: You wouldn't want robots to mow your lawn, maybe do the boring bits of cooking (prep! endless stirring!), clean your house, wash your clothes? Man, sign me up!
One cool use case for this could be "generative hybrid video meetings"; when I participate in a teams meeting and the majority is in the same physical room, the video conference software could read the wall camera video feed and generate individual video streams of each person as if they sat just in front of me.
Of all things this must be the most boring use case for this crazy looking new technology. But hybrid video meetings have always annoyed me and I think to myself that surely there must be a better way (and why hasn't it arrived yet?).
Genuine question: What is the point of telling us about this if we can’t use it? Is it just to flex on everyone?
[flagged]
Why is this downvoted and flagged? I am laughing so hard at the second sentence, that I am on the verge of tears. Nothing has made me laugh so hard in a while. This part really did it for me: