Live data from Hacker News

Rendering a game in real time with AI

blog.jeffschomay.com

111–115 of 115 posts

Re: Rendering a game in real time with AI

#111
post #21
post #20

This is a pre-cursor to a dystopian future where reality will be a game generated in realtime at 60 FPS and streamed to your brain over Neuralink.

Some people on HN will surely cheer for it, it's the peak of efficiency, you don't even have to move anymore!

Yup, only the 2nd or 3rd most common trope of cyberpunk dystopias. We clearly just want the world to end at this point.

Re: Rendering a game in real time with AI

#112
post #30

I do not get the point of this at all, why not just generate game assets and run them in an engine? With this format there would be no regularity that the thing you saw before will look the same (and that is not a fixable problem). Actually figuring out and improving AI approaches for generating consistent and decent quality game assets is actually something that will be useful, this I have no idea the point of past…

hack, learn and have fun, that's it.

What are we learning here, and are we still bound by ethics?

Re: Rendering a game in real time with AI

#113

I do not get the point of this at all, why not just generate game assets and run them in an engine? With this format there would be no regularity that the thing you saw before will look the same (and that is not a fixable problem). Actually figuring out and improving AI approaches for generating consistent and decent quality game assets is actually something that will be useful, this I have no idea the point of past…

The tech will improve to far exceed the capabilities of a game engine. Real time improvisation and infinite choices, scope, etc. It makes no sense when people say AI can't do this or that. It will do it next week.

I'm a game engine programmer and part of my job is to figure how how to "do it next week". I don't see it happening with the we we use LLM's right now. We don't have time to push data to a cloud and come back and render a scene, we have 16ms per frame on most projects (maybe 33 if you are doing something cinematic).

You're gonna have to break the light barrier before thinking about how to do real time Ai rendering at this rate.

Re: Rendering a game in real time with AI

#114

Earlier quoted context omitted.

The tech will improve to far exceed the capabilities of a game engine. Real time improvisation and infinite choices, scope, etc. It makes no sense when people say AI can't do this or that. It will do it next week.

Having spent 20 years making game engines and the past 4 years playing with AI image gen, I believe you are right. There have been musings for a while now that 3D rendering is going to switch from “lay down the scene’s albedo & specular parameters then do the lighting pass” to “lay down the scene’s latent parameters and then do the diffusion pass”. Recently, the advances in “real time AI world models” have been comin…

>It’s not going to happen this week. But, in 5 years? Somebody’s gonna pull it off.

in a tech demo, sure. In a real product? I doubt it. We have neat tech demos from 20 years ago that amounted to not much, because implementing it in a real business product was unviable, unweildy, or didn't meet standards.

There's a lot to get away with with demos. Not so much in a product you want to sell. Much less so for a deluxe product with a bunch of competition like games.

Re: Rendering a game in real time with AI

#115
post #86

Earlier quoted context omitted.

Really interesting perspective honestly, I legitimately have no issue with machine learning being used as a tool, like all technology it has benefits! It’s when it’s used as a replacement for creativity that really gets to me.

Having spent a lot of time talking to engineers working on AI tools, I find the idea that AI is intended to replace creativity comes entirely from internet comment sections and not from the engineers working on AI.

The engineers working on AI should speak up, then. To say that the barrel is rotten is an understatement; it's more like a bunch of rotten apples and you're trying to find the one good one.

That's why the conversation feels more like the NFT boom. MAYBE it had merit, but it didn't matter

Post reply on HN