91–100 of 171 posts
If there's one thing I've always wanted, it's shitty video knockoffs of real life. Can't wait to stream some AI hallucinations.
I know its a delicate topic people (especially in the US) don't want to speak about at all, but damn, this is a giant market and could do humanity good if done well.
I am a newbie to this area. Honest questions: Is this generating videos as streaming content e.g. like a mp4 video. As far as I can see, it is doing that. Is it possible for AI to actually produce the 3d models? What kind of compute resources are required to produce the 3d models.
https://twitter.com/BenMildenhall/status/1758224827788468722
https://twitter.com/ScottieFoxTTV/status/1758272455603327455
The key is that the video has spatial consistency. Once you've got that, then other existing tech can take the output and infer actual spatial forms.
Earlier quoted context omitted.
I’ve been dying for someone to make a Civilization AI. It might not be too crazy of an idea - would love to see a model fine-tuned on sequences of moves. The biggest limitation of video game AI currently is not theory, but hardware. Once home compute doubles a few more times, we’ll all be running GPT-4 locally and a competent Civilization AI starts to look realistic.
I am 100% certain that the training of such an AI will result in winning a game without ever building a single city* and 1,000 other exploits before being nerfbatted enough to play a 'real' game. (That doesn't mean I don't want to see the ridiculousness it comes up with!) * https://www.youtube.com/watch?v=6CZEEvZqJC0
That guy is a genius at finding exploits in computer games. I don't know how he does it, I think you need to play a fair bit of each game before you find these little corners of the ruleset.
I think people might be missing what this enables. It can make plausible continuations of video, with realistic physics. What happens if this gets fast enough to work _in real time_. Connect this to a robot that has a real time camera feed. Have it constantly generate potential future continuations of the feed that it's getting -- maybe more than one. You have an autonomous robot building a real time model of the wor…
What I find interesting is that b/c we have so much video data, we have this thing that can project the future in 2d pixel space. Projecting into the future in 3d world space is actually what the endgame for robotics is and I imagine depending on how complex that 3d world model is, a working model for projecting into 3d space could be waaaaaay smaller. It's just that the equivalent data is not as easily available on…
Okay, The Matrix can't be too far away now.
Maybe this says more about me than about the technology, but I found the consistency of the Minecraft simulation super impressive.
Presumably, this would work for non-minecraft applications, but Minecraft has a really standardized interface layer
I find it wild that this model does not have explicit 3D prior, yet learns to generate videos with such 3D consistency, you can directly train a 3D representation (NeRF-like) from those videos: https://twitter.com/BenMildenhall/status/1758224827788468722
It is impressive at a glance, but if you pay attention, it is more like dreaming than realism (images conjured out of other images, without attention to long term temporal, spatial, and causal consistency). I'm hardly more impressed that Google's deep dream, which is 10 years old.