201–208 of 208 posts
Earlier quoted context omitted.
Progress often happens in waves. There will be a trough again.
AI might be different - as has been predicted for many years now - due to the compounding effects on intelligence.
I'm also not sure someone couldn't cleverly figure out a way to use stable diffusion to write code based on a text prompt.
As someone who dabbles in 3d modeling, this is going to be an incredible resource for creating static 3d objects. Someone ought to come up with a way to convert to mesh better than the Marching Cubes algorithm I've seen applied to most NERFs. The models still lack coherent topology and would probably be janky if fully rigged.
Is there code for any of these models? Or a collab? Ajay Jain's colab doesn't work, but I would love to see a colab for this.
The most incredible thing here is that this demonstrates a level of 3D understanding that I didn't believe existed in 2D image models yet. All of the 3D information in the output was inferred from the training set, which is exclusively uncurated and unsorted 2D still images. No 3D models, no camera parameters, no depth maps. No information about picture content other than a text label (scraped from the web and often…
Earlier quoted context omitted.
Maybe because you said "Metaverse" (and to some extent "VR") making it sound like sci-fi nonsense. You could have just said: How long then until we get photorealistic AI generated 3D games and experiences?
3D game and VR game (i.e. stereoscopic 3D game) is not the same experience. But I agree that particular company is creating a bad marketing around the term Metaverse. (But pretty decent HW.) NVIDIA has much better footing with their Omniverse. But in the end, we all know the thing will be build as web browsers are today. USD + JS + WebRTC + WebXR can go a long way.
Earlier quoted context omitted.
The model clearly has an understanding of the 3D structure of objects. If it didn't, using it to generate 3D models wouldn't work. The knowledge that the leg bone is connected to the knee bone, etc, isn't coming from NeRF, it's all in the "2D" model. Sure, maybe you could distill that knowledge into a different model architecture that is somehow natively 3D in order to improve the efficiency of sampling. But that's m…
>The model clearly has an understanding of the 3D structure of objects. And the submarine clearly can swim! :D The model encompasses 3D information, but a model is not a thinking entity able to understand anything. Well, it might be argued that saying that the "model understands" is a metaphor, and used as such OK, fine. But that’s it. Analogies rarely scale well. As for humans, have you ever heard of proprioception?…
A machine with 3d understanding from 2d samples predates computers
Is there code for any of these models? Or a collab? Ajay Jain's colab doesn't work, but I would love to see a colab for this.
Hi @sirianth, this is Ajay. Are you talking about the https://ajayj.com/dreamfields colab? Feel free to dm me on Twitter (@ajayj_) or email me if you're facing bugs. Dependencies keep shifting, really should have pinned versions originally...