11–14 of 14 posts
I'm entirely unfamiliar with this, but is there a future where we can take a few pictures of something physical, and have AI generate a 3d model that we can then modify and 3d print? Asking as someone who's dreadfully slow at 3d modeling.
https://blogs.nvidia.com/blog/2022/09/23/3d-generative-ai-re...
https://research.nvidia.com/publication/2021-11_extracting-t...
>> In order to maximize the reproducibility of our results, we provide code in JAX (Bradbury et al., 2018) for our proposed X-UNet neural architecture from Section 2.3 Nice. OpenAI shitting their pants even more.
Oh, OpenAI does more or less release that much. People don't have issues implementing the models from their papers. What they don't do is release the actual models and datasets, and it's very expensive to retrain those.
They also release Whisper model and code[2]
This approach is interesting in that it applies image-to-image diffusion modeling to autoregressively generate 3D consistent novel views, starting with even a single reference 2D image. Unlike some other approaches, a NeRF is not needed as an intermediate representation.
In DreamFusion they do use a NeRF representation.
btw I like how it hallucinated bumper carrier mounted Spare Wheel based on the size of tires, heavy duty roof rack and bull bars while ground truth render was in a much less likely configuration of stock undercarriage frame hanger/no spare.