Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
1–10 of 20 posts
Re: Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
#2Hoping for the day this technology makes it into gaming. Looks incredible.
Re: Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
#3Hoping for the day this technology makes it into gaming. Looks incredible.
My thoughts exactly. This is the future - both realistic and lazy (as a scene can simply be described to a proompt).
Re: Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
#4Hoping for the day this technology makes it into gaming. Looks incredible.
My thoughts exactly. This is the future - both realistic and lazy (as a scene can simply be described to a proompt).
To clarify for people who don't follow NeRF techniques, this research is not prompt based. The algorithm is capturing the 3d scene from real life images. There is some super promising work in mixing NeRF based techniques with various generative models to create 3d objects from prompts but it doesn't seem close to creating anything of this kind of scale / detail yet. I do agree this is a future possibility though.
Re: Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
#5Hoping for the day this technology makes it into gaming. Looks incredible.
The problem for gaming is, these scenes are completely static.
Re: Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
#6Project page: https://jonbarron.info/zipnerf/
Re: Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
#7Re: Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
#8Earlier quoted context omitted.
The problem for gaming is, these scenes are completely static.
True but even for static areas and backgrounds I feel like this detail and fidelity blows away what is used in current AAA games.
I think a bigger problem is how much computational resources NERF models need. From the paper,
"Our model, Mip-NeRF 360, and our 'mip-NeRF 360 + iNGP' baseline were all trained on 8 NVIDIA Tesla V100-SXM2-16GB GPUs."
Even with all that, it takes almost an hour to train. A developer would need to do this for every scene, which may make it unfeasible for indies, those who would benefit the most from NERF in gaming.
Re: Zip-NeRF: Anti-aliased grid-based neural radiance fields [video]
#9Earlier quoted context omitted.
True but even for static areas and backgrounds I feel like this detail and fidelity blows away what is used in current AAA games.
I think a bigger problem is how much computational resources NERF models need. From the paper, "Our model, Mip-NeRF 360, and our 'mip-NeRF 360 + iNGP' baseline were all trained on 8 NVIDIA Tesla V100-SXM2-16GB GPUs." Even with all that, it takes almost an hour to train. A developer would need to do this for every scene, which may make it unfeasible for indies, those who would benefit the most from NERF in gaming.
The better question is how many person hours would it take to model a scene like that with alternative approaches, and can a NeRF be used to create outputs that could be used in a game engine?