This blows my mind. This is probably a naive thought; This technique looks like it could be combined with robotics to help it navigate through its environment. I'd also like to see what it does when you give it multiple views of scenes in a video game. Some from the direct pictures and some from pictures of the monitor.
NeRF: Representing scenes as neural radiance fields for view synthesis
31–40 of 43 posts
Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#32I would like to see “neural enhances” an already rendered 3D scene with the changes which would make it more realistic, given depth map and other information to the neural network
Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#33Earlier quoted context omitted.
Huh, what? It needs almost a million views, and takes 1-2 days to train on a GPU. I’m not sure where the “5 minutes” number comes from. EDIT: I was referring to the last paragraph of section 5.3 (Implementation details), but maybe I’m misunderstanding how they use rays / sampled coordinates. Very impressive visual quality. But it seems like they need a LOT of data and computation for each scene. So, its still plausib…
> It needs almost a million views Not sure what you mean by "views". The comparisons in the paper use at most 100 input images per scene.
Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#34This blows my mind. This is probably a naive thought; This technique looks like it could be combined with robotics to help it navigate through its environment. I'd also like to see what it does when you give it multiple views of scenes in a video game. Some from the direct pictures and some from pictures of the monitor.
Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#35Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#36This blows my mind. This is probably a naive thought; This technique looks like it could be combined with robotics to help it navigate through its environment. I'd also like to see what it does when you give it multiple views of scenes in a video game. Some from the direct pictures and some from pictures of the monitor.
It takes 12 hours on a high end GPU to make one frame.
Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#37Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#38Earlier quoted context omitted.
It takes 12 hours on a high end GPU to make one frame.
No, as appendix A of the paper states, each frame takes about 30 seconds to render.
Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#39Re: NeRF: Representing scenes as neural radiance fields for view synthesis
#40This blows my mind. This is probably a naive thought; This technique looks like it could be combined with robotics to help it navigate through its environment. I'd also like to see what it does when you give it multiple views of scenes in a video game. Some from the direct pictures and some from pictures of the monitor.
They've only showed it working with static content - they'll need to do it with video (multiple synchronised cameras) and in real time for ant robotics application.