This is very impressive but given its by Google, will some code ever be released?
SMERF: Streamable Memory Efficient Radiance Fields
71–80 of 152 posts
Re: SMERF: Streamable Memory Efficient Radiance Fields
#72Very impressive! Any information on how this compares to 3D Gaussian splatting in terms of performance, quality or data size?
Re: SMERF: Streamable Memory Efficient Radiance Fields
#73Does the an open source toolchain exist for capturing, processing, and hosting navigable 3D walkthroughs like this (e.g. something like an open-source Matterport)?
Re: SMERF: Streamable Memory Efficient Radiance Fields
#74How long until you can stitch Street View into a seamless streaming NeRF of every street in the world? I hope that's the goal you're working towards!
Not every street yet: https://waymo.com/research/block-nerf/
Re: SMERF: Streamable Memory Efficient Radiance Fields
#75Amazing, impressive, almost unbelievable :O
Re: SMERF: Streamable Memory Efficient Radiance Fields
#76[dead]
Re: SMERF: Streamable Memory Efficient Radiance Fields
#77Does the an open source toolchain exist for capturing, processing, and hosting navigable 3D walkthroughs like this (e.g. something like an open-source Matterport)?
Not yet, as far as I'm aware. The current flow involves a DSLR for capture, COLMAP for camera parameter estimation, one codebase for training a teacher model, our codebase for training SMERF, and our web viewer for rendering models.
Sounds like an opportunity!
Re: SMERF: Streamable Memory Efficient Radiance Fields
#78Very impressive! Any information on how this compares to 3D Gaussian splatting in terms of performance, quality or data size?
All these details and more in our technical paper! In short: SMERF training takes much longer, SMERF rendering is nearly as fast as 3DGS when a CUDA GPU is available, and quality is visibly higher than 3DGS on large scenes and slightly higher on smaller scenes.
Re: SMERF: Streamable Memory Efficient Radiance Fields
#79Amazing, impressive, almost unbelievable :O
Thank you!
Re: SMERF: Streamable Memory Efficient Radiance Fields
#80What kind of modes does the viewer cycle through when I press the space key?
Nice discovery :). Check the developer console: it'll tell you.