Localrf – Nerf from casual shaky videos
localrf.github.io
Localrf – Nerf from casual shaky videos
1–10 of 31 posts
Re: Localrf – Nerf from casual shaky videos
#2Related: "Nerfies: Deformable Neural Radiance Fields"
AKA: Selfie nerfs from hand-held phone camera selfie vids.
Re: Localrf – Nerf from casual shaky videos
#3Incredible future VR use-case for all the hours of useless video footage in my archives.
Re: Localrf – Nerf from casual shaky videos
#4Is this better than what was previously achievable using classical structure from motion? It seems worse because of extreme detail loss?
And if they're just plotting a smoothed but similar path through the scenery, didn't Microsoft do that in 2014 with Hyperlapse?
Re: Localrf – Nerf from casual shaky videos
#5My grandmother's farm had to be sold in 2012 after she died. Since my family moved around when I was a kid, but always visited there for holidays, it felt more like home than any other place I lived in. I have extensive videos I recorded in 2006. It'd be wonderful to walk through there again using reconstructions from material I already have.
Or maybe not. There's a reason I haven't watched those videos in years. Who wants to remember the garden of Eden when you know you can't go back?
Re: Localrf – Nerf from casual shaky videos
#6Is this better than what was previously achievable using classical structure from motion? It seems worse because of extreme detail loss? And if they're just plotting a smoothed but similar path through the scenery, didn't Microsoft do that in 2014 with Hyperlapse?
The renderings look a lot prettier but the 3D structure seems not really good.
Most nerfs use classical bundle adjustment (eg Colmap) as an initialization but this one does not, and the authors mention that they leave bundle adjustment for future work.
Re: Localrf – Nerf from casual shaky videos
#7FYI: Under the "Video Comparisons" section, those two little "Sequence" and "Method" buttons are actually dropdowns.
Re: Localrf – Nerf from casual shaky videos
#8nice
edit: is this process public? how can i test and try this? on kdenlive?
edit 2: https://github.com/facebookresearch/localrf
got it but when will it be implemented by kdenlive? any dev here?
Re: Localrf – Nerf from casual shaky videos
#9My grandmother's farm had to be sold in 2012 after she died. Since my family moved around when I was a kid, but always visited there for holidays, it felt more like home than any other place I lived in. I have extensive videos I recorded in 2006. It'd be wonderful to walk through there again using reconstructions from material I already have. Or maybe not. There's a reason I haven't watched those videos in years. Who…
When you're young there's often nothing to look forward to but the future, so why revisit the past?
When you're old, your health is failing, and there's no future to look forward to, you're gonna want to look back in time -- maybe remember the better days of your youth.
Re: Localrf – Nerf from casual shaky videos
#10nice edit: is this process public? how can i test and try this? on kdenlive? edit 2: https://github.com/facebookresearch/localrf got it but when will it be implemented by kdenlive? any dev here?
> got it but when will it be implemented by kdenlive? any dev here?
I hate to be that person but https://kdenlive.org/en/developers-welcome/
This is research work. I don't suspect anyone currently has any plans to implement something like this into kdenlive.