81–90 of 152 posts
There is a market here for Realtors to upload pictures and produce walk-throughs of homes for sale.
The Luma folks made something similar: https://apps.apple.com/app/luma-flythroughs/id6450376609?l=e...
>Google DeepMind Google Research Google Inc. What a variety of groups! How did this come about?
Earlier quoted context omitted.
The pretrained models are already available online! Check out the "demo" section of the website. Your browser is fetching the model when you run the demo.
Will the code be released, or an API endpoint? Otherwise it will be impossible for us to use it for anything.. since it's Google I assume it will just end up in a black hole like most of the research.. or five years later some AI researchers leave and finally create a startup.
Im not sure why this demo runs so horribly in Firefox but not other browsers..anyone else having this?
In the meantime, give it a shot in a Webkit- or Chromium-based browser. I've had good results on Safari on iPhone, Chrome on Android/Macbook/Windows.
Hope this doesn't come as snarky, but does Google pressure researchers to do PR in their papers? This really is cool, but there is a lot of self-promotion in this paper and very little discussion of limitations (and the discussion of them is bookended by qualifications why they really aren't limitations). It makes it harder for me to trust the paper if I feel like the paper is trying to persuade me of something rathe…
By no means do I claim that SMERF is the be-all-end-all in real-time rendering, but I do believe it's a sold step in the right direction. There are all kinds of ways to improve this work and others in the field: smaller representation sizes, faster training, higher quality, and fewer input images would all make this technology more accessible.
Does the an open source toolchain exist for capturing, processing, and hosting navigable 3D walkthroughs like this (e.g. something like an open-source Matterport)?
Is there any relation between this class of rendering techniques and the way the BD scenes in Cyberpunk 2077 were created? The behavior of the volume and the "voxels" seem eerily similar.
Is there any relation between this class of rendering techniques and the way the BD scenes in Cyberpunk 2077 were created? The behavior of the volume and the "voxels" seem eerily similar.
I can't say. I'm not familiar with BD in Cyberpunk.
It's a sort of replayable cutscene that happens a couple times in the game where you can wander through it. The noteworthy bit is it's rendered out of voxels that look very similar to the demos but at a much lower resolution and if you push the frustrum into any objects, you get the same kind of effect where the surface breaks into blocks.
This is __really__ stunning work, huge, huge, deal that I'm seeing this in a web browser on my phone. Congratulations! When I look at the NYC scene in the highest quality on desktop, I'm surprised by how low-quality ex. the stuff on the counter and shelves is. So then I load the lego model, and see that's _very_ detailed, so it doesn't seem inherent to the method. Is it a consequence of input photo quality, or someth…
> This is __really__ stunning work Thank you :) > Is it a consequence of input photo quality, or something else? It's more a consequence of spatial resolution: the bigger the space, the more voxels you need to maintain a fixed resolution (e.g. 1 mm^3). At some point, we have to give up spatial resolution to represent larger scenes. A second limitation is the teacher model we're distilling. Zip-NeRF ( https://jonbarro…