Live data from Hacker News

Show HN: Gaussian Splat of a Strawberry

superspl.at

151–160 of 211 posts

Re: Show HN: Gaussian Splat of a Strawberry

#151
post #39

Beautiful. What I love about gaussian splats is the way they degrade - instead of a hard cutoff or LoD changing spheres into cubes etc., they get increasingly "dreamy" - the basic idea is still there, just less detailed. Take for example this scene: https://superspl.at/scene/e721ea7c If you navigate closer to the trees, things around you become blurry - as if the very fabric of reality unraveled.

They remind me a lot of the 'memories' scene in Minority Report:

https://www.youtube.com/watch?v=arTIRgdEb1g

Re: Show HN: Gaussian Splat of a Strawberry

#152
post #142

Earlier quoted context omitted.

It's an artefact unfortunately. Gaussian splats have no concept of refraction and have a hard time dealing with reflection. Highlights, usually so so. Something I always wrangle.

I wonder if that is somehow related to how you seem to have very strong studio light for the subjects? Somehow the bright light penetrating deeper into the material or something like that

The light doesn't need to be completely flat like what you'd do when scanning it more traditionally, for meshing. The problem is when the highlight is sharp and reflects it's surrounding. You could remove it, with cross polarization.. But then it wouldn't look realistic anymore.

Re: Show HN: Gaussian Splat of a Strawberry

#153

Noting the permissive license, could we be witnessing the birth of a new Utah teapot or Sponza atrium?

Oh, that would be amazing! The photos are also available and some people definitely take it for a test ride. However.. This dataset with the stacking is far from generic.

Re: Show HN: Gaussian Splat of a Strawberry

#156
post #105

Also interesting: https://github.com/apple/ml-sharp Apples model to generate Gaussian splats from a single image. Takes about 30 seconds on an M1 Pro. It falls apart once you move too much, but for a little side-wiggling or a second-eye view for VR, it's great. And looks a lot better than the old approach of depth map + vertex shaders that I use in https://github.com/combatwombat/tiefling . But ml-sharp has 2.6 GB we…

Any idea what kind of vram is needed to run this on Nvidia?

The smallest Nvidia gpu I've run Sharp on is an Nvidia T4 which I think has 16 GB on the chip

Re: Show HN: Gaussian Splat of a Strawberry

#157
post #150

Earlier quoted context omitted.

What would this look like in practice? A net that outputs weights for a new net to use?

Couldn’t you “uncurry” such a process to have only a single network?

Probably? I'm no expert, just a SysAdmin trying to keep up really... but in my head it's would look like a form of MoE that would gen the 'Expert' model on demand instead of having a variety baked in.

That's assuming you could even reasonably train a neural net to output viable weights, of course.

Re: Show HN: Gaussian Splat of a Strawberry

#158

For those unfamiliar with Gaussian Splatting: https://en.wikipedia.org/wiki/Gaussian_splatting >. (I'm ... still not sure what I'm looking at on TFA, and whether or not my browser configuration fails to fully present the site as intended.... OK, if all you're seeing is a blurred image of a strawberry, yes, you'll want to enable a bunch of JS resources. I'm using uMatrix, several hosts must be enabled.)

I like to think of Gaussian Splatting as a stage full of improv actors who are iteratively/concurrently filling details in regions down to pixels until the full picture is painted.
Post reply on HN