Live data from Hacker News

Show HN: Gaussian Splat of a Strawberry

superspl.at

61–70 of 211 posts

Re: Show HN: Gaussian Splat of a Strawberry

#61

There is a faint sensation of translucency, I wonder if that's an artefact of the process, or if it's the actual optics of the surface layer if the strawberry...

It's an artefact unfortunately. Gaussian splats have no concept of refraction and have a hard time dealing with reflection. Highlights, usually so so. Something I always wrangle.

Re: Show HN: Gaussian Splat of a Strawberry

#62
Looking at all the outdoor scenes that you can walk around, I wonder how long until we start seeing this in places like Google Maps/Earth, as a replacement for the low-res 3D renderings we have now.

I guess the number of samples required to generate a GS is the constraint now, but maybe that will get solved.

Re: Show HN: Gaussian Splat of a Strawberry

#65
post #37

I read [1], but I still don't quite know what I'm looking at. My guess is a 3D model reconstructed from lots of detailed pictures? [1] https://en.wikipedia.org/wiki/Gaussian_splatting

Here’s a good 2 minute explainer https://youtu.be/HVv_IQKlafQ

Re: Show HN: Gaussian Splat of a Strawberry

#66
post #31

My intuition is that in theory focus stacking should not be necessary as preprocessing step for 3dgs (or photogrammetry). Does anyone know if there is any recent developments in this regard? Focus stacking generally is not perfect process and can lead to artifacts/errors and I'd imagine those can then compound when stacked images are used for 3dgs. Also the image focus actually provides some depth data in itself that…

This is an interesting question. There has been some attempt to model the camera better than just a pinhole camera, that could work. https://dof-gaussian.github.io/ https://github.com/leoShen917/DoF-Gaussian

My take.. at a macro scale, the dof is usually so small, that it's hard to get a reliably track. So you'd need some sort of way to tell that these stacked photos belong into a series, and then you sort of are doing focus stacking :-) I do think the alignment algorithm could be improved. Maybe the approaches I linked could be used to make a much more robust focus stacking algorithm, that also corrects for 3D geometry. That would be really cool!

Re: Show HN: Gaussian Splat of a Strawberry

#68
post #62

Looking at all the outdoor scenes that you can walk around, I wonder how long until we start seeing this in places like Google Maps/Earth, as a replacement for the low-res 3D renderings we have now. I guess the number of samples required to generate a GS is the constraint now, but maybe that will get solved.

rendering them is also non trivial from what i understand, since the millions of indivudal point positions need to be recalculated all the time while moving

Re: Show HN: Gaussian Splat of a Strawberry

#70
For those unfamiliar with Gaussian Splatting: https://en.wikipedia.org/wiki/Gaussian_splatting>.

(I'm ... still not sure what I'm looking at on TFA, and whether or not my browser configuration fails to fully present the site as intended.... OK, if all you're seeing is a blurred image of a strawberry, yes, you'll want to enable a bunch of JS resources. I'm using uMatrix, several hosts must be enabled.)

Post reply on HN