Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Gaussian Splat of a Strawberry

superspl.at

Post reply on HN
Print view View original

51–60 of 211 posts

Re: Show HN: Gaussian Splat of a Strawberry

#55

Post by idoco »

ImJasonH wrote: post #48

I'm really interested to see what folks can do with animated Gaussian splats: https://youtu.be/X8yRlA7jqEQ?si=dXeHa03jO7MTBNLA The filesize of a 3d animated splat is seemingly very small, and the method enables ~arbitrary FPS. But it seems the setup required to record it is still huge and expensive, which limits its usefulness. Even with that there are some interesting use cases, eg. I'd love to be able to watch conc…

Great video. I was about to share it here myself.

Re: Show HN: Gaussian Splat of a Strawberry

#57

Post by vanderZwan »

evrimoztamur wrote: post #53

There is a faint sensation of translucency, I wonder if that's an artefact of the process, or if it's the actual optics of the surface layer if the strawberry...

Well, at certain angles you actually get very noticeable gaps in the strawberry that are visible when rotating it, but almost invisible when static. I think it's mostly due to that.

Re: Show HN: Gaussian Splat of a Strawberry

#58

Post by zokier »

KeplerBoy wrote: post #46
zokier wrote: post #31

My intuition is that in theory focus stacking should not be necessary as preprocessing step for 3dgs (or photogrammetry). Does anyone know if there is any recent developments in this regard? Focus stacking generally is not perfect process and can lead to artifacts/errors and I'd imagine those can then compound when stacked images are used for 3dgs. Also the image focus actually provides some depth data in itself that…

If you don't focus stack and try to train on partially unfocused images, the optimizer will try to match the rendered view to be also partially unfocused. You would have to mask out the blurry areas for each image. I guess one could just implement a feature where the optimizer only optimizes gaussians within the sharp distances relative to the camera.

Other way of looking at the question is if you could make focus stacking better by using the full multi-view dataset? Afaik focus stacking essentially does depth estimation so it seems like multiple views would help with that.

Another way would be some kind of 4d GS where one dimension is the focus distance. But I'd guess the renders would inherently have shallow depth then, which is less useful usually.

Re: Show HN: Gaussian Splat of a Strawberry

#60

Post by jaccola »

KeplerBoy wrote: post #44
jaccola wrote: post #43

Earlier quoted context omitted.

Lots of translucent blobs composited to produce the appearance of a strawberry. There is no mesh or model. The visual surface of the strawberry could be made up of blobs spaced far apart physically and not where the surface appears to be. This is why they are called radiance fields, they model the light not the geometry. Practically the blobs positions/rotations can be constrained to better physically match the geome…

I'm not sure i agree. The blobs are exactly where the surface appear to be because they are constrained by multiple viewing angles. Otherwise the splat would fall apart as soon as the viewing angle is changed slightly (Which it absolutely does in many examples on supersplat, you cannot really create an out of distribution view with 3GS, it's not magic)

Yes, my statement was loose. The blob doesn’t really have a position since it is theoretically an infinite distribution in 3 space.

It has a mean, and that mean doesn’t have to lie on the surface, consider the case where the mean is deep inside the strawberry but its spike contributes to the surface appearance (e.g a seed could be represented this way, or it could be represented by a small well-oriented blob on the surface, the optimiser doesn’t care)

Post reply on HN