Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Gaussian Splat of a Strawberry

superspl.at

Post reply on HN
Print view View original

121–130 of 211 posts

Re: Show HN: Gaussian Splat of a Strawberry

#121

Post by kridsdale1 »

dudefeliciano wrote: post #68
sbarre wrote: post #62

Looking at all the outdoor scenes that you can walk around, I wonder how long until we start seeing this in places like Google Maps/Earth, as a replacement for the low-res 3D renderings we have now. I guess the number of samples required to generate a GS is the constraint now, but maybe that will get solved.

rendering them is also non trivial from what i understand, since the millions of indivudal point positions need to be recalculated all the time while moving

Turns out, GPUs are amazing at this.

Re: Show HN: Gaussian Splat of a Strawberry

#122

Post by danybittel »

RobotToaster wrote: post #109
Centigonal wrote: post #95

This is like a beautiful little miniature. It's cool to see gaussian splatting applied to a detailed small thing versus a big scene. I have a question about perhaps the most boring aspect of this strawberry: the license. you write, "You can download it under CC BY license, but attribution is appreciated rather than required." IANAL, but I'm pretty sure you can't license your work CC-BY and then waive the BY requireme…

I'm pretty sure it's allowed, just as saying "do what you want with it" is an informal license, it's just a little pointless.

That's what I thought too.. supersplat has no way to set it to CC0 otherwise.

Re: Show HN: Gaussian Splat of a Strawberry

#123

Post by thrownthatway »

divan wrote: post #115

Does anyone know if it's already possible to build gaussian splat of the person that moves/rotates from the single camera? (I.e. to use sequence of frames to reconstruct occluded parts of the body for other frames)

I watched this 1 month old video two days ago:

https://youtu.be/X8yRlA7jqEQ

It kinda splatted my mind.

As I understand it, Gussian Splats aren’t a method of constructing missing data in the sense you’re asking here.

But there are other, well established, methods of generating missing data in convincing manner, that are beyond my field of expertise or interest to be able to repeat here.

With the added benefit that if I’m wrong, being wrong can be a great way to spur discussion 8)

Re: Show HN: Gaussian Splat of a Strawberry

#124

Post by cubefox »

lopsotronic wrote: post #103
data-ottawa wrote: post #80

Earlier quoted context omitted.

It’s amazing this runs perfectly smooth on my iPhone 12 mini That is indeed a very cool scene being about to wander around and still have decent resolution

Ah the timeless joy of falling through the floor geometry. Seriously though - it's breathtaking. The first guy who figures out the bridge between splats and dynamism - animation, editing, responsiveness - is going to be one of the immortals of 3d design.

There are many ways to represent 3D data, but animations really only work properly with polygon meshes (e.g. triangle surface meshes or volumetric tetrahedral meshes).

Re: Show HN: Gaussian Splat of a Strawberry

#125

Post by satvikpendem »

Lerc wrote: post #104
MattCruikshank wrote: post #88

I know feelings about AI are mixed. But when AI can dream up gaussian splats in real time, from a prompt, and do refinement as you get closer to things... That's going to be pretty bonkers.

This will be the future of a class of 3d Game. the prompt may not be text however. An input of a kind of schematic representation of what the designer wants would be better. It may resemble a storyboard or a collection of organised notes that large projects tend to already use. Fully generative could probably do some cool things, but people will still want to bring their peronal vision to life.

Curious, why wouldn't the future be a full world model like Google's Genie? It just renders every pixel so someone could still make their vision come to life via a prompt too.

Re: Show HN: Gaussian Splat of a Strawberry

#126

Post by thrownthatway »

cubefox wrote: post #114
perching_aix wrote: post #92

Earlier quoted context omitted.

That's kinda what NERFs are (neural radience fields). They actually preceeded this Gaussian story, with Gaussians coming in and outperforming them. Maybe they'll merge later for something even better, I don't know enough about them.

NERFs have significantly higher image quality than 3D Gaussian Splatting or more recent similar techniques, though they are much slower to render.

This one month old video did a reasonable job of getting my entirely ignorant self relatively up to day on NERFs and Gaussian Splats:

https://youtu.be/X8yRlA7jqEQ

Re: Show HN: Gaussian Splat of a Strawberry

#127

Post by danybittel »

MattCruikshank wrote: post #98
galsapir wrote: post #5

From the link: "Shot from 90 perspectives, 88 focus stacked images each. Nikon Z8, full frame, f/7.1, exposure 1/160, ISO 100, Laowa 180mm macro lens, with LED light and bluescreen." Insane!

Where's the Lytro camera when you need one? I was really pulling for OTOY to keep making light field capture and display technology...

There is actually still a Lytro type camera for industrial application available: https://raytrix.de/ Too low res, too expensive for my use case unfortunately.

Re: Show HN: Gaussian Splat of a Strawberry

#128

Post by hamburglar »

lightedman wrote: post #112

A Youtuber that records jookin (a mid-South form of dance) uses Gaussian splats for his videos to bring the dancers out into the forefront and hold center stage, it's a neat trick. https://www.youtube.com/watch?v=k0MGoFaIiWs - WARNING - heavily adult lyrics and a loud starting "MOTHERFU*AAAAAAS" right off the top.

What makes you say this is using Gaussian splats? It looks like simple motion-based cropping to me.

Re: Show HN: Gaussian Splat of a Strawberry

#129

Post by evan_ »

lightedman wrote: post #112

A Youtuber that records jookin (a mid-South form of dance) uses Gaussian splats for his videos to bring the dancers out into the forefront and hold center stage, it's a neat trick. https://www.youtube.com/watch?v=k0MGoFaIiWs - WARNING - heavily adult lyrics and a loud starting "MOTHERFU*AAAAAAS" right off the top.

That doesn’t really look like Gaussian splats to me- but this video, Helicopters by A$AP Rocky, uses the technique well:

https://youtu.be/g1-46Nu3HxQ?si=y_u257DzgOg2QV83

Re: Show HN: Gaussian Splat of a Strawberry

#130

Post by db48x »

0xWTF wrote: post #106

How did they decide what the inside of the strawberry looks like? Because that seems very incorrect.

The flesh of the strawberry is very slightly translucent. By taking images from many angles, you can derive some information about the interior. This is not a separate step, it is simply the optimizer finding splats that contribute the right amount of color and light at various viewing angles. Of course those splats aren’t really going to look right to anyone who has ever eaten a strawberry, because they are only derived from the input images and not your past memories of a real strawberry.

You’ll also see the same type of problems in any incomplete part of any scene. Go poke around any of them and you’ll find places where there wasn’t enough information to make a satisfying reconstruction. For example, the back of the moon https://superspl.at/scene/2ac8f423>, the fridge in the coffee shop https://superspl.at/scene/6a0c3ccf>, underneath the footbridge in the forest https://superspl.at/scene/23ebe85c> (or indeed anything in the distance), etc, etc.

Post reply on HN