Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Gaussian Splat of a Strawberry

superspl.at

Post reply on HN
Print view View original

181–190 of 211 posts

Re: Show HN: Gaussian Splat of a Strawberry

#181

Post by Lerc »

satvikpendem wrote: post #125
Lerc wrote: post #104

Earlier quoted context omitted.

This will be the future of a class of 3d Game. the prompt may not be text however. An input of a kind of schematic representation of what the designer wants would be better. It may resemble a storyboard or a collection of organised notes that large projects tend to already use. Fully generative could probably do some cool things, but people will still want to bring their peronal vision to life.

Curious, why wouldn't the future be a full world model like Google's Genie? It just renders every pixel so someone could still make their vision come to life via a prompt too.

It could be done that way but you are spending parameters managing the fact that the output changes completely with a change in view position or orientation. A observer independent model only has to manage changes of things that are actually changing in the world.

Since you can view Gaussian splats from any POV you end up generating an output that is closer to the representation of the world instead of a projection that a single observer sees.

Re: Show HN: Gaussian Splat of a Strawberry

#182

Post by data-ottawa »

cubefox wrote: post #124
lopsotronic wrote: post #103

Earlier quoted context omitted.

Ah the timeless joy of falling through the floor geometry. Seriously though - it's breathtaking. The first guy who figures out the bridge between splats and dynamism - animation, editing, responsiveness - is going to be one of the immortals of 3d design.

There are many ways to represent 3D data, but animations really only work properly with polygon meshes (e.g. triangle surface meshes or volumetric tetrahedral meshes).

I don’t know. Maybe today, but tomorrow?

If you can sample points inside a volume, in theory you could do that with splat geometry. If someone figures out a way to pass in animation time to a sampler, sample along geometry/wireframe or something else, and keep it from overly twinkling it might change everything.

I’m hand waving all the complexity into “if done one figures out”, of course.

I just don’t see why this method can’t evolve in the way diffusion models have evolved (knowing very little of the geberative mechanics of splats).

Re: Show HN: Gaussian Splat of a Strawberry

#183

Post by lightedman »

hamburglar wrote: post #128
lightedman wrote: post #112

A Youtuber that records jookin (a mid-South form of dance) uses Gaussian splats for his videos to bring the dancers out into the forefront and hold center stage, it's a neat trick. https://www.youtube.com/watch?v=k0MGoFaIiWs - WARNING - heavily adult lyrics and a loud starting "MOTHERFU*AAAAAAS" right off the top.

What makes you say this is using Gaussian splats? It looks like simple motion-based cropping to me.

Because I know the video producer and have talked about this in-depth with him.

Re: Show HN: Gaussian Splat of a Strawberry

#184

Post by squidsoup »

Tade0 wrote: post #39

Beautiful. What I love about gaussian splats is the way they degrade - instead of a hard cutoff or LoD changing spheres into cubes etc., they get increasingly "dreamy" - the basic idea is still there, just less detailed. Take for example this scene: https://superspl.at/scene/e721ea7c If you navigate closer to the trees, things around you become blurry - as if the very fabric of reality unraveled.

You might enjoy some of my art derived from gaussian splats in that case, I've been calling them gaussographs.

https://bayardrandel.com/gaussographs

More recent work on my instagram

https://www.instagram.com/bayardrandel/

Re: Show HN: Gaussian Splat of a Strawberry

#186

Post by db48x »

cubefox wrote: post #124
lopsotronic wrote: post #103

Earlier quoted context omitted.

Ah the timeless joy of falling through the floor geometry. Seriously though - it's breathtaking. The first guy who figures out the bridge between splats and dynamism - animation, editing, responsiveness - is going to be one of the immortals of 3d design.

There are many ways to represent 3D data, but animations really only work properly with polygon meshes (e.g. triangle surface meshes or volumetric tetrahedral meshes).

It’s easy but a bit data intensive. Take two 3D splat images at different times, optimize them, then interpolate from the first to the second. Repeat at intervals. Now you have a video. A full moving subject is about 500Mbps, although it depends a lot on the quality of the source images that you make the 3D splats from and how detailed the output image is. Search for “4D gaussian splats” to find references.

Re: Show HN: Gaussian Splat of a Strawberry

#187

Post by Intralexical »

data-ottawa wrote: post #182
cubefox wrote: post #124

Earlier quoted context omitted.

There are many ways to represent 3D data, but animations really only work properly with polygon meshes (e.g. triangle surface meshes or volumetric tetrahedral meshes).

I don’t know. Maybe today, but tomorrow? If you can sample points inside a volume, in theory you could do that with splat geometry. If someone figures out a way to pass in animation time to a sampler, sample along geometry/wireframe or something else, and keep it from overly twinkling it might change everything. I’m hand waving all the complexity into “if done one figures out”, of course. I just don’t see why this me…

Since splats sample the light field after surface reflection, you can't do realtime shading with splats the way you can with raytracing and rasterization. I guess it could be animated like a holographic movie, but not like a video game and not like a 3D editor, because the light for all angles in all frames has to be precomputed.

Re: Show HN: Gaussian Splat of a Strawberry

#188

Post by cubefox »

data-ottawa wrote: post #182
cubefox wrote: post #124

Earlier quoted context omitted.

There are many ways to represent 3D data, but animations really only work properly with polygon meshes (e.g. triangle surface meshes or volumetric tetrahedral meshes).

I don’t know. Maybe today, but tomorrow? If you can sample points inside a volume, in theory you could do that with splat geometry. If someone figures out a way to pass in animation time to a sampler, sample along geometry/wireframe or something else, and keep it from overly twinkling it might change everything. I’m hand waving all the complexity into “if done one figures out”, of course. I just don’t see why this me…

> If someone figures out a way to pass in animation time to a sampler, sample along geometry/wireframe or something else, and keep it from overly twinkling it might change everything.

Not sure that's what you mean, but there was recently a paper where they put meshless (e.g. voxel or SDF) geometry in an animated tetrahedral mesh "cage" and then animate the meshless model by animating the mesh cage:

https://diglib.eg.org/server/api/core/bitstreams/bd94e19b-98...

https://youtube.com/watch?v=6lKAvxV2mno

https://youtube.com/watch?v=3c3-ue-fd88

Though this currently isn't compatible with 3DGS if I understand the limitations section correctly.

> Finally, our method operates unordered, limiting its suitability for complex volumetric effects. However, a potential solution lies in sorting the generated intervals for proper blending. This enhancement could improve our approach’s compatibility with various meshless representations, such as radiance fields and volumetric lighting.

Re: Show HN: Gaussian Splat of a Strawberry

#189

Post by joshvm »

ivolimmen wrote: post #42

Wow this is a time killer... ended up here: https://superspl.at/scene/ff1d0393 beautiful!

That one has a strange rendering error for me, the trees and horizon are in front of the mill building and the exterior isn't properly rendered unless you are in orbit mode. But my mind was a little blown when i discovered that I could walk up the stairs. It needs shift to run!

The scene desperately needs some clipping on the boundaries. If you use an app like Scaniverse, you can add a bounding box to cull far away points which are often poorly reconstructed.

If you have a newer iPhone with a LIDAR scanner, highly recommended. You can make dolls-house renderings of your house or garden which is surprisingly useful for planning and measuring walls/features.

Re: Show HN: Gaussian Splat of a Strawberry

#190

Post by fragmede »

0x1ceb00da wrote: post #169
amelius wrote: post #147

Earlier quoted context omitted.

That's what Google Street View should be like more.

Gaussian splats are huge. I don't think they'll scale to google maps level. It'll be too much data.

Google's downloaded most of the Internet for decades by this point. I don't think "it'll be too much data" is in their vocabulary.
Post reply on HN