Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gaussian Splatting – A$AP Rocky "Helicopter" music video

radiancefields.com

Post reply on HN
Print view View original

31–40 of 278 posts

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#31

Post by [deleted] »

rkuykendall-com wrote: post #13
pleurotus wrote: post #8

Super cool to read but can someone eli5 what Gaussian splatting is (and/or radiance fields?) specifically to how the article talks about it finally being "mature enough"? What's changed that this is now possible?

I found this VFX breakdown of the recent Superman movie to have a great explanation of what it is and what it makes possible: https://youtu.be/eyAVWH61R8E?t=232 tl;dr eli5: Instead of capturing spots of color as they would appear to a camera, they capture spots of color and where they exist in the world. By combining multiple cameras doing this, you can make a 3D works from footage that you can then zoom a virtual ca…

[deleted]

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#32

Post by darhodester »

yieldcrv wrote: post #5

so basically despite the higher resource requirements like 10TB of data for 30 minutes of footage, the compositing is so much faster and more flexible and those resources can be deleted or moved to long term storage in the cloud very quickly and the project can move on fascinating I wouldn't have normally read this and watched the video, but my Claude sessions were already executing a plan the tl;dr is that all the a…

Gaussian splatting is not NeRF (neural radiance field), but it is a type of radiance field, and supports novel view synthesis. The difference is in an explicit point cloud representation (Gaussian splatting), versus a process that needs to be inferred by a neural network.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#34

Post by dmarcos »

pleurotus wrote: post #8

Super cool to read but can someone eli5 what Gaussian splatting is (and/or radiance fields?) specifically to how the article talks about it finally being "mature enough"? What's changed that this is now possible?

It’s a point cloud where each point is a semitransparent blob that can have a view dependent color: color changes depending on direction you look at them. Allowing to capture reflections, iridescence…

You generate the point clouds from multiple images of a scene or an object and some machine learning magic

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#36

Post by yieldcrv »

andybak wrote: post #26
yieldcrv wrote: post #5

so basically despite the higher resource requirements like 10TB of data for 30 minutes of footage, the compositing is so much faster and more flexible and those resources can be deleted or moved to long term storage in the cloud very quickly and the project can move on fascinating I wouldn't have normally read this and watched the video, but my Claude sessions were already executing a plan the tl;dr is that all the a…

> and then "NeRF"'d which means to extrapolate any missing data about their transposed 3D model Not sure if it's you or the original article but that's a slightly misleading summary of NeRFs.

I'm all for the better summary

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#37

Post by [deleted] »

darhodester wrote: post #22
noman-land wrote: post #7

Really amazing video. Unfortunately this article is like 60% over my head. Regardless, I actually love reading jargon-filled statements like this that are totally normal to the initiated but are completely inscrutable to outsiders. "That data was then brought into Houdini, where the post production team used CG Nomads GSOPs for manipulation and sequencing, and OTOY’s OctaneRender for final rendering. Thanks to this c…

Hi, I'm one of the creators of GSOPs for SideFX Houdini. The gist is that Gaussian splats can replicate reality quite effectively with many 3D ellipsoids (stored as a type of point cloud). Houdini is software that excels at manipulating vast numbers of points, and renderers (such as Octane) can now leverage this type of data to integrate with traditional computer graphics primitives, lights, and techniques.

[deleted]

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#38

Post by suzzer99 »

darhodester wrote: post #22
noman-land wrote: post #7

Really amazing video. Unfortunately this article is like 60% over my head. Regardless, I actually love reading jargon-filled statements like this that are totally normal to the initiated but are completely inscrutable to outsiders. "That data was then brought into Houdini, where the post production team used CG Nomads GSOPs for manipulation and sequencing, and OTOY’s OctaneRender for final rendering. Thanks to this c…

Hi, I'm one of the creators of GSOPs for SideFX Houdini. The gist is that Gaussian splats can replicate reality quite effectively with many 3D ellipsoids (stored as a type of point cloud). Houdini is software that excels at manipulating vast numbers of points, and renderers (such as Octane) can now leverage this type of data to integrate with traditional computer graphics primitives, lights, and techniques.

Can you put "Gaussing splats" in some kind of real world metaphor so I can understand what it means? Either that or explain why "Gaussian" and why "splat".

I am vaguely aware of stuff like Gaussian blur on Photoshop. But I never really knew what it does.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#39

Post by darhodester »

Hi,

I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video.

If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA.

Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#40

Post by b00ty4breakfast »

larsmaxfield wrote: post #24
MuffinFlavored wrote: post #18

How did Rhianna look him in the eyes and say "yes babe, good album, release it, this is what the people wanted after 7 years, it is pleasing to listen to and enjoyable"?

I prefer when artists make music they intrinsically want to make — not what others want them to make.

the real question is how much of the art is their own and how much is outside expectations and their reactions to it.

And it's not always giving in to those voices, sometimes it's going in the opposite direction specifically to subvert those voices and expectations even if that ends up going against your initial instincts as an artist.

With someone like A$AP Rocky, there is a lot of money on the line wrt the record execs but even small indie artists playing to only a hundred people a night have to contend with audience expectation and how that can exert an influence on their creativity.

Post reply on HN