Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gaussian Splatting – A$AP Rocky "Helicopter" music video

radiancefields.com

Post reply on HN
Print view View original

121–130 of 278 posts

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#121

Post by [deleted] »

meindnoch wrote: post #78
pleurotus wrote: post #8

Super cool to read but can someone eli5 what Gaussian splatting is (and/or radiance fields?) specifically to how the article talks about it finally being "mature enough"? What's changed that this is now possible?

1. Create a point cloud from a scene (either via lidar, or via photogrammetry from multiple images) 2. Replace each point of the point cloud with a fuzzy ellipsoid, that has a bunch of parameters for its position + size + orientation + view-dependent color (via spherical harmonics up to some low order) 3. If you render these ellipsoids using a differentiable renderer, then you can subtract the resulting image from th…

[deleted]

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#122

Post by huflungdung »

darhodester wrote: post #39

Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).

[dead]

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#123

Post by SchemaLoad »

klondike_klive wrote: post #94
meindnoch wrote: post #78

Earlier quoted context omitted.

1. Create a point cloud from a scene (either via lidar, or via photogrammetry from multiple images) 2. Replace each point of the point cloud with a fuzzy ellipsoid, that has a bunch of parameters for its position + size + orientation + view-dependent color (via spherical harmonics up to some low order) 3. If you render these ellipsoids using a differentiable renderer, then you can subtract the resulting image from th…

You... you must have been quite some 5 year old.

Some things would be literally impossible to properly explain to a 5 year old.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#124

Post by roughly »

filoleg wrote: post #52
roughly wrote: post #4

Be sure to watch the video itself* - it’s really a great piece of work. The energy is frenetic and it’s got this beautiful balance of surrealism from the effects and groundedness from the human performances. * (Mute it if you don’t like the music, just like the rest of us will if you complain about the music)

Similarly, the music video for Taylor Swif[0] (another track by A$AP Rocky) is just as surrealistic and weird in the best way possible, but with an eastern european flavor of it (which is obviously intentional and makes sense, given the filming location and being very on-the-nose with the theme). 0. https://youtu.be/5URefVYaJrA

Holy shit that’s great. I need to check a few more of his videos.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#126

Post by c-fe »

darhodester wrote: post #39

Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).

Hi David, have you looked into alternatives to 3DGS like https://meshsplatting.github.io/ that promise better results and faster training?

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#127

Post by IshKebab »

darhodester wrote: post #32
yieldcrv wrote: post #5

so basically despite the higher resource requirements like 10TB of data for 30 minutes of footage, the compositing is so much faster and more flexible and those resources can be deleted or moved to long term storage in the cloud very quickly and the project can move on fascinating I wouldn't have normally read this and watched the video, but my Claude sessions were already executing a plan the tl;dr is that all the a…

Gaussian splatting is not NeRF (neural radiance field), but it is a type of radiance field, and supports novel view synthesis. The difference is in an explicit point cloud representation (Gaussian splatting), versus a process that needs to be inferred by a neural network.

It's not a type of radiance field.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#128

Post by Foreignborn »

I want to shoutout Nial Ashley (aka Llainwire) for doing this in 2023 as a solo act and doing the visuals himself as well - https://www.youtube.com/watch?v=M1ZXg5wVoUU

A shame that kid was slept on. Allegedly (according to discord) he abandoned this because so many artists reached out to have him do this style of mv, instead of wanting to collaborate on music.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#129

Post by renewiltord »

meindnoch wrote: post #78
pleurotus wrote: post #8

Super cool to read but can someone eli5 what Gaussian splatting is (and/or radiance fields?) specifically to how the article talks about it finally being "mature enough"? What's changed that this is now possible?

1. Create a point cloud from a scene (either via lidar, or via photogrammetry from multiple images) 2. Replace each point of the point cloud with a fuzzy ellipsoid, that has a bunch of parameters for its position + size + orientation + view-dependent color (via spherical harmonics up to some low order) 3. If you render these ellipsoids using a differentiable renderer, then you can subtract the resulting image from th…

Great explanation/simplification. Top quality contribution.
Post reply on HN