Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gaussian Splatting – A$AP Rocky "Helicopter" music video

radiancefields.com

Post reply on HN
Print view View original

21–30 of 278 posts

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#21

Post by nebezb »

londons_explore wrote: post #9

Pretty sure most of this could be filmed with a camera drone and preprogrammed flight path... Did the Gaussian splatting actually make it any cheaper? Especially considering that it needed 50+ fixed camera angles to splat properly, and extensive post-processing work both computationally and human labour, a camera drone just seems easier.

If it was achievable, cheaper, and of equal quality then it would have been done that way. Surely it would’ve been done that way a long time ago too. Drone paths have been around a lot longer than this technology.

There’s no proof of your claim and this video is proof of the opposite.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#22

Post by darhodester »

noman-land wrote: post #7

Really amazing video. Unfortunately this article is like 60% over my head. Regardless, I actually love reading jargon-filled statements like this that are totally normal to the initiated but are completely inscrutable to outsiders. "That data was then brought into Houdini, where the post production team used CG Nomads GSOPs for manipulation and sequencing, and OTOY’s OctaneRender for final rendering. Thanks to this c…

Hi, I'm one of the creators of GSOPs for SideFX Houdini.

The gist is that Gaussian splats can replicate reality quite effectively with many 3D ellipsoids (stored as a type of point cloud). Houdini is software that excels at manipulating vast numbers of points, and renderers (such as Octane) can now leverage this type of data to integrate with traditional computer graphics primitives, lights, and techniques.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#23

Post by ex-aws-dude »

londons_explore wrote: post #9

Pretty sure most of this could be filmed with a camera drone and preprogrammed flight path... Did the Gaussian splatting actually make it any cheaper? Especially considering that it needed 50+ fixed camera angles to splat properly, and extensive post-processing work both computationally and human labour, a camera drone just seems easier.

I think you’re missing the point

Volumetric capture like this allows you to decide on the camera angles in post-production

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#24

Post by larsmaxfield »

MuffinFlavored wrote: post #18

How did Rhianna look him in the eyes and say "yes babe, good album, release it, this is what the people wanted after 7 years, it is pleasing to listen to and enjoyable"?

I prefer when artists make music they intrinsically want to make — not what others want them to make.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#25

Post by pants2 »

noman-land wrote: post #7

Really amazing video. Unfortunately this article is like 60% over my head. Regardless, I actually love reading jargon-filled statements like this that are totally normal to the initiated but are completely inscrutable to outsiders. "That data was then brought into Houdini, where the post production team used CG Nomads GSOPs for manipulation and sequencing, and OTOY’s OctaneRender for final rendering. Thanks to this c…

Corridor has done some great stuff with Gaussian Splats, I recommend this video for a primer!

https://youtube.com/watch?v=cetf0qTZ04Y

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#26

Post by andybak »

yieldcrv wrote: post #5

so basically despite the higher resource requirements like 10TB of data for 30 minutes of footage, the compositing is so much faster and more flexible and those resources can be deleted or moved to long term storage in the cloud very quickly and the project can move on fascinating I wouldn't have normally read this and watched the video, but my Claude sessions were already executing a plan the tl;dr is that all the a…

> and then "NeRF"'d which means to extrapolate any missing data about their transposed 3D model

Not sure if it's you or the original article but that's a slightly misleading summary of NeRFs.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#27

Post by darhodester »

rjh29 wrote: post #6

To be honest it looks like it was rendered in an old version of Unreal Engine. That may be an intentional choice - I wonder how realistic guassian splatting can look? Can you redo lights, shadows, remove or move parts of the scene, while preserving the original fidelity and realism? The way TV/movie production is going (record 100s of hours of footage from multiple angles and edit it all in post) I wonder if this is…

The aesthetic here is at least partially an intentional choice to lean into the artifacts produced by Gaussian splatting, particularly dynamic (4DGS) splatting. There is temporal inconsistency when capturing performances like this, which are exacerbated by relighting.

That said, the technology is rapidly advancing and this type of volumetric capture is definitely sticking around.

The quality can also be really good, especially for static environments: https://www.linkedin.com/posts/christoph-schindelar-79515351....

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#29

Post by darhodester »

londons_explore wrote: post #9

Pretty sure most of this could be filmed with a camera drone and preprogrammed flight path... Did the Gaussian splatting actually make it any cheaper? Especially considering that it needed 50+ fixed camera angles to splat properly, and extensive post-processing work both computationally and human labour, a camera drone just seems easier.

A drone path would not allow for such seamless transitions, never mind the planning required to nail all that choreography, effects, etc.

This approach is 100% flexible, and I'm sure at least part of the magic came from the process of play and experimentation in post.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#30

Post by hamburglar »

londons_explore wrote: post #9

Pretty sure most of this could be filmed with a camera drone and preprogrammed flight path... Did the Gaussian splatting actually make it any cheaper? Especially considering that it needed 50+ fixed camera angles to splat properly, and extensive post-processing work both computationally and human labour, a camera drone just seems easier.

> Pretty sure most of this could be filmed with a camera drone and preprogrammed flight path

This is a “Dropbox is just ftp and rsync” level comment. There’s a shot in there where Rocky is sitting on top of the spinning blades of a helicopter and the camera smoothly transitions from flying around the room to solidly rotating along with the blades, so it’s fixed relative to rocky. Not only would programming a camera drone to follow this path be extremely difficult (and wouldn’t look as good), but just setting up the stunt would be cost prohibitive.

This is just one example of the hundreds you could come up with.

Post reply on HN