Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gaussian Splatting – A$AP Rocky "Helicopter" music video

radiancefields.com

Post reply on HN
Print view View original

171–180 of 278 posts

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#171

Post by np_tedious »

klondike_klive wrote: post #94
meindnoch wrote: post #78

Earlier quoted context omitted.

1. Create a point cloud from a scene (either via lidar, or via photogrammetry from multiple images) 2. Replace each point of the point cloud with a fuzzy ellipsoid, that has a bunch of parameters for its position + size + orientation + view-dependent color (via spherical harmonics up to some low order) 3. If you render these ellipsoids using a differentiable renderer, then you can subtract the resulting image from th…

You... you must have been quite some 5 year old.

Lol. Def not for 5 year olds but it's about exactly what I needed

How about this:

Take a lot of pictures of a scene from different angles, do some crazy math, and then you can later pretend to zoom and pan the camera around however you want

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#173

Post by alok-g »

meindnoch wrote: post #78
pleurotus wrote: post #8

Super cool to read but can someone eli5 what Gaussian splatting is (and/or radiance fields?) specifically to how the article talks about it finally being "mature enough"? What's changed that this is now possible?

1. Create a point cloud from a scene (either via lidar, or via photogrammetry from multiple images) 2. Replace each point of the point cloud with a fuzzy ellipsoid, that has a bunch of parameters for its position + size + orientation + view-dependent color (via spherical harmonics up to some low order) 3. If you render these ellipsoids using a differentiable renderer, then you can subtract the resulting image from th…

Thanks.

How hard is it to handle cases where the starting positions of ellipsoids in 3D is not correct (being too off). How common is such a scenario with the state of the art? E.g., if having only a stereoscopic image pair, the correspondences are often not accurate.

Thanks.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#174

Post by m4ck_ »

PlatoIsADisease wrote: post #166
nodra wrote: post #2

Never did I think I would ever see anything close to related to A$AP on HN. I love this place.

I run a programming company and one of my sales people was surprised to see I liked soundcloud rap. I was like: What did you expect? >Classical music? Nah I like hype, helps when things are slow.

Prokofiev's Alexander Nevsky goes hard if you do want something in the classical world though.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#177

Post by nelkazzu »

It’s interesting to see Gaussian splatting show up in a mainstream music video this quickly. A year ago it was mostly a research demo, and now artists are using it as part of their visual toolkit. What I find most notable is how well splats handle chaotic motion like helicopter shots — it’s one of the few 3D reconstruction methods that doesn’t completely fall apart with fast movement. Feels like we’re going to see a lot more of this in creative work before it shows up in anything “serious”.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#178

Post by darhodester »

chrisjj wrote: post #133
darhodester wrote: post #39

Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).

[flagged]

That's hurtful.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#179

Post by sowbug »

darhodester wrote: post #42
suzzer99 wrote: post #38

Earlier quoted context omitted.

Can you put "Gaussing splats" in some kind of real world metaphor so I can understand what it means? Either that or explain why "Gaussian" and why "splat". I am vaguely aware of stuff like Gaussian blur on Photoshop. But I never really knew what it does.

Sure! Gaussian splatting is a bit like photogrammetry. That is, you can record video or take photos of an object or environment from many angles and reproduce it in 3D. Gaussians have the capability to "fade" their opacity based on a Gaussian distribution. This allows them to blend together in a seamless fashion. The splatting process is achieved by using gradient descent from each camera/image pair to optimize these…

I think this means that you could produce more versions of this music video from other points of view without having to shoot the video again. For example, the drone-like effects could take a different path through the scene. Or you could move people/objects around and still get the lighting right.

Given where this technology is today, you could imagine 5-10 years from now people will watch live sports on TV, but with their own individual virtual drone that lets them view the field from almost any point.

Post reply on HN