Live data from Hacker News

Gaussian Splatting – A$AP Rocky "Helicopter" music video

radiancefields.com

131–140 of 278 posts

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#131

Earlier quoted context omitted.

I think it's because they already had proven capture hardware, harvest, and processing workflows. But yes, you can easily use iPhones for this now.

Looks great by the way, i was wondering if there’s a file format for volumetric video captures

Recording pointclouds over time i guess i mean. I’m not going to pretend to understand video compression, but could it be possible to do the following movement aspect in 3d the same as 2d?

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#132

In another setting, it looks like ass, but lo-fi, glitchy shit is perfectly compatible with hip-hop aesthetic. Good track though.

The technology is impressive, but the end result… Weapons-grade brainrot. I’m curious what other artists end up making with it.

I really disagree with the label brainrot. Brainrot is low-quality garbage with no artistic merit, and very little thought behind its creation, which does nothing but make you briefly pause while scrolling, before scrolling away with no lasting impression being done to your mind (besides increased boredom and inability to focus).

This is clearly an artistic statement, whether you like the art or not. A ton of thought and time was put into it. And people will likely be thinking and discussing this video for some time to come.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#133

Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).

[flagged]

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#134
post #96

Earlier quoted context omitted.

Why is that “cool” or desirable?

Desirable because it’s a rare culture + tooling combo. I’m into both and HN is one of the few places I would see them come together. So yeah, “cool”

[flagged]

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#135

Super cool to read but can someone eli5 what Gaussian splatting is (and/or radiance fields?) specifically to how the article talks about it finally being "mature enough"? What's changed that this is now possible?

1. Create a point cloud from a scene (either via lidar, or via photogrammetry from multiple images) 2. Replace each point of the point cloud with a fuzzy ellipsoid, that has a bunch of parameters for its position + size + orientation + view-dependent color (via spherical harmonics up to some low order) 3. If you render these ellipsoids using a differentiable renderer, then you can subtract the resulting image from th…

Or: Matrix bullet time with more viewpoints and less quality.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#136

Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).

[flagged]

[deleted]

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#137

Super cool to read but can someone eli5 what Gaussian splatting is (and/or radiance fields?) specifically to how the article talks about it finally being "mature enough"? What's changed that this is now possible?

This 2-minute video is a great intro to the topic https://www.youtube.com/watch?v=HVv_IQKlafQ

I think this tech has become "production-ready" recently due to a combination of research progress (the seminal paper was published in 2023 https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/) and improvements to differentiable programming libraries (e.g. PyTorch) and GPU hardware.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#138
post #126

Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).

Hi David, have you looked into alternatives to 3DGS like https://meshsplatting.github.io/ that promise better results and faster training?

I have. Personally, I'm a big fan of hybrid representations like this. An underlying mesh helps with relighting, deformation, and effective editing operations (a mesh is a sparse node graph for an otherwise unstructured set of data).

However, surface-based constraints can prevent thin surfaces (hair/fur) from reconstructing as well as vanilla 3DGS. It might also inhibit certain reflections and transparency from being reconstructed as accurately.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#139
post #96

Earlier quoted context omitted.

Desirable because it’s a rare culture + tooling combo. I’m into both and HN is one of the few places I would see them come together. So yeah, “cool”

[flagged]

don't be a square

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#140
post #96

Earlier quoted context omitted.

Desirable because it’s a rare culture + tooling combo. I’m into both and HN is one of the few places I would see them come together. So yeah, “cool”

[flagged]

What do you mean by that?
Post reply on HN