Never did I think I would ever see anything close to related to A$AP on HN. I love this place.
And nearly a Carti post at the top of HN
Gaussian Splatting – A$AP Rocky "Helicopter" music video
41–50 of 278 posts
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#42Earlier quoted context omitted.
Hi, I'm one of the creators of GSOPs for SideFX Houdini. The gist is that Gaussian splats can replicate reality quite effectively with many 3D ellipsoids (stored as a type of point cloud). Houdini is software that excels at manipulating vast numbers of points, and renderers (such as Octane) can now leverage this type of data to integrate with traditional computer graphics primitives, lights, and techniques.
Can you put "Gaussing splats" in some kind of real world metaphor so I can understand what it means? Either that or explain why "Gaussian" and why "splat". I am vaguely aware of stuff like Gaussian blur on Photoshop. But I never really knew what it does.
Sure!
Gaussian splatting is a bit like photogrammetry. That is, you can record video or take photos of an object or environment from many angles and reproduce it in 3D. Gaussians have the capability to "fade" their opacity based on a Gaussian distribution. This allows them to blend together in a seamless fashion.
The splatting process is achieved by using gradient descent from each camera/image pair to optimize these ellipsoids (Gaussians) such that the reproduce the original inputs as closely as possible. Given enough imagery and sufficient camera alignment, performed using Structure from Motion, you can faithfully reproduce the entire space.
Read more here: https://towardsdatascience.com/a-comprehensive-overview-of-g....
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#43Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).
From the article:
>Evercoast deployed a 56 camera RGB-D array
Do you know which depth cameras they used?
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#44This reminds me about how Soulja Boy just used a cracked copy of Fruity Loops and a cheap microphone and recorded all his songs that made him millions.[1]
Edit: Ok this was a big team of VFX producers who did this. Still, prices are coming down dramatically in general, but yeah that idea is a bit of an underfit to this case.
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#45Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).
From the article: >Evercoast deployed a 56 camera RGB-D array Do you know which depth cameras they used?
Kinect Azure
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#46Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).
From the article: >Evercoast deployed a 56 camera RGB-D array Do you know which depth cameras they used?
I was not involved in the capture process with Evercoast, but I may have heard somewhere they used RealSense cameras.
I recommend asking https://www.linkedin.com/in/benschwartzxr/ for accuracy.
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#47Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).
From the article: >Evercoast deployed a 56 camera RGB-D array Do you know which depth cameras they used?
Aha: https://www.red.com/stories/evercoast-komodo-rig
So likely RealSense D455.
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#48Hi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs (example content included).
[deleted]
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#49Dang, it's been cool watching gaussian splats go from tech demo to real workflow.
Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video
#50Earlier quoted context omitted.
Hi, I'm one of the creators of GSOPs for SideFX Houdini. The gist is that Gaussian splats can replicate reality quite effectively with many 3D ellipsoids (stored as a type of point cloud). Houdini is software that excels at manipulating vast numbers of points, and renderers (such as Octane) can now leverage this type of data to integrate with traditional computer graphics primitives, lights, and techniques.
Can you put "Gaussing splats" in some kind of real world metaphor so I can understand what it means? Either that or explain why "Gaussian" and why "splat". I am vaguely aware of stuff like Gaussian blur on Photoshop. But I never really knew what it does.
How can you expect someone to tailor a custom explanation, when they don’t know your level of mathematical understanding, or even your level of curiosity. You don’t know what a Gaussian blur does; do you know what a Gaussian is? How deeply do you want to understand?
If you’re curious start with the Wikipedia article and use an LLM to help you understand the parts that don’t make sense. Or just ask the LLM to provide a summary at the desired level of detail.