Live data from Hacker News

Gaussian Splatting – A$AP Rocky "Helicopter" music video

radiancefields.com

161–170 of 278 posts

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#161

Earlier quoted context omitted.

Not everything has to be. Sometimes, an artist's style or a particular track just hits a particular vibe one may be after or need in a particular moment. I'm not a fan of this music either but I could imagine hearing it while I'm studying or coding. Don't trash something just because it's not your vibe. Not everything has to be Mozart.

I mean, it's not like I trashed it or compared it to Mozart—I even made sure to include "interesting, stimulating, or tonally remarkable" in an attempt to preempt that latter pushback. But even if I did, why can't I? It's fine to call some music shit. Just like you can call my opinion shit. Policing dissenting opinions and saying everything is equally worthy of praise are two sides of the same coin sliding in the ven…

You absolutely trashed it in your first sneering, shitty swipe about “culture”. You don’t get to make comments like that and then whine about “policing” like a four year-old caught in the cookie jar.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#162
post #58

Earlier quoted context omitted.

Couldn’t you just use iphone pros for this? I developed an app specifically for photogrammetry capture using AR and the depth sensor as it seemed like a cheap alternative. EDIT: I realize a phone is not on the same level as a red camera, but i just saw iphones as a massively cheaper option to alternatives in the field i worked in.

ASAP Rocky has a fervent fanbase who's been anticipating this album. So I'm assuming that whatever record label he's signed to gave him the budget. And when I think back to another iconic hip hop (iconic that genre) video where they used practical effects and military helicopters chasing speedboats in the waters off of Santa Monica...I bet they had change to spear.

Is there any reason to think https://thebaffler.com/salvos/the-problem-with-music doesn't apply here?

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#163
The texture of Gaussian Splatting always looks off to me. It looks like the entire scene has been textured or has a bad, uniform film grain filter to me. Everything looks a little off in an unpleasing way -- things that should be sharp are aren't, and things that should be blurry are not. It's uncanny valley and not in a good way. I don't get what all the rage is about it and it always looks like really poor B-roll to me.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#165

Earlier quoted context omitted.

Looks great by the way, i was wondering if there’s a file format for volumetric video captures

https://developer.apple.com/av-foundation/ https://developer.apple.com/documentation/spatial/ Edit: As I'm digging, this seems to be focused on stereoscopic video as opposed to actual point clouds. It appears applications like cinematic mode use a monocular depth map, and their lidar outputs raw point cloud data.

A LIDAR point cloud from a single point of view is a mono-ocular depth map. Unless the LIDAR in question is like, using supernova level gamma rays or neutrino generators for the laser part to get density and albedo volumetric data for its whole distance range.

You just can't see the back of a thing by knowing the shape of the front side with current technologies.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#166
post #2

Never did I think I would ever see anything close to related to A$AP on HN. I love this place.

I run a programming company and one of my sales people was surprised to see I liked soundcloud rap. I was like:

What did you expect?

>Classical music?

Nah I like hype, helps when things are slow.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#168

Earlier quoted context omitted.

1. Create a point cloud from a scene (either via lidar, or via photogrammetry from multiple images) 2. Replace each point of the point cloud with a fuzzy ellipsoid, that has a bunch of parameters for its position + size + orientation + view-dependent color (via spherical harmonics up to some low order) 3. If you render these ellipsoids using a differentiable renderer, then you can subtract the resulting image from th…

You... you must have been quite some 5 year old.

ELI5 has meant friendly simplified explanations (not responses aimed at literal five-year-olds) since forever, at least on the subreddit where the concept originated.

Now, perhaps referring to differentiability isn't layperson-accessible, but this is HN after all. I found it to be the perfect degree of simplification personally.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#169
post #6

To be honest it looks like it was rendered in an old version of Unreal Engine. That may be an intentional choice - I wonder how realistic guassian splatting can look? Can you redo lights, shadows, remove or move parts of the scene, while preserving the original fidelity and realism? The way TV/movie production is going (record 100s of hours of footage from multiple angles and edit it all in post) I wonder if this is…

I wonder if you are thinking Source engine? I was getting serious skibidi toilet vibes during several parts of this video.

Re: Gaussian Splatting – A$AP Rocky "Helicopter" music video

#170

Earlier quoted context omitted.

Hi, I'm one of the creators of GSOPs for SideFX Houdini. The gist is that Gaussian splats can replicate reality quite effectively with many 3D ellipsoids (stored as a type of point cloud). Houdini is software that excels at manipulating vast numbers of points, and renderers (such as Octane) can now leverage this type of data to integrate with traditional computer graphics primitives, lights, and techniques.

Can you put "Gaussing splats" in some kind of real world metaphor so I can understand what it means? Either that or explain why "Gaussian" and why "splat". I am vaguely aware of stuff like Gaussian blur on Photoshop. But I never really knew what it does.

> explain why "Gaussian" and why "splat".

Happily. Gaussian splats are a technique for 3D images, related to point clouds. They do the same job (take a 3D capture of reality and generate pictures later from any point of view "close enough" to the original).

The key idea is that instead of a bunch of points, it stores a bunch of semi-transparent blobs - or "splats". The transparency increases quickly with distance, following a normal distribution- also known as the "Gaussian distribution."

Hence, "Gaussian splats".

Post reply on HN