Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bolt3D: Generating 3D Scenes in Seconds

szymanowiczs.github.io

Post reply on HN
Print view View original

21–30 of 60 posts

Re: Bolt3D: Generating 3D Scenes in Seconds

#21

Post by echelon »

emmelaich wrote: post #4
slowtrek wrote: post #3

Is anything like this available locally yet?

Here's the repo: https://github.com/szymanowiczs/splatter-image Apparently you can clone and run the demo locally. But wasn't clear at a glance how much is local and what hardware required.

Your link above (Splatter Image) is not the same code / paper / research as Bolt3D.

This is a previous paper/work by the lead author a year before they interned at Google Research and produced Bolt3D.

Bolt3D appears to be his intern research project done in conjunction with a bunch of other Google and DeepMind researchers.

I don't suspect there will ever be publicly available code for this.

Re: Bolt3D: Generating 3D Scenes in Seconds

#22

Post by tracerbulletx »

diggan wrote: post #12
ajwin wrote: post #7

Earlier quoted context omitted.

My understanding is that it is not mesh, it’s Gaussian Splatting. There are tools to convert Splats into mesh though.

Yeah, but isn't still the expected outcome to end up with actual 3D objects, not point clouds? Or did people start integrating point clouds into their 3D workflows already? Besides for stuff like volumes and alike, I think most of us are still stuck working with polygons for 3D.

No geometry in the conventional sense. I did a demo of rendering a Gaussian splat in React Three Fiber here, you can open the linked splat file (its hosted on hugging face) if you want to see the data format. https://codesandbox.io/p/sandbox/3d-gaussian-splat-in-react-... I also have this youtube video about creating that demo https://www.youtube.com/watch?v=6tVcCTazmzo

Re: Bolt3D: Generating 3D Scenes in Seconds

#23

Post by Legend2440 »

jsheard wrote: post #10
diggan wrote: post #6

Show. Us. The. Wireframes! Every single time a new "Generate 3D" thing appears, they never show the wireframes of the objects/scenes up front, always you need to download and inspect things yourself. How is this not standard practice already? Not displaying the wireframes at all, or even offer sample files so we could at least see it ourselves, just makes it look like you already know that the generated results are u…

They usually don't show the material channels either, which I assume is because there aren't any, and instead the lighting is statically baked into the asset. That works for a demo where you just wiggle the camera in a circle, but it'll immediately fall apart if the lighting environment changes or anything in the scene moves.

Think of it more like a 3D picture than an animation model.

There are no materials channels or wireframe. It’s a volumetric 3D representation, like a picture made up of color blobs.

Re: Bolt3D: Generating 3D Scenes in Seconds

#24

Post by Legend2440 »

diggan wrote: post #12
ajwin wrote: post #7

Earlier quoted context omitted.

My understanding is that it is not mesh, it’s Gaussian Splatting. There are tools to convert Splats into mesh though.

Yeah, but isn't still the expected outcome to end up with actual 3D objects, not point clouds? Or did people start integrating point clouds into their 3D workflows already? Besides for stuff like volumes and alike, I think most of us are still stuck working with polygons for 3D.

You can convert splats into meshes using a simple marching cubes algorithm.

But the meshes produced are not easy to edit.

Re: Bolt3D: Generating 3D Scenes in Seconds

#25

Post by kookamamie »

Legend2440 wrote: post #23
jsheard wrote: post #10

Earlier quoted context omitted.

They usually don't show the material channels either, which I assume is because there aren't any, and instead the lighting is statically baked into the asset. That works for a demo where you just wiggle the camera in a circle, but it'll immediately fall apart if the lighting environment changes or anything in the scene moves.

Think of it more like a 3D picture than an animation model. There are no materials channels or wireframe. It’s a volumetric 3D representation, like a picture made up of color blobs.

And thus unusable for most things 3D models and scenes would be used for today.

Re: Bolt3D: Generating 3D Scenes in Seconds

#26

Post by lmpdev »

diggan wrote: post #12
ajwin wrote: post #7

Earlier quoted context omitted.

My understanding is that it is not mesh, it’s Gaussian Splatting. There are tools to convert Splats into mesh though.

Yeah, but isn't still the expected outcome to end up with actual 3D objects, not point clouds? Or did people start integrating point clouds into their 3D workflows already? Besides for stuff like volumes and alike, I think most of us are still stuck working with polygons for 3D.

I use pointclouds all the time in Rhino/Lastools/Meshlab

I much prefer pointclouds and nurbs over meshes

Not everything is gamedev

Re: Bolt3D: Generating 3D Scenes in Seconds

#28

Post by kombine »

emmelaich wrote: post #4
slowtrek wrote: post #3

Is anything like this available locally yet?

Here's the repo: https://github.com/szymanowiczs/splatter-image Apparently you can clone and run the demo locally. But wasn't clear at a glance how much is local and what hardware required.

This is previous work. Bolt3D uses the same principle, of predicting a per-pixel Gaussian splatting representation but it also trains a diffusion model, which is only feasible if you have substantial compute available.

Given that it's a work done at Google I will not expect them to release source code. But it will be reproduced by someone else soon enough.

Re: Bolt3D: Generating 3D Scenes in Seconds

#29

Post by emmelaich »

kombine wrote: post #28
emmelaich wrote: post #4

Earlier quoted context omitted.

Here's the repo: https://github.com/szymanowiczs/splatter-image Apparently you can clone and run the demo locally. But wasn't clear at a glance how much is local and what hardware required.

This is previous work. Bolt3D uses the same principle, of predicting a per-pixel Gaussian splatting representation but it also trains a diffusion model, which is only feasible if you have substantial compute available. Given that it's a work done at Google I will not expect them to release source code. But it will be reproduced by someone else soon enough.

True, I should've said related work.

Re: Bolt3D: Generating 3D Scenes in Seconds

#30

Post by [deleted] »

diggan wrote: post #6

Show. Us. The. Wireframes! Every single time a new "Generate 3D" thing appears, they never show the wireframes of the objects/scenes up front, always you need to download and inspect things yourself. How is this not standard practice already? Not displaying the wireframes at all, or even offer sample files so we could at least see it ourselves, just makes it look like you already know that the generated results are u…

[deleted]
Post reply on HN