Live data from Hacker News

DreamFusion: Text-to-3D using 2D Diffusion

dreamfusion3d.github.io

41–50 of 208 posts

Re: DreamFusion: Text-to-3D using 2D Diffusion

#41
post #35

Unclear to me what is going on, but there’s another URL that lists the authors names. Given it’s possible this change was done for reason, not linking to it, but strikes me as odd it’s still up. Anyone know what’s going on without causing problems for the authors?

This link was from OpenReview which must be anonymous (double blind). The full author list is on the updated link at: https://dreamfusion3d.github.io

Aware of the link, though you have not provided any clarification for why there are two links; strikes me as odd if authors are trying to post it anonymously that simple Google finds authors names.

Re: DreamFusion: Text-to-3D using 2D Diffusion

#43
post #8

Is there code for any of these models? Or a collab? Ajay Jain's colab doesn't work, but I would love to see a colab for this.

Silly replying to myself I know, but I had more thoughts. I'm an architect for 3D worlds and I am desperate, lol, for this kind of tool. I use both blender and grasshopper, but I use midjourney to think and prototype all the time. Obvious but it would be astonishing to have something like this for game worlds. I used another version of this to create "a forest emerging from an aircraft carrier" https://www.instagram.…

You should try the AUTOMATIC1111 version of stable diffusion. It's crazy fast and has great results - https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki...

Re: DreamFusion: Text-to-3D using 2D Diffusion

#44

Did we hit some sort of technical inflection point in the last couple of weeks or is this just coincidence that all of these ML papers around high quality procedural generation are just dropping every other day?

I think DALLE really kicked things into high gear.

Re: DreamFusion: Text-to-3D using 2D Diffusion

#45

Did we hit some sort of technical inflection point in the last couple of weeks or is this just coincidence that all of these ML papers around high quality procedural generation are just dropping every other day?

THIS

WTF - the singularity is closer than we thought!!!

Re: DreamFusion: Text-to-3D using 2D Diffusion

#46

Did we hit some sort of technical inflection point in the last couple of weeks or is this just coincidence that all of these ML papers around high quality procedural generation are just dropping every other day?

They're AI generated, the singularity already happened but the machines are trying to ease us into it.

Scary fn thought!

and I agree with you!

And the OP comment its by the magnanimous/infamous AnigBrowl

You need to start doing AI legal admin ( I dont have the terms, but you may - we need legal language to control how we deal with AI)

and @dang - kill the gosh darn "posting too fast" thing

Jiminey Crickets I have talked to you abt this so many times...

Re: DreamFusion: Text-to-3D using 2D Diffusion

#47

Huh, it's a pretty similar technique to what I outlined a couple days ago: https://news.ycombinator.com/item?id=32965139 Although they start with random initialization and a text prompt. It seems to work well. I now see no reason we can't start with image initialization!

The version that you proposed wouldn't have worked

Re: DreamFusion: Text-to-3D using 2D Diffusion

#48

Did we hit some sort of technical inflection point in the last couple of weeks or is this just coincidence that all of these ML papers around high quality procedural generation are just dropping every other day?

Maybe deadline for neurips which is coming up?

This was submitted to ICLR

Re: DreamFusion: Text-to-3D using 2D Diffusion

#50
post #29
post #22

Earlier quoted context omitted.

From the abstract: “We introduce a loss based on probability density distillation that enables the use of a 2D diffusion model as a prior for optimization of a parametric image generator. Using this loss in a DeepDream-like procedure, we optimize a randomly-initialized 3D model (a Neural Radiance Field, or NeRF) via gradient descent such that its 2D renderings from random angles achieve a low loss.” This seems like b…

> This seems like basically plugging a couple of techniques together that already existed as with a majority of ML research

>as with a majority of ML research

Plus "we did the same thing, but with 10x the compute resources".

But yeah.

Post reply on HN