The thing that frightens me is that we are rapidly reaching broad humanity disrupting ML technologies without any of the social or societal frameworks to cope with it.
DreamFusion: Text-to-3D using 2D Diffusion
51–60 of 208 posts
Re: DreamFusion: Text-to-3D using 2D Diffusion
#52Did we hit some sort of technical inflection point in the last couple of weeks or is this just coincidence that all of these ML papers around high quality procedural generation are just dropping every other day?
It’s called the technological singularity. Pretty fun so far!
Re: DreamFusion: Text-to-3D using 2D Diffusion
#53It's funny that the authors are 'anonymous' but they have access to Imagen so obviously it's by Google.
This is par for the course - there have been other instances where an 'anonymous' paper mentioned training on a cluster of TPUs that weren't publicly available yet - dead giveaway it was Google.
Re: DreamFusion: Text-to-3D using 2D Diffusion
#54Can someone explain what's going on in this example from the gallery? The prompt is "a humanoid robot using a rolling pin to roll out dough":
https://dreamfusion-cdn.ajayj.com/gallery_sept28/crf20/a_DSL...
But if you look closely, the pin looks like it's actually rolling across the dough as the camera orbits.
Re: DreamFusion: Text-to-3D using 2D Diffusion
#55The thing that frightens me is that we are rapidly reaching broad humanity disrupting ML technologies without any of the social or societal frameworks to cope with it.
There were bigger disruptions in the past. The telegraph, railroads, explosives. "The Devils" by Dostoevsky is a great fictional account of what all these technological disruptions do to the fragile social order in the late 19th century Russia countryside. All of a sudden all these foreign people, ideas , technology and commerce start streaming in to these once isolated communities.
Re: DreamFusion: Text-to-3D using 2D Diffusion
#56The thing that frightens me is that we are rapidly reaching broad humanity disrupting ML technologies without any of the social or societal frameworks to cope with it.
I'm usually not a fan of this general hand wringing / fear mongering around ML that a lot of people with too much time and not enough STEM background constantly bring up.
Stable diffusion has been made available to the public for quite a while now and if anything has disproved a lot of the ungrounded nonsense that made companies like OpenAI censor their generative models.
Re: DreamFusion: Text-to-3D using 2D Diffusion
#57Did we hit some sort of technical inflection point in the last couple of weeks or is this just coincidence that all of these ML papers around high quality procedural generation are just dropping every other day?
From the abstract: “We introduce a loss based on probability density distillation that enables the use of a 2D diffusion model as a prior for optimization of a parametric image generator. Using this loss in a DeepDream-like procedure, we optimize a randomly-initialized 3D model (a Neural Radiance Field, or NeRF) via gradient descent such that its 2D renderings from random angles achieve a low loss.” This seems like b…
> This seems like basically plugging a couple of techniques together that already existed [...]
In his Lex Fridman interview, John Carmack makes similar assertions about this prospect for AGI: That it will likely be the clever combination of existing primitives (plus maybe a couple novel new ones) that make the first AGI feasible in just a couple thousand lines of code.
Re: DreamFusion: Text-to-3D using 2D Diffusion
#58Did we hit some sort of technical inflection point in the last couple of weeks or is this just coincidence that all of these ML papers around high quality procedural generation are just dropping every other day?
It’s called the technological singularity. Pretty fun so far!
This isn't what is usually meant by "technological singularity". It is an inflection point where technology growth becomes incontrollable and unpredictable, usually theorized to be cause by a self improving agent (/AI) that becomes smarter with each of its iterations. This is still standard technological progress, human control, even if very fast
Re: DreamFusion: Text-to-3D using 2D Diffusion
#59Earlier quoted context omitted.
From the abstract: “We introduce a loss based on probability density distillation that enables the use of a 2D diffusion model as a prior for optimization of a parametric image generator. Using this loss in a DeepDream-like procedure, we optimize a randomly-initialized 3D model (a Neural Radiance Field, or NeRF) via gradient descent such that its 2D renderings from random angles achieve a low loss.” This seems like b…
> This seems like basically plugging a couple of techniques together that already existed as with a majority of ML research
Isn't that what the Singularity was described as a few decades ago? Progress so fast it's unpredictable even in the short term.
Re: DreamFusion: Text-to-3D using 2D Diffusion
#60Did we hit some sort of technical inflection point in the last couple of weeks or is this just coincidence that all of these ML papers around high quality procedural generation are just dropping every other day?
Conference season?