Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Magic3D: High-Resolution Text-to-3D Content Creation

deepimagination.cc

Post reply on HN
Print view View original

1–10 of 19 posts

Re: Magic3D: High-Resolution Text-to-3D Content Creation

#2

Post by lwneal »

Magic3D looks like an improvement on DreamFusion [1], so it's sad to see that the code and models are not being made public.

What is public right now is StableDreamFusion [2]. It produces surprisingly good results on radially symmetrical organic objects like flowers and pineapples. You can run it on your own GPU or a colab.

Or, if you just want to type a prompt into a website and see something in 3D, try our demo at https://holovolo.tv

[1] https://dreamfusion3d.github.io/

[2] https://github.com/ashawkey/stable-dreamfusion

[3] https://holovolo.tv

Re: Magic3D: High-Resolution Text-to-3D Content Creation

#3

Post by Geee »

lwneal wrote: post #2

Magic3D looks like an improvement on DreamFusion [1], so it's sad to see that the code and models are not being made public. What is public right now is StableDreamFusion [2]. It produces surprisingly good results on radially symmetrical organic objects like flowers and pineapples. You can run it on your own GPU or a colab. Or, if you just want to type a prompt into a website and see something in 3D, try our demo at…

Looks like Magic3D doesn't depend on any additional training, which means that open-source methods like StableDreamFusion can be adapted to this new method quite easily.

They use https://deepimagination.cc/eDiffi/ as the text-to-image diffusion model, which can be replaced with Stable Diffusion or something else.

Re: Magic3D: High-Resolution Text-to-3D Content Creation

#5

Post by r_hoods_ghost »

Many moons ago my job was banging out greebles and low poly textured models for arch-viz (architectural visualisation) libraries. Think variations of "technological" shapes to provide detailing for a space ship, chair models to be used in background of render of fancy new office, or door variation number 26 type models. Yes it was as boring as it sounds. A lot of the models have ended up being used in games more recently as well as GPUs have got better. I can certainly see these types of systems being good enough to replace that type of drudge work in modelling pipelines within the next two years. What I really want to see (now that my livelihood doesn't depend on it) is a system that can produce models from prompts with decent mesh topology suitable for rigging (or even auto rigged) and that can be separated into component parts and even have physics applied to them. My dream would be for the bunny to be able to hop off, the stack of pancakes to react realistically and the maple syrup to ooze down!

Re: Magic3D: High-Resolution Text-to-3D Content Creation

#6

Post by fsloth »

dr_dshiv wrote: post #4

I’m curious about how tools like this could intersect w skilled workflows in something like Rhino/Grasshopper.

As a grasshopper style node graph is effectively an abstract syntax tree (AST, i.e. code) I imagine that actually something like GitHub copilot and such tools would be more appropriate.

Current state of the art tends not to differentiate between gibberish and output of actual value so that may be a bit of a downer.

But I definetly see it as plausible - I just don't know where you would get the training data though...

Re: Magic3D: High-Resolution Text-to-3D Content Creation

#8

Post by aliqot »

EamonnMR wrote: post #7

Can't wait for shovelware games that use nothing but these. But also something like Scribblenauts where arbitrary 3d objects can be created by wizards.

IDK about you but I kinda miss the "1000 games on one disc" things we used to get from the backs of magazines.

Re: Magic3D: High-Resolution Text-to-3D Content Creation

#9

Post by MrGilbert »

aliqot wrote: post #8
EamonnMR wrote: post #7

Can't wait for shovelware games that use nothing but these. But also something like Scribblenauts where arbitrary 3d objects can be created by wizards.

IDK about you but I kinda miss the "1000 games on one disc" things we used to get from the backs of magazines.

Isn't that itch.io nowadays? Sort by popularity and filter for free, and you should be good to go. :)
Post reply on HN