or Single Photon Avalanche Diode, coming to a LIDAR near you very soon if not already. Yay ambiguous acronyms.
SPAD: Spatially Aware Multiview Diffusers
21–30 of 37 posts
Re: SPAD: Spatially Aware Multiview Diffusers
#22I’m confused why there is so much focus on text to images and models. If you spent five minutes talking to anyone with artistic ability, they would tell you that this is not how they generate their work. Making images involves entirely different parts of reasoning than that for speech and language. We seem to be building an entirely faulty model of image generation (outside of things like ControlNet) on the premise t…
What are your ideas about the differences between a human and AI's creative process ?
Are there any similarities, or analagous processes ?
Do you think creators have an kind of latent space where different concepts are inspired by multi-modal inputs ( what sparks inspiration ? e.g. sometimes music or a mood inspires a picture ) and then the creators make different versions of their idea by combining different amounts of different concepts ?
I am not being snarky, I am genuinely interested in views comparing human an AI's creative processes.
Re: SPAD: Spatially Aware Multiview Diffusers
#23or Single Photon Avalanche Diode, coming to a LIDAR near you very soon if not already. Yay ambiguous acronyms.
Re: SPAD: Spatially Aware Multiview Diffusers
#24No major comment other than this tech is obviously going to transform gaming.
to my understanding it produces 2D images (from various angles), not 3D models… But sure, it's very close to producing a 3D model.
https://github.com/bytedance/MVDream-threestudio
It should be fairly straightforward to adapt this repo (which is based on threestudio) to use SPAD instead of MVDream.
Re: SPAD: Spatially Aware Multiview Diffusers
#25No major comment other than this tech is obviously going to transform gaming.
to my understanding it produces 2D images (from various angles), not 3D models… But sure, it's very close to producing a 3D model.
I.e. can these be assets for traditional game engines ?
Could a sort of photogrammetry like Meshroom or Reality capture do the trick ?
Re: SPAD: Spatially Aware Multiview Diffusers
#26I’m confused why there is so much focus on text to images and models. If you spent five minutes talking to anyone with artistic ability, they would tell you that this is not how they generate their work. Making images involves entirely different parts of reasoning than that for speech and language. We seem to be building an entirely faulty model of image generation (outside of things like ControlNet) on the premise t…
Can you share some of what you have found about the creative process by talking to people with artistic ability ? What are your ideas about the differences between a human and AI's creative process ? Are there any similarities, or analagous processes ? Do you think creators have an kind of latent space where different concepts are inspired by multi-modal inputs ( what sparks inspiration ? e.g. sometimes music or a mo…
Most illustration briefs are also not wrote descriptions of images because people are remarkably bad at describing what they want in an image, beyond in the most general sense of its subject. This is why you see DALLE doing all kinds of prompt elaboration on user inputs to generate “good” images. Typically, the illustrator is given the work to be illustrated (e.g. an editorial), distills key concepts from the work and translates these into various visual analogues, such as archetypes, metaphors and themes. Depending on the subject, one may have to include reference images or other work in a particular style, if the client has something specific in mind.
Re: SPAD: Spatially Aware Multiview Diffusers
#27I’m confused why there is so much focus on text to images and models. If you spent five minutes talking to anyone with artistic ability, they would tell you that this is not how they generate their work. Making images involves entirely different parts of reasoning than that for speech and language. We seem to be building an entirely faulty model of image generation (outside of things like ControlNet) on the premise t…
Project briefs to an artist typically contain both text and reference images. Image diffusion models and the like likewise typically use a text prompt together with optional reference images.
Re: SPAD: Spatially Aware Multiview Diffusers
#28Earlier quoted context omitted.
Project briefs to an artist typically contain both text and reference images. Image diffusion models and the like likewise typically use a text prompt together with optional reference images.
Project briefs are generally not descriptions of images and reference tends to be more style than content focused. Source: I used to be an illustrator for major media outlets like the NYTimes, etc.
(Also, reference images can absolutely be used to communicate style to a diffusion model)
Re: SPAD: Spatially Aware Multiview Diffusers
#29Earlier quoted context omitted.
Project briefs are generally not descriptions of images and reference tends to be more style than content focused. Source: I used to be an illustrator for major media outlets like the NYTimes, etc.
So how is the desired content communicated to the artist? (Also, reference images can absolutely be used to communicate style to a diffusion model)
Re: SPAD: Spatially Aware Multiview Diffusers
#30I’m confused why there is so much focus on text to images and models. If you spent five minutes talking to anyone with artistic ability, they would tell you that this is not how they generate their work. Making images involves entirely different parts of reasoning than that for speech and language. We seem to be building an entirely faulty model of image generation (outside of things like ControlNet) on the premise t…
Check out invoke.ai for an example of something much closer to a professional tool.