Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Image-blaster: Creates 3D environments, SFX, and meshes from a single image

github.com

Post reply on HN
Print view View original

11–20 of 42 posts

Re: Image-blaster: Creates 3D environments, SFX, and meshes from a single image

#11

Post by janfoeh »

taffydavid wrote: post #7
ZiiS wrote: post #2

So Blade Runner's Esper photo analysis went from ruining the suspension of disbelief to reality quicker then most magic.

Well, in blade runner he looks around a corner and zooms in microscopic detail on something not visible from the photo. But the esper interface is all voice activated, and doesn't talk back - which I think is very prescient, and more likely the way things will go. I'd much rather voice assistants just did the thing that I want them to do rather than talk back to me

I've never forgotten this SIGGRAPH demo from almost twenty years ago, in which the authors effectively switch camera and light source computationally (... in a static scene) [1]

Ever since then, I have viewed scenes such as the "lingerie store scene" from Enemy of the State [2] with a little bit less eye rolling...

[1] - https://www.youtube.com/watch?v=p5_tpq5ejFQ

[2] - https://youtu.be/3EwZQddc3kY?t=6

Re: Image-blaster: Creates 3D environments, SFX, and meshes from a single image

#13

Post by MattCruikshank »

janfoeh wrote: post #11
taffydavid wrote: post #7

Earlier quoted context omitted.

Well, in blade runner he looks around a corner and zooms in microscopic detail on something not visible from the photo. But the esper interface is all voice activated, and doesn't talk back - which I think is very prescient, and more likely the way things will go. I'd much rather voice assistants just did the thing that I want them to do rather than talk back to me

I've never forgotten this SIGGRAPH demo from almost twenty years ago, in which the authors effectively switch camera and light source computationally (... in a static scene) [1] Ever since then, I have viewed scenes such as the "lingerie store scene" from Enemy of the State [2] with a little bit less eye rolling... [1] - https://www.youtube.com/watch?v=p5_tpq5ejFQ [2] - https://youtu.be/3EwZQddc3kY?t=6

I went to high school with the sales clerk, Ivana Miličević.

It's always weird to see her in stuff.

Re: Image-blaster: Creates 3D environments, SFX, and meshes from a single image

#14

Post by NitpickLawyer »

avaer wrote: post #4

If you haven't tried AI modeling pipelines in the last year you'll be surprised. The star of the show here is https://platform.worldlabs.ai/ (author works there, I don't) which is really good. There's also Meshy.ai (which this repo doesn't seem to use?) for non-scene stuff that's right up there in quality. There's texturing, auto-rigging, etc. The latest VLLM models have true pixel image grounding which means you can…

> I'm actually surprised I don't see this stuff being used more;

There's very little incentive to publicly admit you're using this tech. In fact there are a lot of reasons not to.

Re: Image-blaster: Creates 3D environments, SFX, and meshes from a single image

#17

Post by nomadar »

Curious about the actual architecture. From the outside it looks like Gaussian splatting anchored to roughly one viewpoint, since the moment you wander outside the original frame or behind an object, it becomes messy. But Ben Mildenhall is one of the co-founders and a NeRF co-author (https://arxiv.org/abs/2003.08934), so I'm betting that whatever they're doing is more interesting than naive splatting. Curious if OP can share anything about the pipeline.

Re: Image-blaster: Creates 3D environments, SFX, and meshes from a single image

#18

Post by agentifysh »

I wonder if there is something similar but for creating isometric sprites? I burned through $30 yesterday realizing that I can't just get image gen to give me isometric static/animated sprites with consistency....even the best image gen cannot do this and im just baffled how difficult isometric sprite is compared to 3d mesh gen

I'm at a crossroad , do I opt for 3d mesh isometrics with more hardware requirements for mobile phones or stick to isometric sprite which nobody seems to be generating via AI reliably (happy to be corrected here if anybody does find a way)

Re: Image-blaster: Creates 3D environments, SFX, and meshes from a single image

#19

Post by taffydavid »

MattCruikshank wrote: post #13
janfoeh wrote: post #11

Earlier quoted context omitted.

I've never forgotten this SIGGRAPH demo from almost twenty years ago, in which the authors effectively switch camera and light source computationally (... in a static scene) [1] Ever since then, I have viewed scenes such as the "lingerie store scene" from Enemy of the State [2] with a little bit less eye rolling... [1] - https://www.youtube.com/watch?v=p5_tpq5ejFQ [2] - https://youtu.be/3EwZQddc3kY?t=6

I went to high school with the sales clerk, Ivana Miličević. It's always weird to see her in stuff.

Oh like Banshee! Which is also weird to see because homelander

Re: Image-blaster: Creates 3D environments, SFX, and meshes from a single image

#20

Post by agentifysh »

tombert wrote: post #3

This is cool as hell. I remember like seventeen years years ago, Microsoft had "PhotoSynth", which would make 3D environments based on a bunch of images, and seventeen-year-old-tombert thought it was one of the most amazing things to ever be done on a computer. Doing this with just one image makes this at least an order of magnitude cooler. I will be playing with this over the weekend.

yeah I remember that was pretty neat each generation 3d stuff gets wilder and wilder

I used to spend all day on Bryce3D creating 3d landscapes, leaving computer on fall night to render like 10 seconds of video of a flyover sunset

bit of a rant here but we are definitely speedrunning 3d and its just going to get wilder once we get glass free bounded AR...projecting 3d video streams and objects in front of our phones (this one I know Samsung is already working on) and rooms

Post reply on HN