Live data from Hacker News

SHARP, an approach to photorealistic view synthesis from a single image

apple.github.io

21–30 of 114 posts

Re: SHARP, an approach to photorealistic view synthesis from a single image

#25
post #13

See also Spaitial[0] which announced today full 3D environment generation from a single image [0] https://www.spaitial.ai/

I'm confused, does it actually generate environments from photographs? I can't view the galleries since I didn't sign up for emails but all of the gallery thumbnails are AI, not photos.

Re: SHARP, an approach to photorealistic view synthesis from a single image

#28
Is there a link with some sample gaussian splat files coming from this model? I couldn't find it.

Without that that it's hard to tell how cherry-picked the NVS video samples are.

EDIT: I did it myself, if anyone wants to check out the result (caveat, n=1): https://github.com/avaer/ml-sharp-example

Re: SHARP, an approach to photorealistic view synthesis from a single image

#29
post #13

See also Spaitial[0] which announced today full 3D environment generation from a single image [0] https://www.spaitial.ai/

Why are all their examples of rooms? Why no landscape or underwater scenes or something in space, etc.?

Constrained environments are much simpler.

I believe this company is doing image (or text) -> off the shelf image model to generate more views -> some variant of gaussian splatting.

So they aren't really "generating" the world as one might imagine.

Re: SHARP, an approach to photorealistic view synthesis from a single image

#30

Can someone ELI5 what this does? I read the abstract and tried to find differences in the provided examples, but I don't understand (and don't see) what the "photorealistic" part is.

From a single picture it infers a hidden 3D representation, from which you can produce photorealistic images from slightly different vantage points (novel views).
Post reply on HN