Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SHARP, an approach to photorealistic view synthesis from a single image

apple.github.io

Post reply on HN
Print view View original

41–50 of 114 posts

Re: SHARP, an approach to photorealistic view synthesis from a single image

#41

Post by derleyici »

Leptonmaniac wrote: post #27

Can someone ELI5 what this does? I read the abstract and tried to find differences in the provided examples, but I don't understand (and don't see) what the "photorealistic" part is.

It turns a single photo into a rough 3D scene so you can slightly move the camera and see new, realistic views. "Photorealistic" means it preserves real textures and lighting instead of a flat depth effect. Similar behavior can be seen with Apple's Spatial Scene feature in the Photos app: https://files.catbox.moe/93w7rw.mov

Re: SHARP, an approach to photorealistic view synthesis from a single image

#42

Post by avaer »

Leptonmaniac wrote: post #27

Can someone ELI5 what this does? I read the abstract and tried to find differences in the provided examples, but I don't understand (and don't see) what the "photorealistic" part is.

It makes your picture 3D. The "photorealistic" part is "it's better than these other ways".

Re: SHARP, an approach to photorealistic view synthesis from a single image

#44

Post by diimdeep »

Works great, model file is 2.8 GB, on M2 rendering took a few seconds, result is guassian .ply file but repo implementation requires CUDA card to render video, I have used one of webgl live renderers from here https://github.com/scier/MetalSplatter?tab=readme-ov-file#re...

Re: SHARP, an approach to photorealistic view synthesis from a single image

#47

Post by jrflowers »

dag11 wrote: post #25
yodon wrote: post #13

See also Spaitial[0] which announced today full 3D environment generation from a single image [0] https://www.spaitial.ai/

I'm confused, does it actually generate environments from photographs? I can't view the galleries since I didn't sign up for emails but all of the gallery thumbnails are AI, not photos.

> I'm confused, does it actually generate environments from photographs?

It’s a website that collects people’s email addresses

Re: SHARP, an approach to photorealistic view synthesis from a single image

#48

Post by kurtis_reed »

emsign wrote: post #34
Leptonmaniac wrote: post #27

Can someone ELI5 what this does? I read the abstract and tried to find differences in the provided examples, but I don't understand (and don't see) what the "photorealistic" part is.

Imagine history documentaries where they take an old photo and free objects from the background and move them round giving the illusion of parallax movement. This software does that in less than a second, creating a 3D model that can be accurately moved (or the camera for that matter) in your video editor. It's not new, but this one is fast and "sharp". Gaussian splashing is pretty awesome.

What are free objects?

Re: SHARP, an approach to photorealistic view synthesis from a single image

#49

Post by ferriswil »

kurtis_reed wrote: post #48
emsign wrote: post #34

Earlier quoted context omitted.

Imagine history documentaries where they take an old photo and free objects from the background and move them round giving the illusion of parallax movement. This software does that in less than a second, creating a 3D model that can be accurately moved (or the camera for that matter) in your video editor. It's not new, but this one is fast and "sharp". Gaussian splashing is pretty awesome.

What are free objects?

The "free" in this case is a verb. The objects are freed from the background.
Post reply on HN