Live data from Hacker News

SHARP, an approach to photorealistic view synthesis from a single image

apple.github.io

111–114 of 114 posts

Re: SHARP, an approach to photorealistic view synthesis from a single image

#111

Earlier quoted context omitted.

Black Mirror episode portraying what this could do: https://youtu.be/XJIq_Dy--VA?t=14 . If Apple ran SHARP on this photo and compared it to the show, that would be incredible. Or if you prefer Blade Runner: https://youtu.be/qHepKd38pr0?t=107

One more example from Star Trek Into Darkness https://youtu.be/p7Y4nXTANRQ?t=61

I was thinking Enemy of the State (1998) https://www.youtube.com/watch?v=3EwZQddc3kY

Re: SHARP, an approach to photorealistic view synthesis from a single image

#112
post #106

Apple dropping this is interesting. They've been quiet on the flashy AI stuff while everyone else is yelling about transformers, but 3D reconstruction from single images is actually useful hardware integration stuff. What's weird is we're getting better at faking 3D from 2D than we are at just... capturing actual 3D data. Like we have LiDAR in phones already, but it's easier to neural-net your way around it than deal…

I wonder if humans are any different. We don't have LIDAR in our eyes but we approximate depth "enough" with only our 2D input

We also constantly move our heads and refocus our eyes. We can get a rough idea of depth from only a static stereo pair, but in reality we ingest vastly more information than that and constantly update our internal representation in real time.

Re: SHARP, an approach to photorealistic view synthesis from a single image

#113
post #106

Apple dropping this is interesting. They've been quiet on the flashy AI stuff while everyone else is yelling about transformers, but 3D reconstruction from single images is actually useful hardware integration stuff. What's weird is we're getting better at faking 3D from 2D than we are at just... capturing actual 3D data. Like we have LiDAR in phones already, but it's easier to neural-net your way around it than deal…

I wonder if humans are any different. We don't have LIDAR in our eyes but we approximate depth "enough" with only our 2D input

We don't have 2d input, we have 3d input.

We have two eyes that gives us depth by default.

Re: SHARP, an approach to photorealistic view synthesis from a single image

#114
post #61

Earlier quoted context omitted.

I miss those. Anyone know if it's still possible to get the models etc. needed to generate them?

I also wanted to generate one of those this year, so I'll camp around here just in case anybody comments on it :)

https://github.com/kenjibailly/Deep_Dream_GUI

and

https://www.tensorflow.org/tutorials/generative/deepdream

oh and Google's original repo from 10 years ago with a Python notebook about running it: https://github.com/google/deepdream/blob/master/dream.ipynb

Post reply on HN