Well, I got _something_ to work on Apple Silicon: https://github.com/rcarmo/ml-sharp (has a little demo GIF) I am looking at ways to approximate Gaussian splats without having to reinvent the wheel, but I'm a bit over my depth since I haven't been playing a lot of attention to those in general.
SHARP, an approach to photorealistic view synthesis from a single image
91–100 of 114 posts
Re: SHARP, an approach to photorealistic view synthesis from a single image
#92Re: SHARP, an approach to photorealistic view synthesis from a single image
#93Not only do many VR and AR systems acquire stereo, we have historical collections of stereo views in many libraries and museums.
Re: SHARP, an approach to photorealistic view synthesis from a single image
#94Well, I got _something_ to work on Apple Silicon: https://github.com/rcarmo/ml-sharp (has a little demo GIF) I am looking at ways to approximate Gaussian splats without having to reinvent the wheel, but I'm a bit over my depth since I haven't been playing a lot of attention to those in general.
The example doesn't look particularly impressive to say the least. Look at the bottom 20 %
Keep in mind that this is not Gaussian splat rendering but just a hacked approximation--on my NVIDIA machine that looks way smoother.
Re: SHARP, an approach to photorealistic view synthesis from a single image
#95cuda gpu only https://github.com/apple/ml-sharp#rendering-trajectories-cud...
Re: SHARP, an approach to photorealistic view synthesis from a single image
#96Earlier quoted context omitted.
They're using their Depth Pro model for depth estimation, and that seems to do faces really well. https://github.com/apple/ml-depth-pro https://learnopencv.com/depth-pro-monocular-metric-depth/
Im not sure how the depth estimation alone translates into the view synthesis, but the current implementation on-device is definitely not convincing for literally any portrait photographs I have seen. True stereoscopic captures are convincing statically, but don't provide the parallax.
Re: SHARP, an approach to photorealistic view synthesis from a single image
#97Earlier quoted context omitted.
Goading companies into improving image and video generation by showing them how terrible they are is only going to make them go faster, and personally I’d like to enjoy the few moments I have left thinking that maybe something I watch is real. It will evolve into people hooked into entertainment suits most of the day, where no one has actual relationships or does anything of consequence, like some sad mashup of Wall-…
It turns out the Great Filter is that any species with the technology to colonize space also has the technology to soma itself into annihilation. https://en.wikipedia.org/wiki/Great_Filter
A great filter needs to apply to every civilisation imaginable, no exceptions, nerfing billions of species before they get to a higher Kardashev scale, not just something that "could happen" or the latest “Dunning-Kruger” mic-drop in every thread. In 1960s "the great filter is nuclear war", in 1890 "the great filter is heroin", in 1918 "the great filter is world war, we are destined to destroy ourselves", in 2015 "the great filter is climate change our emissions will end us like bacteria in a petri dish", in antiquity "the great filter is the punishment for crossing the will of the Gods".
It's got to be something you cannot get around even if you try really really hard and get very very lucky, because there are ~200,000,000,000 stars in the Milky Way and with those numbers there will be some species which lucks its way past almost any candidate, spreads out and in a mere 100k years is all over this galaxy leaving rocket trails and explosion signatures and radio signals and terraforming signs and megastructures.
Maybe when NASA, ESA, SpaceX, RosCOSMOS, CNSA, IRSA all collapse because of this effect… look how many countries have a space agency! https://en.wikipedia.org/wiki/List_of_government_space_agenc...
Re: SHARP, an approach to photorealistic view synthesis from a single image
#98Re: SHARP, an approach to photorealistic view synthesis from a single image
#99Can someone ELI5 what this does? I read the abstract and tried to find differences in the provided examples, but I don't understand (and don't see) what the "photorealistic" part is.