11–20 of 37 posts
Very interesting tech, though the article makes a piss poor job of explaining anything about how it works. Rendering surfaces is how literally 99.9% of 3D graphics work, not a "breakthrough" of any sorts.
I'm good at inferring the shape of something from a side view well enough that I can use it in some kludgy mental models, but down the page they're essentially asking the computer to look at something from the side and render a precise(ish) 3-D mechanical model of the object from memory. For example, I have what I think is a pretty good idea of what a Boeing 737 looks like, but if you asked me to draw it on a piece of paper it would look like a kinder gardener did it. What I'm good at is boiling down features and distinguishing a 737 from an Oscar Meyer wiener truck. Drawing a scale-accurate picture of it is a job for artists and savants.
I'm very excited about the potential for extracting voxel specific or procedural generated 3D objects from a low number of 2D images - primarily with a combination of Semantic Segmentation and some form of MVS. The results of papers like this and other similar ones are great progress.
Seems like Google Earth is doing this yeah?
For example the red pickup truck. There is no way the algorithm could create that model from that image only (depth of the trunk).
So my guess is that they use the tiny picture to search a database for similar pictures and then create a model with all that data.
I'm looking at the second example from the image in the article - the blue plane - and can't work out how the algorithm could possibly infer a second wing from that picture.
I'm looking at the second example from the image in the article - the blue plane - and can't work out how the algorithm could possibly infer a second wing from that picture.
I'm looking at the second example from the image in the article - the blue plane - and can't work out how the algorithm could possibly infer a second wing from that picture.
I kind of got lost on the first sentence: "With a lifetime of observing the world informing our perceptions, we’re all pretty good at inferring the overall shape of something we only see from the side, or for a brief moment. Computers, however, are just plain bad at it." I'm good at inferring the shape of something from a side view well enough that I can use it in some kludgy mental models, but down the page they're…
Very interesting tech, though the article makes a piss poor job of explaining anything about how it works. Rendering surfaces is how literally 99.9% of 3D graphics work, not a "breakthrough" of any sorts.
This: "Computer, here's a 2D projection. Infer the likely 3D data that would produce the projection."