If anyone is interested in an alternative to the software mentioned in the article, I've had very good results with Meshroom[0], and it works on Linux.
References:
Modeling my Grandpa with 3D Photogrammetry (2021)
21–30 of 30 posts
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#22Earlier quoted context omitted.
As far as I can see, It uses LiDAR. Unlike photo-based PG, LiDAR does not get confused by lighting conditions. It is also good for large scenes and environments. The downside of apples lidar is that the mesh is too low resolution for most practical uses.
Scaniverse uses both LiDAR and photogrammetry. There are some examples here: https://sketchfab.com/scaniverse/collections/made-with-scani... In general, I think the iPhone LiDAR works quite well, even at small scales.
The LiDAR on the iPhone is limited, but fun. Commercial lidars are hella expensive (last time I looked).
Looked at your sketchfab collection. Lovely work.
For those who don’t know, Sketchfab allows you to preview the mesh using the layers button. Your bread roll model is nicely detailed with quite a tight mesh.
It is possible to model anything in 3D, but for complex (organic or natural) objects, nothing beats PG. Your bread roll model I would certainly use in middle distance. However, for close up ‘her’ shots all PG acquired models fail, unless they are significantly retopologized. The outcome would be a tidy quad mesh.
Having been retopologized, I would then have to project the original textures onto the new model.
The origami RGB imformation would then have to have its lighting information removed, either in photoshop or Ali soft delighter. In this way, I would be able to independently light it inside of my compositor or 3D app.
The final task would be to cook up some kind of roughness map. Likely I would derive this from the RGB map.
For those who are interested, my link below leads to a resource that details this process.
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#23Scaniverse from Niantic is (really) free on iOS and makes this almost trivial: https://scaniverse.com Apple’s Object Capture looks impressive too: https://developer.apple.com/augmented-reality/object-capture...
As far as I can see, It uses LiDAR. Unlike photo-based PG, LiDAR does not get confused by lighting conditions. It is also good for large scenes and environments. The downside of apples lidar is that the mesh is too low resolution for most practical uses.
What I'd love is software that starts with a scan and then calculates a confidence level for all the vertices, which it would then let you edit with exact measurements or even intelligent questions like "is this part circular?"
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#24Scaniverse from Niantic is (really) free on iOS and makes this almost trivial: https://scaniverse.com Apple’s Object Capture looks impressive too: https://developer.apple.com/augmented-reality/object-capture...
As far as I can see, It uses LiDAR. Unlike photo-based PG, LiDAR does not get confused by lighting conditions. It is also good for large scenes and environments. The downside of apples lidar is that the mesh is too low resolution for most practical uses.
> Unlike photo-based PG, LiDAR does not get confused by lighting conditions.
I tried to use the app that GP mentioned, inside of a dark room. This confused the app and it thought I was in motion.
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#25Earlier quoted context omitted.
As far as I can see, It uses LiDAR. Unlike photo-based PG, LiDAR does not get confused by lighting conditions. It is also good for large scenes and environments. The downside of apples lidar is that the mesh is too low resolution for most practical uses.
> Unlike photo-based PG, LiDAR does not get confused by lighting conditions. I tried to use the app that GP mentioned, inside of a dark room. This confused the app and it thought I was in motion.
Most of them use the system AR sdks, which still relies heavily on the cameras for feature detection, if it’s too dark they have a hard time anchoring themselves to the scene
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#26Can we call this photogranpammetry then?
[deleted]
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#27i suggest using NeRFs instead of pont clouds... it's a fun experience with the toolkit
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#28The name OpenMVS is all kinds of confusing for people interested in retrocomputing.
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#29If you have an IPhone I warmly recommend Luma AI for these sort of scans. Their nerf (neural field, not the toy) based photogrammetry pipeline is close to magic.
I heard that the mesh from nerf is rather shabby. Not good enough for 3D printing or (in our case) VFX. Was this your experience?
Actually I haven't tried prints! Very good point. The visual quality though is really good - the thing it does out of the box right are specular surfaces which are really hard for traditional photogrammetry. This makes capturing even shiny objects trivial (which might be impossible with with trad. photogrammetry).
Re: Modeling my Grandpa with 3D Photogrammetry (2021)
#30Wonder if anyone has experience with RealityCapture ( https://www.capturingreality.com/realitycapture ), they also have an iOS app but it seems the original service was for generating 3D models from photos like the author took.
I tried Meshroom and RealityCapture (both on Windows) and the latter yielded better results in a fraction of the time. YMMV.