OP should try out SuperGlue for features instead of SIFT
Reprojecting the Perseverance landing footage onto satellite imagery
31–40 of 40 posts
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#32I've been having trouble finding the answer to this. How close to it's intended target did it land? Thanks
If you look at the last final seconds to the left of the landing you can make out an ancient river delta. That is one of the prime targets they want to investigate.
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#33Not only impressively coded but a beautiful result as well fascinating to have that real time, frame by frame comparison. Great job! It only reinforces that I really need to learn my matrix math.
Maybe they only uploaded a 1080p version of the video - but I was expecting higher def. ...then again, I suppose interplanetary bandwidths are probably not great.
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#34Earlier quoted context omitted.
I'm curious - what did you do, in what software, and how?
ESRI software has had this raster function for quite a while, at least 20 years. Usually 2 or 3 points would suffice. Using hundreds of points was unnecessary.
Hundreds of points lets you get a good average. 2 or 3 requires that you've definitely clicked the same point on both images; a human can use other bits of the image to work that out, but a computer finds it harder.
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#35Fascinating and well explained! Reminded me of the video tracking work these folks do: https://forensic-architecture.org/
These are outstanding!
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#36I've been having trouble finding the answer to this. How close to it's intended target did it land? Thanks
Or perhaps more importantly, did the terrain navigation software correctly choose an optimal landing location? It seems like it chose one of the rockiest places.
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#37It'd be pretty neat to lift this up into 3d - you could probably reverse the transforms to find the camera pose for each frame, then drop it into a scene alongside the camera frustum and the topography so we can see exactly how much steering the descent stage did to hit its target and how fast it was descending at every stage.
On the other hand, I'd fully expect NASA/JPL to have IMU telemetry from the EDL. If I'm not completely mistaken, they would eventually get published in PDS here: https://naif.jpl.nasa.gov/naif/data.html For example for MSL (Curiosity, the previous rover) the EDL CK and SPK provides orientation and position data if I'm interpreting this description right: https://naif.jpl.nasa.gov/pub/naif/pds/data/msl-m-spice-6-v1...…
I’ve been thinking more about the navigation of their little helicopter.
On earth were used to being able to use GPS for route planning. If you could use this process in reverse to constantly determine ones position in 3D space above the surface using stored satellite imagery with a downward facing camera cross referenced with whatever gyro / accelerometer based positioning they’re using I wonder if there’d be any benefit. Maybe what they’ve got already is sufficient for anything you’d want to do in the near future.
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#38Fascinating and well explained! Reminded me of the video tracking work these folks do: https://forensic-architecture.org/
Wow. Thanks for sharing.
30+ years ago, I had friends reconstructing crime scenes for court proceedings. Architectural drawings and 3D scenes. They used AutoCAD and AutoSolid (?). Showing stuff like blood and ballistics.
Super effective. They turned my stomach.
I don't have words for these Forensic Architecture recreations. I almost feel like that I'm there (present).
I can only imagine their future VR recreations will be overpowering.
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#39The graph based approach is interesting... But I wonder if better and far simpler results might be had by simply using a few iterations of optical flow to perfect the alignment of each frame starting from the alignment of the previous frame? As a benefit, the transformation could use images after being projected onto a deformable mesh to model the hills etc.
Pretty sure this is optical flow
Re: Reprojecting the Perseverance landing footage onto satellite imagery
#40Earlier quoted context omitted.
On the other hand, I'd fully expect NASA/JPL to have IMU telemetry from the EDL. If I'm not completely mistaken, they would eventually get published in PDS here: https://naif.jpl.nasa.gov/naif/data.html For example for MSL (Curiosity, the previous rover) the EDL CK and SPK provides orientation and position data if I'm interpreting this description right: https://naif.jpl.nasa.gov/pub/naif/pds/data/msl-m-spice-6-v1...…
I’ve been thinking more about the navigation of their little helicopter. On earth were used to being able to use GPS for route planning. If you could use this process in reverse to constantly determine ones position in 3D space above the surface using stored satellite imagery with a downward facing camera cross referenced with whatever gyro / accelerometer based positioning they’re using I wonder if there’d be any be…
> If you could use this process in reverse to constantly determine ones position in 3D space above the surface using stored satellite imagery with a downward facing camera cross referenced with whatever gyro / accelerometer based positioning they’re using I wonder if there’d be any benefit
That is pretty much exactly how TRN worked for the EDL. I don't think Ingenuity has much in terms of navigation ability, probably just basic INS. But its also not intended to fly any extended distances, so it doesn't really need any navigation abilities. I'd imagine future copters would use TRN style navigation.
(TRN = terrain relative navigation)