Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stitching – A Python package for fast and robust Image Stitching (Panoramas)

github.com

Post reply on HN
Print view View original

11–20 of 32 posts

Re: Stitching – A Python package for fast and robust Image Stitching (Panoramas)

#11

Post by folli »

bmh wrote: post #3
est wrote: post #2

How is this compared with Microsoft ICE?

Microsoft seems to have discontinued ICE a long time ago. As far as I know, the state of the art in panorama stitching is PTGui. I was working on mobile panorama stitching last year, and one of my datasets had a kitchen wall that was almost purely white, so very little detail for the classic feature algorithms such as SIFT and ORB to cling to. The OpenCV stitching pipeline, which is built on these (and RANSAC), didn'…

So how did you solve the mobile panorama stitching? You ran PTGui on a backend server and uploaded the user images there?

Re: Stitching – A Python package for fast and robust Image Stitching (Panoramas)

#13

Post by LukasWeber »

bmh wrote: post #3
est wrote: post #2

How is this compared with Microsoft ICE?

Microsoft seems to have discontinued ICE a long time ago. As far as I know, the state of the art in panorama stitching is PTGui. I was working on mobile panorama stitching last year, and one of my datasets had a kitchen wall that was almost purely white, so very little detail for the classic feature algorithms such as SIFT and ORB to cling to. The OpenCV stitching pipeline, which is built on these (and RANSAC), didn'…

A simple GUI would be great to let the user select high quality 3-4 matches (reference points) between the image pairs. Then the rest of the stitching pipeline could stay the same.

Re: Stitching – A Python package for fast and robust Image Stitching (Panoramas)

#16

Post by _aavaa_ »

LukasWeber wrote: post #14
_aavaa_ wrote: post #12

Would be nice to include some sort of performance benchmarks that compare it to the alternatives.

what do you think should be the alternatives it should be compared to?

Depends on what the package is supposed to be used for.

If its meant for photographers to create panoramas, then I think a comparison to: Photoshop, Hugin (or PTGUI for gpu acceleration), and Microsoft ICE would be a good benchmark.

Re: Stitching – A Python package for fast and robust Image Stitching (Panoramas)

#18

Post by actionfromafar »

ggm wrote: post #7
PetitPrince wrote: post #4

Earlier quoted context omitted.

True, but ICE is free while PT GUI is 150€. And compared to the open source darling Hugin it has also a less fussy UI.

Hugin hasn't worked for me on macos well for a couple of years.

I never got it work with my images. (Flatbed mosaic.)

Re: Stitching – A Python package for fast and robust Image Stitching (Panoramas)

#19

Post by Mumps »

StephenSmith wrote: post #17

I'd love someone with more CV experience to explain why this fails on my use case? (four image zip) https://drive.google.com/file/d/1gTZWlKmS4ZtEZDK8OjjLeGN_V0F...

(sorry don't have time to run through the OP script and check what you're getting for outputs, but...)

- I'm not even entirely sure how these images would stitch together

- between 1.jpeg and the rest, there is very little overlap. RANSAC likely won't find matchable points.

- you're asking for a pretty severe homography of the scene.

Re: Stitching – A Python package for fast and robust Image Stitching (Panoramas)

#20

Post by bmh »

StephenSmith wrote: post #17

I'd love someone with more CV experience to explain why this fails on my use case? (four image zip) https://drive.google.com/file/d/1gTZWlKmS4ZtEZDK8OjjLeGN_V0F...

A panorama is built by stitching together many images taken from the same viewpoint.

The 1st critical thing you need to know, is that the camera may not move. It may only rotate. If the camera moves a tiny bit, that's generally OK, but there will be stitching artifacts. To be really precise, the entrance pupil of the camera shouldn't move, but this is quite hard to get right.

The 2nd thing, is that the stitching algorithms need to match images to each other, and in order to do this, the images must have large overlapping portions. This usually means that if you want to create a 360 degree panorama where you spin your camera all the way around, you'll have at least about 12 images. The minimum number of images depends on how wide your lens is.

This is a great overview of panoramas: http://6.869.csail.mit.edu/fa17/lecture/lecture14sift_homogr...

One more thing: It really helps to apply lens correction to your camera images, if you're trying to create a high quality panorama.

Post reply on HN