SnapUp lets you shop on your iPhone by taking screenshots
1–10 of 12 posts
Re: SnapUp lets you shop on your iPhone by taking screenshots
#2Do I have to upload the pics manually?
Re: SnapUp lets you shop on your iPhone by taking screenshots
#3Do I have to upload the pics manually?
No, it detects the screenshots as you take them. (I helped build the app)
Re: SnapUp lets you shop on your iPhone by taking screenshots
#4If the tech just looks at the screenshot image, how does it have near full coverage of mobile web but has to train/fingerprint apps?
Re: SnapUp lets you shop on your iPhone by taking screenshots
#5If the tech just looks at the screenshot image, how does it have near full coverage of mobile web but has to train/fingerprint apps?
Good question- with Safari, we use the visible domain to help score the confidence for mobile websites. For native apps, we don't have any such "easy" confidence boost. So we have to fingerprint the app based on different features present in the image that is captured.
The system is computer vision / machine learning based, so even on novel sites, it will get better over time with more usage and training. We've trained it up for a bunch of the most popular sites already though.
Does this make sense?
Re: SnapUp lets you shop on your iPhone by taking screenshots
#6If the tech just looks at the screenshot image, how does it have near full coverage of mobile web but has to train/fingerprint apps?
Good question- with Safari, we use the visible domain to help score the confidence for mobile websites. For native apps, we don't have any such "easy" confidence boost. So we have to fingerprint the app based on different features present in the image that is captured. The system is computer vision / machine learning based, so even on novel sites, it will get better over time with more usage and training. We've train…
Sounds impressive. Do you have a pre-existing product database that you match them up to or do you just create products on the fly?
Re: SnapUp lets you shop on your iPhone by taking screenshots
#7[deleted]
Re: SnapUp lets you shop on your iPhone by taking screenshots
#8Earlier quoted context omitted.
Good question- with Safari, we use the visible domain to help score the confidence for mobile websites. For native apps, we don't have any such "easy" confidence boost. So we have to fingerprint the app based on different features present in the image that is captured. The system is computer vision / machine learning based, so even on novel sites, it will get better over time with more usage and training. We've train…
Sounds impressive. Do you have a pre-existing product database that you match them up to or do you just create products on the fly?
We do our own searching and wrote our own crawlers. Does that answer your question?
Re: SnapUp lets you shop on your iPhone by taking screenshots
#9Earlier quoted context omitted.
Good question- with Safari, we use the visible domain to help score the confidence for mobile websites. For native apps, we don't have any such "easy" confidence boost. So we have to fingerprint the app based on different features present in the image that is captured. The system is computer vision / machine learning based, so even on novel sites, it will get better over time with more usage and training. We've train…
Sounds impressive. Do you have a pre-existing product database that you match them up to or do you just create products on the fly?
I would strongly guess it's a fixed set of product images they're training against, possibly attained by massive scraping. Another part of training or processing might consist of a reverse image search API, like TinEye, and gathering metadata from the pages containing the result images.