31–40 of 83 posts
Add speech synthesis and this would be an awesome camera for the blind.
Even with a six-minute latency?
Someone (the "turk", or whatever Amazon calls them) keeps an open window (and is optionally paid for each minute with the window open), so new HITs would appear immediately, and the "turk" would be rewarded based on the speed of the response.
I was hoping that the description would be derived algorithmically rather than via human intervention. I guess that really was a bit optimistic though :(
A more practical approach may be to develop a camera with access to the web. When pictures have been taken and the camera can get a 3g/4g/wifi network connection it uploads the pics to the cloud (optionally removing or retaining to save space on the camera's local memory or allow the images to be accessed on the camera in offline mode). You can then put in some serious server power to run through all uploaded images to describe the contents (including tagging people in the photos and using GPS data to help identify content based on location context) and have this data automatically sent back to the camera (if desired) as well as stored against the image online. Randomly picked images, or those with a low accuracy rating (e.g. the algorithm has rated its description as tenuous) could be sent to a service such as mechanical turk so that the results can be verified / improved upon / to ensure the algorithm has feedback to learn from.
Add speech synthesis and this would be an awesome camera for the blind.
Earlier quoted context omitted.
I think you're missing the point of it.
Am I? Would the point somehow be served if you took a self-portrait and the response back was "haha ur so ugly"...? (I should add that I know that Amazon offers a review process, but I am not sure how it integrates with the above camera, and I am thus assuming that the camera automatically has to accept a description as correct before printing it out. This might not be the case; and I don't know.)
It is a cute idea but unfortunately (or fortunately?) this particular implementation of the camera comes with (a) opinions, (b) typos, and (c) probably trolls, if they know that their text will automatically be accepted and printed out. I guess these factors could probably be reduced with more money? I don't mean paying more for the job: I mean using the API to ask a second human to verify the results of the first hu…
I was hoping that the description would be derived algorithmically rather than via human intervention. I guess that really was a bit optimistic though :(
----------------------------------- | | | | | | This is a picture of | | | | 30-60% off top brand name | | | | shoes like Nike, Vans, | | | | Adidas, Toms, and more. | | | | Call 1-800-TURK-GAMER to | | | | find your perfect pair. | | | | | | | ------------------------------- | | | | | -----------------------------------
Amazing - the meta concepts behind the "Descriptive Camera" are limited only by the imagination, the resolution of the sensing devices, the ubiquity/bandwidth of the data pipe, and the ability to manage/train the backend human workforce and maintain a consistent level of quality. I'm pretty certain, that within 3-5 years, a billion dollar company will emerge using the basic concepts captured by the "descriptive camer…
Medical analysis I don't think I would rely on a description from a Mechanical Turk human for describing what they see in a pictue. Is that a tibia or a fibula?!?
Here is an idea, translate the text into a picture. An API will take text and generate a representation of the description using images from the web via google image search.