Live data from Hacker News

Descriptive Camera: A camera that prints a description, not an image

mattrichardson.com

21–30 of 83 posts

Re: Descriptive Camera: A camera that prints a description, not an image

#21
post #18

[deleted]

"Exactly what humans do." Isn't that because the real work is being done by a human?

You're right. I just scanned the post with the eyes before making my comment. I thought this was done with an algorithm.. That's why I deleted it. False alarm. I will not say that is useless but is not a revolution. With this we will never get a real time answer.

Re: Descriptive Camera: A camera that prints a description, not an image

#22
post #16

Earlier quoted context omitted.

I think you're missing the point of it.

Am I? Would the point somehow be served if you took a self-portrait and the response back was "haha ur so ugly"...? (I should add that I know that Amazon offers a review process, but I am not sure how it integrates with the above camera, and I am thus assuming that the camera automatically has to accept a description as correct before printing it out. This might not be the case; and I don't know.)

You are. This isn't ment to be a completely realistic project ready to be shipped, it's a glimpse of the future, or maybe an art project. I think it's wonderful to see out-of-the-box stuff like this appearing on Hacker News.

Re: Descriptive Camera: A camera that prints a description, not an image

#24
Maybe not too practical as presented here, but if you start with mechanical turks doing the recognition, the pairs of images / description could be an invaluable source when developing and training automatic algorithms that does this kind of image analysis.

Thare are already systems that can analyze wounds automatically by analyzing pictures of it.

Re: Descriptive Camera: A camera that prints a description, not an image

#25
post #19
post #8

Add speech synthesis and this would be an awesome camera for the blind.

Even with a six-minute latency?

Absolutely. for example, a big challenge for blind people is interacting with devices in the environment that report status via visual signals. For example, a blind coffee fiend I know can't tell what state his fancy espresso machine is in ("brewing", "out of beans") without sighted help to read the little display. He would happily wait a few minutes to get someone to tell him - it's quicker than waiting for his wife to come home.

Re: Descriptive Camera: A camera that prints a description, not an image

#27
post #5

Earlier quoted context omitted.

Medical analysis I don't think I would rely on a description from a Mechanical Turk human for describing what they see in a pictue. Is that a tibia or a fibula?!?

Right - you don't send to Mechanical Turk. You instead send it to a highly trained backend workforce, presumably highly skilled in the vertical that you are doing analysis on. And, it's not just a picture, but video/sound/other sensing. Who knows what the next advances in remote telemetry will be.

You can always require Mechanical Turks to pass qualification tests before they work on your HITs. There are also pre-existing qualifications like language and location.

Of course, you need to pay well enough to get enough people to bother, but I imagine one could build a reasonably skilled workforce for many areas if your training material is good and you have an objective measure of the correct answer.

This image description application is both perfect and terrible for Mechanical Turk though - it's an ideal task for a human rather than a computer, but it's also impossible to score the result objectively, so you'll have to pay everyone, all the time, or introduce another level of scoring - "Is this an accurate description?" "Does this description read fluently in $LANGUAGE" etc.

Re: Descriptive Camera: A camera that prints a description, not an image

#28

Amazing - the meta concepts behind the "Descriptive Camera" are limited only by the imagination, the resolution of the sensing devices, the ubiquity/bandwidth of the data pipe, and the ability to manage/train the backend human workforce and maintain a consistent level of quality. I'm pretty certain, that within 3-5 years, a billion dollar company will emerge using the basic concepts captured by the "descriptive camer…

I think the fauna/flora possibility is the strongest. There are lots of amateur gardeners (me:-) who would love to snap something and find out what it is (and hence how best to feed, water and shade it). I've often thought this should be possible with an android/iphone app.

Re: Descriptive Camera: A camera that prints a description, not an image

#29

  -----------------------------------
  | |                             | |
  | |    This is a picture of     | |
  | |  30-60% off top brand name  | |
  | |    shoes like Nike, Vans,   | |
  | |    Adidas, Toms, and more.  | |
  | |   Call 1-800-TURK-GAMER to  | |
  | |   find your perfect pair.   | |
  | |                             | |
  | ------------------------------- |
  |                                 |
  |                                 |
  -----------------------------------

Re: Descriptive Camera: A camera that prints a description, not an image

#30

Amazing - the meta concepts behind the "Descriptive Camera" are limited only by the imagination, the resolution of the sensing devices, the ubiquity/bandwidth of the data pipe, and the ability to manage/train the backend human workforce and maintain a consistent level of quality. I'm pretty certain, that within 3-5 years, a billion dollar company will emerge using the basic concepts captured by the "descriptive camer…

I think the fauna/flora possibility is the strongest. There are lots of amateur gardeners (me:-) who would love to snap something and find out what it is (and hence how best to feed, water and shade it). I've often thought this should be possible with an android/iphone app.

Have you seen Snapseed or Leafsnap?
Post reply on HN