Live data from Hacker News

Show HN: I built an AI that recognizes food

infino.me

21–30 of 140 posts

Re: Show HN: I built an AI that recognizes food

#21
I remember the latest Android camera app being able to extrapolate distances in the app (thus simulating photos with large apertures/shallow depth of field).

I wonder if you could use this visual distance algorithm to somehow judge portion sizes/plate sizes?

Re: Show HN: I built an AI that recognizes food

#22

Built using those newfangled convolutional neural network things. Trained caffe on a set of about a million food related images. Can't believe how accurate the classifier is... UI needs work. Would love feedback on how to make food logging more intuitive.

Your app kinda sucks now, but the detection is great. You could also do food identification as a service...

I'm trying to use fatsecret/myfitnesspal for counting calories. Something like this could make it much easier!

To me, a better workflow would be: take pictures of everything you eat and classify later (at night, maybe on the PC). Of course, this software would simplify the classification, the user would only fix any errors and adjust sizes.

This workflow would be well suited to your app, which operates on a server? (my understanding).

Congrats, I understand the relevance of AI for simple apps now ;)

Re: Show HN: I built an AI that recognizes food

#23
post #21

I remember the latest Android camera app being able to extrapolate distances in the app (thus simulating photos with large apertures/shallow depth of field). I wonder if you could use this visual distance algorithm to somehow judge portion sizes/plate sizes?

Haven't thought of that! What I have considered is letting users put something like a quarter or ID card in the field of view for that purpose.

Aside from that though, I figured Id do portion estimation down the road should this preliminary version take off.

Re: Show HN: I built an AI that recognizes food

#24
post #22

Built using those newfangled convolutional neural network things. Trained caffe on a set of about a million food related images. Can't believe how accurate the classifier is... UI needs work. Would love feedback on how to make food logging more intuitive.

Your app kinda sucks now, but the detection is great. You could also do food identification as a service... I'm trying to use fatsecret/myfitnesspal for counting calories. Something like this could make it much easier! To me, a better workflow would be: take pictures of everything you eat and classify later (at night, maybe on the PC). Of course, this software would simplify the classification, the user would only fi…

Ive been thinking of that 'classify later' workflow. I think of it kind of like facebooks photo tagging, and it might even be better as web app that you get email reminders for to complete entries.

It would also work nicely for background geolocation services, since if the photograph was taken near a restaurant the service could extrapolate those things.

Anyways, I might make this project opensource and build a nice community around it. Depends on whether or not that model would best support my research goals.

Re: Show HN: I built an AI that recognizes food

#25
post #21

I remember the latest Android camera app being able to extrapolate distances in the app (thus simulating photos with large apertures/shallow depth of field). I wonder if you could use this visual distance algorithm to somehow judge portion sizes/plate sizes?

Haven't thought of that! What I have considered is letting users put something like a quarter or ID card in the field of view for that purpose. Aside from that though, I figured Id do portion estimation down the road should this preliminary version take off.

Its not that bad to let the user estimate it too.

Re: Show HN: I built an AI that recognizes food

#26
post #10

Something like this would be a fantastic addition to MyFitnessPal. I find myself sometimes not logging food on that app because I couldn't be bothered to search for it. On the other hand if the product has a barcode I always scan it in because that is convenient.

Same - its one of the reasons I wanted to make my own. That and data export functionality, which is requisite for research.

I feel like its easy to make a better app if you don't try to please all use cases - just try to make the food logging in less taps. Logging in those apps takes me around 5-10 taps plus typing the food name. Ify ou could do it in 2 or 3, it would be great.

Re: Show HN: I built an AI that recognizes food

#27
post #22

Earlier quoted context omitted.

Your app kinda sucks now, but the detection is great. You could also do food identification as a service... I'm trying to use fatsecret/myfitnesspal for counting calories. Something like this could make it much easier! To me, a better workflow would be: take pictures of everything you eat and classify later (at night, maybe on the PC). Of course, this software would simplify the classification, the user would only fi…

Ive been thinking of that 'classify later' workflow. I think of it kind of like facebooks photo tagging, and it might even be better as web app that you get email reminders for to complete entries. It would also work nicely for background geolocation services, since if the photograph was taken near a restaurant the service could extrapolate those things. Anyways, I might make this project opensource and build a nice…

Great! And think about using the new data from the users to improve the system (that should probably be in your terms).

How well does it work on plates with multiple foods "kinda mixed"?

Re: Show HN: I built an AI that recognizes food

#28
post #27

Earlier quoted context omitted.

Ive been thinking of that 'classify later' workflow. I think of it kind of like facebooks photo tagging, and it might even be better as web app that you get email reminders for to complete entries. It would also work nicely for background geolocation services, since if the photograph was taken near a restaurant the service could extrapolate those things. Anyways, I might make this project opensource and build a nice…

Great! And think about using the new data from the users to improve the system (that should probably be in your terms). How well does it work on plates with multiple foods "kinda mixed"?

Thats another huge design challenge Ive faced, specifically because it really complicates the data model and UI.

Implicitly, since the app presents a list of possible identified foods, and the user can easily check multiple boxes, thats straightforward, but then having the app pull each of those items AND ask the user to estimate portions for each .... gets a little messy.

So I put that complexity off for v2. That use case in particular would also be best off for a web-interface, I think.

Post reply on HN