I wonder if you could use this visual distance algorithm to somehow judge portion sizes/plate sizes?
Show HN: I built an AI that recognizes food
21–30 of 140 posts
Re: Show HN: I built an AI that recognizes food
#22Built using those newfangled convolutional neural network things. Trained caffe on a set of about a million food related images. Can't believe how accurate the classifier is... UI needs work. Would love feedback on how to make food logging more intuitive.
I'm trying to use fatsecret/myfitnesspal for counting calories. Something like this could make it much easier!
To me, a better workflow would be: take pictures of everything you eat and classify later (at night, maybe on the PC). Of course, this software would simplify the classification, the user would only fix any errors and adjust sizes.
This workflow would be well suited to your app, which operates on a server? (my understanding).
Congrats, I understand the relevance of AI for simple apps now ;)
Re: Show HN: I built an AI that recognizes food
#23I remember the latest Android camera app being able to extrapolate distances in the app (thus simulating photos with large apertures/shallow depth of field). I wonder if you could use this visual distance algorithm to somehow judge portion sizes/plate sizes?
Aside from that though, I figured Id do portion estimation down the road should this preliminary version take off.
Re: Show HN: I built an AI that recognizes food
#24Built using those newfangled convolutional neural network things. Trained caffe on a set of about a million food related images. Can't believe how accurate the classifier is... UI needs work. Would love feedback on how to make food logging more intuitive.
Your app kinda sucks now, but the detection is great. You could also do food identification as a service... I'm trying to use fatsecret/myfitnesspal for counting calories. Something like this could make it much easier! To me, a better workflow would be: take pictures of everything you eat and classify later (at night, maybe on the PC). Of course, this software would simplify the classification, the user would only fi…
It would also work nicely for background geolocation services, since if the photograph was taken near a restaurant the service could extrapolate those things.
Anyways, I might make this project opensource and build a nice community around it. Depends on whether or not that model would best support my research goals.
Re: Show HN: I built an AI that recognizes food
#25I remember the latest Android camera app being able to extrapolate distances in the app (thus simulating photos with large apertures/shallow depth of field). I wonder if you could use this visual distance algorithm to somehow judge portion sizes/plate sizes?
Haven't thought of that! What I have considered is letting users put something like a quarter or ID card in the field of view for that purpose. Aside from that though, I figured Id do portion estimation down the road should this preliminary version take off.
Re: Show HN: I built an AI that recognizes food
#26Something like this would be a fantastic addition to MyFitnessPal. I find myself sometimes not logging food on that app because I couldn't be bothered to search for it. On the other hand if the product has a barcode I always scan it in because that is convenient.
Same - its one of the reasons I wanted to make my own. That and data export functionality, which is requisite for research.
Re: Show HN: I built an AI that recognizes food
#27Earlier quoted context omitted.
Your app kinda sucks now, but the detection is great. You could also do food identification as a service... I'm trying to use fatsecret/myfitnesspal for counting calories. Something like this could make it much easier! To me, a better workflow would be: take pictures of everything you eat and classify later (at night, maybe on the PC). Of course, this software would simplify the classification, the user would only fi…
Ive been thinking of that 'classify later' workflow. I think of it kind of like facebooks photo tagging, and it might even be better as web app that you get email reminders for to complete entries. It would also work nicely for background geolocation services, since if the photograph was taken near a restaurant the service could extrapolate those things. Anyways, I might make this project opensource and build a nice…
How well does it work on plates with multiple foods "kinda mixed"?
Re: Show HN: I built an AI that recognizes food
#28Earlier quoted context omitted.
Ive been thinking of that 'classify later' workflow. I think of it kind of like facebooks photo tagging, and it might even be better as web app that you get email reminders for to complete entries. It would also work nicely for background geolocation services, since if the photograph was taken near a restaurant the service could extrapolate those things. Anyways, I might make this project opensource and build a nice…
Great! And think about using the new data from the users to improve the system (that should probably be in your terms). How well does it work on plates with multiple foods "kinda mixed"?
Implicitly, since the app presents a list of possible identified foods, and the user can easily check multiple boxes, thats straightforward, but then having the app pull each of those items AND ask the user to estimate portions for each .... gets a little messy.
So I put that complexity off for v2. That use case in particular would also be best off for a web-interface, I think.
Re: Show HN: I built an AI that recognizes food
#29Re: Show HN: I built an AI that recognizes food
#30Please do blog about the technical details, if you could post a walkthrough of setting up and training the net it would be great!