Not Hotdog App • Hacker News Board

Re: Not Hotdog App

#111

Post by redxblood » Tue, May 16, 2017, 4:28 PM UTC

timanglade wrote: post #13

Ha didn't expect this to end up here. If anyone is interested, I'm working on a blogpost explaining how we built the app in detail… It uses embedded TensorFlow on device (better availability, better speed, better privacy, $0 cost), with a custom neural net inspired by last month's MobileNets paper, built & trained with Keras. It was loads of fun to build :)

Definitely! Link please?

Re: Not Hotdog App

#112

Post by ip_addr » Tue, May 16, 2017, 4:31 PM UTC

a_c wrote: post #108

timanglade wrote: post #13

Ha didn't expect this to end up here. If anyone is interested, I'm working on a blogpost explaining how we built the app in detail… It uses embedded TensorFlow on device (better availability, better speed, better privacy, $0 cost), with a custom neural net inspired by last month's MobileNets paper, built & trained with Keras. It was loads of fun to build :)

Had not heard MobileNets before. Mind sharing which paper are you referring to?

I believe they are referring to this paper titled "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications"

https://arxiv.org/pdf/1704.04861.pdf

Re: Not Hotdog App

#113

Post by timanglade » Tue, May 16, 2017, 4:33 PM UTC

laktek wrote: post #87

timanglade wrote: post #28

Earlier quoted context omitted.

It was random, I was already working on the show as what Hollywood calls a (technical) “consultant”: advising on storylines, dialogue, background assets, etc. When this idea popped up, someone suggested we build the app for real. We took a try and ended up building the entire thing in-house with the crew, as opposed to hiring an external agency to do it for us.

How long did it take you to build the app? How many devs worked on it and who got to feed the training data set?

I should say a lot of people made the app possible, including the show's awesome producers, writers, designers, and a lot of kind folks at HBO. To answer your question, I was the only dev on the project, and I've been working on it since last Summer, on a very part-time basis (some nights and weekends). A lot of time was spent learning Deep Learning to be honest. The last revision of the neural net was designed & trained in less than a month of nights/weekend work but obviously couldn't have been achieved without the preceding months of work — but if I was starting today knowing what I know now yeah it'd probably be about a month of work. The React Native shell around the neural net was just a few weekends worth of work — mostly it was about finding the right extensions, tuning a few things for rendering/performance, and like a whole weekend dealing with the UX around iOS permissions to access the camera & photos (lol it's seriously so complicated).

Re: Not Hotdog App

#114

Post by porker » Tue, May 16, 2017, 4:34 PM UTC

timanglade wrote: post #26

pkulak wrote: post #21

Earlier quoted context omitted.

It was written in Objective C?

It's actually written in React Native with a fair bit of C++ (TensorFlow), and some Objective-C++ to glue the two. One cool thing we added on top of React Native was a hack to let us inject new versions of our deep learning model on the fly without going through an App Store review. If you thought injecting JavaScript to change the behavior of your app was cool, you need to try injecting neural nets, it's quite a fee…

Nice! I'd never known that C++ could be used in an iOS app; learned something new today thanks.

Re: Not Hotdog App

#115

Post by tripzilch » Tue, May 16, 2017, 4:37 PM UTC

Hail Eris! This app may be very useful to Discordians, because of the Original Snub and the Five Commandmends of the Pentabarf: http://www.principiadiscordia.com/book/11.php

Re: Not Hotdog App

#116

Post by [deleted] » Tue, May 16, 2017, 4:38 PM UTC

659087 wrote: post #109

timanglade wrote: post #13

Ha didn't expect this to end up here. If anyone is interested, I'm working on a blogpost explaining how we built the app in detail… It uses embedded TensorFlow on device (better availability, better speed, better privacy, $0 cost), with a custom neural net inspired by last month's MobileNets paper, built & trained with Keras. It was loads of fun to build :)

> It uses embedded TensorFlow on device (better availability, better speed, better privacy, $0 cost) It's sad that this isn't more common outside of hot dog detectors.

[deleted]

Re: Not Hotdog App

#117

Post by timanglade » Tue, May 16, 2017, 4:39 PM UTC

vernie wrote: post #107

timanglade wrote: post #13

Ha didn't expect this to end up here. If anyone is interested, I'm working on a blogpost explaining how we built the app in detail… It uses embedded TensorFlow on device (better availability, better speed, better privacy, $0 cost), with a custom neural net inspired by last month's MobileNets paper, built & trained with Keras. It was loads of fun to build :)

How did you not expect it to end up here?

I honestly thought the app itself would come across as too limited — and I wasn't quite sure how HN felt about the show it's attached to. I was preparing that technical blogpost specifically for HN because I thought that would be a more hacker-centric way of looking at the same thing.

Re: Not Hotdog App

#118

Post by timanglade » Tue, May 16, 2017, 4:41 PM UTC

1zee wrote: post #99

timanglade wrote: post #86

Earlier quoted context omitted.

Sounds like you're further ahead than I was with the React Native part! Not Hotdog is very simple so I just wrote a simple Native module around my TensorFlow code and let the chips fall where they may performance-wise. The snap/analyze/display sequence is slow enough that I don't need to worry about fps or anything like that. As much as I enjoyed using RN for this app, I would probably move to native code if I needed…

Can you explain to a noob how you wrote the Native module around TensorFlow? My main area of focus is in python, but I feel hindered when I think I'm ready to start developing for mobile apps. I'm looking into RN, but still not sure how that plays with TF and other python modules.

It was honestly just maybe 10 lines of code, but I was very confused about it before I got it done. The message passing is a bit counterintuitive at first. I'll try to share example code in my blogpost!

Re: Not Hotdog App

#119

Post by imsofuture » Tue, May 16, 2017, 4:41 PM UTC

timanglade wrote: post #117

vernie wrote: post #107

Earlier quoted context omitted.

How did you not expect it to end up here?

I honestly thought the app itself would come across as too limited — and I wasn't quite sure how HN felt about the show it's attached to. I was preparing that technical blogpost specifically for HN because I thought that would be a more hacker-centric way of looking at the same thing.

You can tell a lot about SV-types based on how they feel about the show SV...

Re: Not Hotdog App

#120

Post by timanglade » Tue, May 16, 2017, 4:54 PM UTC

alexcnwy wrote: post #41

For anyone keen to learn more about object detection (and deep learning in general), I just finished working through an excellent free MOOC taught by Jeremy Howard (former chief scientist at Kaggle) - you basically learn how to fine-tune a convolutional neural network with your own data (e.g. hotdog vs not hotdog) in lesson 2! http://course.fast.ai/lessons/lesson2.html

I can't recommend that course enough! I attended it in person and got a lot out of it. Jeremy & Rachel were also enormously kind & helpful outside of class.