Live data from Hacker News

Dive into Deep Learning

d2l.ai

1–10 of 94 posts

Re: Dive into Deep Learning

#3

this looks pretty good. certainly much better than goodfellow's deep learning book. definitely much the diagrams and code are much appreciated but i'm curious why mxnet over pytorch?

I find this comment amusing, have you read the goodfellow's book? That book is amazing.

Re: Dive into Deep Learning

#4
I'll chip in with my book, which is written with programmers in mind, implements everything from scratch, works on CPU and GPU, at great speed. Directly links theory to implementation, and you can use it along with Goodfellow's Deep Learning book. Also, discusses all steps, and does not skip gradients by using autograd.

Deep Learning for Programmers: An Interactive Tutorial with CUDA, OpenCL, DNNL, Java, and Clojure.

https://aiprobook.com/deep-learning-for-programmers/

Re: Dive into Deep Learning

#6

this looks pretty good. certainly much better than goodfellow's deep learning book. definitely much the diagrams and code are much appreciated but i'm curious why mxnet over pytorch?

all the authors look to be Amazon employees and I think MXNet is Amazon's "chosen" DL framework.

Re: Dive into Deep Learning

#7

this looks pretty good. certainly much better than goodfellow's deep learning book. definitely much the diagrams and code are much appreciated but i'm curious why mxnet over pytorch?

all the authors look to be Amazon employees and I think MXNet is Amazon's "chosen" DL framework.

ah that makes sense. should've googled author's names. i just assumed they were academic because of the large number of unis using the book.

Re: Dive into Deep Learning

#8
As an engineer I find myself in this type of situation quite often - if anyone can point me to some good resources or has any advice, I'd be quite grateful:

- Some non-technical stakeholder comes to me and says "can we solve this problem with Machine Learning?" usually it's something like "there need to be two supervisors on the factory floor at all times, and I want an email alert everytime there are less than 2 supervisors for more than 20 minutes"

- I ask for some sample footage to build a prototype and get a few very poor quality videos, at a very different standard from what I see in most of these tutorials.

- I find some pre-trained model that is able to do people detection or face detection and return bounding rectangles and download it in whatever form

- After about 30 minutes of fiddling and googling errors, I run it against the sample footage

- I get about 60% accuracy - this is no good. Where do I go from here? Keep trying different models? There are all sorts of models like YOLO and SSD and RetinaNet and YOLO2 and YOLO3.

- At some point I try a bunch of models and all of them are at best 75% good. At this point I figure I should train it with my own dataset, and so I guess I need to arrange to have this stuff labelled. In my experience stakeholders are usually willing to appoint someone to do it but they want to know how much footage they need to label and whether their team will need special training to do the labelling and after it's all done is this even going to work?

What are some effective / opinionated workflows for this part of the overall process that have worked well for you? What's a labelling tool that non-technical users can use intuitively? How good are tools/services like Mechanical Turk and Ground Truth?

This part of the process costs time and money - stakeholders, particularly managers who are non-technical tend to want an answer beforehand - "If we spend all this time and money labelling footage, how well is this going to work? How much footage do we need to label?". How do you handle these kinds of conversations?

I find this space fairly well-populated with ML tutorials and resources but haven't been able to find content that is focused on this part of the process.

Re: Dive into Deep Learning

#9
post #8

As an engineer I find myself in this type of situation quite often - if anyone can point me to some good resources or has any advice, I'd be quite grateful: - Some non-technical stakeholder comes to me and says "can we solve this problem with Machine Learning?" usually it's something like "there need to be two supervisors on the factory floor at all times, and I want an email alert everytime there are less than 2 sup…

60% on a per-frame basis might be enough if all you need to do is identify the condition "two supervisors are not on the floor" for at least 20 minutes.

As in, if you compute your per-frame score and compare it over bigger chunks of time, is it sufficiently different when 2 are on the floor and 2 are not?

Post reply on HN