Live data from Hacker News

Cutting Edge Deep Learning for Coders, Part 2

course.fast.ai

21–30 of 77 posts

Re: Cutting Edge Deep Learning for Coders, Part 2

#21
post #16

I watched all of the 2018 Part 1 videos and it was not my style. One thing I liked is the positive attitudes of Jeremy and Rachel, but there was not much theory and a lot of time was spent on questions and answers for the participants of the lecture that I don't think necessary. I wanted to see definitions and "why", but the course spends too much time on "how". Sometimes I see "why" in the lecture, but many times it…

Top-down vs bottom-up depends to some extent on what you enjoy, vs what you need to be patient about. With our top-down approach you do get to all of the 'why', but only after understanding 'how'. So it's good for people who want to get started doing stuff right away, and don't mind waiting a bit to understand the details. It means you can start experimenting and building a good intuition for training models, which I believe is the most important skill for a practitioner.

On the other hand, with the bottom-up approach of Andrew Ng in deeplearning.ai, you start with a lot of 'why', and later on get to 'how' (although in less detail and fewer best practices than we show). So it's good for people who want to understand the theory right away, and don't mind waiting a bit to understand how to use it.

A lot of our students did Andrew's course after ours, and many did it in the reverse order. All have reported finding the combination more helpful than either on their own. When we describe 'why' it's mainly with code, whereas with Andrew it's mainly with math - so which you prefer will also depend on which notation and framework you're more comfortable with.

(But I promise - you do get all the 'how' with us, particularly in part 2! Our students have gone on to OpenAI, Google Brain, and senior AI leadership positions at well known startups, as well as writing and implementing new papers. Here's an example of a student who just implemented a paper that was released within the last month: https://sgugger.github.io/deep-painterly-harmonization.html#... )

Re: Cutting Edge Deep Learning for Coders, Part 2

#22
post #14
post #12

Earlier quoted context omitted.

Is Rachel the lady that always keeps interrupting Jeremy so that he goes out of flow all the time, making lectures less enjoyable?

Dr Rachel Thomas, the co-founder of fast.ai, is the person who takes the highest voted questions from our 600+ in-person students and passes them on to me, as I asked her to do. At least 4 different people must have wanted the question asked before she asks it. This approach helps ensure that if I haven't explained something clearly enough that I get another chance to do so, and, more importantly, keeps me fresh and…

I am a firm believer in candid feedback; I talked to multiple people taking fast.ai and all of them took it as disturbing the flow of lectures. I really like fast.ai, it's an excellent hands-on course, so please don't get offended.

Re: Cutting Edge Deep Learning for Coders, Part 2

#23
post #6

Earlier quoted context omitted.

I might be helping author a textbook based on our upcoming introduction to machine learning MOOC. Which maybe one day would lead to a deep learning book - but that would be years away! (BTW, I used to think I didn't like videos for learning, but actually I now think some material works best in this format. E.g. in this case we're walking through interactive notebooks, and you can follow along too. Some of the materia…

Just another thought on this, as someone slowly trying to work his way through part 1 (and generally very happy with it, thanks for this amazing resource!): videos are great when they're really short. It's tough for working people to find enough unbroken time to watch an hour or two long video, like the ones in fast.ai (as amazing as they are), especially with frequent pauses for note-taking and such. But it's much e…

Thanks for the feedback! One thing you may be interested in, if you haven't seen it, is that you can right-click the video and copy a link to the current time code, so you can always go back to where you were (or just pause the video in a tab and return later).

Personally, I really hate the Coursera approach of lots of separate short videos - I totally get that some people like it, and that's fine, but it's not something I want to do myself.

Re: Cutting Edge Deep Learning for Coders, Part 2

#24
post #5
post #2

Jeremy from fast.ai here. I've posted a summary of the course materials for anyone who's interested : http://www.fast.ai/2018/05/07/part2-launch/ Let me know if you have any questions about the material or approach. There's also a discussion for the course here: http://forums.fast.ai/c/part2-v2

Hey Jeremy, thanks for making these courses! I was curious if you could offer any points of comparison between the fast.ai courses and the Udacity ML nanodegree course (or any other MOOCs you have opinions about).

fast.ai 1 is much better than Udacity's ML if you want to do purely Deep Learning. Udacity's DLF ND is IMO better than fast.ai 1. However, fast.ai 2 is way better than Udacity's DLF ND, and only their self-driving car has some Deep Learning models that are even more awesome (imagine driving using Deep Learning only). Take both fast.ai 1 and DLF ND if you are a beginner; after that jump on Stanford's CV & NLP courses; Oxford NLP might be a good idea as well. Then do UCL's Reinforcement Learning and you are set.

Re: Cutting Edge Deep Learning for Coders, Part 2

#26
post #23

Earlier quoted context omitted.

Just another thought on this, as someone slowly trying to work his way through part 1 (and generally very happy with it, thanks for this amazing resource!): videos are great when they're really short. It's tough for working people to find enough unbroken time to watch an hour or two long video, like the ones in fast.ai (as amazing as they are), especially with frequent pauses for note-taking and such. But it's much e…

Thanks for the feedback! One thing you may be interested in, if you haven't seen it, is that you can right-click the video and copy a link to the current time code, so you can always go back to where you were (or just pause the video in a tab and return later). Personally, I really hate the Coursera approach of lots of separate short videos - I totally get that some people like it, and that's fine, but it's not somet…

Oh, I did not know you could link to specific time slices! That's a big help, thanks!

Re: Cutting Edge Deep Learning for Coders, Part 2

#27
post #5
post #2

Jeremy from fast.ai here. I've posted a summary of the course materials for anyone who's interested : http://www.fast.ai/2018/05/07/part2-launch/ Let me know if you have any questions about the material or approach. There's also a discussion for the course here: http://forums.fast.ai/c/part2-v2

Hey Jeremy, thanks for making these courses! I was curious if you could offer any points of comparison between the fast.ai courses and the Udacity ML nanodegree course (or any other MOOCs you have opinions about).

Thanks Jeremy and Rachel for the excellent materials. I am a beginner with ML and initially tried to start with fast.ai part-1. I struggled initially as I preferred to know some basics. So, I looked for a beginner friendly course and ended up with Udacity's AI programming with Python. It gives a pretty decent overview on the basics. Now, I am very excited to take up the fast.ai part-1 & part-2 courses.

Re: Cutting Edge Deep Learning for Coders, Part 2

#28
post #2

Jeremy from fast.ai here. I've posted a summary of the course materials for anyone who's interested : http://www.fast.ai/2018/05/07/part2-launch/ Let me know if you have any questions about the material or approach. There's also a discussion for the course here: http://forums.fast.ai/c/part2-v2

Jeremy and Rachel are very active on Twitter. I learn a lot from their tweets too! Thanks!!

Re: Cutting Edge Deep Learning for Coders, Part 2

#29
I have taken the classes and also did Udacity Nano Degree and Deeplearning.ai. All of them help you in your journey of mastering DL. But Fast.AI part-2 really teaches you to cutting edge of DL through a number of practical examples. Don't wait and join other fellow learners at forums.fast.ai

Re: Cutting Edge Deep Learning for Coders, Part 2

#30
post #22
post #14

Earlier quoted context omitted.

Dr Rachel Thomas, the co-founder of fast.ai, is the person who takes the highest voted questions from our 600+ in-person students and passes them on to me, as I asked her to do. At least 4 different people must have wanted the question asked before she asks it. This approach helps ensure that if I haven't explained something clearly enough that I get another chance to do so, and, more importantly, keeps me fresh and…

I am a firm believer in candid feedback; I talked to multiple people taking fast.ai and all of them took it as disturbing the flow of lectures. I really like fast.ai, it's an excellent hands-on course, so please don't get offended.

Personally, I find the questions helpful, and for everyone who's watching on video, you can skip whatever portion you like, can't you?
Post reply on HN