Live data from Hacker News

New Fast.ai Course: A Code-First Introduction to Natural Language Processing

fast.ai

21–23 of 23 posts

Re: New Fast.ai Course: A Code-First Introduction to Natural Language Processing

#21

I just started the fast.ai MOOC (practical deep learning for coders), and boy, I much prefer reading through a tutorial than sitting through hours upon hours of videos. I looked for transcripts and/or a written version of the content and came up empty-handed. Can anyone recommend a solid, written, introduction, covering similar material?

For deep learning / neural networks, I think these are the best balance of theory and practice (not to mention great visualizations): http://cs231n.github.io

More on the intuition/theory side for NNs, but Michael Nielsen’s book is highly recommended: http://neuralnetworksanddeeplearning.com

For NLP, you can try this extremely slick interactive course on spaCy (highly recommended Swiss Army knife library for NLP) from package author Ines Montani: https://course.spacy.io

The Keras tutorials are solid, here’s one on seq2seq models: https://blog.keras.io/a-ten-minute-introduction-to-sequence-...

For more cutting edge NLP, it looks like the fast.ai course covers the Transformer model (the basis of BERT, GPT-2, et al. This is a great overview of that architecture: http://nlp.seas.harvard.edu/2018/04/03/attention.html

And PyTorch implementations of Transformer models can be found here: https://github.com/huggingface/pytorch-pretrained-BERT/blob/...

LMK if anyone wants more, I have a learning resource hoarding problem.

Re: New Fast.ai Course: A Code-First Introduction to Natural Language Processing

#22

I just started the fast.ai MOOC (practical deep learning for coders), and boy, I much prefer reading through a tutorial than sitting through hours upon hours of videos. I looked for transcripts and/or a written version of the content and came up empty-handed. Can anyone recommend a solid, written, introduction, covering similar material?

https://www.deeplearningbook.org/ is also great

Re: New Fast.ai Course: A Code-First Introduction to Natural Language Processing

#23

I just started the fast.ai MOOC (practical deep learning for coders), and boy, I much prefer reading through a tutorial than sitting through hours upon hours of videos. I looked for transcripts and/or a written version of the content and came up empty-handed. Can anyone recommend a solid, written, introduction, covering similar material?

For deep learning / neural networks, I think these are the best balance of theory and practice (not to mention great visualizations): http://cs231n.github.io More on the intuition/theory side for NNs, but Michael Nielsen’s book is highly recommended: http://neuralnetworksanddeeplearning.com For NLP, you can try this extremely slick interactive course on spaCy (highly recommended Swiss Army knife library for NLP) from…

unfortunately the cs231n notes are not complete w.r.t the course itself. But what does exist is quite nice indeed
Post reply on HN