Live data from Hacker News

Oxford Deep NLP – An advanced course on natural language processing

github.com

21–30 of 68 posts

Re: Oxford Deep NLP – An advanced course on natural language processing

#21

Here [1] is an example of the videos, the player has a handy search feature and links to video parts. update: It would be great to have a way to take your own notes, any chrome extension that can help with that ? [1] https://ox.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=ff9...

Where could I find a list of links to the videos?

Re: Oxford Deep NLP – An advanced course on natural language processing

#22
"Prerequisites: This not meant to be an introduction to Machine Learning course. Hopefully you've all got some knowledge to machine learning, otherwise you may find this a bit opaque. So at least you should understand/have taken courses in linear algebra, calculus, probability, ... we are not going to do anything particularly challenging in those areas, but ideas from those areas will be useful."

around 7 mins 30secs into the introduction

Re: Oxford Deep NLP – An advanced course on natural language processing

#23
post #18

Earlier quoted context omitted.

Language encoding and generation (sequence to sequence).

Could you expand a bit on that. I have come across examples generating poems from Shakespeare works and realistic looking css/javascript but still trying to find out a more realistic usecase.

Say you want to translate a sentence from language A to language B. You have a system that generates 10 possible translations in language B. Now you use a language model of language B to figure out which is the best translation by asking the language model which of the translations has the highest probability of being generated by the model.

Re: Oxford Deep NLP – An advanced course on natural language processing

#24

Here [1] is an example of the videos, the player has a handy search feature and links to video parts. update: It would be great to have a way to take your own notes, any chrome extension that can help with that ? [1] https://ox.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=ff9...

Where could I find a list of links to the videos?

On the README https://github.com/oxford-cs-deepnlp-2017/lectures/blob/mast...

Re: Oxford Deep NLP – An advanced course on natural language processing

#25

Im taking this course at Oxford and they have been working through the practicals 1-3 (further ones will be posted) For anyone considering working through this outside of Oxford: I think the practicals are the real gems here and should be doable without the practical lab sessions that you get when attending the course. With that being said, they use a dataset a bit closer to a real world assignment. Therefore, it req…

Regarding practicals: is there anything more than the overview slides ?

Re: Oxford Deep NLP – An advanced course on natural language processing

#26

What are the practical uses of language modelling RNNs ? (apart from writing grammar/syntax checkers)

I wonder if they could be used to improve speech recognition accuracy. So you'd have two models running when someone utters a sentence: the first would generate the x most likely phrases that it thinks were spoken, and the second (the RNN) would select the highest ranked 'plausible' sentence (i.e. a sentence it would have been able to generate itself).

I guess that's a bit indirect, but these RNNs are essentially learning the 'rules' that actual phrases conform to. It'd definitely be better than trying to hard-code the rules (especially for a language like English!). And the training data is very easy to get: just feed it a few thousand ebooks, the comments section from HN etc.

Re: Oxford Deep NLP – An advanced course on natural language processing

#28

Earlier quoted context omitted.

Could you expand a bit on that. I have come across examples generating poems from Shakespeare works and realistic looking css/javascript but still trying to find out a more realistic usecase.

Say you want to translate a sentence from language A to language B. You have a system that generates 10 possible translations in language B. Now you use a language model of language B to figure out which is the best translation by asking the language model which of the translations has the highest probability of being generated by the model.

Is there any way to "translate" between writing styles of the same language? I'm thinking something analogous to the Van Gogh-ify image-processing techniques using deep convolutional networks.

Even very simple transformations, e.g., adding alliteration/assonance or adding rhymes everywhere, might be fun.

Re: Oxford Deep NLP – An advanced course on natural language processing

#30
post #25

Im taking this course at Oxford and they have been working through the practicals 1-3 (further ones will be posted) For anyone considering working through this outside of Oxford: I think the practicals are the real gems here and should be doable without the practical lab sessions that you get when attending the course. With that being said, they use a dataset a bit closer to a real world assignment. Therefore, it req…

Regarding practicals: is there anything more than the overview slides ?

yes if you go to the root https://github.com/oxford-cs-deepnlp-2017/ you will find the practicals 1-3. Practical 1 has a jupyter notebook skeleton. Practicals 2 & 3 are simply questions guiding your implementation, but you are supposed to write it yourself from scratch.
Post reply on HN