Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

youtube.com

Post reply on HN
Print view View original

21–30 of 63 posts

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#21

Post by kossTKR »

schizo89 wrote: post #5

[flagged]

Exactly. Unfortunately hackernews these days is huge fans of the military and the richest classes without much question.

Psyops don't exist, research journalism is tinfoilhattery and all science is awesome science.

Question one state and you're apparently fan of another, it's become the perfect setup for the status quo.

In reality the US intelligentsia is tiny and unfathomably powerful, an octopus with its arms deep in everything "academia" and technology, this is apparently mind boggling even after a myriad of leaks over the last 30 years, and no one dares to do even the simplest network analysis because of an enormous amount of media controlled shitcoating.

There's absolutely nothing "hacker" in hackernews anymore.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#22

Post by j1br »

quickthrower2 wrote: post #19
seer wrote: post #18

Earlier quoted context omitted.

I’ve been watching https://karpathy.ai/zero-to-hero.html and they seem amazing so far, literally go to gpt from basic math and programming - he first codes the libs from scratch to show you how the internals work, and only then uses an off the shelf production lib.

Yes this is a great course, on every level. I recommend to do the exercises after each lecture to cement the concepts too. The exercises are good too. Stretching but achievable.

what do you mean by exercises are there any specific exercises or the ones who is solving while he's explaining the material?

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#23

Post by sudosysgen »

credit_guy wrote: post #16
schizo89 wrote: post #5

[flagged]

> They have blood on their hands and history of silencing and oppressing dissidents such as Aaron Schwartz. I guess what you have in mind is that Aaron Swartz was arrested by the MIT Campus Police (together with a Secret Service agent). This is not oppression by MIT. The MIT Campus Police received the arrest warrant from a federal prosecutor (Carmen Ortiz) and they needed to carry out the arrest. They did not have a…

Just because other militaries are bad doesn't make the US military good. It's perfectly analogous in its wars of agression, and supporting it is morally bad, no matter how hard you whatabout it.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#24

Post by nightski »

seer wrote: post #18
ramraj07 wrote: post #13

Which is the best course or set of videos to learn the basics of neural networks and deep learning? Something that really gets the best explanation of things like backprop?

I’ve been watching https://karpathy.ai/zero-to-hero.html and they seem amazing so far, literally go to gpt from basic math and programming - he first codes the libs from scratch to show you how the internals work, and only then uses an off the shelf production lib.

It's a great resource, but very focused on language models. I'd say if you are looking for a general overview of deep learning that fastai is fantastic.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#25

Post by jessemcbride »

ramblerman wrote: post #20

Bit of a side tangent, but why does MIT upload (or allow the upload) of these videos under the staff member's youtube. Alexander Amini in this case. It makes it hard to find and subscribe to. And also a bit weird from an ownership perspective. For better or worse I think it's how Lex Fridman got his initial boost, I believe his personal youtube channel contained some popular MIT lectures of him at the start.

When I worked in higher ed, I learned that professors retain a lot more ownership of their content than I expected. I don’t know if this is how it works everywhere, but I wouldn’t be surprised if that was the case here.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#26

Post by fshbbdssbbgdd »

ramblerman wrote: post #20

Bit of a side tangent, but why does MIT upload (or allow the upload) of these videos under the staff member's youtube. Alexander Amini in this case. It makes it hard to find and subscribe to. And also a bit weird from an ownership perspective. For better or worse I think it's how Lex Fridman got his initial boost, I believe his personal youtube channel contained some popular MIT lectures of him at the start.

I thought MIT had to remove a huge catalogue of institutional content (under the opencourseware label) because of an ADA lawsuit. The problem was they didn’t hire people to subtitle it, which was discrimination.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#27

Post by flangola7 »

748 wrote: post #12
schizo89 wrote: post #10

Earlier quoted context omitted.

[flagged]

Your nickname is lit. We live in a world where we are not the only superpower. If we will stop developing capable tools for dealing with adversaries, adversaries will use that to their benefit and take advantage of our inferior toolings. Please try to understand what I am trying to say: no-one wants to have blood on their hands, but the reality is that we are not the ones who decide, whether it will be spilled, all w…

Someone can develop it, but it won't be me.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#28

Post by fnbr »

kevmo314 wrote: post #14

Interesting that they're using TensorFlow. Is TensorFlow still common for new projects or is it because Google is sponsoring the class?

It is not common for new projects. The vast majority of new projects use PyTorch, with some using tensorflow and some using JAX.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#29

Post by Foobar8568 »

fshbbdssbbgdd wrote: post #26
ramblerman wrote: post #20

Bit of a side tangent, but why does MIT upload (or allow the upload) of these videos under the staff member's youtube. Alexander Amini in this case. It makes it hard to find and subscribe to. And also a bit weird from an ownership perspective. For better or worse I think it's how Lex Fridman got his initial boost, I believe his personal youtube channel contained some popular MIT lectures of him at the start.

I thought MIT had to remove a huge catalogue of institutional content (under the opencourseware label) because of an ADA lawsuit. The problem was they didn’t hire people to subtitle it, which was discrimination.

It was Berkeley, I don't think MIT was impacted.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#30

Post by quickthrower2 »

j1br wrote: post #22
quickthrower2 wrote: post #19

Earlier quoted context omitted.

Yes this is a great course, on every level. I recommend to do the exercises after each lecture to cement the concepts too. The exercises are good too. Stretching but achievable.

what do you mean by exercises are there any specific exercises or the ones who is solving while he's explaining the material?

under the first video there is a link to a google colab document with exercises - different but similar to what is in the video.
Post reply on HN