MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

Why not just say the word "hysteresis" and bring some magnets to class for show-and-tell to help your students develop an intuition for the "h" parameter in RNNs.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#5

Post by schizo89 » Sun, Apr 02, 2023, 1:18 AM UTC

[flagged]

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#6

Post by spiderPig » Sun, Apr 02, 2023, 1:20 AM UTC

schizo89 wrote: post #5

[flagged]

That user name though

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#7

Post by totetsu » Sun, Apr 02, 2023, 1:21 AM UTC

matt_langston wrote: post #4

I wonder why that parameter is called "h"? Hmmm ... Why not just say the word "hysteresis" and bring some magnets to class for show-and-tell to help your students develop an intuition for the "h" parameter in RNNs.

hysteresis is also important to understand for working with radio networking.

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#8

Post by schizo89 » Sun, Apr 02, 2023, 1:23 AM UTC

spiderPig wrote: post #6

schizo89 wrote: post #5

[flagged]

That user name though

Exactly, and it has something to do with Ken Kesey. Learn about what they did to Aaron, and you will see the parallels

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#9

Post by albntomat0 » Sun, Apr 02, 2023, 1:24 AM UTC

schizo89 wrote: post #5

[flagged]

Might as well be complete, and filter out websites based on MIT developed programming languages

https://en.wikipedia.org/wiki/Hacker_News (Note the programming language, and find what it's based on)

https://en.wikipedia.org/wiki/Lisp_(programming_language)

Re: MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention [video]

#10

Post by schizo89 » Sun, Apr 02, 2023, 1:31 AM UTC

albntomat0 wrote: post #9

schizo89 wrote: post #5

[flagged]

Might as well be complete, and filter out websites based on MIT developed programming languages https://en.wikipedia.org/wiki/Hacker_News (Note the programming language, and find what it's based on) https://en.wikipedia.org/wiki/Lisp_(programming_language)

[flagged]