Neural network from scratch • Hacker News Board

Re: Neural network from scratch

#31

Post by sabertoothed » Wed, Jan 05, 2022, 12:59 PM UTC

iamricks wrote: post #29

I was disappointed when i realized this isn’t Sentdex’s NNFS. He makes really good content.

I agree. I really like his vulnerable, authentic content. He does not come across as a know-it-all but as someone who is genuinely curious about the world.

Re: Neural network from scratch

#32

Post by sabertoothed » Wed, Jan 05, 2022, 1:01 PM UTC

iamricks wrote: post #29

I was disappointed when i realized this isn’t Sentdex’s NNFS. He makes really good content.

Link to book website: https://nnfs.io/

Link to one video: https://www.youtube.com/watch?v=Wo5dMEP_BbI

Re: Neural network from scratch

#33

Post by wizzwizz4 » Wed, Jan 05, 2022, 1:20 PM UTC

bigdict wrote: post #4

import torch as scratch from scratch import nn

You can't do this in Python.

Re: Neural network from scratch

#34

Post by bsenftner » Wed, Jan 05, 2022, 2:11 PM UTC

bullen wrote: post #20

I think NNs are going to be a challenge as complexity grows. I'm trying to make mobs behave autonomously in my 3D action MMO. The memory (depth) I would need for that to succeed and the processing power to do it in real-time is making my head spin. Let's hope Raspberry 5 has some hardware to help with this. At this point I'm probably going to have some state machine AI (think mobs in Minecraft; basically check range…

Having experience writing crowd simulations in both games and VFX in film, I suggest you take a look at Massive, and perhaps read some of their documentation to learn how this successful implementation handles crowd simulations: https://www.massivesoftware.com/

Re: Neural network from scratch

#35

Post by anon_123g987 » Wed, Jan 05, 2022, 2:44 PM UTC

wizzwizz4 wrote: post #33

bigdict wrote: post #4

import torch as scratch from scratch import nn

You can't do this in Python.

You can do anything in Python.

    import antigravity

https://xkcd.com/353/

Re: Neural network from scratch

#36

Post by wizzwizz4 » Wed, Jan 05, 2022, 2:46 PM UTC

anon_123g987 wrote: post #35

wizzwizz4 wrote: post #33

Earlier quoted context omitted.

You can't do this in Python.

You can do anything in Python. import antigravity https://xkcd.com/353/

Yeah, but the Python for it would be more like:

  import sys
  import torch
  sys.modules['scratch'] = torch
  from scratch import nn

Re: Neural network from scratch

#37

Post by [deleted] » Wed, Jan 05, 2022, 2:48 PM UTC

[deleted]

Re: Neural network from scratch

#38

Post by lindwhi » Wed, Jan 05, 2022, 3:10 PM UTC

You can't definitely start Neural network without learning other concepts.

Re: Neural network from scratch

#39

Post by fhe » Wed, Jan 05, 2022, 3:27 PM UTC

iamricks wrote: post #29

I was disappointed when i realized this isn’t Sentdex’s NNFS. He makes really good content.

this is exactly that I have been looking for -- and I wonder how I missed it until now in my search for ML tutorials. Many thanks.

Re: Neural network from scratch

#40

Post by cercatrova » Wed, Jan 05, 2022, 7:23 PM UTC

gbersac wrote: post #23

Interesting read, but there's a few things I haven't understood. In the training [function]( https://colab.research.google.com/drive/1YRp9k_ORH4wZMqXLNkc... ): 1- In the instruction `hidden_layer.data[index] -= learning_rate * hidden_layer.grad.data[index]`where was the `hidden_layer.grad` value updated? 2- from what I've understood, we'll update the hidden_layer according to the inclination of the error function (be…

FYI Markdown type links don't work on HN, that's why you see people type footnotes [0]

[0] like this