Live data from Hacker News

Minitorch: Implement the Torch API from Scratch, from Cornell Tech

minitorch.github.io

11–20 of 22 posts

Re: Minitorch: Implement the Torch API from Scratch, from Cornell Tech

#13
post #3

Earlier quoted context omitted.

There is also the book Deep Learning from Scratch .

Are there any resources that use languages other than python? I would prefer to work with code examples in a language that I might actually use.

> that I might actually use

The only language that you might actually use is Python.

Re: Minitorch: Implement the Torch API from Scratch, from Cornell Tech

#14
post #9

“from scratch” == “using numpy and numba”

This material is focused on teaching how to develop a Deep Learning library, and not teaching Deep Learning through implementing things from scratch.

If that's what you want, then there are:

- Data Science from Scratch

- Deep Learning from Scratch

Re: Minitorch: Implement the Torch API from Scratch, from Cornell Tech

#15
post #14
post #9

“from scratch” == “using numpy and numba”

This material is focused on teaching how to develop a Deep Learning library, and not teaching Deep Learning through implementing things from scratch. If that's what you want, then there are: - Data Science from Scratch - Deep Learning from Scratch

It's totally fine if you want to implement a DL library using Numpy. Just don't call it "from scratch". Especially if you say "in pure Python". Numpy is just as "pure Python" as Pytorch, so this does not make much sense.

Re: Minitorch: Implement the Torch API from Scratch, from Cornell Tech

#16
post #12
post #9

“from scratch” == “using numpy and numba”

If you wish to implement the Torch API from scratch, you must first invent the universe. (Apologies to Sagan)

"from scratch" in this context does not make any sense - Pytorch is already implemented "from scratch" using Python, C++, and CUDA. Implementing Pytorch using Numpy is the opposite of "from scratch".

Re: Minitorch: Implement the Torch API from Scratch, from Cornell Tech

#17
post #16
post #12

Earlier quoted context omitted.

If you wish to implement the Torch API from scratch, you must first invent the universe. (Apologies to Sagan)

"from scratch" in this context does not make any sense - Pytorch is already implemented "from scratch" using Python, C++, and CUDA. Implementing Pytorch using Numpy is the opposite of "from scratch".

I didn't dig too deeply, however on the pytorch installation page, it says "Please ensure that you have met the prerequisites below (e.g., numpy)"

Does pytorch already require numpy?

Re: Minitorch: Implement the Torch API from Scratch, from Cornell Tech

#18
post #17
post #16

Earlier quoted context omitted.

"from scratch" in this context does not make any sense - Pytorch is already implemented "from scratch" using Python, C++, and CUDA. Implementing Pytorch using Numpy is the opposite of "from scratch".

I didn't dig too deeply, however on the pytorch installation page, it says "Please ensure that you have met the prerequisites below (e.g., numpy)" Does pytorch already require numpy?

It does, because it can convert a numpy array to a pytorch tensor and back, but I don’t think numpy is used for anything else.

Re: Minitorch: Implement the Torch API from Scratch, from Cornell Tech

#19
post #15
post #14

Earlier quoted context omitted.

This material is focused on teaching how to develop a Deep Learning library, and not teaching Deep Learning through implementing things from scratch. If that's what you want, then there are: - Data Science from Scratch - Deep Learning from Scratch

It's totally fine if you want to implement a DL library using Numpy. Just don't call it "from scratch". Especially if you say "in pure Python". Numpy is just as "pure Python" as Pytorch, so this does not make much sense.

This is focused on API Design. Not on developing a DL library from scratch.

Re: Minitorch: Implement the Torch API from Scratch, from Cornell Tech

#20
post #18
post #17

Earlier quoted context omitted.

I didn't dig too deeply, however on the pytorch installation page, it says "Please ensure that you have met the prerequisites below (e.g., numpy)" Does pytorch already require numpy?

It does, because it can convert a numpy array to a pytorch tensor and back, but I don’t think numpy is used for anything else.

They must be doing something else with numpy as Python has a generic API, that allows direct access to data of numpy array-like structures: Buffer Protocol https://docs.python.org/3/c-api/buffer.html
Post reply on HN