Live data from Hacker News

PyTorch – Tensors and Dynamic neural networks in Python

pytorch.org

41–50 of 91 posts

Re: PyTorch – Tensors and Dynamic neural networks in Python

#41
post #9

It's a community-driven project, a Python take of Torch http://torch.ch/ . Several folks involved in development and use so far (a non-exhaustive list): * Facebook * Twitter * NVIDIA * SalesForce * ParisTech * CMU * Digital Reasoning * INRIA * ENS The maintainers work at Facebook AI Research

Not only that, but it appears to use the same core c libray (TH) as Lua torch.

Re: PyTorch – Tensors and Dynamic neural networks in Python

#42
post #3

This project aside, I'm in love with that setup UI on the homepage telling you exactly how to get started given your current setup.

Agreed. Reminds me of this scary page I found the other day when googling "certbot setup":

https://certbot.eff.org/all-instructions/

Re: PyTorch – Tensors and Dynamic neural networks in Python

#44

Guess there's no escaping Python. I had hoped Lua(jit) might emerge as a scientific programming alternative but with Torch now throwing its hat into the Python ring I sense a monoculture in the making. Bit of a shame really because Lua is a nice language and was an interesting alternative.

I was also on this bandwagon. Its about pythonic syntax not semantics that drives this.

If only Mike Pall created a transpiler infrastructure layer on top of LuaJIT.

Re: PyTorch – Tensors and Dynamic neural networks in Python

#45
post #43

Every time I decide I'm going to get into Python frameworks again, and I start looking at code, and I see people making everything object-oriented, I bail Just a personal (anti-)preference I guess

Same. I know there can be nice, composable OO approaches, but every time I bump into a super crazy stacktrace, or need one of those police-detective-style boards with yarn to connect everything, I start to wonder.

Re: PyTorch – Tensors and Dynamic neural networks in Python

#46
post #41
post #9

It's a community-driven project, a Python take of Torch http://torch.ch/ . Several folks involved in development and use so far (a non-exhaustive list): * Facebook * Twitter * NVIDIA * SalesForce * ParisTech * CMU * Digital Reasoning * INRIA * ENS The maintainers work at Facebook AI Research

Not only that, but it appears to use the same core c libray (TH) as Lua torch.

we actually share the same git-subtree between Lua and Python variants. TH, THNN, THC, THCUNN are shared.

Re: PyTorch – Tensors and Dynamic neural networks in Python

#47

Guess there's no escaping Python. I had hoped Lua(jit) might emerge as a scientific programming alternative but with Torch now throwing its hat into the Python ring I sense a monoculture in the making. Bit of a shame really because Lua is a nice language and was an interesting alternative.

You're making the language out to be more important than it really is.

The Python that you write when using these frameworks just the glue code / scripts. All you're doing is calling the framework's functions. Most of it gets thrown away (as researchers). The stuff that doesn't is self-contained and usually short. You're not writing 100k+ line codebases.

Lua may be faster for certain tasks (data processing), but the time it takes for does tasks is usually a rounding error in deep learning. Not to mention you can still code in C/C++ with pytorch.

If there is a monoculture in machine learning, it would be the deep learning monoculture.

Re: PyTorch – Tensors and Dynamic neural networks in Python

#48
post #33

Only a few months ago people saying that the deep learning library ecosystem was starting to stabilize. I never saw that as the case. The latest frontier for deep learning libraries is ensuring efficient support for dynamic computation graphs. Dynamic computation graphs arise whenever the amount of work that needs to be done is variable. This may be when we're processing text, one example being a few words while anot…

Could you elaborate on what you find lacking in TensorFlow? I regularly use TensorFlow for exactly these sorts of dynamic graphs, and it seems to work fairly well; I haven't used Chainer or DyNet extensively, so I'm curious to see what I'm missing!

Re: PyTorch – Tensors and Dynamic neural networks in Python

#49
post #31

Earlier quoted context omitted.

A very large portion of performance problems can be mitigated with the use of cython and the new asyncio stuff. asyncio success story: https://magic.io/blog/asyncpg-1m-rows-from-postgres-to-pytho... cython: http://scikit-learn.org/stable/developers/performance.html

Luajit is at least 10x faster than python and easily obviates the need to mess around with cython. That's an easy win for Lua. Let's be honest: Torch has decided that if you cannot beat them, join them. It is about network effects. Not about Python better than Lua intrinsically.

[deleted]

Re: PyTorch – Tensors and Dynamic neural networks in Python

#50

Guess there's no escaping Python. I had hoped Lua(jit) might emerge as a scientific programming alternative but with Torch now throwing its hat into the Python ring I sense a monoculture in the making. Bit of a shame really because Lua is a nice language and was an interesting alternative.

Here is an emerging julia alternative http://www.breloff.com/transformations/
Post reply on HN