Live data from Hacker News

Array Programming with NumPy

nature.com

31–40 of 114 posts

Re: Array Programming with NumPy

#31
post #23

Ah, just the right time to publish about numpy - right when everyone is moving over to Julia because of numpy's warts.

Interestingly, one of the Julia creators is one of the named reviewers.

Julia and the NumPy/SciPy community get along pretty well (or at least they did while I was still doing this stuff). In fact, I may have first heard of Julia when someone presented it at PyCon.

Re: Array Programming with NumPy

#32
post #29

Earlier quoted context omitted.

Theoretically Julia is better for scientific computing, the only issue is its package ecosystem isn't as mature as Python's. But it's growing incredibly fast and there have already been libraries available for a few years that would be really impractical to write and maintain at such a level in C++ for Python. I assume that for science at least Julia will catch on a lot.

> Theoretically Julia is better for scientific computing, the only issue is its package ecosystem isn't as mature as Python's. That's not a small issue. The ecosystem is probably the reason people choose NumPy over MATLAB, for example. NumPy is not inherently superior to MATLAB, and most academicians that adopted NumPy in the 2000's already had a MATLAB license, so cost was not a concern either.

Well that could have been said (and was said) about Numpy/Scipy when it started, "oh R has so many more packages, what numpy can do I can do in MATLAB ...", yet here we are.

Re: Array Programming with NumPy

#34
post #30
post #28

Don't underestimate the impact this has on getting funding or even just tenure/etc recognition for working on numpy. I'm in industry these days, but coming from the academic side, it's _really_ hard to get recognized for building the underlying infrastructure that tons of people use. I've built and maintained libraries that are used in a ton of publications, but was always told my work was "utterly and completely use…

> my work was "utterly and completely useless I can never understand the arrogance of folks who would say something like this

I used to maintain a code beautifier/diff tool and hear the same things about how the idea was useless only to see those same people shortly there after use my tool or a close competitor. Once you see that pattern a few times you learn to ignore it in it’s entirety.

It’s hard to tell why people behave like that. I presume it’s because many people have a great fear of originality and require social validation.

Re: Array Programming with NumPy

#36
post #3

For some reason this struck me as inappropriate for the outlet. It's a nice piece as an introduction to array programming with numpy, but seemed out of place to me.

Yeah, this is a review article. Nature is not the right spot for it.

Nature has numerous review articles every year since 1974 (right on their website): https://www.nature.com/nature/articles?type=review-article&y...

Re: Array Programming with NumPy

#37
post #3

For some reason this struck me as inappropriate for the outlet. It's a nice piece as an introduction to array programming with numpy, but seemed out of place to me.

While NumPy may be old news to the programming community, I have experienced a surge of programming capability into wet bio labs that was not there a decade ago. This kind of article heralds its adoption to mainstream biology. It's now well known enough to interest biologists in general!

That's a good point.

At first I was like, NumPy's fame -- owing to the rise of Python in scientific computing and data science circles -- has gone far beyond that of most things ever published in academic journals, so this hardly seems necessary.

But I see your point: Nature has always been held in high regard among natural scientists, and though most recently minted natural scientists have at least a passing familiarity with Python, the generations of scientists before them probably don't. Nature at least has enough of a cachet to grab their attention.

Plus having a publication in Nature does open doors. Travis Oliphant and some of the already-famous co-authors probably don't need these doors opened, but I'm sure others on that list would benefit.

Re: Array Programming with NumPy

#38
post #32
post #29

Earlier quoted context omitted.

> Theoretically Julia is better for scientific computing, the only issue is its package ecosystem isn't as mature as Python's. That's not a small issue. The ecosystem is probably the reason people choose NumPy over MATLAB, for example. NumPy is not inherently superior to MATLAB, and most academicians that adopted NumPy in the 2000's already had a MATLAB license, so cost was not a concern either.

Well that could have been said (and was said) about Numpy/Scipy when it started, "oh R has so many more packages, what numpy can do I can do in MATLAB ...", yet here we are.

You probably don't realize it, you are agreeing with me :-)

Re: Array Programming with NumPy

#39
post #30
post #28

Don't underestimate the impact this has on getting funding or even just tenure/etc recognition for working on numpy. I'm in industry these days, but coming from the academic side, it's _really_ hard to get recognized for building the underlying infrastructure that tons of people use. I've built and maintained libraries that are used in a ton of publications, but was always told my work was "utterly and completely use…

> my work was "utterly and completely useless I can never understand the arrogance of folks who would say something like this

Academic administrators judge performance based on publication counts, journal impact factors, citations/h-index, and fundraising. Working on tooling doesn't fit in those buckets, so it's broadly-speaking "useless" to a researcher vying for promotions (eg tenure). It's an imperfect method of measuring true impact.

Re: Array Programming with NumPy

#40

Earlier quoted context omitted.

I'm interested in Julia, but if numpy has warts, I suppose Julia has not yet had time to even grow its skin.

Theoretically Julia is better for scientific computing, the only issue is its package ecosystem isn't as mature as Python's. But it's growing incredibly fast and there have already been libraries available for a few years that would be really impractical to write and maintain at such a level in C++ for Python. I assume that for science at least Julia will catch on a lot.

Julia interop with Python is insanely easy.

using PyCall

np = pyimport("numpy")

res = np.fft.fft(rand(ComplexF64, 10))

You just called numpy fft from Julia.

Post reply on HN