Live data from Hacker News

What's up in the Python community? – April 2023

bitecode.substack.com

21–30 of 63 posts

Re: What's up in the Python community? – April 2023

#21
post #14

I just tried some pre-trained models to classify images, using a CPU, it takes about 10s to 15s per image. I did not know it was so inefficient.

I am trying to understand your point. Are you saying it could be more efficient on a CPU using a different language than Python? Or are you saying CPUs are slow, GPUs should be used? Or are you saying classifying images algorithms can be improved more?

Re: What's up in the Python community? – April 2023

#22

I was browsing the most popular pip packages recently and was also downright shocked how much AI stuff is up at the top. I will be very curious if much of these things are still popular or relevant in a year.

Python has exploded in popularity over the past ~7 years because of AI. Python’s ever increasingly relevance is directly tied to AI.

Re: What's up in the Python community? – April 2023

#23

I was browsing the most popular pip packages recently and was also downright shocked how much AI stuff is up at the top. I will be very curious if much of these things are still popular or relevant in a year.

Python has exploded in popularity over the past ~7 years because of AI. Python’s ever increasingly relevance is directly tied to AI.

And Flask, and FastAPI, and pandas, and pola.rs, and numba, and as glue code, and....

"AI" is pretty narrow, but the python ecosystem is massive, which a strong incumbency in the data processing space. Weird, since it i̶s̶n̶'̶t̶ ̶a̶ ̶t̶y̶p̶e̶d̶ is a dynamically language, where sometimes placeholders like pandas `object` result in unexpected behavior, but it sure is simple to write something quick.

Re: What's up in the Python community? – April 2023

#25
post #14

I just tried some pre-trained models to classify images, using a CPU, it takes about 10s to 15s per image. I did not know it was so inefficient.

The neural network inference (and training) is all done in compiled C libraries called by Python. The inefficiencies you're seeing are because you're doing it on a CPU, probably in one thread, rather than on a GPU with tens of thousands of "threads."

Re: What's up in the Python community? – April 2023

#26
post #23

Earlier quoted context omitted.

Python has exploded in popularity over the past ~7 years because of AI. Python’s ever increasingly relevance is directly tied to AI.

And Flask, and FastAPI, and pandas, and pola.rs, and numba, and as glue code, and.... "AI" is pretty narrow, but the python ecosystem is massive, which a strong incumbency in the data processing space. Weird, since it i̶s̶n̶'̶t̶ ̶a̶ ̶t̶y̶p̶e̶d̶ is a dynamically language, where sometimes placeholders like pandas `object` result in unexpected behavior, but it sure is simple to write something quick.

> "AI" is pretty narrow, but the python ecosystem is massive, which a strong incumbency in the data processing space. Weird, since it isn't a typed language

Nor is Excel, and that didn't stop it.

Re: What's up in the Python community? – April 2023

#28

Question from a beginner: I'm deploying a python project to aws (beanstalk + lambda, among others), and I've noticed I can only use python versions 3.9 and 3.8. Why is that? Is 3.10 not considered stable?

Lambda support was added this month:

https://aws.amazon.com/about-aws/whats-new/2023/04/aws-lambd...

Re: What's up in the Python community? – April 2023

#29
post #12

I was browsing the most popular pip packages recently and was also downright shocked how much AI stuff is up at the top. I will be very curious if much of these things are still popular or relevant in a year.

By volume of different projects probably not, but by usage probably. Once winners get decided and paths get treaded the ecosystem will probably be smaller but I bet the user count will be bigger. Look, even if you're the most biggest skeptic of all the AI stuff you can still do useful things with it that you couldn't before like present full-English interfaces and get embeddings for arbitrary text which is a leap com…

Is this a setup you've already built? Could you outline what you've glued together for this bot?

Re: What's up in the Python community? – April 2023

#30

I was browsing the most popular pip packages recently and was also downright shocked how much AI stuff is up at the top. I will be very curious if much of these things are still popular or relevant in a year.

So weird - you really think AI/ML is a flash in the pan when it comes to Python? You realize pytorch, tensorflow, pandas, numpy, scikit-learn are all approaching 10 years on pypi?

Yeah all the stuff I was seeing seemed to be variations and light wrappers around openai APIs and such. We don't need a million versions of those things, one or two clear 'winners' should emerge. You can see them here, expand it to 50 per page and start browsing down after the usual suspects: https://awesomepython.org/
Post reply on HN