Live data from Hacker News

'New' Python modules of 2015

blog.rtwilson.com

91–100 of 137 posts

Re: 'New' Python modules of 2015

#92
post #33

Earlier quoted context omitted.

It slightly lags, but you can include pip requirements in an environment.yml file, and they install normally. I really only use conda for the non-python bits of our stack: numpy/scipy/pandas etc - packages that are a pain to install on Heroku.

They are a pain to install on a desktop as well! Especially with all the blas linking. Was there anything special you had to do or was it simply conda install numpy-blas or something like that ?

Fro Heroku we created/modified a custom buildpack (https://github.com/joshowen/conda-buildpack), and use that with the multibuildpack.

We use conda-env (https://github.com/conda/conda-env) which makes it really simple to manage environments locally and in remote environments.

Re: 'New' Python modules of 2015

#93
post #34

Earlier quoted context omitted.

We have to use a mix of pypi and conda since quite a few of our dependencies are not in conda. We have a script which checks conda first, then falls back to pypi, all from one requirements.txt

Why not conda all the way? Anything of concern? Incidentally is the buildscript of anaconda itself opensource? Couldn't find it anywhere.

Not sure if this is what you're looking for: https://github.com/conda/conda

Re: 'New' Python modules of 2015

#94
post #85

Earlier quoted context omitted.

Anaconda is very underrated, I use it both on my linux and mac systems. Also check out: Simple, Clean Python Deploys with Anaconda http://blog.stuart.axelbrooke.com/deployment-with-anaconda

I love it on Windows but I wonder why you use it on Linux. What does it do better than the alternative (native packages and pip)?

infinite8s beat me to it, exactly what he/she said.

Re: 'New' Python modules of 2015

#95
tqdm looks super promising. progressbar and progressbar2 end up being complicated and weird enough to use that my company ended up making wrappers. Why maintain that when you can just use a library that works out of the box.

It would be great if it had ipython notebook support. I often end up doing long operations that scrape services for data but have no idea what their progress is.

For me 2015 has been the year of tox. It is a great tool and worth using for just about any python project.

Re: 'New' Python modules of 2015

#96

Hands down, my favorite new library is schema: https://pypi.python.org/pypi/schema Here's a schema I use in production, see how readable it makes the parameters of the API and how quick all the validation and normalization is: https://www.pastery.net/mhwwnv/ At the end, you get an object called data, and you can do data.title, data.language, etc, and be sure that everything is as you expect.

There is also JSON-Schema protocol: http://json-schema.org/implementations.html curious how schema may be superior :).

Yup, this one is way easier to use and very cross-language compatible.

Re: 'New' Python modules of 2015

#97
post #63

Earlier quoted context omitted.

For those of us more dictionary oriented, there is https://pypi.python.org/pypi/voluptuous (which is OK for the most part, as long as you are only trying to do validation, and nothing too crazy)

Similar, I've used this library with a lot of success: https://marshmallow.readthedocs.org/en/latest/

Marshmallow is also my favourite lib of the year. Pyramid guys love it too! The developer is responsive, and the library moves really fast!

Re: 'New' Python modules of 2015

#98

tqdm looks super promising. progressbar and progressbar2 end up being complicated and weird enough to use that my company ended up making wrappers. Why maintain that when you can just use a library that works out of the box. It would be great if it had ipython notebook support. I often end up doing long operations that scrape services for data but have no idea what their progress is. For me 2015 has been the year of…

tqdm does have ipython notebook support :). Progress is displayed in stderr field under cell. But no progress bar AFAIR, just textual information.

Re: 'New' Python modules of 2015

#99
post #63

Earlier quoted context omitted.

For those of us more dictionary oriented, there is https://pypi.python.org/pypi/voluptuous (which is OK for the most part, as long as you are only trying to do validation, and nothing too crazy)

Similar, I've used this library with a lot of success: https://marshmallow.readthedocs.org/en/latest/

That looks great, I've built similar things myself and it's great to find someone elses I can use.

Re: 'New' Python modules of 2015

#100
post #18
post #10

Earlier quoted context omitted.

Me too...I taught a python class by making everyone download Anaconda's distribution of 3.x...and everyone could do the assignments no matter what kind of computer they used. Anaconda does a little too much for me to have it be my own default install but it does quite well in on boarding beginners. I use pyenv to install maintain Anaconda on my own machine when I need to replicate student work

What does it do that ends up being a little too much for your use?

A few years back I made the mistake of allowing Anaconda to prepend it's path to .bashrc without realizing it. I was a bit of a novice back then, but I had a number of existing projects in virtualenvs on my system and was rather upset when everything stopped working because my default python had changed. For those out there that would like to test out Anaconda but already have a lot of projects using their default installation, I would recommend using this installation guide to keep things separate:

http://giusedroid.blogspot.com/2015/04/dont-let-anaconda-eat...

Post reply on HN