Impossible to read on mobile, least of all because of the lack of any word breaking.
I gave up after a few lines. Why would you do this?
Conda: A package management disaster?
161–170 of 234 posts
Re: Conda: A package management disaster?
#162Can somebody please eli5 why it is so unanimously accepted that Python's package management is terrible? For personal projects venv + requirements.txt has never caused problems for me. For work projects we use poetry because of an assumption that we would need something better but I remain unconvinced (nothing was causing a problem for that decision to be made).
In your requirements.txt, do you pin the concrete versions or leave some leeway? If you aren't precise, you're gonna get different versions of your dependencies on different machines. Oops. Pinning concrete versions is of course better, but then there isn't a clear and easy way to upgrade all dependencies and check whether ci still passes.
You should use freeze files. Whatever language you are using, you should specify your dependencies on the loosest way possible, and use freeze files to pin them down.
The only difference from one language to another is that some make this mandatory, while in others it's only something that you should really do and there isn't any other real option you should consider.
Re: Conda: A package management disaster?
#163I strongly suspect that there is about to be a spike in Python packaging discussion over and above the high ambient baseline.
uv is here to kick ass and chew bubblegum. And it’s all out of gum.
Re: Conda: A package management disaster?
#164Earlier quoted context omitted.
My experience with conda is that its fine if you're the original author of whatever you're using it for and never share it with anyone else. But as a professional I usually have to pull in someone else's work and make it function on a completely different machine/environment. I've only had negative experiences with conda for that reason. IME the hard job of package management is not getting software to work in one lo…
Poetry is pretty slow. I think `uv` will ultimately displace it on that basis alone.
For what it’s worth – A small technical fact:
It is entirely possible to use poetry to determine the precise set of packages to install and write a requirements.txt, and then shotgun install those packages in parallel. I used a stupidly simple fish shell for loop that ran every requirements line as a pip install with an “&” to background the job and a “wait” after the loop. (iirc) Could use xargs or parallel too.
This is possible at least. Maybe it breaks in some circumstances but I haven’t hit it.
Re: Conda: A package management disaster?
#165The Five Demons of Python Packaging That Fuel Our Persistent Nightmare:
https://youtu.be/qA7NVwmx3gw?si=QbchrYvCEp8aazvL
Re: Conda: A package management disaster?
#166As someone with admittedly no formal CS education, I've been using conda for all of my grad school and never managed to break it. I create a virtual environment for every project. I install almost all packages with pip, except for any binaries or CUDA related things from conda. I always exported the conda yaml file and managed to reproduce the code/environment including the Python version. I've seen a lot of posts ov…
This is exactly the kind of thing that causes python package nightmares. Pip is barely aware of packages it's installed itself, let alone packages from other package managers and especially other package repositories. Mixing conda and pip is 100% doing it wrong (not that there's an easy way to do it right, but stick to one or the other, I would generally recommend just using pip, the reasons for conda's existance are…
Works absolutely fine as possible with Python using conda to manage the environments and python versions and pip to install the packages.
Re: Conda: A package management disaster?
#167Really the issue is python itself, it shouldn't be treating it's installs and packages as something that's linked and intertwined to the base operating system.
People like to complain about node packages but never seen people have the trouble with them that they have with python.
Re: Conda: A package management disaster?
#168Conda is the only package manager I've used on Ubuntu that intermittently and inexplicably gets stuck when installing or uninstalling. It will sometimes resolve itself if left alone for hours, but often won't. I avoid it as much as possible.
The situation has since changed as the solver is rewritten. (Upstreamed from the work done in mamba.) I encourage you to try again.
Re: Conda: A package management disaster?
#169Can somebody please eli5 why it is so unanimously accepted that Python's package management is terrible? For personal projects venv + requirements.txt has never caused problems for me. For work projects we use poetry because of an assumption that we would need something better but I remain unconvinced (nothing was causing a problem for that decision to be made).
> For personal projects venv + requirements.txt has never caused problems for me. That means you don't use Windows. What is great. Keep not using it. But most people will have a different experience.
Wait, are most of the people having problems in this thread using windows? It's been mentioned a couple of times, but not by most.
Re: Conda: A package management disaster?
#170Are most people having problems with python packages using Windows? It's been mentioned a couple of times in this thread, but not that often.