Making Python fast – Adventures with mypyc
blog.meadsteve.dev
Making Python fast – Adventures with mypyc
1–10 of 95 posts
Re: Making Python fast – Adventures with mypyc
#2I recently experimented with using mypyc to make some of my python a little faster. I was pleasantly surprised with how well it worked for very little code change so I thought I'd share my experiences.
The blog post wanders around a little because I had to add setuptools and wheel building as my project had previously skipped this.
Re: Making Python fast – Adventures with mypyc
#3> for free ... this was a problem as a number of my tests rely on this [incompatible behaviour]
Re: Making Python fast – Adventures with mypyc
#4> for free ... this was a problem as a number of my tests rely on this [incompatible behaviour]
Maybe I should have said for cheap
Re: Making Python fast – Adventures with mypyc
#5I didn't know that you can compile individual modules with mypyc. That's very interesting since it allows a gradual adoption of the compiler, which really helps with big codebases.
Do you know if there are any requirements for which modules can be compiled? E.g. can they be imported in other modules or do they have to be a leaf in the import tree/graph ?
Re: Making Python fast – Adventures with mypyc
#6Nice to see this. Do they have a project roadmap for mypyc?
Doubling performance is nice, though it does still leave a lot of performance on the table. I’d be curious to see a comparison between this and Cython.
Re: Making Python fast – Adventures with mypyc
#7Mind you, it still requires to have a c compiler, to be installed separately. It's very easy on linux, but a x-code install on mac, and can be fiddling on windows.
Still nice, but not like golang or rust where you have a stand alone solution.
It's an alternative to nuitka, which I recommend to try out.
Re: Making Python fast – Adventures with mypyc
#8Is anyone else using MyPyC in production and can share their experience?
Did you attempt the compile it all approach, or incrementally add?
What do compile times look like at scale?
Would love to buy you a coffee and hear about your experience and the challenges and benefits.
Re: Making Python fast – Adventures with mypyc
#9mypyc is cool and all, but I can't help thinking about how Node just JITs everything automatically without the need for any special steps like this.
Re: Making Python fast – Adventures with mypyc
#10mypyc is cool and all, but I can't help thinking about how Node just JITs everything automatically without the need for any special steps like this.
That's not Node - that's V8. And it's possible to do the same thing for Python - there's nothing magic about JavaScript compared to Python - it's just a lot of engineering work to do it, which is beyond what this project's scope is. PyPy does it, but not inside standard Python.