11–19 of 19 posts
Already a substantial amount of work has gone into making Ruby, R, node and Python to work.
This is the Python implementation - https://github.com/securesystemslab/zippy
Earlier quoted context omitted.
Also: https://www.python.org/dev/peps/pep-0523/
A couple years ago I was toying around with libjit in python, wrote some bindings, traced down (most of) the seqfaults and then got distracted by other things. Was going to dust it off to try to hook into pep-0523 but totally forgot about it until you posted that link. https://github.com/eponymous/libjit-python
I'd love to see a comparison of the various JIT libraries. I guess both give you optimizations and register allocation for free. Of course, the JITting speed is quite important as well.
The future of this approach is Java 9 Truffle + Graal language compiler. Already a substantial amount of work has gone into making Ruby, R, node and Python to work. This is the Python implementation - https://github.com/securesystemslab/zippy http://chrisseaton.com/rubytruffle/jokerconf17/
They have an example where this code is compiled:
def sumitup(n):
total = 0
for i in range(n):
total = total + i
return total
def sumitup(n):
if n That is, the assembly generated by clang seems to be equivalent to
if n > 1) + (n-1)
The future of this approach is Java 9 Truffle + Graal language compiler. Already a substantial amount of work has gone into making Ruby, R, node and Python to work. This is the Python implementation - https://github.com/securesystemslab/zippy http://chrisseaton.com/rubytruffle/jokerconf17/
Copyright (c) Regents of the University of California and individual contributors.
On the wiki home page, we have :
Author Wei Zhang, Facebook, Inc. Mohaned Qunaibit, University of California Irvine
So basically, this is half owned by FaceBook... Right ?
The future of this approach is Java 9 Truffle + Graal language compiler. Already a substantial amount of work has gone into making Ruby, R, node and Python to work. This is the Python implementation - https://github.com/securesystemslab/zippy http://chrisseaton.com/rubytruffle/jokerconf17/
Truffle + Graal looks awesome. I looked at some old ZipPy slides (JIT compiler for Python) here: http://socalpls.github.io/archive/2013nov/slides/zippy.pdf They have an example where this code is compiled: def sumitup(n): total = 0 for i in range(n): total = total + i return total It was optimized quite well, but still had loops. I know this is a lot to ask, but I would have expected it to be possible to specialize i…
I'll try to just talk about what makes Python hard to run quickly (especially as compared to less-dynamic languages like JS or Lua).
The thing I wish people understood about Python performance is that the difficulties come from Python's extremely rich object model, not from anything about its dynamic scopes or dynamic types. The problem is that every
operation in Python will typically have multiple points at which the user can override the behavior, and these features are used, often very extensively. Some examples are inspecting the locals of a frame after the frame
has exited, mutating functions in-place, or even something as banal as overriding isinstance. These are all things that we had to support, and are used enough that we have to support efficiently, and don't have analogs in
less-dynamic languages like JS or Lua.Earlier quoted context omitted.
A couple years ago I was toying around with libjit in python, wrote some bindings, traced down (most of) the seqfaults and then got distracted by other things. Was going to dust it off to try to hook into pep-0523 but totally forgot about it until you posted that link. https://github.com/eponymous/libjit-python
What is your impression of libjit? It looks really nice. I've only tried GNU Lightning, and I made Python bindings for it (although, today I would have used cffi to interface with it instead of my ctypes approach, because of the header files): https://github.com/cslarsen/lyn I'd love to see a comparison of the various JIT libraries. I guess both give you optimizations and register allocation for free. Of course, the…
Mostly what messing around with it did was taught me that I had a lot to learn about compiler construction which is what I've been slowly doing since then.
The blog is fun introduction into JIT compiler, but the big thing that is missing and that makes Python a hard problem for JIT is supporting Objects. From http://blog.kevmod.com/2017/02/personal-thoughts-about-pysto... I'll try to just talk about what makes Python hard to run quickly (especially as compared to less-dynamic languages like JS or Lua). The thing I wish people understood about Python performance is that…