Live data from Hacker News

What if Python was natively distributable?

medium.com

31–40 of 66 posts

Re: What if Python was natively distributable?

#31

I ask this question, but instead: I ask it of Lua. As in, what if there was a Linux distro that focused, primarily, on building a Lua layer on top of everything, system-wise. Just replace all the standard stuff with one single, system-friendly language: Lua. C/C++ everything as it currently is: put Lua on top all the way to the Desktop. It’s only a thought experiment, except there are cases where I can see a way to u…

Join the EDA industry, and you can have TCL. :D

Re: What if Python was natively distributable?

#33

Whats curious to me here is that the github repo linked to in the article seems to exactly recreate the "operating system" that is called an "opinion in the wrong layer". Perhaps I am misunderstanding this, but after looking at the code what exactly are we achieving here over other frameworks? The repo is obviously very new (and the author certainly seems busy), so perhaps a better question is what do we aim to achie…

But seriously, I just wanted to have an easy way to parallelize my projects without a bunch of slow, bloated, boilerplate ridden frameworks, and I'm having fun building it. And I must not be the only to have had this desire considering there's way more than one solution to this problem out there already, so f*k it.

Re: What if Python was natively distributable?

#34
I'm a little confused by the article. Everything mentioned seem to be real problems you'll fairly quickly run into that need real solutions (passing data over the network, handling transient errors).

Celery + Redis is already mature, easy, and can be setup quickly. Not my favorite framework by any means but it seems to work, more or less

Re: What if Python was natively distributable?

#35
post #28

Absolutely wild to see none of the long lineage of similar attempts mentioned here. The earliest I could find with a quick search was Pyro which started in 1998 and still seems to be going: https://pyro4.readthedocs.io/en/stable/ RPyC came along in the aughts. There's a long history of "transparent clustering and rpc" efforts in Python that could be used or drawn on. Sad to see that history ignored here.

I guess I'm not old enough.

to research? you should start. it can be pretty illuminating.

Re: What if Python was natively distributable?

#37

Pah - all these newcomers with interpreted/bytecode languages for remote functions! It's easy to send text or bytecode to another instance of your runtime. I did a distributed system sending native code functions to be executed remotely. Fair enough, it was for academic purposes, but it worked [1]. ------------------------------------- [1] By "worked" I mean got a passing grade on a thesis that got an IMDB number. Pr…

Film studies thesis?

Re: What if Python was natively distributable?

#38
post #5

I don't have much experience with this kind of thing, but from here it looks like a program written this way would be nearly impossible to reason about performance when something as simple as a function call in your Python interpreter can have wild fluctuations in predictability just due to underlying network latency, remote host saturation, etc. It seems like you would need an entire observability framework built an…

To be clear, not all of your coroutines become distributed. You explicitly declare what you want executed remotely, and you'll probably want your workers running in a VPC - it's just a nifty way of scaling your app horizontally without sinking too much effort into how you choose to define your distribution boundaries. It wouldn't be any different than scaling any other service horizontally using something like Kubernetes (which is probably how you'd manage wool workers as well).

Re: What if Python was natively distributable?

#40
post #28

Absolutely wild to see none of the long lineage of similar attempts mentioned here. The earliest I could find with a quick search was Pyro which started in 1998 and still seems to be going: https://pyro4.readthedocs.io/en/stable/ RPyC came along in the aughts. There's a long history of "transparent clustering and rpc" efforts in Python that could be used or drawn on. Sad to see that history ignored here.

I guess I'm not old enough.

Harsh but fair. :)
Post reply on HN