Viewing profile — donnygreenberg

Hi HN, AI/ML is a vertically integrated field. Frameworks and methods that integrate deeply down the stack win. Despite this, most open-source ML libraries and frameworks do not in…

If you want a PyTorch-like experience on your own GPUs (either static or cloud), see https://github.com/run-house/runhouse

Would be nice if this came with scripts which could launch the examples on compatible GPUs on cloud providers (rather than trying to guess?). Would anyone else be interested in tha…

Neat idea and elegant execution. The vibe I'm getting from the README is that I'd want to reach for this as a Python dev (over Streamlit or Gradio) if I already have a FastAPI app …

Yes! It's natively supported in the cluster object. You can specify rh.cluster(name="my-a10", instance_type="A10:1", provider="aws"), and gcp, azure, and lambda labs are also suppo…

Good catch - this is actually only for functions defined inside interactive Notebook or iPython environments, and we do have an option to bypass it (which serializes the function a…

Yes, we work pretty closely with them and they're lovely. Everyone should try SkyPilot.

Good question. We actually use Ray to handle a bunch of the scheduling within the compute, but largely see our role as outside the compute. Meaning, Ray provides a powerful DSL for…

No, I know of CentML but don't deeply know the surface of hardware they compile for. I'm enthusiastic about projects like this and others which integrate with PyTorch 2.0. Flexible…

Excellent! Don't hesitate to reach out (donny at run dot house) if you want to chat about adopting our approach or using Runhouse.

It's a great point. The funny thing is that the rest of the world just has dev, QA, and prod staging and canaries, while ML has "the 6 months it takes to translate from notebook to…

That's a good question. I actually love the Mojo concept, but see it as very different. They're creating a portable acceleration option in Python proper, while we're trying to make…

Hi! That's awesome to hear, and very aligned with the devx we're going for. How was your system received? In fact we totally agree and are not cloudpickling the function because of…

I've been using SkyPilot for 3 months within an ML platform project and it is exactly as awesome as it sounds. The overall experience for launching and managing compute is thoughtf…