Live data from Hacker News

Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks

news.ycombinator.com

21–30 of 58 posts

Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks

#22
post #18
post #15

Earlier quoted context omitted.

Ah, yeah, I misspoke, sorry. I was aware of that feature, but everyone I've talked to said it's so annoying to use they basically never use it, so I didn't think it was worth mentioning. The big reason it's annoying is because (I believe) Colab still only lets you connect to runtimes running on your computer - which is why at the end at the end of that article they suggest using SSH port forwarding if you want to con…

> I think Moonglow's target audience is slightly different than Colab's though because of the tight VSCode/Cursor integration - many people we've talked to said they really value the code-complete, which you can't get in any web frontend! At the risk of repeating the famous Dropbox comment I like the idea and that the ease of usage is your selling point. But I don't know if that is actually a reasonable reason. Peopl…

Thanks! I think the "deploy and connect" workflow is itself not super painful, but even if you're invested in VSCode, doing that again and again every day is pretty annoying (and it certainly was for me when I used to do ML), so hopefully the ease of use is valuable for people.

Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks

#24
post #15

Earlier quoted context omitted.

> Colab only lets you connect to compute provided by Google. That is no longer true - you can use remote kernels on your own compute via colab: https://research.google.com/colaboratory/local-runtimes.html There is also the same feature in CoCalc, including using the official colab Docker image: https://doc.cocalc.com/compute_server.html#onprem Cocalc also supports 1 click use of vscode. (The above might not work with…

Ah, yeah, I misspoke, sorry. I was aware of that feature, but everyone I've talked to said it's so annoying to use they basically never use it, so I didn't think it was worth mentioning. The big reason it's annoying is because (I believe) Colab still only lets you connect to runtimes running on your computer - which is why at the end at the end of that article they suggest using SSH port forwarding if you want to con…

Interesting idea. I'm not very well-versed in training models or LLMs or even Jupyter Notebooks, but the comment about port forwarding SSH caught my eye since I work on a free, open source zero-trust overlay network (OpenZiti). I tried to find some information about moonglow under the hood / how it worked but didn't succeed.

If you're interested, you might find embedding OpenZiti into Moonglow a pretty compelling alternative to port forwarding and it might open even crazier ideas once your connectivitiy is embedded into the app. You can find the cheapest compute for people and just connect them to that cheapest compute using your extension... Might be interesting? Anyway, I'd be happy to discuss some time if that sounds neat... Until then, good luck with your launch!

Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks

#25

We can literally transpile and run everything client side these days. You can run a recompiled quake 3 inside your browser. Why is a hosted notebook anything other than a static html+js+css site that runs behind a cdn (effectively free to host)? I suspect that’s a matter of time right?

In fact a quick google: https://github.com/jtpio/jupyterlite Yay I really can have serverless notebooks! Not just an easy to manage server environment but literally a static html file that can be passed around and runs the full notebook environment. It’s weird it was ever done any other way.

Does that run with your GPU in the way this service offers?

Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks

#27

We can literally transpile and run everything client side these days. You can run a recompiled quake 3 inside your browser. Why is a hosted notebook anything other than a static html+js+css site that runs behind a cdn (effectively free to host)? I suspect that’s a matter of time right?

I too share the dream of transpiling everything/WebAssembly/everything can run everywhere, but we're pretty far.

For a lot of ML/AI workloads and tasks, Python is just a binding for underlying C/C++.

It's already a nightmare to try to reproduce any ML/AI paper, pip breaks 3 times, incompatible peer deps, some obscure library emits an obscure CLANG error that means I need to brew install some libwhatever, etc...

I don't think the WebAssembly toolchain is quite ready for plug and play "pip install" time yet. I hope it eventually will be though.

Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks

#28

Earlier quoted context omitted.

In fact a quick google: https://github.com/jtpio/jupyterlite Yay I really can have serverless notebooks! Not just an easy to manage server environment but literally a static html file that can be passed around and runs the full notebook environment. It’s weird it was ever done any other way.

Does that run with your GPU in the way this service offers?

[deleted]

Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks

#30
post #15

Earlier quoted context omitted.

Ah, yeah, I misspoke, sorry. I was aware of that feature, but everyone I've talked to said it's so annoying to use they basically never use it, so I didn't think it was worth mentioning. The big reason it's annoying is because (I believe) Colab still only lets you connect to runtimes running on your computer - which is why at the end at the end of that article they suggest using SSH port forwarding if you want to con…

Interesting idea. I'm not very well-versed in training models or LLMs or even Jupyter Notebooks, but the comment about port forwarding SSH caught my eye since I work on a free, open source zero-trust overlay network (OpenZiti). I tried to find some information about moonglow under the hood / how it worked but didn't succeed. If you're interested, you might find embedding OpenZiti into Moonglow a pretty compelling alt…

Is it possible to use OpenZiti with Runpod? Their execution environment is very locked down, which might make ssh the only option.
Post reply on HN