I really like this concept. I SSH to my university HPC to submit Python script for ML related work (sbatch script.py), and sometimes I edit a script with VIM. Now I can use Jupyter Lab on HPC with port forwarding, but it is not as convenient as just running Jupyter lab locally. Does your software have some sort of command line features within Jupyter Notebook that can be run on HPC?
Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
41–50 of 58 posts
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#42I really like this concept. I SSH to my university HPC to submit Python script for ML related work (sbatch script.py), and sometimes I edit a script with VIM. Now I can use Jupyter Lab on HPC with port forwarding, but it is not as convenient as just running Jupyter lab locally. Does your software have some sort of command line features within Jupyter Notebook that can be run on HPC?
I recommend VScode for that use case (other editors probably support this too) where you can ssh to your cluster, access all your files in the tree, and run Jupyter notebooks from VScode directly using HPC resources, very nice workflow
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#43I really like this concept. I SSH to my university HPC to submit Python script for ML related work (sbatch script.py), and sometimes I edit a script with VIM. Now I can use Jupyter Lab on HPC with port forwarding, but it is not as convenient as just running Jupyter lab locally. Does your software have some sort of command line features within Jupyter Notebook that can be run on HPC?
I recommend VScode for that use case (other editors probably support this too) where you can ssh to your cluster, access all your files in the tree, and run Jupyter notebooks from VScode directly using HPC resources, very nice workflow
I almost exclusively us VSCode to access remote hosts now. VSCode is my ssh client.
I havent had a personal jupyter need like this thread is about, yet - but I am a curious mind in search of tools to help me curious harder.
I need to find a project that lets me leverage moonglow.
I hope they got the name MoonGlow from Ultima:
>Moonglow
>>Moonglow is a city dedicated to magic and mystical arts, found on the island of Verity. The principle area of the city is fenced and gated, surrounding a maze from which teleporters connect to the more outlying shops and facilities. One of these, the Encyclopedia Magicka, contains a magical pentagram, which proves to be a further teleporter. Saying, or more discretely whispering, the password ‘Recdu’ while standing on this will transport you to the Lost lands, to a second pentagram in the town of Papua. The city’s tinkers have no dedicated shop, instead they can be found in the city’s bank.
Seems appropriate for this project...
even has a theme song: https://www.youtube.com/watch?v=XMRlwVmetcc
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#44I really like this concept. I SSH to my university HPC to submit Python script for ML related work (sbatch script.py), and sometimes I edit a script with VIM. Now I can use Jupyter Lab on HPC with port forwarding, but it is not as convenient as just running Jupyter lab locally. Does your software have some sort of command line features within Jupyter Notebook that can be run on HPC?
I recommend VScode for that use case (other editors probably support this too) where you can ssh to your cluster, access all your files in the tree, and run Jupyter notebooks from VScode directly using HPC resources, very nice workflow
Yeah, I agree! We looked into integrating Moonglow with academic clusters, because many of my ML PhD friends complained about using them. We unfortunately haven't found a good generalized solution, so I think VSCode's remote SSH + manual server management is probably the best option for now.
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#45Congratulations on today's launch. Going to BYOC and test out the API on an A100.
Curious, are the SSH keys stored on Moonglow's internal servers?
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#46I really like this concept. I SSH to my university HPC to submit Python script for ML related work (sbatch script.py), and sometimes I edit a script with VIM. Now I can use Jupyter Lab on HPC with port forwarding, but it is not as convenient as just running Jupyter lab locally. Does your software have some sort of command line features within Jupyter Notebook that can be run on HPC?
Toy could try using euporie [1] to run Jupyter notebooks in the terminal
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#47Congratulations on today's launch. Going to BYOC and test out the API on an A100. Curious, are the SSH keys stored on Moonglow's internal servers?
Excited to hear that!
There's no SSH keys to store - we start a tunnel from the remote machine and connect to that.
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#48Is this similar to brev.dev?
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#49Is this similar to brev.dev?
Not exactly. Brev.dev helps you set up a Jupyter server, but you still need to set up your connection to it yourself. It's also mostly designed to run on the browser.
Moonglow abstracts over this, so you don't need to think about the server connection details at all. We're aiming for an experience where it feels like you've moved your notebook from local to cloud compute while staying in your editor.
Re: Launch HN: Moonglow (YC S24) – Serverless Jupyter Notebooks
#50We can literally transpile and run everything client side these days. You can run a recompiled quake 3 inside your browser. Why is a hosted notebook anything other than a static html+js+css site that runs behind a cdn (effectively free to host)? I suspect that’s a matter of time right?
GPU time