Computational chemistry, Locally? My rant on SSH
chillphysicsenjoyer.substack.com
Computational chemistry, Locally? My rant on SSH
1–10 of 45 posts
Re: Computational chemistry, Locally? My rant on SSH
#2i think instead of trying to do more of the work locally, it might be worth considering trying to work more frictionlessly within the cluster environment instead? e.g. using claude to script visualizing the results and transferring them to your local environment for convenient inspection, or even designing a local GUI for running the jobs and inspecting the results?
it doesn't handle the VPN/2FA friction I guess, but I'd think unless most work can be done locally it would be better to invest in making cluster work more convenient
Re: Computational chemistry, Locally? My rant on SSH
#3OP is not ready for corporate environments if "VPN + ssh + 2FA" already "feels like too much" lol
I also wonder how they didn't come across X Forwarding at all? When i used a remote machine for my thesis that was one of the first things i set up, just so i could do small experiments on GPU and look at results more easily.
Basically every issue they seem to have is solved by using VSCode + Remote development (Transferring files, Customizing hotkeys, looking at outputs)
>And as for compute, I also realised that there are many small tasks that can actually be run on my machine
Yes, if you have a $3000 Computer, you can do many things that other people would need to use remote compute for. Depending on the "Cluster" they are talking about, the mac might even have better specs lol
Re: Computational chemistry, Locally? My rant on SSH
#4It seems like you’re so close but yet so far. It’s interesting that you concluded that Claude makes it easier to run tasks locally but did not conclude that claude makes it easier to use the cluster. Feels we’re in need of a part 2 where you use CC to automate all of the mundane cluster work.
Also just a hot tip, if you’re able to keep any always-only PC on a university subnet (your PI should have some form of a server) you can use tailscale as a jump proxy and bypass the whole VPN dance.
Re: Computational chemistry, Locally? My rant on SSH
#5OP is not ready for corporate environments if "VPN + ssh + 2FA" already "feels like too much" lol I also wonder how they didn't come across X Forwarding at all? When i used a remote machine for my thesis that was one of the first things i set up, just so i could do small experiments on GPU and look at results more easily. Basically every issue they seem to have is solved by using VSCode + Remote development (Transfer…
Most issues can be solved by RTFM. They don't seem to have ever considered that...
Re: Computational chemistry, Locally? My rant on SSH
#6Living this dream with the CI/CD pipeline deploying to a cloud system.
It's really, really hard to shrink the problem and troubleshoot with large, opaque, containerized chunks of functionality and services.
Can I just connect to a DB in a terminal and run some SQL to figure out the problem?
Why, no: no, you cannot.
Re: Computational chemistry, Locally? My rant on SSH
#7It seems like you’re so close but yet so far. It’s interesting that you concluded that Claude makes it easier to run tasks locally but did not conclude that claude makes it easier to use the cluster. Feels we’re in need of a part 2 where you use CC to automate all of the mundane cluster work. Also just a hot tip, if you’re able to keep any always-only PC on a university subnet (your PI should have some form of a serv…
Yeah I came to the same conclusion.
Universities use all kinds of hard to setup stuff which are often custom built. Slurm configs, custom configured HPC servers etc. All of this pays off though if you need to do heavy computations which a local machine won't do.
IMO it would be better to make Claude build out something that makes interacting with the HPC much easier. A web UI, Tailscale whatever.
Re: Computational chemistry, Locally? My rant on SSH
#8My work has the vpn simplified to just typing a single code from an app, just an 8 digit number. It's not that bad, but I despise the additional latency the VPN adds.
Re: Computational chemistry, Locally? My rant on SSH
#9> You know those really annoying shower controls in fancy hotels when you need to adjust two separate knobs for the pressure and temperature separately? That's clunky.
I like being able to control those two variables separately.
Re: Computational chemistry, Locally? My rant on SSH
#10 man 5 ssh_config
/ControlMaster