Live data from Hacker News

Computational chemistry, Locally? My rant on SSH

chillphysicsenjoyer.substack.com

11–20 of 45 posts

Re: Computational chemistry, Locally? My rant on SSH

#11
> There is also a layer of friction between doing the computations and then analysing the logs that comp chemistry programs spit out. If you want to visualise orbitals or look at the outputs of your simulations, it's really awkward to run Python whilst being in the cluster, and the cluster has no GUI display.

By the description it appears computational chemistry is stuck in batch processing era. They are yet to discover their equivalent to REPL tight feedback loop workflow.

Re: Computational chemistry, Locally? My rant on SSH

#13
post #11

> There is also a layer of friction between doing the computations and then analysing the logs that comp chemistry programs spit out. If you want to visualise orbitals or look at the outputs of your simulations, it's really awkward to run Python whilst being in the cluster, and the cluster has no GUI display. By the description it appears computational chemistry is stuck in batch processing era. They are yet to disco…

You can fly by wire SLURM via Claude Code and bash fairly easily or run MATLAB batch over ssh tunnel etc

Re: Computational chemistry, Locally? My rant on SSH

#14
post #12

man 5 ssh_config /ControlMaster

how would multiplexing ssh connections help for this?

Not a help for the VPN part, but I have to 2FA for SSH, with an app or YubiKey, and that would be tedious to set up with multiple shells. With a control channel it's instant login for subsequent shells, sshfs mounts, etc.

Re: Computational chemistry, Locally? My rant on SSH

#15
Recently Claude Code said my authentication credentials had become invalid and I needed to log in again. I recorded the ridiculous number of steps this took:

- Copy-paste link to browser

- Wait several minutes while page load hangs

- Click refresh a couple of times, page finally loads

- Type in work email

- Redirect to work portal, type in work email again

- Asked for work password: open KeepassXC and type in Keepass database password

- KeepassXC additionally demands that I enter my laptop PIN

- Copy work password into work portal

- Asked for Authenticator code: go look for phone

- Find phone, load up authenticator app, type into work portal

- Wait several minutes while page load hangs

- Click refresh a couple of times, eventually get code to paste back into Claude session.

Re: Computational chemistry, Locally? My rant on SSH

#16
post #11

> There is also a layer of friction between doing the computations and then analysing the logs that comp chemistry programs spit out. If you want to visualise orbitals or look at the outputs of your simulations, it's really awkward to run Python whilst being in the cluster, and the cluster has no GUI display. By the description it appears computational chemistry is stuck in batch processing era. They are yet to disco…

I’m a computational chemist who has been working on this kind of stuff for a while, and I will say it’s just a weird field. The overall issue is that it’s still very academic and very very fragmented. People have tried to make businesses out of this stuff but it has rarely worked, and there isn’t enough money/funding to sustain the level of work needed to really advance the field in that way. Especially now that government funding is drying up and business are reluctant to spend on fundamental research like this.

Re: Computational chemistry, Locally? My rant on SSH

#17
post #7

It seems like you’re so close but yet so far. It’s interesting that you concluded that Claude makes it easier to run tasks locally but did not conclude that claude makes it easier to use the cluster. Feels we’re in need of a part 2 where you use CC to automate all of the mundane cluster work. Also just a hot tip, if you’re able to keep any always-only PC on a university subnet (your PI should have some form of a serv…

Yeah I came to the same conclusion. Universities use all kinds of hard to setup stuff which are often custom built. Slurm configs, custom configured HPC servers etc. All of this pays off though if you need to do heavy computations which a local machine won't do. IMO it would be better to make Claude build out something that makes interacting with the HPC much easier. A web UI, Tailscale whatever.

I mean Open OnDemand has been built for that purpose and is deployed in like 2000 locations at this point.

https://www.openondemand.org/

Re: Computational chemistry, Locally? My rant on SSH

#18
A modern terminal emulator like Ghostty or Kitty can render images, even over ssh. And a tui editor like Neovim or Helix works over ssh just fine. If you need something more interactive, open a Jupyter or Marimo notebook.

Working on a cluster can be a pleasure if you use the right tools.

Re: Computational chemistry, Locally? My rant on SSH

#19
post #12

Earlier quoted context omitted.

how would multiplexing ssh connections help for this?

Not a help for the VPN part, but I have to 2FA for SSH, with an app or YubiKey, and that would be tedious to set up with multiple shells. With a control channel it's instant login for subsequent shells, sshfs mounts, etc.

Sure, but that is not a problem listed in the post.

Re: Computational chemistry, Locally? My rant on SSH

#20
In my previous life I did similar computational physics work with similar environments. I ran into a similar set of problems and found that with a little work one can cobble together tools to automate all the steps that are a hassle. And then the hassle goes away. And this was pre-Claude Code. And pre-Google. And actually pre-ssh. Good old telnet for me. Some shell script or a little AppleScript. Granted no 2FA in those day. But the same learned helplessness with people sitting in front of a device who's entire purpose is to automate things and when presented with a task that would be better automated they fail to use the tools at hand to solve the problem. Kids these days (and back in those days too for that matter).
Post reply on HN