Are there ways to run such apps with a remote GPU over network? I want to run the UI on my laptop, but use my homeserver GPU from the local network. Anything better than X forwarding?
This project returns results over HTTP. You get what you want by running the server binary on the server, then access it with your web browser.
For example, to run the Stable Diffusion webui (which defaults to port 7860), it would be something not too far off from:
$ ssh -p1234 -L7860:127.0.0.1:7860 assigned.dns.at.startup.ngrok.io
(IIRC ngrok free-tier will allocate you a random port on the public side every time you start the service)
Then, can just browse localhost:7860 from the remote field machine.
I got bit by the AI bug a few days ago, and I already rent some lightsail instances, one of which has a static IP reserved and one of my domain names pointing to it. So, I set up something a little more convoluted and perhaps unnecessarily complex, turning that lightsail VM into a jumpbox/bastion host. Anywho:
AutoSSH from server to my lightsail instance, with two remote port forwards (not local port forwards): SSH and SD webui. Then, connect from the field machine anywhere in the world to the jumpbox with matching local port forwards. (I set up both ports, so I can shell back into the original machine, but this isn't strictly required.)
Then, fire up localhost:7860 in the web browser. Make sure this isn't being served on 0.0.0.0 or un-firewalled.
(e: I re-read original question after posting and realized GP was merely asking for over the LAN, but hey, now they know how to do this over the 'net :)