Earlier quoted context omitted.
Very much this. Running the X11 protocol over the network is usually not a good idea anymore. By the way, does anyone know of a VNC-like solution that can use MPEG compression? Also, VNC could be better if it could increase the quality of parts of the screen once they stop updating. E.g. in TigerVNC setting a low bitrate doesn't improve the quality of text once the text stops changing.
If you're not afraid of big brother, I can recommend Chrome Remote desktop. You just install a server on the shared machine, and you can access your stuff using a regular browser thanks to the wonders of WebRTC.
It turns out that CRD is well known for breaking other seemingly random things, such as accessing your printer:
https://askubuntu.com/questions/1196248/automount-when-click...