Earlier quoted context omitted.
I fixed this by using this dock Lenovo ThinkPad Thunderbolt 4 Workstation Dock - DK2131
I fixed my issue as well with a dock from UGreen and the DisplayLink software. Just unfortunate I had to do it.
A TB4 dock fixes most problems, but I have to hack the EDID to disable YCbCr and force RGB, or the colors look like absolute shit. The external monitors still look significantly worse under macOS than either Windows or Linux, and I have no idea why.
External display handling is easily the worst part of using a Mac for me.