Earlier quoted context omitted.
Maybe instead of using expensive SSDs. A topology of many spanning disks in large ZFS clusters by using PCIe HDD controllers. Then link the machines via 10GBe could provide you the speed and performance you require require. I've set up a moderate size pool of 1Pb across 16 physical servers on 4 full size racks. This cost less than 50k. Electricity and cooling come from solar. Its the damn internet connection for peop…
I believe DO uses Ceph for storage, much more scalable than a do-it-yourself zfs solution and a lot easier to manage.
Side note: I took that cluster and split it into 8. Then moved them to different geographical locations and where I could use friend or families residential connections and a cloudflare cluster to offset my cost in exchange for unlimited hosting. Very similar to Ceph actually