I think there is an awesome setup that many are overlooking! With a RockPro64 board, you can configure it to use SSD's, both SATA & NVMe!
RockPro64 boards: https://pine64.com/product-category/rockpro64/?v=0446c16e2e6...
Accessories: https://pine64.com/product-category/rockpro64-accessories/?v...
I think these RockPro64 boards are highly underrated. I got one a while back, I was looking for something more powerful than a Raspberry pi. You can get it with 2 or 4 GB RAM.
They have PCI-e slots, so the SSD interface cards plug into the board through them. With this setup you will get full performance from your drive, instead of having to rely on a USB connection on raspberry pi & others.
SATA: https://pine64.com/product/rockpro64-pci-e-to-dual-sata-ii-i... NVMe: https://pine64.com/product/rockpro64-pci-e-x4-to-m-2-ngff-nv...
I've not set mine up like this yet, as I've not been doing much with my board lately except running pi-hole. But I plan on getting an NVMe interface in the future, and maybe the metal desktop casing. I think this type of setup is exactly what you're looking for. The cost is reasonable. If you get a 4GB board, a power supply, and an SATA interface you'd be all in for ~$103 before shipping.
There are lots of accessories, and tons of OS options with an easy installer. I just checked, as of writing this the are builds for (both desktop & minimal) Debian, Ubuntu, Slackware, CentOS, Manjaro, Armbian debian/ubuntu, DietPi. Also other stuff like Recalbox, batocera, OpenMediaVault, ChromiumOS, or Android. I not an expert in the entire SBC market, but I'm doubt many other boards have community support for that many different OSs.