Live data from Hacker News

Ultra fast Thunderbolt NAS with Apple M1 and Linux

chrisbergeron.com

61–70 of 102 posts

Re: Ultra fast Thunderbolt NAS with Apple M1 and Linux

#61
Does anyone know if I installed ubuntu on a m1 apple mac would I get pci passthrough to gpu. That would be no right because that isnt possible due to the hardware. I was going to do the ubuntu conversion myself but I am running a developer beta and the commands don't work and if I wait longer it might just be in the next LTS or release of ubuntu by the time Monterey is stable.

Re: Ultra fast Thunderbolt NAS with Apple M1 and Linux

#62

Earlier quoted context omitted.

Maybe with hardware decoding, but software decoding is often done in browsers when hardware support is not available. I suppose Apple doesn't want to include a software fallback for platforms where hardware isn't available to discourage developers from using the format. It's not like Apple would need to write any complicated decoding algorithms when there's already an open source implementation that's free to use.

H264 didn't work in FF on MacOS and Linux (but it still worked on windows) until v34 (and it only started working because Cisco donated a license), Ogg Vorbis only works on MacOS 11.3 or later in safari (and it also depends on which container you use), HEVC in IE/EdgeHTML depended on hardware (with no fallback to software whatsoever), AV1 in FF65 only worked on Windows, AV1 in FF66 only worked on Windows and MacOS, c…

That's because of the licensing issues, especially H.265/HEIF. AV1 has barely any hardware support and software decoding is terrible for performance, so while many browsers can easily build in support, it's not really worth it to enable it by default.

VP9 and WebP patents are all granted freely by Google. WebP images aren't as terrible for power consumption even in software because the browser doesn't decode 60 of them every second.

Re: Ultra fast Thunderbolt NAS with Apple M1 and Linux

#63
post #33

Earlier quoted context omitted.

why don't you simply use one or many nvme thunderbolt/usb disks and move the caches there?

Author here: I actually used a thunderbolt nvme and adapter for a bit. Then, for kicks I got another one and combined them in a raid-0 on macos. Realizing I didn’t want to run nvme’s, in raid-0 over two cables in any sort of production (homelab - I use production loosely here), is what sent me down the Thunderbolt rabbit hole that precipitated this blog post.

In case a single-cable solution would work, I've been using an external TB NVMe RAID 0 in this enclosure for several months and it's worked flawlessly: https://www.amazon.com/gp/product/B08S5JPWR6 (The only drawback is that the power supply is bizarrely-large, and the power connector feels a bit janky. In practice it hasn't been an issue.)

Re: Ultra fast Thunderbolt NAS with Apple M1 and Linux

#66
> As NVMe disks and interfaces have gotten faster I’ve found myself saturating a 10Gb ethernet network.

I love this race between network speeds, drive speeds, and RAM speeds. The classic "net vs disk vs ram vs cache vs register" interview question is much trickier these days.

Re: Ultra fast Thunderbolt NAS with Apple M1 and Linux

#67

This is cool, but my main takeaway is that you can get around needing the thunderbolt enablement header by shorting two pins together and use it on any motherboard? What the hell Intel...

If memory serves the main problem is some Thunderbolt cards don't ship with the necessary firmware on them, so would need to be used at least once in a supported motherboard before just used in any system.

That seems even more WTF, and puts me in mind of the old Winmodem setup. Not precisely analogous, but boy it seems weird.

Re: Ultra fast Thunderbolt NAS with Apple M1 and Linux

#68
This is cool, I’ve been thinking about something like it.

However I’m still slightly disappointed because I expected an article describing an M1 Mac Mini as a NAS, running Linux (this dream probably isn’t technically there just yet, as Thunderbolt [and network?] drivers are so far still missing from the Asahi project).

Re: Ultra fast Thunderbolt NAS with Apple M1 and Linux

#69

Earlier quoted context omitted.

H264 didn't work in FF on MacOS and Linux (but it still worked on windows) until v34 (and it only started working because Cisco donated a license), Ogg Vorbis only works on MacOS 11.3 or later in safari (and it also depends on which container you use), HEVC in IE/EdgeHTML depended on hardware (with no fallback to software whatsoever), AV1 in FF65 only worked on Windows, AV1 in FF66 only worked on Windows and MacOS, c…

That's because of the licensing issues, especially H.265/HEIF. AV1 has barely any hardware support and software decoding is terrible for performance, so while many browsers can easily build in support, it's not really worth it to enable it by default. VP9 and WebP patents are all granted freely by Google. WebP images aren't as terrible for power consumption even in software because the browser doesn't decode 60 of th…

Regardless of that it's not uncommon to have the same browser version support different media codecs/formats.

Regarding the examples, when it comes to Ogg Vorbis there is no issue with software decoding (it's software everywhere), AV1 was granted software decode support on some OS'es but not others in the exact same browser, version and hardware (and IIRC it's the encoding perf that is especially bad for AV1, not decoding) and the chrome on android issue also shows how legal or hardware issues are not the only things limiting what is available (it can also be bugs that just stay around).

All I'm saying is that testing for browser version A is not a surefire test. Either check the support or test on browser A version B on OS C version D on hardware E (for each of the A/B/C/D/E variants) or just stick with what works across the board. Either way you probably won't end up shipping a site with only webp support.

Re: Ultra fast Thunderbolt NAS with Apple M1 and Linux

#70

I was actually looking for something like this. I have one computer that I want to back up to both local hard drives and to the cloud. A NAS is great, because you can back up to it and have the backup stored on local hard drives, but it also has a CPU and it can be responsible for uploading the data to the cloud. This is better to do from a dedicated device, especially if you are uploading large amounts of data with…

Running FreeNAS on a 1GbE network and I wouldn’t call it slow at all. The initial back is much much faster than my 1TB personal media library I sometimes backup to OneDrive. I think I have 3TB of video from Usenet that is downloaded onto a windows box, uses a 10 year old intel as an unpack scratch pad, and then is stored on the NAS box. Sure the initial library transfer is slow but if you can use a wire it’s not that slow. Certainly not Comcast 25Mb upload slow.

Agree about 10Gb devices being expensive especially if you’re invested in the UniFi ecosystem. I’m tempted to do a direct 10Gb SFP+ connection using used intel or Mellanox 10Gb NICs but I haven’t pulled the trigger. 10Gb Thunderbolt NICs are too expensive and give off questionable amounts of heat.

SFP+ is the way to go right now and gives you options. Fiber, DAC (copper), or Ethernet.

Post reply on HN