The smallest edge AI device for local LLMs

Post by RataNova » Tue, Sep 08, 2026, 5:30 AM UTC

pizza234 wrote: post #17

tristanj wrote: post #9

I don't understand the value proposition here. This device is selling for $1,999. In the product page on their website, they show the device plugged into a MacBook Pro. A MacBook Pro already has excellent ability to run local LLMs, so why wouldn't someone just spend that $1,999 on maxing out their MacBook specs (M5 Max with extra RAM) instead? Or why not buy a Mac Mini with 48GB of RAM for $2300?

> Or why not buy a Mac Mini with 48GB of RAM for $2300? Because this device has 80 GB, which allows running larger models (which is the whole point of the device). AFAIK, the next significant step in terms of quality above 32 GB is 256 GB, but 80 GB still buys convenience. > A MacBook Pro already has excellent ability to run local LLMs, so why wouldn't someone just spend that $1,999 on maxing out their MacBook specs…