The smallest edge AI device for local LLMs
1–10 of 22 posts
Re: The smallest edge AI device for local LLMs
#2Re: The smallest edge AI device for local LLMs
#3I am confused as to weather this is software or a product
> SoC (Armv9.2
> CPU + NPU) 30TOPS +
> dNPU 160TOPS
Re: The smallest edge AI device for local LLMs
#4Re: The smallest edge AI device for local LLMs
#5Re: The smallest edge AI device for local LLMs
#6Re: The smallest edge AI device for local LLMs
#7Re: The smallest edge AI device for local LLMs
#8This entire page (except for the footer) is made with images. Is there any reason they would do this? Are they making these images by hand or are they generated somehow? Just seems like an unusual choice.
Re: The smallest edge AI device for local LLMs
#9This device is selling for $1,999. In the product page on their website, they show the device plugged into a MacBook Pro.
A MacBook Pro already has excellent ability to run local LLMs, so why wouldn't someone just spend that $1,999 on maxing out their MacBook specs (M5 Max with extra RAM) instead?
Or why not buy a Mac Mini with 48GB of RAM for $2300?
Re: The smallest edge AI device for local LLMs
#10This entire page (except for the footer) is made with images. Is there any reason they would do this? Are they making these images by hand or are they generated somehow? Just seems like an unusual choice.