11–20 of 162 posts
Currently the barrier to entry for local models is about $2500. Funny thing is $2500 is about the amount my parents paid for a 166 MHZ machine in 1995.
Currently the barrier to entry for local models is about $2500. Funny thing is $2500 is about the amount my parents paid for a 166 MHZ machine in 1995.
Entry level is actually MAC MINI 16GB at <$499, I have models running on M2 MINI 16GB, it's working with small models.
I would think a quantized 27b should be doable in mac world too?
Earlier quoted context omitted.
Entry level is actually MAC MINI 16GB at <$499, I have models running on M2 MINI 16GB, it's working with small models.
If "small models" is the bar, then you can run inference for ~$50 on Raspberry Pi like hardware. I do that with 1.8b-4b models.
This seems like an inevitable idea: a security system with full context. So you don't get alerts about your friend's car plates or your kid coming home late.
Currently the barrier to entry for local models is about $2500. Funny thing is $2500 is about the amount my parents paid for a 166 MHZ machine in 1995.
This is very false. My first system was a 3060 which you can buy new for about $300 or used for about $200. If you already have an existing system you can use it, else you can pick up a used PC for about $150. Entry is about $500.
I've got a 3060 myself, which is nice to play around with the smaller models for free (minus electricity) and with 100% uptime, but I was not able to program anything with them yet that I didn't want to rewrite completely. A heavily quantized Qwen3.5-27B model is getting close though. Maybe in a few months.
Can’t take it seriously due to the ai-generated site. Sorry. Try just writing a simple plain text file instead