131–140 of 162 posts
Earlier quoted context omitted.
The used model is 9B even with a big context you can easily run it on 16GB. You don't need a $2500 machine for it.
For coding and personal assistance the context window on 16GB is not good enough. Ideally I want a context window of 100k.
Why is there so much interest in local AI systems, am I missing something? Cloud providers have scale and expertise that would allow for much bigger throughput at lower costs. The small latency gains will be nice, but ChatGPT and Claude already come through blazingly fast via their API.
Look at how much Google has changed over the years in the pursuit of profit. What will ChatGPT and Claude look like when they are pushed further down the profit maximization path?
https://github.com/SharpAI/DeepCamera/blob/c7e9ddda012ad3f8e...
The M5 Pro just dropped, so here's a real AI workload instead of another Geekbench score. We run Qwen3.5 as the brain of a fully local home security system and benchmarked it against OpenAI cloud models on a custom 96-test suite. The Qwen3.5-9B scores 93.8% — within 4 points of GPT-5.4 — while running entirely on the M5 Pro at 25 tok/s, 765ms TTFT, using only 13.8 GB of unified memory. The 35B MoE variant hits 42 tok…
Between the all the em-dashes, this:
> Zero API costs, full data privacy, all local.
and the way your comments have completely different voices it's pretty clear that you're letting AI write some of your HN comments, too.
Is there some place we can quickly go see what's actually being tested? The landing page has non-clickable entries for the categories
Earlier quoted context omitted.
I don’t think there’s anything different between what you’re suggesting and a homelab. Most people do not have a homelab and are happy to offload services like photo storage or security to remote providers.
I'm thinking 'everyone needs an air conditioner', kinda need. Instead of 'some nerds run servers'. And this 'ac' is your 'ai'. Maybe even subsidized by the government. This will be a fundamental need.
Can’t take it seriously due to the ai-generated site. Sorry. Try just writing a simple plain text file instead
landing page is not so optimized for non m5 users..
I'm not very convinced by these prompt injection tests: https://github.com/SharpAI/DeepCamera/blob/c7e9ddda012ad3f8e...
The M5 Pro just dropped, so here's a real AI workload instead of another Geekbench score. We run Qwen3.5 as the brain of a fully local home security system and benchmarked it against OpenAI cloud models on a custom 96-test suite. The Qwen3.5-9B scores 93.8% — within 4 points of GPT-5.4 — while running entirely on the M5 Pro at 25 tok/s, 765ms TTFT, using only 13.8 GB of unified memory. The 35B MoE variant hits 42 tok…
Thanks for sharing the results, but it's getting hard to cut through all of the AI generated hype on the page and in your comments to understand what's being testing. Between the all the em-dashes, this: > Zero API costs, full data privacy, all local. and the way your comments have completely different voices it's pretty clear that you're letting AI write some of your HN comments, too. Is there some place we can quic…
https://github.com/SharpAI/DeepCamera/tree/master/skills/ana...