Live data from Hacker News

Running local LLMs offline on a ten-hour flight

deploy.live

111–112 of 112 posts

Re: Running local LLMs offline on a ten-hour flight

#111
post #77

Earlier quoted context omitted.

Yeah, for real. Imagine being so addicted to the AI slot machine that you can't be without it for 10 hours.

Imagine criticizing people for what they do with their time.

People can spend their time as they choose, but if you feel the need to post about it online don't be surprised if someone offers their opinion. If they don't want feedback then don't call attention to it.

Re: Running local LLMs offline on a ten-hour flight

#112
post #4

This has been exactly my experience too. I've tried multiple harnesses (pi, claude code, codex) with multiple variants of qwen3.6 and gemma4 driven by both o mlx and ollama - and every single time I try to do anything meaningful I end up in a loop. On a 64GB Macbook Pro M3 Max. I really don't know what the hell people are doing locally, and suspect a lot of the hype around running these models locally is bullshit. Su…

I have been testing and using Qwen3.6 27B (running from my 3090) since it dropped and I genuinely think this is the first consumer hardware-grade model that can actually replace frontiers for a lot of workloads. I ran 8 tests on a variety of open-weights models, and opus 4.7 (1mil ctx version) and the little dense model was right behind it: https://github.com/sleepyeldrazi/llm_programming_tests/tree/... Of note is th…

Combine that with full ZIMs of Wikipedia and Stack Overflow, plus documentation of your languages of choice, and you should be golden. I have 4TB SSDs in almost all my laptops (except Macs due to Tim Apple's price-gouging, but I am transitioning away from macOS), and I sync my entire eBook library as well so I am fully covered on the reference manual front.
Post reply on HN