I don't know if this has been asked here, but is it really possible to connect to a free search service like Google? The point is to use information that's relevant to, say, 2026.
Running local LLMs offline on a ten-hour flight
101–110 of 112 posts
Re: Running local LLMs offline on a ten-hour flight
#102Earlier quoted context omitted.
That was the first thing I thought of when I saw the image. That's a very expensive computer that you risk destroying when the 300lb guy in front of you decides to lean back. The ergonomics of using a laptop on an economy-class tray table are not worth it. You're sitting there like a T-rex trying to make your arms as small as possible to tap on the keys. And the vertical viewing angle to your screen sometimes prevent…
Obese people (250lb+) shouldn't even be allowed in Economy.
Packing people into tiny spaces like sardines should be illegal.
Re: Running local LLMs offline on a ten-hour flight
#103Earlier quoted context omitted.
Sweet, free upgrades! Edit to be slightly less obtuse: surely you're not implying that a common carrier be allowed to discriminate based on facts about a passenger's body without making reasonable accommodations. Surely you're not implying that obese people not be allowed to fly at all. Surely you're not suggesting that fat people should just remove themselves from society so you don't have to deal with them. Therefo…
I'll imply those things. If you don't fit in the seat, you should have to buy two seats is a not very controversial opinion on the internet IMO. I think that opinion basically violates all of your "surely"s already. Where do you draw the line? A 250lb person probably mostly fits in their seat still, but at some point a person is just physically going to take up two seats. Do you really think the airline should be res…
The downvote the upvote ratios in this thread imply that significant amounts of HN are land whales.
Re: Running local LLMs offline on a ten-hour flight
#104tried doing exactly this with ollama on a cross-country flight last month. my macbook basically turned into a jet engine and the battery died in under an hour. curious if you had to heavily throttle the cpu or stick to super small quants (like 4 bit phi3) to actually make it through 10 hours without a power outlet?
Using an LLM to code without AC power is ... certainly a choice.
On my framework 13 a couple exploratory prompts and a code writing step drained my battery to 85% in about 5 minutes.
Re: Running local LLMs offline on a ten-hour flight
#105I've been relatively impressed with local llms, but by far the hardest thing for me is how hot they make my laptop run.
Re: Running local LLMs offline on a ten-hour flight
#106I don't know if this has been asked here, but is it really possible to connect to a free search service like Google? The point is to use information that's relevant to, say, 2026.
There are paid solutions for this, I've seen Exa recommended.
Re: Running local LLMs offline on a ten-hour flight
#107This has been exactly my experience too. I've tried multiple harnesses (pi, claude code, codex) with multiple variants of qwen3.6 and gemma4 driven by both o mlx and ollama - and every single time I try to do anything meaningful I end up in a loop. On a 64GB Macbook Pro M3 Max. I really don't know what the hell people are doing locally, and suspect a lot of the hype around running these models locally is bullshit. Su…
> a lot of the hype around running these models locally is bullshit. Sure, you can make it do something but certainly nothing useful or substantial. There is certainly a lot of hype around local models. Some of it is overhype, some of it is just "people finding out" and discovering what cool stuff you can do. I suspect the post is a reply to the other one a few days ago where someone from hf posted a pic with them in…
Can you share more on how your setup has changed over time for running these? Do you prompt them for code samples like some people do with ChatGPT or did you integrate them into your IDE or some kind of custom harness?
Re: Running local LLMs offline on a ten-hour flight
#108Earlier quoted context omitted.
> a lot of the hype around running these models locally is bullshit. Sure, you can make it do something but certainly nothing useful or substantial. There is certainly a lot of hype around local models. Some of it is overhype, some of it is just "people finding out" and discovering what cool stuff you can do. I suspect the post is a reply to the other one a few days ago where someone from hf posted a pic with them in…
Can you share more on how your setup has changed over time for running these? Do you prompt them for code samples like some people do with ChatGPT or did you integrate them into your IDE or some kind of custom harness?
Sure. I usually work with devcontainers from vscode. They provide great integration ootb (port forwarding & stuff) and are ok for containing the agents for most cases. If you want to work on docker projects I also tried vagrant for vm with docker inside, and you instantiate the agent from vagrant.
For local models I used mainly cline and then roo code extensions. Roo was a bit better because it offered more customisation (prompts, tool choice, etc). I found that local models need shorter prompts and less tools to be effective. Unfortunately roo seems to be discontinued, no idea what I'll use after it stops working. Cline works fine for most of the cases ootb, especially if you run inference on a platform that supports good kv caching - I use vLLM.
For subscriptions I use their own harness, as you get the best bang for the buck. For 3rd party subscriptions that don't have their own harness I use opencode (I got a very cheap sub for GLM that I use for exploration and oss projects).
Re: Running local LLMs offline on a ten-hour flight
#109Earlier quoted context omitted.
Obese people (250lb+) shouldn't even be allowed in Economy.
Man, I hate being rude because I myself weighed 230lbs once upon a time, I get it. I just dealt with a 200lb+ man who spread his legs past the arm rests. Pissed me off the whole flight because I had to contort my body in my own seat so he wasn't spilling into me.
You didn’t have to, but possibly that was preferable to confrontation.
Re: Running local LLMs offline on a ten-hour flight
#110Author here
Great engagement!
Apologies for the sloppinnes in model names. I've been writing it at 1am in Vegas, which was 9am in London (a time my body was operating at) - I was dozing off while finishing it - but excitement about my offline experience kept be _somewhat_ going. I've fixed model naming inconsistencies.
I've updated post with some more info and responses to your comments, I hope you find it useful.