Live data from Hacker News

Protect your right to run local AI

righttointelligence.org

41–50 of 222 posts

Re: Protect your right to run local AI

#41

"12 acres and an LLM"

Mock it we might now, but 12 acres and (not too distant future) open weights AI models capable of driving open source robots for farm labor would be huge. No need for huge expensive purpose built tractors. Even if they’re slow you could have half a dozen running 24/7. It could provide independence for anyone with a modicum of resources.

The new frontier! I love it

Re: Protect your right to run local AI

#42

In the US at least, repealing a law takes the same number of votes as passing a new one. I don't follow the purpose of this, unless it's to pass a constitutional amendment or something. Or maybe just to get clicks on a website. And I already have the right to local intelligence, because my GPUs are my private property, and if someone freely releases a beerware model then I can freely download it. What am I missing?

I think the bogeyman would be making possession of a local AI a felony.

Re: Protect your right to run local AI

#43

Earlier quoted context omitted.

This. They can see their valuations slipping. They hope that in a few/several years they will start reaping profits. However, in several years local hardware will be well suited to run models locally at 80-90% efficiency - for "free". You won't need frontier models for daily tasks in a few years. I'd guess.

> 80-90% efficiency wdym by that > for daily tasks which are?

What do you need a frontier model for, really.

Re: Protect your right to run local AI

#45
This is one of those things we should absolutely push proactively rather than reactively, if only because I’ve had several “chats” with AI models both local and AIaaS, and all repeat the same talking point that AIaaS is the only sensible, safe, and secure choice.

Which is bullshit, unless you’re an AIaaS company whose revenue is dependent on state-sanctioned market fixing and regulatory capture.

Look, when this shitty cycle ends, we’re likely to find ourselves back in the start of a new memory cycle of surplus and lower costs. We’re talking what very well may be the boom that shatters the 16GB “baseline” we’ve been stuck at for over a decade in consumer computing, and make larger RAM counts (64GB to 1TB+) valuable to consumers specifically for local AI workloads. Local AI isn’t just an enthusiast thing, it’s likely the future of consumer AI provided we don’t let companies and policymakers curtail its use via fearmongering.

Be proactive, and protect consumer right to compute and AI models. Enforce existing laws, don’t outlaw legitimate use just to prop up an unsustainable business model.

Re: Protect your right to run local AI

#46
post #6

Llama, ik-Llama, Krasis, etc are already out. The Chinese are the open ones, with free downloads, open weights, and loads of published research. The USA with OpenAI is some of the most closed shit out there.

There's gpt-oss from OpenAI, gemma from Google, phi from Microsoft, granite from IBM, nemotron from NVIDIA, Ornith from DeepReinforce, Olmo from the Allen Institute. Aside from that you're 100% correct.

One of these is not like the other

Re: Protect your right to run local AI

#47
post #40

Earlier quoted context omitted.

Mock it we might now, but 12 acres and (not too distant future) open weights AI models capable of driving open source robots for farm labor would be huge. No need for huge expensive purpose built tractors. Even if they’re slow you could have half a dozen running 24/7. It could provide independence for anyone with a modicum of resources.

What do you imagine the farming robots will look like? I'm betting they look like expensive purpose built tractors.

We're not going to go down the path of training a bunch of highly specialized models for tasks like "this tractor should tend this field".

We're going to (and are already on the way to) train deeply general models that can be told: "go tend that field."

And if that's the case, it no longer makes sense to build specialized, purpose-built tractors to house that level of autonomous capability. You instead put it in a humanoid frame (with a little extra sauce for locomotion of said humanoid), and get that to drive your existing tractor.

Re: Protect your right to run local AI

#48
post #47
post #40

Earlier quoted context omitted.

What do you imagine the farming robots will look like? I'm betting they look like expensive purpose built tractors.

We're not going to go down the path of training a bunch of highly specialized models for tasks like "this tractor should tend this field". We're going to (and are already on the way to) train deeply general models that can be told: "go tend that field." And if that's the case, it no longer makes sense to build specialized, purpose-built tractors to house that level of autonomous capability. You instead put it in a hu…

Well true, that's possible. The sensors and compute are relatively expensive and tractors are already highly automated. Plus a small tractor can be relatively inexpensive and optimized for the mechanics of the task!

I'm thinking more of the small tasks that are often needed. Mending fences. Pulling weeds. Feeding chickens. Running off coyotes. Lots of things.

Re: Protect your right to run local AI

#50

Earlier quoted context omitted.

> 80-90% efficiency wdym by that > for daily tasks which are?

What do you need a frontier model for, really.

Frontier models like Fable are mostly useful if you want to paste in one or two prompts, and receive a subtly broken application that looks impressive. That is very hard to do with local models today.

What current local models work fine for is delegating clearly-described tasks in a code base the programmer actually understands. Qwen3.6 27B and DeepSeek V4 Flash are both great little workhorses.

There's also GLM 5.2, which is kind of like "store brand Opus", and which might be considered a "near-frontier" model. I don't have as much experience with it.

Post reply on HN