Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Protect your right to run local AI

righttointelligence.org

Post reply on HN
Print view View original

161–170 of 222 posts

Re: Protect your right to run local AI

#161

Post by dryarzeg »

anax32 wrote: post #75
throw93930 wrote: post #60

Earlier quoted context omitted.

[flagged]

A ban on desktop PC components over a certain power threshold (300W) or PSUs would definitely affect local AI, and Europe is not a big enough market, nor has it's own internal supply chains to offer alternatives. This has been done in the EU/UK in the past (hoovers/vacuum cleaners) so the mechanism exists. I'm in the UK and support your direction.

> would definitely affect local AI

And not only. Given your example with 300W, it will affect even things like (somewhat advanced) home servers, (mostly) personal self-hosting machines and even just gaming PCs. That would affect way too much, if I understood your thought correctly.

Re: Protect your right to run local AI

#162

Post by thewebguyd »

gonzalohm wrote: post #138
prima-facie wrote: post #136

Earlier quoted context omitted.

And this is exactly my point, the OEMs have more lobbying power and leverage. Anthropic might be valuated at whatever amount, but they're a new player and their only product is a piece of software - which others like Google, OpenAI, etc also have (not identical but similar enough). EDIT: FYI https://ibb.co/nMYP34Rr

And you think Google, one of the biggest cloud providers, Microsoft, etc. are going to be onboard with local LLMs? I don't think so

Not sure about Google, but these Nvidia RTX Spark machines are specifically a Microsoft+Nvidia partnership. Microsoft is actually pushing hard on Windows security primitives for agents & local AI. At BUILD this year they used the phrase "unmetered local intelligence" more times than I can count.

From their blog about the RTX Spark surface ultra

> purpose-built to develop and run up to 1 trillion-parameter frontier AI models locally

Google may not want it, but Microsoft has a ton of lobbying power, and being primarily an enterprise software and services company, they know local AI is important for their own customers, and will also be important to sustain the PC OEMs that are threatened by a move toward thin client like devices.

Re: Protect your right to run local AI

#163

Post by bmurphy1976 »

gonzalohm wrote: post #135
prima-facie wrote: post #99

Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.

You seem to be so sure, but lobbying in the US can do incredible (and stupid) things. Look at the 3d printing control laws that are being passed in NY

It's not just NY. California, Colorado, Washington, they are trying to pull this bullshit in a whole bunch of states.

Re: Protect your right to run local AI

#164

Post by godwinson__4-8 »

WarmWash wrote: post #145

I don't know why people are so sure that Mythos level+ models will be made freely available. Obviously money is not freely distributed, so how could we possibly make the case that power will be? All that needs to happen is Xi Jinpeng feel that Chinese SOTA models would be better kept to benefit solely China, and just upon that single utterance, no more models will come out of China.

That would not make much strategic sense. China's main advantage is its export power. Why would they cut that off? They are also making incredible investments in actual power to sustain this. The kind of investments the United States doesn't seem capable of making, mostly because our leaders are staggeringly incompetent and unfit. And no, picking the bar up off the floor is not good enough.

Once they dominate the market, they will export to keep it that way. The exported models will be a generation or two behind their SOTA. It will nevertheless surpass Mythos unless you believe we are already at the peak. And it might be "free" but it will obviously be backdoored the same way the United States government benefits from Microsoft's global dominance. The same way America hands out fighter jets just generation behind their own best to keep other governments part of the club and in line.

Unlike the United States where every four years we are at risk to some 180 on policy the Chinese have a clear thesis and a clear direction. How many presidents has Xi seen come and go? Do you get the sense he is getting more impressed? They really don't have to do anything but just keep doing what they are doing. Suddenly stopping their export engine is not in keeping with this strategy. That is "stable genius" behavior.

Re: Protect your right to run local AI

#165

Post by dominotw »

windexh8er wrote: post #38
dominotw wrote: post #22

Earlier quoted context omitted.

there will always be higher valuation for company inventing model+1 . no one wants to use latest_model -1 when their competiton is using latest_model.

If neither model+1 or model-1 are providing tangible value to the business does anyone really care, though? At a certain point nobody believes Chicken Little. I get it. These models can be powerful. But will they be useful is a different question.

right. thats the real question. Are models improving meanginflully for ppl to pay a premium for latest model or are they just a commodity.

i would argue that no one knows answer to that yet.

Re: Protect your right to run local AI

#168

Post by ang_cire »

prima-facie wrote: post #99

Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.

I think you are assuming those companies won't sign on to be on a list of "authorized model operators", while letting it become illegal for you to run deepseek yourself.

Re: Protect your right to run local AI

#169

Post by chrisjj »

dalmo3 wrote: post #74
chrisjj wrote: post #71

> Right to Local Intelligence Misleading title. The article is about local "AI".

Anything using the word "intelligence", unqualified, when referring to AI, is pure propaganda.

Anything using the word "intelligence", unqualified or not, when referring to "AI", is pure propaganda.
Post reply on HN