Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ollama is now powered by MLX on Apple Silicon in preview

ollama.com

Post reply on HN
Print view View original

261–270 of 384 posts

Re: Ollama is now powered by MLX on Apple Silicon in preview

#261

Post by raw_anon_1111 »

DesiLurker wrote: post #260
raw_anon_1111 wrote: post #234

Earlier quoted context omitted.

Users don’t care about “privacy”. If they did, Meta and Alphabet wouldn’t be worth $1T+. Users really don’t matter at all. The revenue for AI companies will be B2B where the user is not the customer - including coding agents. Most people don’t even use computers as their primary “computing device” and most people are buying crappy low end Android phones - no I’m not saying all Android phones are crappy. But that’s wh…

you are missing a but 'given a choice' disclaimer. Meta is pretty much a monopoly in social space. So is Android. given a choice people will absolutely gravitate towards not-always-snooping device. most people with resources anyway, who matter for the AI adoption. Oh an wait till ad companies start selling your healthcare data and you will see how fast things turn 'given a choice'.

People A) don’t have to use Meta and B) do have a choice between not using a mobile phone by an ad tech company.

Re: Ollama is now powered by MLX on Apple Silicon in preview

#262

Post by innagadadavida »

raw_anon_1111 wrote: post #246
barelysapient wrote: post #241

Earlier quoted context omitted.

Different users. Many people care about privacy and aren’t using Meta products. And many businesses care about it too and have information policies to protect their IP.

70% of the world’s population use at least one Meta property at least once per day. How many of the other 30% are too poor/young/computer illiterate to be part of an addressable market? Every company has dozens of SaaS products that store their business critical information. Amazon installs Office on each computer, Slack (they were moving away from Chime when I left), and the sales department uses SalesForce - SA’s a…

These are all great statistics, but how do you explain ClawdBot explosion. Even in lower income countries like China. So much demand that Apple can’t keep up production of Mac Minis. Why aren’t these folks going towards cloud solutions? Is it cost or is there some consideration for having more control over their data?

Re: Ollama is now powered by MLX on Apple Silicon in preview

#263

Post by JambalayaJimbo »

raw_anon_1111 wrote: post #246
barelysapient wrote: post #241

Earlier quoted context omitted.

Different users. Many people care about privacy and aren’t using Meta products. And many businesses care about it too and have information policies to protect their IP.

70% of the world’s population use at least one Meta property at least once per day. How many of the other 30% are too poor/young/computer illiterate to be part of an addressable market? Every company has dozens of SaaS products that store their business critical information. Amazon installs Office on each computer, Slack (they were moving away from Chime when I left), and the sales department uses SalesForce - SA’s a…

The banking industry absolutely does care about privacy of their business data btw. We do use tools like Confluence but they're all hosted in our own data centers.

Re: Ollama is now powered by MLX on Apple Silicon in preview

#264

Post by zozbot234 »

innagadadavida wrote: post #262
raw_anon_1111 wrote: post #246

Earlier quoted context omitted.

70% of the world’s population use at least one Meta property at least once per day. How many of the other 30% are too poor/young/computer illiterate to be part of an addressable market? Every company has dozens of SaaS products that store their business critical information. Amazon installs Office on each computer, Slack (they were moving away from Chime when I left), and the sales department uses SalesForce - SA’s a…

These are all great statistics, but how do you explain ClawdBot explosion. Even in lower income countries like China. So much demand that Apple can’t keep up production of Mac Minis. Why aren’t these folks going towards cloud solutions? Is it cost or is there some consideration for having more control over their data?

ClawBot doesn't generally run the model locally, it just talks to remote APIs. No different than any other agentic harness. You could run a local model on the same Mac Mini as your agent, but it wouldn't be very smart and many agentic tasks around computer GUI/browser use, etc. would be out of reach.

Re: Ollama is now powered by MLX on Apple Silicon in preview

#266

Post by raw_anon_1111 »

innagadadavida wrote: post #262
raw_anon_1111 wrote: post #246

Earlier quoted context omitted.

70% of the world’s population use at least one Meta property at least once per day. How many of the other 30% are too poor/young/computer illiterate to be part of an addressable market? Every company has dozens of SaaS products that store their business critical information. Amazon installs Office on each computer, Slack (they were moving away from Chime when I left), and the sales department uses SalesForce - SA’s a…

These are all great statistics, but how do you explain ClawdBot explosion. Even in lower income countries like China. So much demand that Apple can’t keep up production of Mac Minis. Why aren’t these folks going towards cloud solutions? Is it cost or is there some consideration for having more control over their data?

And people using Clawdbot are still not using local inference for the most part…

They aren’t buying high end $2000+ Mac Minis.

Re: Ollama is now powered by MLX on Apple Silicon in preview

#267

Post by brcmthrowaway »

xiconfjs wrote: post #227
yard2010 wrote: post #81

Earlier quoted context omitted.

Can you please write about your hardware?

* macOS 26.x on MacBookPro M1 Max 32GB * Ollama on macOS, cursor to play around * Open WebUI [1] on my Homeserver via API to Ollama (also for remote „A.I.“ access) * running gpt-oss:20b, qwen3.5:9b with ease, qwen3.5:27b for more complex tasks [1] https://github.com/open-webui/open-webui

Seems complicated. Switch to LMStudio

Re: Ollama is now powered by MLX on Apple Silicon in preview

#268

Post by raw_anon_1111 »

JambalayaJimbo wrote: post #263
raw_anon_1111 wrote: post #246

Earlier quoted context omitted.

70% of the world’s population use at least one Meta property at least once per day. How many of the other 30% are too poor/young/computer illiterate to be part of an addressable market? Every company has dozens of SaaS products that store their business critical information. Amazon installs Office on each computer, Slack (they were moving away from Chime when I left), and the sales department uses SalesForce - SA’s a…

The banking industry absolutely does care about privacy of their business data btw. We do use tools like Confluence but they're all hosted in our own data centers.

And Capital One and Goldman Sachs are both hosted on AWS…

Re: Ollama is now powered by MLX on Apple Silicon in preview

#269

Post by raw_anon_1111 »

esseph wrote: post #256
raw_anon_1111 wrote: post #251

Earlier quoted context omitted.

In the history of cloud computing, prices have mostly only come down especially as inference becomes a commodity. Realistically, just looking at Mac prices, the cost of a computer with decent local inference would be around $6000 per person. The world is not moving back to on prem.

> The world is not moving back to on prem. Lol, you should tell my customers (that are moving back on prem) that! You should also tell Microsoft, who just yesterday said they are going back to focusing on local apps.

Your customers are an anecdote, now compare that to the publicly reported numbers from AWS, GCP and Azure where they all say the only thing keeping them from growing more is the chip shortage.

Re: Ollama is now powered by MLX on Apple Silicon in preview

#270

Post by locknitpicker »

konschubert wrote: post #230
locknitpicker wrote: post #167

Earlier quoted context omitted.

> What makes you think that? The fact that today's and yesterday's models are quite capable of handling mundane tasks, and even companies behind frontier models are investing heavily in strategies to manage context instead of blindly plowing through problems with brute-force generalist models. But let's flip this around: what on earth even suggests to you that most users need frontier models?

Everybody has difficult decisions to make in their daily lives and in their work. Having access to a model that is drawing from good sources and takes time to think instead of hallucinating a response is important in many domains of life.

[dead]
Post reply on HN