Live data from Hacker News

Ollama is now powered by MLX on Apple Silicon in preview

ollama.com

381–384 of 384 posts

Re: Ollama is now powered by MLX on Apple Silicon in preview

#381
post #125

Earlier quoted context omitted.

Honestly I can't believe Apple put that foundation model product out the door. I was so excited about it, but when I tried it, it was such a disappointment. Glad to hear you calling that out so I know it wasn't just me. Looks like they have pivoted completely over to Gemini, thank god.

yeah, it is super limited but also you can now do cmd(){ local x c r a; while [[ $1 == -* ]]; do case $1 in -x)x=1;shift;; -c)c=1;shift;; *)break;; esac; done; r=$(apfel -q -s 'Output only a shell command.' "$*" | sed '/^```/d;/^#/d;s/^[[:space:]]*//;/^$/d' | head -1); [[ $r ]] || { echo "no command generated"; return 1; }; printf '\e[32m$\e[0m %s\n' "$r"; [[ $c ]] && printf %s "$r" | pbcopy && echo "(copied)"; [[ $x…

That would be pretty cool if the model was a little more useful, but it isn't very good. And the guardrails are hilariously bad.

     cmd print first and last line from stdin
    $ echo -n | tail -n 2


     cmd print first and last line from stdin using sed
    error: [guardrail] The request was blocked by Apple's safety guardrails. Try rephrasing.
    no command generated

Re: Ollama is now powered by MLX on Apple Silicon in preview

#382

Earlier quoted context omitted.

Please reread what i wrote from the start more carefully. I am not claiming what percentage of people care or not. I made a valid point of what is evidence or not, for not caring. You also responded to my E2EE reference without absorbing the example. It isn’t a big deal. We can move on.

Because it is irrelevant to whether people are purposefully explicitly sharing their likes and dislikes, and other information to let FB know more about them.

Of course. Nobody disputes whether.

Re: Ollama is now powered by MLX on Apple Silicon in preview

#383
post #68
post #58

Earlier quoted context omitted.

Brilliant. Hope to see you in the App Store!

Oh thank you! I wasn’t sure if it was worth submitting to the app store since it was just a research preview, but I could do it if people want it.

Ok it's on the app store now: https://apps.apple.com/app/volocal/id6761493288

Re: Ollama is now powered by MLX on Apple Silicon in preview

#384
post #295

On-device models are the future. Users prefer them. No privacy issues. No dealing with connectivity, tokens, or changes to vendors implementations. I have an app using Foundation Model, and it works great. I only wish I could backport it to pre macOS 26 versions.

I am concerned that local models will never benefit from the training on live requests that is surely improving cloud-only models. This might be the cost of privacy, and it might be worth paying, unless cloud models reach an inflection point that make local models archaic.

There’s been some success training models on top of differential privacy.

I imagine that with live requests it would be quite challenging but not impossible, assuming you could somehow sanitize all sorts of private data that people throw at these prompts.

Post reply on HN