Nativ: Run frontier open models locally on your Mac

rvz wrote: post #2

Looks like my call [0] for more competitors to Ollama has been answered. We need more like this as well as llama.app, which also has a native mac app. [0] https://news.ycombinator.com/item?id=48968898

Agreed. Just based on this not being Ollama, so I will give it a try.

Re: Nativ: Run frontier open models locally on your Mac

#6

Post by asqueella » Mon, Jul 20, 2026, 7:25 PM UTC

iAMkenough wrote: post #3

How does this compare to LM Studio Bionic?

Bionic is an agent; this appears to be an open-source competitor to lmstudio. The initial commit is just a few hours ago though, so …

Re: Nativ: Run frontier open models locally on your Mac

#7

Post by moontear » Mon, Jul 20, 2026, 7:29 PM UTC

Is „frontier“ overused? I thought frontier models were the best-of-the-best such as Fable right now. I assume you can’t host these models yourself since you would need many GB of RAM and expensive GPU of is my thinking of „frontier models“ wrong?

Re: Nativ: Run frontier open models locally on your Mac

#8

Post by brcmthrowaway » Mon, Jul 20, 2026, 7:32 PM UTC

[dead]

Re: Nativ: Run frontier open models locally on your Mac

#9

Post by philips » Mon, Jul 20, 2026, 7:34 PM UTC

SafeFatNoob wrote: post #4

so now we have this, https://pypi.org/project/rapid-mlx/ , https://mtplx.com , and the oldest I could find at https://omlx.ai .

There is also https://github.com/ml-explore/mlx-swift-lm which is what https://jan.ai uses.

Re: Nativ: Run frontier open models locally on your Mac

#10

Post by 0gs » Mon, Jul 20, 2026, 7:36 PM UTC

rvz wrote: post #2

Looks like my call [0] for more competitors to Ollama has been answered. We need more like this as well as llama.app, which also has a native mac app. [0] https://news.ycombinator.com/item?id=48968898

my thing is kind of an Ollama competitor (surrogate?) too. more for prose/text planning, not so much for coding, at least the harness, but i'm sure someone could set it up to do that: github.com/0gsd/enough