Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nativ: Run frontier open models locally on your Mac

blaizzy.github.io

Post reply on HN
Print view View original

121–130 of 144 posts

Re: Nativ: Run frontier open models locally on your Mac

#123

Post by kmike84 »

giancarlostoro wrote: post #116
Nekorosu wrote: post #115

I really don't like the marketing texts. "Why we’re open source when nobody else is." I'm using oMLX which is open source and seems to be doing everything Nativ offers. I'd rather see the comparison with existing "non-existing" open source competitors.

What they likely mean is, why options like LM Studio are not open source.

omlx is quite similar to LM Studio, so there are "options like LM Studio" which are open source

Re: Nativ: Run frontier open models locally on your Mac

#125

Post by efficax »

JosNun wrote: post #47

Genuinely curious: what are people using these smaller local models for? They are getting decently capable, but they are still small enough that I don't trust them for "real" work outside of a handful of fun toy projects. Are people actually using them in coding agents? Or are they mostly using them for other things?

I use a gemma4 model locally to extract content from messages to a personal agent I'm building for its memory graph (to break the message up into the topic, source (assistant or owner), facts, entities, etc. in the message content (all getting thrown into a magma-esque graph using NLEmbeddings for memory search). This is for a custom personal agent that targets deepseek-v4 flash. The local model is too slow in my setup for a chat agent, but for memory extraction it works pretty well, saving API usage on every chat turn.

Re: Nativ: Run frontier open models locally on your Mac

#126

Post by avazhi »

oersted wrote: post #72
moontear wrote: post #7

Is „frontier“ overused? I thought frontier models were the best-of-the-best such as Fable right now. I assume you can’t host these models yourself since you would need many GB of RAM and expensive GPU of is my thinking of „frontier models“ wrong?

I was confused too, but I believe that it refers to the Pareto Frontier: the best set of solutions to a multi-objective problem. Look it up, it’s a bit difficult to explain concisely in words but it is intuitive visually. If we are thinking of intelligence and price, a model will be in the Pareto Frontier if there’s no cheaper model of the same or higher intelligence. Or if there’s no more intelligent model for that…

That’s not what frontier means.

There are two frontier labs - OpenAI and Anthropic, and maybe 4 frontier models currently. That term refers to model capacity and in general represents a model’s capability relative to the rest of the industry irrespective of price. That’s why even the Qwen announcement carries language about it being ‘near frontier’. Same with Kimi.

Whether a model is frontier or not has everything to do with capability and nothing to do with price.

Re: Nativ: Run frontier open models locally on your Mac

#127

Post by Forgeties79 »

recursivegirth wrote: post #67
erikkahler wrote: post #35

To clarify, this MIT-licensed app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library ( https://github.com/Blaizzy/mlx-vlm ). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster inference on Apple devices than llama.cpp. Historically, MLX is a smaller community than CUDA, but has some of the fastest updates upon the release of new mod…

LM Studio is trash on Windows / Linux... guess that makes sense...

What makes it trash on Linux? I’m a pretty casual user myself so my guess is I haven’t bumped against these limitations. I also don’t have high expectations as I’m running it on a 9070 lol
Post reply on HN