101–110 of 144 posts
To clarify, this MIT-licensed app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library ( https://github.com/Blaizzy/mlx-vlm ). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster inference on Apple devices than llama.cpp. Historically, MLX is a smaller community than CUDA, but has some of the fastest updates upon the release of new mod…
To clarify, this MIT-licensed app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library ( https://github.com/Blaizzy/mlx-vlm ). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster inference on Apple devices than llama.cpp. Historically, MLX is a smaller community than CUDA, but has some of the fastest updates upon the release of new mod…
I was so excited when I saw "blaizzy" in the domain, because Prince Canuma's work around MLX has been of such uniquely high quality.
Earlier quoted context omitted.
The frontier is a curve. https://en.wikipedia.org/wiki/Pareto_front
That's not what people are normally referring to when they say "frontier models". It means the most capable models full stop. Not the most capable that you can run locally.
It's a further way to run mlx models
mlx are apple specific format for M3 or later CPUs, and some benchmarks show mlx are not always better than just running generic ones.
Is „frontier“ overused? I thought frontier models were the best-of-the-best such as Fable right now. I assume you can’t host these models yourself since you would need many GB of RAM and expensive GPU of is my thinking of „frontier models“ wrong?
I was confused too, but I believe that it refers to the Pareto Frontier: the best set of solutions to a multi-objective problem. Look it up, it’s a bit difficult to explain concisely in words but it is intuitive visually. If we are thinking of intelligence and price, a model will be in the Pareto Frontier if there’s no cheaper model of the same or higher intelligence. Or if there’s no more intelligent model for that…
Advice: remove all slop and fluff from the website such as "Everything you need. Nothing you don’t." Just state the information you want to communicate in the plainest and most straightforward way possible.
You’d be surprised how hard this actually is. I spent 3 days iterating on a marketing site, where I had very explicit / “well written” copy, and it would just repeatedly rewrite it back to the most awful slop. Over and over again! Ended up adding various AGENTS rules telling it to leave the copy alone
To clarify, this MIT-licensed app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library ( https://github.com/Blaizzy/mlx-vlm ). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster inference on Apple devices than llama.cpp. Historically, MLX is a smaller community than CUDA, but has some of the fastest updates upon the release of new mod…
(https://arxiv.org/abs/2411.07641)
And if you do care to support modern samplers, you can start with the following:
1. https://arxiv.org/abs/2509.23234
Earlier quoted context omitted.
I was confused too, but I believe that it refers to the Pareto Frontier: the best set of solutions to a multi-objective problem. Look it up, it’s a bit difficult to explain concisely in words but it is intuitive visually. If we are thinking of intelligence and price, a model will be in the Pareto Frontier if there’s no cheaper model of the same or higher intelligence. Or if there’s no more intelligent model for that…
I think this is one of the easiest to understand. https://arena.ai/leaderboard/text/pareto
EDIT: Indeed looking at the overall rankings for text again, the list is rather strange, a lot more about writing style than intelligence.
Genuinely curious: what are people using these smaller local models for? They are getting decently capable, but they are still small enough that I don't trust them for "real" work outside of a handful of fun toy projects. Are people actually using them in coding agents? Or are they mostly using them for other things?
Qwen35ba3b can do a huge amount of data cleaning work on pretty modest hardware. Already have run about 100 billion tokens on it using 2x3090 gpus.