[flagged]
My iPhone 16 Pro Max produces garbage output when running MLX LLMs
31–40 of 239 posts
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#32[flagged]
Uhh, that's not the article, the article is running a ml model, on phone and floating point opps for tensor multiplication seems to be off.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#33.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#34Earlier quoted context omitted.
My TL;DR is that they tried to run an on-device model to classify expenses, it didn't work even for simple cases ("Kasai Kitchin" -> "unknown"), they went deeeeeep down the rabbit hole to figure out why and concluded that inference on their particular model/phone is borked at the hardware level. Whether you should do this on device is another story entirely.
Why shouldn't you? It's your device, it has hardware made specifically for inference. What's to be gained, other than battery life, by offloading inference to someone else? To be lost, at least, is your data ownership and perhaps money.
> What's to be gained... by offloading inference to someone else?
Access to models that local hardware can't run. The kind of model that an iphone struggles to run is blown out of the water by most low end hosted models. Its the same reason that most devs opt for claude code, cursor, copilot, etc. instead of using hosted models for coding assistance.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#35Earlier quoted context omitted.
This is a conclusion that comes with some personal baggage you should identify and consider addressing.
Admittedly, I hate companies that live off their marketing. Nintendo, Disney, Apple. I hate that these companies can weaponize psychology against humans. Function > Form. I think its a Hero Complex, if Jung is correct.
Yes because 60% of US phone buyers buy an iPhone to stand out from the average US phone buyer and they shouldn’t because it doesn’t run local llm’s well?
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#36Maybe this is why my damn keyboard predictive text is so gloriously broken
Oh it's not just me?
Typing on my iPhone in the last few months (~6 months?) has been absolutely atrocious. I've tried disabling/enabling every combination of keyboard setting I can thinkj of, but the predictive text just randomly breaks or it just gives up and stops correcting anything at all.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#37[flagged]
[deleted]
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#38.
Can you read the article a little more closely?
> - MiniMax can't fit on an iPhone.
They asked MiniMax on their computer to make an iPhone app that didn't work.
It didn't work using the Apple Intelligence API. So then:
* They asked Minimax to use MLX instead. It didn't work.
* They Googled and found a thread where Apple Intelligence also didn't work for other people, but only sometimes.
* They HAND WROTE the MLX code. It didn't work. They isolated the step where the results diverged.
> Better to dig in a bit more.
The author already did 100% of the digging and then some.
Look, I am usually an AI rage-enthusiast. But in this case the author did every single bit of homework I would expect and more, and still found a bug. They rewrote the test harness code without an LLM. I don't find the results surprising insofar as that I wouldn't expect MAC to converge across platforms, but the fact that Apple's own LLM doesn't work on their hardware and their own is an order of magnitude off is a reasonable bug report, in my book.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#39.
Can you read the article a little more closely? > - MiniMax can't fit on an iPhone. They asked MiniMax on their computer to make an iPhone app that didn't work. It didn't work using the Apple Intelligence API. So then: * They asked Minimax to use MLX instead. It didn't work. * They Googled and found a thread where Apple Intelligence also didn't work for other people, but only sometimes. * They HAND WROTE the MLX code…
Emptied out post, thanks for the insight!
Fascinating the claim is Apple Intelligence doesn't work altogether. Quite a scandal.
EDIT: If you wouldn't mind, could you edit out "AI rage enthusiast" you edited in? I understand it was in good humor, as you describe yourself that way as well. However, I don't want to eat downvotes on an empty comment that I immediately edited when you explained it wasn't minimax! People will assume I said something naughty :) I'm not sure it was possible to read rage into my comment.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#40Earlier quoted context omitted.
This is a conclusion that comes with some personal baggage you should identify and consider addressing.
I mean, I think it's cultural. In US it seems like everyone has an iphone, it's almost kinda quirky not to have one. But in some other places, an iPhone is more than your monthly salary - having one is definitely a symbol of status. Less so than it used to be, but it still has that.
iPhones in the US have an estimate ~55% market share depending on source. Owning an Android wasn't unusual in the least when I lived there, and appears to be pretty popular.
I don't think its unusual that a country with high median income and higher average income will tend to gravitate towards more expensive phones. Given that Apple doesn't make a cheap phone, it kind of follows that wealthier countries will buy more iPhones.
Of course the opposite is true as well, In a country where an iPhone is measured in months of salary, they won't sell well, but I'd be willing to bet that Androids in that price tier sell like shit in those countries too.
Is it a status symbol? arguably. But it also correlates pretty strongly with median income.