[flagged]
[deleted]
My iPhone 16 Pro Max produces garbage output when running MLX LLMs
41–50 of 239 posts
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#42Posting some code that reproduces the bug could help not only Apple but you and others.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#43.
[deleted]
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#44Earlier quoted context omitted.
Can you read the article a little more closely? > - MiniMax can't fit on an iPhone. They asked MiniMax on their computer to make an iPhone app that didn't work. It didn't work using the Apple Intelligence API. So then: * They asked Minimax to use MLX instead. It didn't work. * They Googled and found a thread where Apple Intelligence also didn't work for other people, but only sometimes. * They HAND WROTE the MLX code…
Emptied out post, thanks for the insight! Fascinating the claim is Apple Intelligence doesn't work altogether. Quite a scandal. EDIT: If you wouldn't mind, could you edit out "AI rage enthusiast" you edited in? I understand it was in good humor, as you describe yourself that way as well. However, I don't want to eat downvotes on an empty comment that I immediately edited when you explained it wasn't minimax! People w…
> Fascinating the claim is Apple Intelligence doesn't work altogether. Quite a scandal.
No, the claim is their particular device has a hardware defect that causes MLX not to work (which includes Apple Intelligence).
> EDIT: If you wouldn't mind, could you edit out "AI rage enthusiast" you edited in? I understand it was in good humor, as you describe yourself that way as well. However, I don't want to eat downvotes on an empty comment that I immediately edited when you explained! People will assume I said something naughty :) I'm not sure it was possible to read rage into my comment.
Your comment originally read:
> This is blinkered.
> - MiniMax can't fit on an iPhone.
> - There's no reason to expect models to share OOMs for output.
> - It is likely this is a graceful failure mode for the model being far too large.
> No fan of Apple's NIH syndrome, or it manifested as MLX.
> I'm also no fan of "I told the robot [vibecoded] to hammer a banana into an apple. [do something impossible]. The result is inedible. Let me post to HN with the title 'My thousand dollars of fruits can't be food' [the result I have has ~nothing to do with the fruits]"
> Better to dig in a bit more.
Rather than erase it, and invite exactly the kind of misreading you don't want, you can leave it... honestly, transparently... with your admission in the replies below. And it won't be downvoted as much as when you're trying to manipulate / make requests of others to try to minimize your downvotes. Weird... voting... manipulating... stuff, like that, tends to be frowned upon on HN.
You have more HN karma than I do, even, so why care so much about downvotes...
If you really want to disown something you consider a terrible mistake, you can email the HN mods to ask for the comment to be dissociated from your account. Then future downvotes won't affect your karma. I did this once.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#45[flagged]
I severely doubt your thesis around iPhones being Veblen goods.
You are claiming that if the price of the iPhone went down, apple would sell fewer phones?
Correspondingly, you are arguing that if they increased prices they could increase sales?
You are claiming that 100s of millions of people have all made the decision that the price of an iPhone is more than it is worth to them as a device, but is made up for by being seen with one in your hand?
Not all goods that signify status are Veblen goods.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#46Methodology is one thing; I can't really agree that deploying an LLM to do sums is great. Almost as hilarious as asking "What's moon plus sun?"
But phenomenon is another thing. Apple's numerical APIs are producing inconsistent results on a minority of devices. This is something worth Apple's attention.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#47Low level numerical operation optimizations are often not reproduceable. For example: https://www.intel.com/content/dam/develop/external/us/en/doc... (2013) But it's still surprising that that LLM doesn't work on iPhone 16 at all. After all LLMs are known for their tolerance to quantization.
Yes, "floating point accumulation doesn't commute" is a mantra everyone should have in their head, and when I first read this article, I was jumping at the bit to dismiss it out of hand for that reason. But, what got me about this is that: * every other Apple device delivered the same results * Apple's own LLM silently failed on this device to me that behavior suggests an unexpected failure rather than a fundamental…
FYI, the saying is "champing at the bit", it comes from horses being restrained.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#48[flagged]
I found the article hard to read. I turned on reader mode. I still found it hard to read. Each sentence is very short. My organic CPU spins trying to figure out how each sentence connects to the next. Each sentence feels more like a paragraph, or a tweet, instead of having a flow. I think that's my issue with it.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#49Earlier quoted context omitted.
Why shouldn't you? It's your device, it has hardware made specifically for inference. What's to be gained, other than battery life, by offloading inference to someone else? To be lost, at least, is your data ownership and perhaps money.
> What's to be gained... by offloading inference to someone else? Access to models that local hardware can't run. The kind of model that an iphone struggles to run is blown out of the water by most low end hosted models. Its the same reason that most devs opt for claude code, cursor, copilot, etc. instead of using hosted models for coding assistance.
Claude code produces stuff orders of magnitude more complicated than classifying expenses.
If the task can be run locally on hardware you own anyway, it should.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#50Maybe this is why my damn keyboard predictive text is so gloriously broken
Oh it's not just me? Typing on my iPhone in the last few months (~6 months?) has been absolutely atrocious. I've tried disabling/enabling every combination of keyboard setting I can thinkj of, but the predictive text just randomly breaks or it just gives up and stops correcting anything at all.
I haven't watched the video, but clearly there's a broad problem with the iOS keyboard recently.
https://news.ycombinator.com/item?id=46232528 ("iPhone Typos? It's Not Just You - The iOS Keyboard is Broken")