[flagged]
My iPhone 16 Pro Max produces garbage output when running MLX LLMs
61–70 of 239 posts
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#62[flagged]
> Its a demonstration of wealth. This is called Veblen good
Just the other day I was reminded of the poor little "I am rich" iOS app (a thousand dollar ruby icon that performed diddly squat by design), which Apple deep-sixed from the app store PDQ.
If misery loves company, Veblen goods sure don't.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#63[flagged]
I found the article hard to read. I turned on reader mode. I still found it hard to read. Each sentence is very short. My organic CPU spins trying to figure out how each sentence connects to the next. Each sentence feels more like a paragraph, or a tweet, instead of having a flow. I think that's my issue with it.
If it was written in turgid prose people would be frantically waggling their AI accusatory fingers.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#64Methodology is one thing; I can't really agree that deploying an LLM to do sums is great. Almost as hilarious as asking "What's moon plus sun?" But phenomenon is another thing. Apple's numerical APIs are producing inconsistent results on a minority of devices. This is something worth Apple's attention.
(This is a total digression, so apologies)
My mind instantly answered that with "bright", which is what you get when you combine the sun and moon radicals to make 明(https://en.wiktionary.org/wiki/%E6%98%8E)
Anyway, that question is not without reasonable answers. "Full Moon" might make sense too. No obvious deterministic answer, though, naturally.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#65I wish he would have tried on a different iPhone 16 Pro Max to see if the defect was specific to that individual device.
So true! And as any sane Apple user or the standard template Apple Support person would have suggested (and as they actually suggest) - did they try reinstalling the OS from scratch after having reset the data (of course before backing it up; preferably with a hefty iCloud+ plan)? Because that's the thing to do in such issues and it's very easy.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#66>"What is 2+2?" apparently "Applied.....*_dAK[...]" according to my iPhone
At least the machine didn't say it was seven!
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#67Low level numerical operation optimizations are often not reproduceable. For example: https://www.intel.com/content/dam/develop/external/us/en/doc... (2013) But it's still surprising that that LLM doesn't work on iPhone 16 at all. After all LLMs are known for their tolerance to quantization.
Yes, "floating point accumulation doesn't commute" is a mantra everyone should have in their head, and when I first read this article, I was jumping at the bit to dismiss it out of hand for that reason. But, what got me about this is that: * every other Apple device delivered the same results * Apple's own LLM silently failed on this device to me that behavior suggests an unexpected failure rather than a fundamental…
As a sister comment said, floating point computations are commutative, but not associative.
a * b = b * a for all "normal" floating point numbers.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#68Earlier quoted context omitted.
I found the article hard to read. I turned on reader mode. I still found it hard to read. Each sentence is very short. My organic CPU spins trying to figure out how each sentence connects to the next. Each sentence feels more like a paragraph, or a tweet, instead of having a flow. I think that's my issue with it.
If it was written in turgid prose people would be frantically waggling their AI accusatory fingers.
Instead he writes Buzzfeed style: a sentence per paragraph, and then smushes several paragraphs into one.
(The idea being, a paragraph usually introduces a new thought.)
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#69I clicked hoping this would be about how old graphing calculators are generally better math companions than a phone. The best way to do math on my phone I know of is the HP Prime emulator.
I was pretty delighted to realize I could now delete the lame Calculator.app from my iPhone and replace it with something of my choice. For now I've settled on NumWorks, which is apparently an emulator of a modern upstart physical graphing calc that has made some inroads into schools. And of course, you can make a Control Center button to launch an app, so that's what I did.
Honestly, the main beef I have with Calculator.app is that on a screen this big, I ought to be able to see several previous calculations and scroll up if needed. I don't want an exact replica of a 1990s 4-function calculator like the default is (ok, it has more digits and the ability to paste, but besides that, adds almost nothing).
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#70[flagged]