Earlier quoted context omitted.
Moon implies there is a planet the moon is orbiting. So unless the planet and its moon are too close to the sun the long term result could also be: solar system.
This goes to show how that plus operation is awfully defined.
My iPhone 16 Pro Max produces garbage output when running MLX LLMs
161–170 of 239 posts
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#162It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083
Blog post dated 28 Jan 2026, the bug fix posted 29 Jan 2026, so I guess this story had a happy ending :) Still, sad state of affairs that it seems like Apple is still fixing bugs based on what blog posts gets the most attention on the internet, but I guess once they started that approach, it's hard to stop and go back to figuring out priorities on their own.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#163Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#164Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#165It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#166It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083
So the underlying issue is that the iPhone 16 Pro SKU was misdetected as having Neural Accelerator (nax) support and this caused silently wrong results. Not a problem with the actual hardware.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#167It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083
Blog post dated 28 Jan 2026, the bug fix posted 29 Jan 2026, so I guess this story had a happy ending :) Still, sad state of affairs that it seems like Apple is still fixing bugs based on what blog posts gets the most attention on the internet, but I guess once they started that approach, it's hard to stop and go back to figuring out priorities on their own.
I don't think that fix is specific to this, but it's absolutely true that MLX is trying to lever every advantage it can find on specific hardware, so it's possible it made a bad choice on a particular device.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#168Earlier quoted context omitted.
So the underlying issue is that the iPhone 16 Pro SKU was misdetected as having Neural Accelerator (nax) support and this caused silently wrong results. Not a problem with the actual hardware.
Apple's documentation is utter garbage, but this code almost seems like a separate issue (and notably the MLX library uses loads of undocumented properties in metal which isn't cool). It looks like the change used to allow the NAX kernel to be used on the iPhone 17 or upcoming 18 if you're on 26.2 or later, to instead only allow it on the iPhone 17 Pro or upcoming 18. I'm fairly sure the GPU arch on the A19 is 17. Th…
What has existed before is the Apple Neural Engine (ANE) which is very different from the newer Neural Accelerator support within the GPU blocks. In fact MLX does not even support ANE yet since at least in previous versions it was hardware-limited to computing FP16 and INT8 MADDs, and not even that fast.
Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#169Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs
#170Does it bother anyone else that the author drops "MiniMax" there in the article without bothering to explain or footnote what that is? (I could look it up, but I think article authors should call out these things).