Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

My iPhone 16 Pro Max produces garbage output when running MLX LLMs

journal.rafaelcosta.me

Post reply on HN
Print view View original

71–80 of 239 posts

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#71

Post by mylifeandtimes »

danpalmer wrote: post #47
bri3d wrote: post #11

Earlier quoted context omitted.

Yes, "floating point accumulation doesn't commute" is a mantra everyone should have in their head, and when I first read this article, I was jumping at the bit to dismiss it out of hand for that reason. But, what got me about this is that: * every other Apple device delivered the same results * Apple's own LLM silently failed on this device to me that behavior suggests an unexpected failure rather than a fundamental…

FYI, the saying is "champing at the bit", it comes from horses being restrained.

hey, I appreciate your love of language and sharing with us.

I'm wondering if we couldn't re-think "bit" to the computer science usage instead of the thing that goes in the horse's mouth, and what it would mean for an AI agent to "champ at the bit"?

What new sayings will we want?

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#72

Post by mikestew »

LoganDark wrote: post #44
refulgentis wrote: post #39

Earlier quoted context omitted.

Emptied out post, thanks for the insight! Fascinating the claim is Apple Intelligence doesn't work altogether. Quite a scandal. EDIT: If you wouldn't mind, could you edit out "AI rage enthusiast" you edited in? I understand it was in good humor, as you describe yourself that way as well. However, I don't want to eat downvotes on an empty comment that I immediately edited when you explained it wasn't minimax! People w…

> Fascinating the claim is Apple Intelligence doesn't work altogether. Quite a scandal. No, the claim is their particular device has a hardware defect that causes MLX not to work (which includes Apple Intelligence). > EDIT: If you wouldn't mind, could you edit out "AI rage enthusiast" you edited in? I understand it was in good humor, as you describe yourself that way as well. However, I don't want to eat downvotes on…

Then future downvotes won't affect your karma.

Who cares? The max amount of karma loss is 4 points, we can afford to eat our downvotes like adults.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#73

Post by CrispinS »

csmantle wrote: post #46

Methodology is one thing; I can't really agree that deploying an LLM to do sums is great. Almost as hilarious as asking "What's moon plus sun?" But phenomenon is another thing. Apple's numerical APIs are producing inconsistent results on a minority of devices. This is something worth Apple's attention.

> What's moon plus sun?

Eclipse, obviously.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#74

Post by odo1242 »

danpalmer wrote: post #47
bri3d wrote: post #11

Earlier quoted context omitted.

Yes, "floating point accumulation doesn't commute" is a mantra everyone should have in their head, and when I first read this article, I was jumping at the bit to dismiss it out of hand for that reason. But, what got me about this is that: * every other Apple device delivered the same results * Apple's own LLM silently failed on this device to me that behavior suggests an unexpected failure rather than a fundamental…

FYI, the saying is "champing at the bit", it comes from horses being restrained.

chomping at the bit

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#75

Post by nilamo »

mylifeandtimes wrote: post #71
danpalmer wrote: post #47

Earlier quoted context omitted.

FYI, the saying is "champing at the bit", it comes from horses being restrained.

hey, I appreciate your love of language and sharing with us. I'm wondering if we couldn't re-think "bit" to the computer science usage instead of the thing that goes in the horse's mouth, and what it would mean for an AI agent to "champ at the bit"? What new sayings will we want?

Byting at the bit?

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#77

Post by danpalmer »

odo1242 wrote: post #74
danpalmer wrote: post #47

Earlier quoted context omitted.

FYI, the saying is "champing at the bit", it comes from horses being restrained.

chomping at the bit

Actually it was originally "champing" – to grind or gnash teeth. The "chomping" (to bite) alternative cropped up more recently as people misheard and misunderstood, but it's generally accepted as an alternative now.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#78

Post by xoa »

Buttons840 wrote: post #7

I clicked hoping this would be about how old graphing calculators are generally better math companions than a phone. The best way to do math on my phone I know of is the HP Prime emulator.

My personal favorite is iHP48 (previously I used m48+ before it died) running an HP 48GX with metakernal installed as I used through college. Still just so intuitive and fast to me.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#79

Post by christophilus »

CrispinS wrote: post #73
csmantle wrote: post #46

Methodology is one thing; I can't really agree that deploying an LLM to do sums is great. Almost as hilarious as asking "What's moon plus sun?" But phenomenon is another thing. Apple's numerical APIs are producing inconsistent results on a minority of devices. This is something worth Apple's attention.

> What's moon plus sun? Eclipse, obviously.

That’s sun minus moon. Moon plus sun is a wildly more massive, nuclear furnace of a moon that also engulfs the earth.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#80

Post by fragmede »

LoganDark wrote: post #44
refulgentis wrote: post #39

Earlier quoted context omitted.

Emptied out post, thanks for the insight! Fascinating the claim is Apple Intelligence doesn't work altogether. Quite a scandal. EDIT: If you wouldn't mind, could you edit out "AI rage enthusiast" you edited in? I understand it was in good humor, as you describe yourself that way as well. However, I don't want to eat downvotes on an empty comment that I immediately edited when you explained it wasn't minimax! People w…

> Fascinating the claim is Apple Intelligence doesn't work altogether. Quite a scandal. No, the claim is their particular device has a hardware defect that causes MLX not to work (which includes Apple Intelligence). > EDIT: If you wouldn't mind, could you edit out "AI rage enthusiast" you edited in? I understand it was in good humor, as you describe yourself that way as well. However, I don't want to eat downvotes on…

Oh no, all my meaningless internet points, gone!
Post reply on HN