Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

My iPhone 16 Pro Max produces garbage output when running MLX LLMs

journal.rafaelcosta.me

Post reply on HN
Print view View original

131–140 of 239 posts

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#131

Post by Melatonic »

watersb wrote: post #121
Buttons840 wrote: post #7

I clicked hoping this would be about how old graphing calculators are generally better math companions than a phone. The best way to do math on my phone I know of is the HP Prime emulator.

PCalc -- because it runs on every Apple platform since the Mac Classic: https://pcalc.com/mac/thirty.html My other favorite calculator is free42, or its larger display version plus42 https://thomasokken.com/plus42/ For a CAS tool on a pocket mobile device, I haven't found anything better than MathStudio (formerly SpaceTime): https://mathstud.io You can run that in your web browser, but they maintain a mobile app vers…

The last one was interesting but both apps haven't been updated in 4 years. Hard to pay for something like that.

They do have some new AI math app that's regularly updated

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#133

Post by josephg »

varun_ch wrote: post #53
VorpalWay wrote: post #12

Earlier quoted context omitted.

I run a TI 83+ emulator on my Android phone when I don't have my physical calculator at hand. Same concept, just learned a different brand of calculators.

built-in calculator apps are surprisingly underbaked... I'm surprised neither of the big two operating systems have elected to ship something comparable to a real calculator built in. It would be nice if we could preview the whole expression as we type it.. I use the NumWorks emulator app whenever I need something more advanced. It's pretty good https://www.numworks.com/simulator/

That’s certainly an improvement - but why can’t I modify a previous expression? Or tap to select previous expressions?

What I want is something like a repl. I want to be able to return to an earlier expression, modify it, assign it to a variable, use that variable in another expression, modify the variable and rerun and so on.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#135

Post by Someone »

jajuuka wrote: post #118
DustinEchoes wrote: post #51

I wish he would have tried on a different iPhone 16 Pro Max to see if the defect was specific to that individual device.

Latest update at the bottom of the page. "Well, now it's Feb. 1st and I have an iPhone 17 Pro Max to test with and... everything works as expected. So it's pretty safe to say that THAT specific instance of iPhone 16 Pro Max was hardware-defective."

That logic is somewhat [1] correct, but it doesn’t say anything about whether all, some, or only this particular iPhone 16 Pro Maxes are hardware-defective.

[1] as the author knows (“MLX uses Metal to compile tensor operations for this accelerator. Somewhere in that stack, the computations are going very wrong”) there’s lots of soft- and firmware in-between the code being run and the hardware of the neural engine. The issue might well be somewhere in those.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#138

Post by idk1 »

csmantle wrote: post #46

Methodology is one thing; I can't really agree that deploying an LLM to do sums is great. Almost as hilarious as asking "What's moon plus sun?" But phenomenon is another thing. Apple's numerical APIs are producing inconsistent results on a minority of devices. This is something worth Apple's attention.

As an aside, one of my very nice family members like tarot card reading, and I think you'd get an extremely different answer for - "What's moon plus sun?" - something like I would guess as they're opposites - "Mixed signals or insecurity get resolved by openness and real communication." - It's kind of fascinating, the range of answers to that question. As a couple of other people have mentioned, it could mean loads of things. I thought I'd add one in there.

I'll just add that if you think this advice applies to you, it's the - https://en.wikipedia.org/wiki/Barnum_effect

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#139

Post by DavidVoid »

ekelsen wrote: post #82
sva_ wrote: post #55

Earlier quoted context omitted.

> floating point accumulation doesn't commute It is commutative (except for NaN). It isn't associative though.

I think it commutes even when one or both inputs are NaN? The output is always NaN.

Unless you compile with fast-math ofc, because then the compiler will assume that NaN never occurs in the program.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#140

Post by jraph »

CrispinS wrote: post #73
csmantle wrote: post #46

Methodology is one thing; I can't really agree that deploying an LLM to do sums is great. Almost as hilarious as asking "What's moon plus sun?" But phenomenon is another thing. Apple's numerical APIs are producing inconsistent results on a minority of devices. This is something worth Apple's attention.

> What's moon plus sun? Eclipse, obviously.

Moon plus sun would be sun because the sun would be an absorbing element.
Post reply on HN