Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

My iPhone 16 Pro Max produces garbage output when running MLX LLMs

journal.rafaelcosta.me

Post reply on HN
Print view View original

21–30 of 239 posts

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#21

Post by ohyoutravel »

gambiting wrote: post #18
ohyoutravel wrote: post #16

Earlier quoted context omitted.

This is a conclusion that comes with some personal baggage you should identify and consider addressing.

I mean, I think it's cultural. In US it seems like everyone has an iphone, it's almost kinda quirky not to have one. But in some other places, an iPhone is more than your monthly salary - having one is definitely a symbol of status. Less so than it used to be, but it still has that.

Fair, but that’s a comment on a US-centric website, run by a US-centric company, in a US-centric industry, on a US-centric medium. So if they didn’t mean US, I think the onus is on them to clarify exactly where this applies.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#22

Post by jojobas »

decimalenough wrote: post #19
lionkor wrote: post #13

[flagged]

My TL;DR is that they tried to run an on-device model to classify expenses, it didn't work even for simple cases ("Kasai Kitchin" -> "unknown"), they went deeeeeep down the rabbit hole to figure out why and concluded that inference on their particular model/phone is borked at the hardware level. Whether you should do this on device is another story entirely.

Why shouldn't you? It's your device, it has hardware made specifically for inference.

What's to be gained, other than battery life, by offloading inference to someone else? To be lost, at least, is your data ownership and perhaps money.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#23

Post by ErroneousBosh »

bri3d wrote: post #17
lionkor wrote: post #13

[flagged]

> Or, rather, MiniMax is! The good thing about offloading your work to an LLM is that you can blame it for your shortcomings. Time to get my hands dirty and do it myself, typing code on my keyboard, like the ancient Mayan and Aztec programmers probably did. They noticed a discrepancy, then went back and wrote code to perform the same operations by hand, without the use of an LLM at all in the code production step. Th…

> Time to get my hands dirty and do it myself, typing code on my keyboard, like the ancient Mayan and Aztec programmers probably did.

https://ia800806.us.archive.org/20/items/TheFeelingOfPower/T...

I should think I'll probably see someone posting this on the front page of HN tomorrow, no doubt. I first read it when it was already enormously old, possibly nearly 30 years old, in the mid 1980s when I was about 11 or 12 and starting high school, and voraciously reading all the Golden Age Sci-Fi I could lay my grubby wee hands on. I still think about it, often.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#24

Post by kulahan »

PlatoIsADisease wrote: post #20
ohyoutravel wrote: post #16

Earlier quoted context omitted.

This is a conclusion that comes with some personal baggage you should identify and consider addressing.

Admittedly, I hate companies that live off their marketing. Nintendo, Disney, Apple. I hate that these companies can weaponize psychology against humans. Function > Form. I think its a Hero Complex, if Jung is correct.

All three of these companies are supremely dedicated to the customer experience. It’s a weird thing to be annoyed at. Ninty is the only company really experimenting with gaming hardware. Disney parks are a thesis on hiding the “behind the scenes” stuff perfectly. Apple does its best to make things just kinda work well, and if you’re in their ecosystem fully, it usually does work out.

Not everyone cares for the most capable device on the planet. Sometimes people just want a pretty familiar and easy experience. I haven’t used my phone for anything more than browsing the web and texting in ages. I absolutely don’t care about whatever function you think I’m missing due to Apple, honestly.

As a side note, the fathers of Psychology were absolutely terrible scientists. The entire field almost failed because they took it so far into pseudo-science land. Of course Jung isn’t correct.

Re: My iPhone 16 Pro Max produces garbage output when running MLX LLMs

#26

Post by DJBunnies »

PlatoIsADisease wrote: post #20
ohyoutravel wrote: post #16

Earlier quoted context omitted.

This is a conclusion that comes with some personal baggage you should identify and consider addressing.

Admittedly, I hate companies that live off their marketing. Nintendo, Disney, Apple. I hate that these companies can weaponize psychology against humans. Function > Form. I think its a Hero Complex, if Jung is correct.

Macbooks and iPhones are good devices though, saying this as a primarily linux user.

There is no way a company could exist purely on marketing, Apple backs it up with tech.

Post reply on HN