Apple Releases Open Source AI Models That Run On-Device
1–10 of 15 posts
Re: Apple Releases Open Source AI Models That Run On-Device
#2Discussion: [0] (33 points, 18 hours ago, 7 comments)
Re: Apple Releases Open Source AI Models That Run On-Device
#3Why is the 3B model worse than the 450M model on MMLU and TruthfulQA?
Re: Apple Releases Open Source AI Models That Run On-Device
#4Has anyone seen a working, clearly explained recipe for running this using the Python MLX library on macOS yet?
Re: Apple Releases Open Source AI Models That Run On-Device
#5Has anyone seen a working, clearly explained recipe for running this using the Python MLX library on macOS yet?
What’s there to explain? There’s a readme in the repo that shows how to do it.
Re: Apple Releases Open Source AI Models That Run On-Device
#6Now we can give credit to Apple for invented AI!
Re: Apple Releases Open Source AI Models That Run On-Device
#7[deleted]
Re: Apple Releases Open Source AI Models That Run On-Device
#8An LLM in my pocket is truly a mind-blowing concept, I have to say. More than anything else — phone, camera, internet. The feels like a really big deal.
And with regard to LLMs (AI?) in general, I don't think right now we have any idea what we will all be using them for in ten years. But it just feels like a fundamental change is coming from all this.
Re: Apple Releases Open Source AI Models That Run On-Device
#9[dupe]
Some more discussion: https://news.ycombinator.com/item?id=40140675
Re: Apple Releases Open Source AI Models That Run On-Device
#10Has anyone seen a working, clearly explained recipe for running this using the Python MLX library on macOS yet?
What’s there to explain? There’s a readme in the repo that shows how to do it.
I tried and failed to follow that. I'm looking for a report from someone who has got it (or something like it) to work.