Apple M5 chip
apple.com
Apple M5 chip
1–10 of 1001 posts
Re: Apple M5 chip
#2This is only the base model, no upgrades yet for the Pro/Max version. The memory bandwidth is 153GB/s which is not enough to run viable open source LLM models properly.
Re: Apple M5 chip
#3Is it me or did they use to avoid calling it "AI"?
Re: Apple M5 chip
#4I get they want to have a lot of their own swift-based bindings but I wish they could also keep their MPS pytorch bindings up to date...
Re: Apple M5 chip
#5Is it me or did they use to avoid calling it "AI"?
Yeah, they rebranded it "Apple Intelligence" but this press release appears to be mostly using AI in the same (vague) way that the rest of the industry does.
Also just noticed this:
"And now with M5, the new 14-inch MacBook Pro and iPad Pro benefit from dramatically accelerated processing for AI-driven workflows, such as running diffusion models in apps like Draw Things, or running large language models locally using platforms like webAI."
First time I've ever heard of webAI - I wonder how they got themselves that mention?
Re: Apple M5 chip
#6The modern Apple feels like their hardware teams way outperforming the software teams.
Re: Apple M5 chip
#7No M5 mac mini?
Re: Apple M5 chip
#8A unified memory bandwidth of 1,224 gigabits per second is quite impressive.
Re: Apple M5 chip
#9No 16”?
Re: Apple M5 chip
#10This is only the base model, no upgrades yet for the Pro/Max version. The memory bandwidth is 153GB/s which is not enough to run viable open source LLM models properly.
What do you mean by properly? What’s the behavior one would observe if they did run an llm?