LPDDR6... that's not enough for speedy inference
Oh thank heavens, computing hardware that the AI companies will not buy all of the supply of.
Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
21–30 of 787 posts
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#22Insane if true. Does Xiaomi sell laptops?
I have Mi Notebook Pro. Not that bad actually.
But they have stopped making premium laptop since then.
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#23This smells somewhat legitimate and somewhat BS. The architecture itself looks impressive — TSMC 3nm, a 4+ GHz prime core, tons of cache, and a very wide execution engine. And the claimed Geekbench numbers — around *3,945 single-core and 15,221 multi-core* — are especially impressive, if not a little suspicious. But it’s sorta like, let’s throw everything against the wall and get the biggest number we can. Do they sh…
[deleted]
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#24RIP Mediatek, RIP Qualcomm
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#25I can feel the scores of messages being sent to the federal government from lobbyists saying what a threat Chinese hardware is to national security.
[deleted]
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#26Earlier quoted context omitted.
> I can feel the scores of messages being sent to the federal government from lobbyists saying what a threat Chinese hardware is to national security. The motivation for such messages may be greedy, but it doesn't mean the facts aren't wrong: 1. As a practical matter, no one can audit systems so thoroughly to determine a system built by an adversary won't act adversarially. 2. Free market incentives work counter to n…
Can we audit American corporations?
Also, who decides which entities are adversaries? I don't personally consider "China" my adversary. As an American who has to deal with US companies, many of them are far more antagonistic to me than a foreign country 10K km away.
If "China" decides it doesn't like me, my life really isn't going to change much. If my electric company decides it doesn't like me, I'm in big trouble.
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#27This smells somewhat legitimate and somewhat BS. The architecture itself looks impressive — TSMC 3nm, a 4+ GHz prime core, tons of cache, and a very wide execution engine. And the claimed Geekbench numbers — around *3,945 single-core and 15,221 multi-core* — are especially impressive, if not a little suspicious. But it’s sorta like, let’s throw everything against the wall and get the biggest number we can. Do they sh…
Were I to guess
> The biggest cores on the the Xring O3 are the C1-Ultra. C1-Ultra really powerful cores. They support SME2 (Scalable Matrix Extension 2) for matrix/AI acceleration, SVE2 for data parallelism (SIMD).
This is where the magic is happening (I believe). They have these ultra cores with additional extensions which they are pinning the benchmarks to.
Realistically, that sort of thing isn't useful as non-homogeneous architectures really suck for an application or OS to deal with.
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#28LPDDR6... that's not enough for speedy inference
It depends on the number of channels. The Xring O3 appears to have 4×24-bit channels, so 113.8 GB/s. The iPhone 17 Pro's memory bandwidth is ~76.8 GB/s. Seems fine?
If I recall correctly, Strix Halo gets about 450G/s. The M series processors get between 400 and 800G/s, and an actual NVIDIA card is like 5.5T/s. 113G/s is pretty slow for inference.
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#29This smells somewhat legitimate and somewhat BS. The architecture itself looks impressive — TSMC 3nm, a 4+ GHz prime core, tons of cache, and a very wide execution engine. And the claimed Geekbench numbers — around *3,945 single-core and 15,221 multi-core* — are especially impressive, if not a little suspicious. But it’s sorta like, let’s throw everything against the wall and get the biggest number we can. Do they sh…
> But it’s sorta like, let’s throw everything against the wall and get the biggest number we can.
From what I recall reading, the impressive performance of Apple mobile CPUs is partly attributable to throwing more silicon area at the problem while not being as cost sensitive (no need to share margin with SoC vendor)
Re: Xiaomi: New CPU matches Apple cores single threaded, much faster multithreaded
#30https://xcancel.com/lemire/status/2091894299289874926
https://addons.mozilla.org/en-US/firefox/addon/xcancel/
And on iOS?
(Also I'd recommend https://libredirect.manerakai.com/)