Live data from Hacker News

Microsoft Phi-3 Cookbook

github.com

31–40 of 59 posts

Re: Microsoft Phi-3 Cookbook

#31

Earlier quoted context omitted.

In Australia they are the same price ($1.9k AUD vs $1.6k for MacBook air). How much where you're at?

M3 15" air with 24gb ram and 1tb ssd is 3400 australian dollars

Does the cheapest Microsoft one come with 24 gigs ram and one TB SSD?

Re: Microsoft Phi-3 Cookbook

#32
post #27

Earlier quoted context omitted.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

In single core performance... In multi-core from what I've seen X Plus is faster than base M3.

I couldn't find the Geekbench results for an MBA M3, but here's for an MBP 14" M3:

Single: 3088 Multi: 11595

Non-production Elite X From Anandtech[1]:

Single: 2800 Multi: 14400

Non-production Plus X From Anandtech[1]:

Single: 2425 Multi: 13100

Slower single perf for both Snapdragons. Decent 10% jump in multi over the M3. I am eager to see how the production units will pan out on benchmarks and sustained performance.

Qualcomm's been shady in the past with their so-called "Apple killer" chip benchmarks. I don't think these are "Apple killers", but I hope it pans out, for competition's sake.

1. https://www.anandtech.com/show/21364/qualcomm-intros-snapdra...

Re: Microsoft Phi-3 Cookbook

#33
post #27

Earlier quoted context omitted.

US. Canada. Probably other regions. A Surface Laptop with 16GB RAM and 512GB SSD is $1200 USD. A M3 MBA with with 16GB RAM and 512GB SSD is $1500.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

Also worth noting that the Macbook Air is still not upgraded to a MicroLED display (uses IPS instead), whereas the Surface Laptop now comes standard with OLED.

Re: Microsoft Phi-3 Cookbook

#34
post #27

Earlier quoted context omitted.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

In single core performance... In multi-core from what I've seen X Plus is faster than base M3.

M3 was last year though, M4 has just been released, though iPad only for now

Re: Microsoft Phi-3 Cookbook

#35
post #27

Earlier quoted context omitted.

US. Canada. Probably other regions. A Surface Laptop with 16GB RAM and 512GB SSD is $1200 USD. A M3 MBA with with 16GB RAM and 512GB SSD is $1500.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

Are we talking about AI/ML?

X Plus and X Elite NPU hit 45 TOPS. M4 is 38 TOPS...

Also, as far I know, Elite does match M3. Actually, Qualcomm promise that even X Plus is able to match it, as they say Elite is better than M3.

We'll have to wait to see more benchmarks.

PS: There's 3 Elite series.

Re: Microsoft Phi-3 Cookbook

#36

Earlier quoted context omitted.

For the price of these new laptops one can already buy a MacBook with a general purpose GPU that is more than capable of running these models. One can buy a windows laptop with a dedicated graphics card that can also run these models. Perhaps it would be interesting if the price was substantially lower.

These new laptops are half the price of macbooks with the same ram and storage

But not same performance. One of the reason QC not releasing anything but controlled benchmarks is most likely the subpar performance of Windows on ARM. This will be the biggest hurdle for QC Elite chips, competing with M-seried which is design in tandem with MacOS.

Re: Microsoft Phi-3 Cookbook

#37
post #36

Earlier quoted context omitted.

These new laptops are half the price of macbooks with the same ram and storage

But not same performance. One of the reason QC not releasing anything but controlled benchmarks is most likely the subpar performance of Windows on ARM. This will be the biggest hurdle for QC Elite chips, competing with M-seried which is design in tandem with MacOS.

Isn't the unified memory architecture one of the advantages of the Apple M* notebooks for running AI workloads?

Re: Microsoft Phi-3 Cookbook

#39
Slightly off topic: what’s the reasonably smallest LLM model i can use to do language processing and rewriting of a large library of word documents? For the purposes of querying information and regurgitating out summaries or detailed information?

My use case is very simple: take 1000 word documents filled with two to three pages of information and pictures. And then output a set of requested information via prompting. Is there something off the shelf? Or do I have to make this?

Re: Microsoft Phi-3 Cookbook

#40
post #36

Earlier quoted context omitted.

These new laptops are half the price of macbooks with the same ram and storage

But not same performance. One of the reason QC not releasing anything but controlled benchmarks is most likely the subpar performance of Windows on ARM. This will be the biggest hurdle for QC Elite chips, competing with M-seried which is design in tandem with MacOS.

Speculation.
Post reply on HN