Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Microsoft Phi-3 Cookbook

github.com

Post reply on HN
Print view View original

21–30 of 59 posts

Re: Microsoft Phi-3 Cookbook

#21

Post by dhruvdh »

killingtime74 wrote: post #10
Dowwie wrote: post #3

"We are introducing Phi Silica which is built from the Phi series of models and is designed specifically for the NPUs in Copilot+ PCs. Windows is the first platform to have a state-of-the-art small language model (SLM) custom built for the NPU and shipping inbox. Phi Silica API along with OCR, Studio Effects, Live Captions, Recall User Activity APIs will be available in Windows Copilot Library in June. More APIs like…

For the price of these new laptops one can already buy a MacBook with a general purpose GPU that is more than capable of running these models. One can buy a windows laptop with a dedicated graphics card that can also run these models. Perhaps it would be interesting if the price was substantially lower.

The NPU runs this Silica model at 1.5 watts. MacBooks cannot even drive multiple monitors in this price range.

Re: Microsoft Phi-3 Cookbook

#22

Post by refulgentis »

nonfamous wrote: post #17
refulgentis wrote: post #8

The initial model release had a terrible, frequent, issue with emitting the wrong "end of message" token, or never emitting one.[1] That is a very serious issue that breaks chat. The ones from today still have this issue.[2] Beyond that, they've been pushing new ONNX features enabling LLMs via Phi for about a month now. The ONNX runtime that supports it still isn't out, much less the downstream integration of it into…

FYI, there's a recipe for running Phi-3 under ONNX on iOS in the linked repository https://github.com/microsoft/Phi-3CookBook/blob/main/md/03.I...

Yes, that's the Potemkin village that broke this camel's back. It was linked in an announcement blog post yesterday.

You have to build two in-development libraries, one from ToT, one of which is a dev branch to make it compile for iOS on a Mac temporarily.

The dev branch doesn't actually exist.

If you use the only branch by the author on the repo, it doesn't work.

The dev branch that doesn't work is a few commits on top of ToT from 2 months ago.

At the end of that non-existent road is a model that can't end messages properly, in MyThing.app that uses llama.cpp, or LM Studio, or Ollama, or MS cloud API.

I can't ship on that, and neither can anyone else.

Re: Microsoft Phi-3 Cookbook

#24

Post by TiredOfLife »

runjake wrote: post #20
TiredOfLife wrote: post #15

Earlier quoted context omitted.

These new laptops are half the price of macbooks with the same ram and storage

In which configs and which geographic locations? In the US, pricing for equivalent Surface and Mac hardware configurations looks the same, to me. And that's if the Snapdragon X Elite is actually on par with the Apple M3, like Microsoft claims. Earlier X Elite benchmarks[1][2] showed that it was behind the M3, but hopefully Qualcomm have made some solid performance changes since then. Competition is good. 1. https://w…

ASUS Vivobook S15 S5507QA: 32GB/1TB 1400 EUR

MacBook Air 15,3" Apple M3 8-Core CPU & 10-Core GPU 24GB/1TB 2649 €

Re: Microsoft Phi-3 Cookbook

#25

Post by goosedragons »

runjake wrote: post #20
TiredOfLife wrote: post #15

Earlier quoted context omitted.

These new laptops are half the price of macbooks with the same ram and storage

In which configs and which geographic locations? In the US, pricing for equivalent Surface and Mac hardware configurations looks the same, to me. And that's if the Snapdragon X Elite is actually on par with the Apple M3, like Microsoft claims. Earlier X Elite benchmarks[1][2] showed that it was behind the M3, but hopefully Qualcomm have made some solid performance changes since then. Competition is good. 1. https://w…

US. Canada. Probably other regions. A Surface Laptop with 16GB RAM and 512GB SSD is $1200 USD. A M3 MBA with with 16GB RAM and 512GB SSD is $1500.

Re: Microsoft Phi-3 Cookbook

#26

Post by TiredOfLife »

killingtime74 wrote: post #16
TiredOfLife wrote: post #15

Earlier quoted context omitted.

These new laptops are half the price of macbooks with the same ram and storage

In Australia they are the same price ($1.9k AUD vs $1.6k for MacBook air). How much where you're at?

M3 15" air with 24gb ram and 1tb ssd is 3400 australian dollars

Re: Microsoft Phi-3 Cookbook

#27

Post by runjake »

goosedragons wrote: post #25
runjake wrote: post #20

Earlier quoted context omitted.

In which configs and which geographic locations? In the US, pricing for equivalent Surface and Mac hardware configurations looks the same, to me. And that's if the Snapdragon X Elite is actually on par with the Apple M3, like Microsoft claims. Earlier X Elite benchmarks[1][2] showed that it was behind the M3, but hopefully Qualcomm have made some solid performance changes since then. Competition is good. 1. https://w…

US. Canada. Probably other regions. A Surface Laptop with 16GB RAM and 512GB SSD is $1200 USD. A M3 MBA with with 16GB RAM and 512GB SSD is $1500.

An equivalent-specced Surface laptop would be the following specs:

- 13" or 15" screen

- Snapdragon X Elite (which still doesn't match M3 performance)

- 16 GB memory

- 512 GB SSD

Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to the Elite and even the older Apple M1/M2 series chips.

This is all to say that neither is a bad buy, depending on your needs.

Re: Microsoft Phi-3 Cookbook

#28

Post by runjake »

TiredOfLife wrote: post #24
runjake wrote: post #20

Earlier quoted context omitted.

In which configs and which geographic locations? In the US, pricing for equivalent Surface and Mac hardware configurations looks the same, to me. And that's if the Snapdragon X Elite is actually on par with the Apple M3, like Microsoft claims. Earlier X Elite benchmarks[1][2] showed that it was behind the M3, but hopefully Qualcomm have made some solid performance changes since then. Competition is good. 1. https://w…

ASUS Vivobook S15 S5507QA: 32GB/1TB 1400 EUR MacBook Air 15,3" Apple M3 8-Core CPU & 10-Core GPU 24GB/1TB 2649 €

1. Ah I had assumed you were talking about the new Surface laptops, my bad.

2. Where are you seeing the pricing for those Vivobook configs? I'm not able to pull up equivalent pricing in the US, so far.

That might be a pretty good deal, depending on the real world performance of the X Elite and the build quality of the ASUS laptop (I've had quite a few and it's been some great hits and some major misses.)

Re: Microsoft Phi-3 Cookbook

#29

Post by goosedragons »

runjake wrote: post #27
goosedragons wrote: post #25

Earlier quoted context omitted.

US. Canada. Probably other regions. A Surface Laptop with 16GB RAM and 512GB SSD is $1200 USD. A M3 MBA with with 16GB RAM and 512GB SSD is $1500.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

In single core performance...

In multi-core from what I've seen X Plus is faster than base M3.

Re: Microsoft Phi-3 Cookbook

#30

Post by TiredOfLife »

runjake wrote: post #28
TiredOfLife wrote: post #24

Earlier quoted context omitted.

ASUS Vivobook S15 S5507QA: 32GB/1TB 1400 EUR MacBook Air 15,3" Apple M3 8-Core CPU & 10-Core GPU 24GB/1TB 2649 €

1. Ah I had assumed you were talking about the new Surface laptops, my bad. 2. Where are you seeing the pricing for those Vivobook configs? I'm not able to pull up equivalent pricing in the US, so far. That might be a pretty good deal, depending on the real world performance of the X Elite and the build quality of the ASUS laptop (I've had quite a few and it's been some great hits and some major misses.)

The euro prices were from a leak.

But the us price for 15" vivobook 16gb/1tb with elite (from announcement video) is 1299.

15" m3 with 16gb/1tb from apple.com is 1899

Post reply on HN