Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Microsoft Phi-3 Cookbook

github.com

Post reply on HN
Print view View original

41–50 of 59 posts

Re: Microsoft Phi-3 Cookbook

#41

Post by adastra22 »

dhruvdh wrote: post #21
killingtime74 wrote: post #10

Earlier quoted context omitted.

For the price of these new laptops one can already buy a MacBook with a general purpose GPU that is more than capable of running these models. One can buy a windows laptop with a dedicated graphics card that can also run these models. Perhaps it would be interesting if the price was substantially lower.

The NPU runs this Silica model at 1.5 watts. MacBooks cannot even drive multiple monitors in this price range.

The MacBooks have an NPU too. Just nobody has done anything with them.

Re: Microsoft Phi-3 Cookbook

#42

Post by TiredOfLife »

talldayo wrote: post #33
runjake wrote: post #27

Earlier quoted context omitted.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

Also worth noting that the Macbook Air is still not upgraded to a MicroLED display (uses IPS instead), whereas the Surface Laptop now comes standard with OLED.

Only the tablet has oled option. And that is an 500$ extra.

Re: Microsoft Phi-3 Cookbook

#43

Post by wilsonnb3 »

talldayo wrote: post #33
runjake wrote: post #27

Earlier quoted context omitted.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

Also worth noting that the Macbook Air is still not upgraded to a MicroLED display (uses IPS instead), whereas the Surface Laptop now comes standard with OLED.

no it doesn't, at least not according to the specs https://www.microsoft.com/en-us/surface/devices/surface-lapt...

The Surface Pro has an OLED config now, which costs more, but the laptop and standard pro are still LCD.

Re: Microsoft Phi-3 Cookbook

#44

Post by dhruvdh »

adastra22 wrote: post #41
dhruvdh wrote: post #21

Earlier quoted context omitted.

The NPU runs this Silica model at 1.5 watts. MacBooks cannot even drive multiple monitors in this price range.

The MacBooks have an NPU too. Just nobody has done anything with them.

The MacBook NPU is 3x slower than the 45 TOPS threshold required for Copilot+ PC branding.

Re: Microsoft Phi-3 Cookbook

#45

Post by sgerenser »

xkgt wrote: post #38

Looks like some of the docs are generated by an llm. I see pictures with typos and imagined terms, incomplete texts etc., I wonder to what extent we can trust rest of the docs. https://github.com/microsoft/Phi-3CookBook/blob/main/md/04.F...

Gool for specific tucks!

Re: Microsoft Phi-3 Cookbook

#46

Post by runjake »

vitorgrs wrote: post #35
runjake wrote: post #27

Earlier quoted context omitted.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

Are we talking about AI/ML? X Plus and X Elite NPU hit 45 TOPS. M4 is 38 TOPS... Also, as far I know, Elite does match M3. Actually, Qualcomm promise that even X Plus is able to match it, as they say Elite is better than M3. We'll have to wait to see more benchmarks. PS: There's 3 Elite series.

  > Are we talking about AI/ML?
No, I was speaking to the usual single-core and multi-core benchmarks. Though you should buy based on what performance metrics you value most.

While I have a basic understanding of TOPS metrics I don’t have a good enough understanding to speak much about it — especially when I’m not sure of what exact AI/ML workloads will be used on such platforms. I mean, how many tokens/sec and what wattage does that equate to?

  > Also, as far I know, Elite does match M3.
I would disagree from what I’ve seen.

  > Actually, Qualcomm promise that even X Plus is able to match it, as they say Elite is better than M3.
The real world benchmarks will tell. I am super curious about the performance-per-watt which is something that really matters to me (heat, battery life, etc).

Can the Elite outperform Apple’s chips? Can it do it at comparable wattage, or is it going to burn your lap doing so? Can’t wait to see.

Re: Microsoft Phi-3 Cookbook

#47

Post by underwater »

talldayo wrote: post #33
runjake wrote: post #27

Earlier quoted context omitted.

An equivalent-specced Surface laptop would be the following specs: - 13" or 15" screen - Snapdragon X Elite (which still doesn't match M3 performance) - 16 GB memory - 512 GB SSD Surface laptop price is $1399 (13") or $1499 (15"), which is $100 cheaper for the 13" vs the equivalent MBA, and $200 cheaper for the equivalent MBA 15". The Snapdragon X Plus, which is what it looks like you priced out, is quite inferior to…

Also worth noting that the Macbook Air is still not upgraded to a MicroLED display (uses IPS instead), whereas the Surface Laptop now comes standard with OLED.

I just bought an M3, my first MacBook in a while. I was appalled by the screen brightness and contrast. It’s really lacking.

Re: Microsoft Phi-3 Cookbook

#48

Post by zone411 »

free_bip wrote: post #4
GaggiX wrote: post #2

https://huggingface.co/collections/microsoft/phi-3-6626e15e9... , all of these models except Phi-3 mini are new.

Looking at the benchmarks, it seems like Phi-3 Small (7B) marginally beats out Llama3-8B on most tasks, which is pretty exciting!

On my benchmark (NYT Connections), Phi-3 Small performs well (8.4) but Llama 3 8B Instruct is still better (12.3). Phi-3 Medium 4k is disappointing and often fails to properly follow the output format.

Re: Microsoft Phi-3 Cookbook

#49

Post by ukuina »

jpdus wrote: post #19

Wow, actually this cookbook is really bad? I expected something like the OpenAI or Anthropic cookbooks, but this seems to be some AI generated low-quality content without any code examples or interesting examples? The Phi-3 models are great though, especially the vision model has great potential for low latency applications (like robotics?)...

Yeah, this is an INSTALL.md masquerading as a cookbook.

Re: Microsoft Phi-3 Cookbook

#50

Post by Foobar8568 »

TiredOfLife wrote: post #24
runjake wrote: post #20

Earlier quoted context omitted.

In which configs and which geographic locations? In the US, pricing for equivalent Surface and Mac hardware configurations looks the same, to me. And that's if the Snapdragon X Elite is actually on par with the Apple M3, like Microsoft claims. Earlier X Elite benchmarks[1][2] showed that it was behind the M3, but hopefully Qualcomm have made some solid performance changes since then. Competition is good. 1. https://w…

ASUS Vivobook S15 S5507QA: 32GB/1TB 1400 EUR MacBook Air 15,3" Apple M3 8-Core CPU & 10-Core GPU 24GB/1TB 2649 €

Asus, the brand that can't make an ISO keyboard in Europe.

Either Surface line or Lenovo x line can be compared with Apple devices, anything else falls short.

Post reply on HN