Microsoft Phi-3 Cookbook
github.com
Microsoft Phi-3 Cookbook
1–10 of 59 posts
Re: Microsoft Phi-3 Cookbook
#2https://huggingface.co/collections/microsoft/phi-3-6626e15e9..., all of these models except Phi-3 mini are new.
Re: Microsoft Phi-3 Cookbook
#3"We are introducing Phi Silica which is built from the Phi series of models and is designed specifically for the NPUs in Copilot+ PCs. Windows is the first platform to have a state-of-the-art small language model (SLM) custom built for the NPU and shipping inbox. Phi Silica API along with OCR, Studio Effects, Live Captions, Recall User Activity APIs will be available in Windows Copilot Library in June. More APIs like Vector Embedding, RAG API, Text Summarization will be coming later."
2024: the year of personal computers with neural processing units running small language models
How do NPU's work? Who builds them and how are they built? Are they capable of running a variety of SLM-like firmware?
Re: Microsoft Phi-3 Cookbook
#4https://huggingface.co/collections/microsoft/phi-3-6626e15e9... , all of these models except Phi-3 mini are new.
Looking at the benchmarks, it seems like Phi-3 Small (7B) marginally beats out Llama3-8B on most tasks, which is pretty exciting!
Re: Microsoft Phi-3 Cookbook
#5You can interact with the new Phi-3 vision model on this page (no login required): https://ai.azure.com/explore/models/Phi-3-vision-128k-instru...
Re: Microsoft Phi-3 Cookbook
#6The bigger news is that Phi-3-Small, Phi-3-Medium and Phi-3-Vision were finally released
Re: Microsoft Phi-3 Cookbook
#7[flagged]
Re: Microsoft Phi-3 Cookbook
#8The initial model release had a terrible, frequent, issue with emitting the wrong "end of message" token, or never emitting one.[1] That is a very serious issue that breaks chat.
The ones from today still have this issue.[2]
Beyond that, they've been pushing new ONNX features enabling LLMs via Phi for about a month now. The ONNX runtime that supports it still isn't out, much less the downstream integration of it into the iOS/Android runtimes. Heck, the Python package for it isn't supported anywhere but Windows.
It's absolutely wild to me that MS is pulling this stuff with ~0 discussion or reputation repercussions.
I'm a huge ONNX fan and bet a lot on it, it works great. It was clear to me about 4 months ago that Wintel's "AI PC" buildup meant "ONNX x newer Phi"
It is very frustrating to see an extremely late rush, propped up by potemkin blog posts that I have to waste time to find out are just straight up lying. Burnt a lot of goodwill that they worked hard to earn.
I am virtually certain that the new Windows AI features previewed about yesterday are going to land horribly if they actually try to land them this year.
[1] https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf... [2] https://x.com/jpohhhh/status/1793003272187351195
Re: Microsoft Phi-3 Cookbook
#9https://huggingface.co/collections/microsoft/phi-3-6626e15e9... , all of these models except Phi-3 mini are new.
Looking at the benchmarks, it seems like Phi-3 Small (7B) marginally beats out Llama3-8B on most tasks, which is pretty exciting!
Have you found either model to be good enough to do anything interesting, reliably?
Re: Microsoft Phi-3 Cookbook
#10"We are introducing Phi Silica which is built from the Phi series of models and is designed specifically for the NPUs in Copilot+ PCs. Windows is the first platform to have a state-of-the-art small language model (SLM) custom built for the NPU and shipping inbox. Phi Silica API along with OCR, Studio Effects, Live Captions, Recall User Activity APIs will be available in Windows Copilot Library in June. More APIs like…
For the price of these new laptops one can already buy a MacBook with a general purpose GPU that is more than capable of running these models. One can buy a windows laptop with a dedicated graphics card that can also run these models. Perhaps it would be interesting if the price was substantially lower.