"built upon a blend of synthetic datasets, data from filtered public domain websites, and acquired academic books and Q&A datasets"
Does this mean the model was trained without copyright infringements?
Phi 4 available on Ollama
81–90 of 138 posts
Re: Phi 4 available on Ollama
#82Earlier quoted context omitted.
That's exactly what they're saying: it's interesting that Microsoft came to the same conclusion that Meta did, that models are generally not worth keeping locked down. It suggests that OpenAI has a very fragile business model, given that they're wholly dependent on large providers for the infra, which is apparently the valuable part of the equation.
Open AI is the only company that really matters in the consumer conversational AI space. Their unique value-adds are the Chat GPT brand, being the "default destination" when people want AI, as well as all the "extra features" they add on top of raw LLMs, like the ability to do internet searches, recall facts about you from previous conversations, present data in a nice, interactive way by writing a react app, call do…
> in the consumer conversational AI space.
The "consumer conversational AI space" only exists right now as a novelty, not a long-term market segment. In the not too distant future that space will be covered for most users for free by their hardware manufacturers, and the number of people willing to pay a monthly subscription to a third party will drop even further than it already has.
Re: Phi 4 available on Ollama
#83Is anyone blown away by how fast we got to running something this powerful locally? I know it's easy to get burnt out on llms but this is pretty incredible. I genuinely think we're only 2 years away from full custom local voice to voice llm assistants that grow with you like JOI in BR2049 and it's going to change how we think about being human and being social, and how we grow up.
Yes, and for image and video generation too.
Hunyuan (open source video) has been remarkable. Flux dev makes some incredible images.
The fact that it's still only going to get better from here is hard to imagine.
Re: Phi 4 available on Ollama
#84It’s odd that MS is releasing models they are competitors to OA. This reinforce the idea that there is no real strategic advantage in owning a model. I think the strategy is now offer cheap and performant infra to run the models.
> This reinforce the idea that there is no real strategic advantage in owning a model.
Yes, because you can't build a moat. Open source will very quickly catch up.
Re: Phi 4 available on Ollama
#85Does this include some of the config fixes that the sloth guys pointed out?
Re: Phi 4 available on Ollama
#86Earlier quoted context omitted.
That's exactly what they're saying: it's interesting that Microsoft came to the same conclusion that Meta did, that models are generally not worth keeping locked down. It suggests that OpenAI has a very fragile business model, given that they're wholly dependent on large providers for the infra, which is apparently the valuable part of the equation.
To be fair, OpenAI's products are not really models, they are... products. So it's debatable if they really do have anything special. I don't really think they do, because to me it seemed pretty much since GPT-1, that having callbacks to run python and query google, having "inner dialog" before summarizing an answer and a dozen more simple improvements like this are quite obvious things to do, that nobody just actual…
> To be fair, OpenAI's products are not really models, they are... products
What's the distinction? What kind of functionality do they offer that other models don't?
Re: Phi 4 available on Ollama
#87I have unfortunately been disappointed with the llama.cpp/ollama ecosystem of late, and thinking about moving my things to vllm instead. llama.cpp basically dropped support for multimodal visual models. ollama still does support them, but only a handful. Also ollama still does not support vulkan eventhough llama.cpp had vulkan support for a long long time now. This has been very sad to watch. I'm more and more convin…
But can you run llms that easily with vllm? do you have to fiddle with formats to get it to run?
I'm still in early stages of exploration, but vllm seems to be compatible with most models on huggingface.
Re: Phi 4 available on Ollama
#88Earlier quoted context omitted.
It's incredible. I've been experimenting with running local LLMs for nearly two years now, ever since the first LLaMA release back in March 2023. About six months ago I had mostly lost interest in them. They were fun to play around with but the quality difference between the ones I could run on my MacBook and the ones I could access via an online API felt insurmountable. This has completely changed in the second half…
I'm in complete agreement with your more recent timeline piece (the negative one), and as a younger user (22 year old student) I'm actively relocating this year to somewhere slightly more rural with a focus on physical/knowledge combined work to secure a good quality of life nearly solely because of how fast our timelines are. A 'word calculator' this effective is the best substitute that we have for a logic calculat…
I should emphasize that I really don't think the dystopian version of this is likely to happen - the one where "AGI/ASI" puts every human out of work and society collapses.
Human beings have agency, and we are very good at rolling with the punches. We've survived waves of automation for hundreds of years. I'm much more confident that we will continue to find ways to use these things as tools that elevate us, not replace us.
I really hope the dystopian version doesn't come to pass!
Re: Phi 4 available on Ollama
#89Earlier quoted context omitted.
Interesting, so apparently UI and UX and responsiveness and polish all don’t matter for products? We can just ship shittily drawn interfaces now?
They aren’t that good. It’s mostly well rounded now, but on nacOS it’s often impossible to select parts of code sections.
That’s not just on macOS, and I’m pretty sure that’s a deliberate dark pattern to prevent users from taking their query to claude or gemini after gpt shits the bed.
Re: Phi 4 available on Ollama
#90Earlier quoted context omitted.
To be fair, OpenAI's products are not really models, they are... products. So it's debatable if they really do have anything special. I don't really think they do, because to me it seemed pretty much since GPT-1, that having callbacks to run python and query google, having "inner dialog" before summarizing an answer and a dozen more simple improvements like this are quite obvious things to do, that nobody just actual…
> To be fair, OpenAI's products are not really models, they are... products What's the distinction? What kind of functionality do they offer that other models don't?
ChatGPT.com does much more than for example Llama3.2-vision. It can search the web automatically, write code and run it just to answer you, much more agency.