Viewing profile — mchiang

hey, thanks for sharing. I had to go to the Twitter feed to find the GitHub link: https://github.com/21st-dev/1code

this one is exciting. It'll enable and accelerate a lot of devices on Ollama - especially around AMD GPUs not fully supported by ROCm, Intel GPUs, and iGPUs across different hardwa…

I am super hopeful! Hardware is improving, inference costs will continue to decrease, models will only improve...

Qwen3-coder:30b is in the blog post. This is one that most users will be able to run locally. We are in this together! Hoping for more models to come from the labs in varying sizes…

ah! This must be downloaded from elsewhere and not from Ollama? So sorry about this. To help future optimizations for given quantizations, we have been trying to limit the quantiza…

Do you find yourself sticking with GLM 4.6 over Claude for some tasks? Or do you find yourself still wanting to reach for Claude?

https://github.com/ollama/ollama?tab=readme-ov-file#supporte...

Z.ai team is awesome and very supportive. I have yet to try synthetic.new. What's the reason for using multiple? Is it mainly to try different models or are you hitting some kind o…

but that is VC funded

sorry, I don't use 4chan, so I don't know what's said there. May I ask what system you are using where you are getting memory estimations wrong? This is an area Ollama has been wor…

It’s so much fun when you can mix passion and seeing students chat about what they want to build the most.

Oh yes! that is why I want to provide the names of the providers we use. I do believe in building in the open. The web search functionality has a very generous free tier (it is beh…

No, Ollama is it's own project and separate. You can check it out via GitHub https://github.com/ollama/ollama

Sorry about this. We are working really hard on providing a usage based pricing. During the preview period we want to start offering a $20 / month plan tailored for individuals - a…

We have relationships with many providers and I don't want to be seen as promoting or not promoting a specific provider. Some decent privacy-preserving vendors - Brave, Exa, Parall…

To provide additional features or using Ollama's cloud hosted models, you can signup for an Ollama account. For starter, this is completely optional. It can be completely local too…

We work with search providers and ensure that we have zero data retention policies in place. The search results are yours to own and use. You are free to do what you want with it. …

When we started Ollama, we were told how open-source (open-weight wasn't a term back then) will always be inferior to the close-sourced models. This was 2 years ago (Ollama's birth…

Fair question. Some of the supported models are large and wouldn't fit on most local devices. This is just the beginning, and Ollama does not need to exclude cloud hosted frontier …

I haven't tried SearXNG personally. How does it compare to Ollama's web search in terms of the search content returned?

I was pleasantly surprised on the model improvements when testing this feature. For smaller models, it can augment it with the latest data by fetching it from the web, solving the …

It’s a different repo. https://github.com/ggml-org/ggml The models are implemented by Ollama https://github.com/ollama/ollama/tree/main/model/models I can say as a fact, for the gp…

I can say trying many inference tools after the launch, many do not have the models implemented well, and especially OpenAI’s harmony. Why does this matter? For this specific relea…

so sorry about this. We are learning. Possible to email, and we will first make it right while we improve Ollama's turbo mode. hello@ollama.com

thanks, I'll take that feedback, but I do want to clarify that it's not from llama.cpp/ggml. It's from ggml-org/ggml. I supposed it's all interchangeable though, so thank you for i…