101–110 of 203 posts
Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?
When you guys use gguf files in ollama, do you normally create a modelfile to go with it, or just hope that whatever default ollama has work with the new model? https://github.com/ollama/ollama/blob/main/docs%2Fmodelfile....
If you ollama pull the modelfile will be downloaded along with the blob. To modify the model permanently, you can copypasta the modelfile into a text editor and then create a new model from the old modelfile with the changes you require/made. Here is my workflow when using Open WebUI: 1. ollama show qwen3:30b-a3b-q8_0 --modelfile 2. Paste the contents of the modelfile into -> admin -> models -> OpenwebUI and rename q…
I meant when you download a gguf file from huggingface, instead of using a model from ollama's library.
Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?
I wonder whether English text having fewer characters provides an advantage somehow.
Earlier quoted context omitted.
English won. The Chinese youth struggle to write their own calligraphy characters they can read now. Typing favors English.
The pendulum already turned back. The current generation under 20 grew up with touchscreens. That obseletes input with pinyin; many don't care if the device has no keyboard.
When you guys use gguf files in ollama, do you normally create a modelfile to go with it, or just hope that whatever default ollama has work with the new model? https://github.com/ollama/ollama/blob/main/docs%2Fmodelfile....
If you ollama pull the modelfile will be downloaded along with the blob. To modify the model permanently, you can copypasta the modelfile into a text editor and then create a new model from the old modelfile with the changes you require/made. Here is my workflow when using Open WebUI: 1. ollama show qwen3:30b-a3b-q8_0 --modelfile 2. Paste the contents of the modelfile into -> admin -> models -> OpenwebUI and rename q…
Earlier quoted context omitted.
If you ollama pull the modelfile will be downloaded along with the blob. To modify the model permanently, you can copypasta the modelfile into a text editor and then create a new model from the old modelfile with the changes you require/made. Here is my workflow when using Open WebUI: 1. ollama show qwen3:30b-a3b-q8_0 --modelfile 2. Paste the contents of the modelfile into -> admin -> models -> OpenwebUI and rename q…
Sorry, I should have been clearer. I meant when you download a gguf file from huggingface, instead of using a model from ollama's library.
Earlier quoted context omitted.
If you ollama pull the modelfile will be downloaded along with the blob. To modify the model permanently, you can copypasta the modelfile into a text editor and then create a new model from the old modelfile with the changes you require/made. Here is my workflow when using Open WebUI: 1. ollama show qwen3:30b-a3b-q8_0 --modelfile 2. Paste the contents of the modelfile into -> admin -> models -> OpenwebUI and rename q…
Pretty sure the whole reason Ollama uses raw hashes everywhere is to avoid copying the whole NN gigabytes every time.
Earlier quoted context omitted.
English won. The Chinese youth struggle to write their own calligraphy characters they can read now. Typing favors English.
The pendulum already turned back. The current generation under 20 grew up with touchscreens. That obseletes input with pinyin; many don't care if the device has no keyboard.
Uh? Pinyin input is by far the most popular input technique in China. I rarely see anyone using handwriting input.
That being said, it has nothing to do with English winning. It's just a Chinese input technique that uses the latin alphabet. English fluency in China is not very common, especially spoken English.
Earlier quoted context omitted.
LLMs are not search engines…
An interesting development to look forward to will be hooking them up to search engines. The proprietary models already do this, and the open equivalents are not far behind; the recent Qwen models are not as great at knowledge, but are some of the best at agentic functionality. Exciting times ahead!
Earlier quoted context omitted.
The mandarin language models obviously exist, but what would you do with them if they provided access to them? And what knowledge would be in them? What is the body of knowledge encoded in Mandarin? What does that look like? Sad reality is that not many outside of China have the facility with Mandarin to use those models. Even non-native Mandarin speakers who claim to be "fluent", are often messing up intended meanin…
For it to be brilliant, AI needs to be a benevolent tool all the time. It would take just a few malignant actors to turn our world upside. I suspect it'll follow the same Internet and social media path. Great at first, grow markets, bring us together and then take a turn.