Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Xiaomi MiMo Reasoning Model

github.com

Post reply on HN
Print view View original

111–120 of 203 posts

Re: Xiaomi MiMo Reasoning Model

#111

Post by o11c »

monkmartinez wrote: post #107
o11c wrote: post #105

Earlier quoted context omitted.

Pretty sure the whole reason Ollama uses raw hashes everywhere is to avoid copying the whole NN gigabytes every time.

Maybe I am doing something wrong! When I change parameters on the modelfile, the whole thing is copied. You can't just edit the file as far as I know, you have to create another 38GB monster to change num_ctx to a reasonable number.

The parameters (prompt, etc.) should be set only in the new modelfile (passed to `ollama create`), using a FROM referencing the previous ollama model. Parameters in a Modelfile override the hard-coded parameters from the GGUF itself (which are sometimes buggy); in fact from elsewhere in the thread it sounds like Mimo is missing proper stop tokens, or maybe templates in general; I'm not an expert).

This will show a separate entry in `ollama list` but only copy the Modelfile not the GGUF.

Alternatively, if you use the API, you can override parameters "temporarily". Some UIs let you do this easily, at least for common parameters.

Re: Xiaomi MiMo Reasoning Model

#112

Post by paulsutter »

lvl155 wrote: post #65

Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?

I don’t see any indication that it’s English-first?

Re: Xiaomi MiMo Reasoning Model

#113

Post by wg0 »

cruzcampo wrote: post #32
jsheard wrote: post #31

Earlier quoted context omitted.

Most open source projects don't need the kinds of resources that ML development does. Access to huge GPU clusters is the obvious one, but it's easy to forget that the big players are also using huge amounts of soulcrushing human labor for data acquisition, cleaning, labeling and fine tuning, and begrudgingly paying for data they can't scrape. People coding in their free time won't get very far without that supporting…

That's a fair point. I think GPU clusters are the big one, the rest sounds like a good fit for volunteer work.

Or sharing GPU compute. Crowd sourcing.

Re: Xiaomi MiMo Reasoning Model

#114

Post by yyhhsj0521 »

lvl155 wrote: post #65

Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?

Chinese internet mostly consists of a few closed gardens tightly controlled by big corps. Crawlers simply don't work when each company employs an army of engineers to guard their data. Many of the most popular websites are also app only. It's impossible to get the corpus necessary to train a good LLM.

Re: Xiaomi MiMo Reasoning Model

#115

Post by [deleted] »

monkmartinez wrote: post #106
rahimnathwani wrote: post #102

Earlier quoted context omitted.

Sorry, I should have been clearer. I meant when you download a gguf file from huggingface, instead of using a model from ollama's library.

ollama pull hf.co/unsloth/Qwen3-30B-A3B-GGUF:Q4_K_M and the modelfile comes with it. It may have errors in the template or parameters this way. It has to be converted to GGUF/GGML prior to using it this way. You can, of course, convert and create the specific ollama model from bf16 safetensors as well.

[deleted]

Re: Xiaomi MiMo Reasoning Model

#116

Post by bredren »

yyhhsj0521 wrote: post #114
lvl155 wrote: post #65

Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?

Chinese internet mostly consists of a few closed gardens tightly controlled by big corps. Crawlers simply don't work when each company employs an army of engineers to guard their data. Many of the most popular websites are also app only. It's impossible to get the corpus necessary to train a good LLM.

Do we have estimates on the corpus that is available? This model's repo describes "multiple strategies to generate massive diverse synthetic reasoning data." FWIW, AI 2027 forecasts heavy emphasis on synthetic data creation.

Is the lack of existing corpus just an extra hurdle for Hanzi-first models that are also leading the pack in benchmarks?

Re: Xiaomi MiMo Reasoning Model

#118

Post by gcy »

34679 wrote: post #77
lvl155 wrote: post #65

Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?

Nearly everyone in the urban areas of China spoke some English when I visited way back in 1995. It's a bilingual society.

I suppose you probably were visiting some university districts/CBDs where people likely to have received higher education. Elsewhere, aside from basic "hello"/"how are you", locals in general are not able to communicate in English.

Re: Xiaomi MiMo Reasoning Model

#119

Post by benterix »

w4yai wrote: post #2

Anyone tried it ?

Yes, not great, not terrible. I gave it my personal test (a coding task), it produced semi-decent quality code that produced a minor error, after pasting the error it failed to solve it during multiple rounds. I believe another 2-3 years and we'll have quite usable small models.

Re: Xiaomi MiMo Reasoning Model

#120

Post by Leary »

lvl155 wrote: post #65

Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?

They are not "English-first". Deepseek-R1, for example, reasons in Chinese when you ask it a question in Chinese.
Post reply on HN