Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Xiaomi MiMo Reasoning Model

github.com

Post reply on HN
Print view View original

131–140 of 203 posts

Re: Xiaomi MiMo Reasoning Model

#131

Post by rahimnathwani »

monkmartinez wrote: post #106
rahimnathwani wrote: post #102

Earlier quoted context omitted.

Sorry, I should have been clearer. I meant when you download a gguf file from huggingface, instead of using a model from ollama's library.

ollama pull hf.co/unsloth/Qwen3-30B-A3B-GGUF:Q4_K_M and the modelfile comes with it. It may have errors in the template or parameters this way. It has to be converted to GGUF/GGML prior to using it this way. You can, of course, convert and create the specific ollama model from bf16 safetensors as well.

Yeah when I do this, the modelfile has only FROM and TEMPLATE. No PARAMETERs:

  ollama pull hf.co/jedisct1/MiMo-7B-RL-GGUF:Q4_K_M
  ollama show --modelfile hf.co/jedisct1/MiMo-7B-RL-GGUF:Q4_K_M

Re: Xiaomi MiMo Reasoning Model

#132

Post by siliconc0w »

This is incredibly strong coding performance for a 7b. I use Gemini Pro 2.5 which got 67.8 and this got 57.8, very close to Gemini 2.5 Flash which got 60.6.

I've become pretty skeptical about eval results given what we've heard about llama4 so we'll see where this lands on the closed evals but very impressive to see.

Re: Xiaomi MiMo Reasoning Model

#133

Post by -__---____-ZXyw »

mensetmanusman wrote: post #75
lvl155 wrote: post #65

Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?

English won. The Chinese youth struggle to write their own calligraphy characters they can read now. Typing favors English.

Source?

This smacks of "I saw a headline once"-itis. Especially the fact that you refer to the Chinese characters as "calligraphy characters", as if that were the general term or something.

Re: Xiaomi MiMo Reasoning Model

#134

Post by fwipsy »

thoroughburro wrote: post #129
choutianxius wrote: post #80

Earlier quoted context omitted.

One reason is that there is no "good" search engine in China. The most popular one, Baidu, is like garbage compared to Google search. The most useful training data in Chinese would likely be from the social media and video sharing platforms, which I guess is much more difficult to crawl and clean up.

A few thousand years of literature ain’t nothing…

Given premodern population sizes and literacy rates, historical texts probably don't exist in anything like the quantity that internet posts do. Even if they did, the information may not be relevant to the modern world.

Re: Xiaomi MiMo Reasoning Model

#135

Post by kccqzy »

thoroughburro wrote: post #129
choutianxius wrote: post #80

Earlier quoted context omitted.

One reason is that there is no "good" search engine in China. The most popular one, Baidu, is like garbage compared to Google search. The most useful training data in Chinese would likely be from the social media and video sharing platforms, which I guess is much more difficult to crawl and clean up.

A few thousand years of literature ain’t nothing…

Peanuts compared to the discourse available on the internet.

The literature that survived thousands of years are cream of the crop; you won't find lots of random unimportant dialog between people thousands of years ago, but you find that on Reddit.

Re: Xiaomi MiMo Reasoning Model

#136

Post by Havoc »

rahimnathwani wrote: post #91

When you guys use gguf files in ollama, do you normally create a modelfile to go with it, or just hope that whatever default ollama has work with the new model? https://github.com/ollama/ollama/blob/main/docs%2Fmodelfile....

One of the core design goals Georgi Gerganov had with GGUF was to not need other files. It's literally bullet point #1 in the specs

>Single-file deployment

>Full information: all information needed to load a model is contained in the model file, and no additional information needs to be provided by the user.

https://github.com/ggml-org/ggml/blob/master/docs/gguf.md

We literally just got rid of that multi file chaos only for ollama to add it back :/

Re: Xiaomi MiMo Reasoning Model

#137

Post by lwansbrough »

lvl155 wrote: post #65

Why are there so many English-first AI models from China? Are they not interested in serving their own population? Or is it that if they publish Chinese-first models it won't get publicity in the West?

I’m going to go with: to ensure it is not disadvantaged in benchmarks

Re: Xiaomi MiMo Reasoning Model

#138

Post by pertymcpert »

throwaway519 wrote: post #95
mensetmanusman wrote: post #75

Earlier quoted context omitted.

English won. The Chinese youth struggle to write their own calligraphy characters they can read now. Typing favors English.

The pendulum already turned back. The current generation under 20 grew up with touchscreens. That obseletes input with pinyin; many don't care if the device has no keyboard.

What? Only people I've seen use the writing input mode was old people.

Re: Xiaomi MiMo Reasoning Model

#139

Post by Svoka »

sigmoid10 wrote: post #74
enlyth wrote: post #70

Earlier quoted context omitted.

I assume a large portion of high quality training material is in English

You'd be correct. The largest portion of all languages in Common Crawl (aka the "whole open internet" training corpus) is English with 43%. No other language even reaches double digit percentages. The next biggest one is Russian at 6%, followed by German at 5%.

I wonder where are you getting your data. According to wikipedia russian is #7 https://en.wikipedia.org/wiki/Languages_used_on_the_Internet

Only place where russian is in top 5 is in Wikipedia views. Russian part of internet steadily goes down, as russian imperialism crumbles.

Re: Xiaomi MiMo Reasoning Model

#140

Post by rahimnathwani »

Havoc wrote: post #136
rahimnathwani wrote: post #91

When you guys use gguf files in ollama, do you normally create a modelfile to go with it, or just hope that whatever default ollama has work with the new model? https://github.com/ollama/ollama/blob/main/docs%2Fmodelfile....

One of the core design goals Georgi Gerganov had with GGUF was to not need other files. It's literally bullet point #1 in the specs >Single-file deployment >Full information: all information needed to load a model is contained in the model file, and no additional information needs to be provided by the user. https://github.com/ggml-org/ggml/blob/master/docs/gguf.md We literally just got rid of that multi file chaos o…

Most of the parameters you would include in ollama's ModelFile are things you would pass to llama.cpp using command line flags:

https://github.com/ggml-org/llama.cpp/blob/master/examples/m...

If you only ever have one set of configuration parameters per model (same temp, top_p, system prompt...), then I guess you can put them in a gguf file (as the format is extensible).

But what if you want two different sets? You still need to keep them somewhere. That could be a shell script for llama.cpp, or a ModelFile for ollama.

(Assuming you don't want to create a new (massive) gguf file for each permutation of parameters.)

Post reply on HN