Didn’t the last thread about this have someone from the lab or an enthusiast in Rio saying exactly that?
Its a fine tune of Qwen
Not a conspiracy
Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
21–30 of 261 posts
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#22Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#23Oh no, someone is profiting off of their work without proper attribution!?!?
Attribution isn't the relevant part. Lying about your lab's capabilities is.
I do not see anyone lying.
The model card says:
> Post-trained from Qwen 3.5 397B
The model card also says that they use an inference framework based on "SwiReasoning: Switch-Thinking in Latent and Explicit for Pareto-Superior Reasoning LLMs" by Shi et al.:
https://arxiv.org/abs/2510.05069
So the sources seem properly attributed.
They only claim that what they did to "Qwen 3.5 397B" has improved the LLM, including, as expected, with "strong performance in Portuguese".
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#24Oh no, someone is profiting off of their work without proper attribution!?!?
"Their work"? First you had the original content creators that did 99.99% of the work. Then you had the US companies bundle it up into a frontier LLM. Then "they" did the "work" of using the US model as a foundation for their own. So in the sense of doing 0.00001% of the actual work that went into their product, sure.
I'd say it's more like someone forking a Linux distro, adding a few themes and fonts, and then complaining when someone else forks their distro and adds another theme.
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#25Oh no, someone is profiting off of their work without proper attribution!?!?
[dead]
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#26Oh no, someone is profiting off of their work without proper attribution!?!?
[deleted]
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#27This is fascinating that it worked though. Can we just merge all the open weight models and get something better?
most merge improve a small subset of "feeling" benchmark (too small, too specific, or out of distribution) and tend to show degradation on actual benchmark, with especially punishing result on long chain benchmarks.
also only work on matching architectures (i.e. finetunes/loras of the same model)
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#28Oh no, someone is profiting off of their work without proper attribution!?!?
[deleted]
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#29Oh no, someone is profiting off of their work without proper attribution!?!?
This is a pure scam on tax payer money. But what else would be expected?
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#30The municipality of Rio de Janeiro (via its IT company IplanRIO) released Rio-3.5-Open-397B, presented as a homegrown Qwen3.5 fine-tune that beats comparable open models on benchmarks. The linked issue argues it's actually a weighted merge of ~60% Nex-N2 Pro + ~40% Qwen3.5-397B-A17B - Nex-N2 having been released about a week earlier.
[dead]