Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
1–10 of 261 posts
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#2The municipality of Rio de Janeiro (via its IT company IplanRIO) released Rio-3.5-Open-397B, presented as a homegrown Qwen3.5 fine-tune that beats comparable open models on benchmarks. The linked issue argues it's actually a weighted merge of ~60% Nex-N2 Pro + ~40% Qwen3.5-397B-A17B - Nex-N2 having been released about a week earlier.
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#3[flagged]
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#4This is fascinating that it worked though. Can we just merge all the open weight models and get something better?
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#5The municipality of Rio de Janeiro (via its IT company IplanRIO) released Rio-3.5-Open-397B, presented as a homegrown Qwen3.5 fine-tune that beats comparable open models on benchmarks. The linked issue argues it's actually a weighted merge of ~60% Nex-N2 Pro + ~40% Qwen3.5-397B-A17B - Nex-N2 having been released about a week earlier.
[deleted]
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#6[flagged]
Without evidence, your comment is just bad mouthing.
I have been involved in academia, including in Brazil, and I don't find academia there any more copycat than any other institution, including top tier ones.
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#7This is fascinating that it worked though. Can we just merge all the open weight models and get something better?
No, they need the same arch, but you can distill them into a single model. And yes, if you use the API directly Claude will often say it’s an open weight model (likely the ones it was distilled from)
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#8[flagged]
No, typically Brazilians go to Paraguay for their education, most of their technology comes from Paraguay too.
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#9The model's webpage at https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B says it's a merge now. It previously didn't contain this paragraph:
>The model is built via a merge of https://huggingface.co/nex-agi/Nex-N2-Pro and https://huggingface.co/Qwen/Qwen3.5-397B-A17B, proceeded by On-Policy Distillation from a stronger model. We detected an incorrect upload in the previous version, where the base merged version was upload instead of the final distilled model. We are sorry for the confusion and apologize profusely.
Incidentally are people using Github issues as blogs now?
Re: Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model
#10Oh no, someone is profiting off of their work without proper attribution!?!?