Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#1

Post by rochoa » Tue, Jan 28, 2025, 3:55 PM UTC

Qwen2.5-Max: Exploring the intelligence of large-scale MoE model
qwenlm.github.io

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#2

Post by ecshafer » Tue, Jan 28, 2025, 4:45 PM UTC

A Chinese company announcing this on Spring Festival eve, that is very surprising. The deep seek announcement must have put a fire under them. I am surprised anything is being done right now in these Chinese tech companies.

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#3

Post by bigcat12345678 » Tue, Jan 28, 2025, 4:50 PM UTC

Party goes on

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#4

Post by [deleted] » Tue, Jan 28, 2025, 5:06 PM UTC

[deleted]

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#5

Post by GaggiX » Tue, Jan 28, 2025, 5:12 PM UTC

Now they need to finetune it like R1 and o1 and it will be competitive with SOTA models.

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#6

Post by simonw » Tue, Jan 28, 2025, 5:14 PM UTC

This appears to be Qwen's new best model, API only for the moment, which they say is better than DeepSeek v3.

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#7

Post by lostmsu » Tue, Jan 28, 2025, 5:32 PM UTC

ecshafer wrote: post #2

A Chinese company announcing this on Spring Festival eve, that is very surprising. The deep seek announcement must have put a fire under them. I am surprised anything is being done right now in these Chinese tech companies.

It's like when Gemini topped Chatbot Arena Leaderboard, and OpenAI released a model next day.

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#8

Post by rochoa » Tue, Jan 28, 2025, 5:34 PM UTC

simonw wrote: post #6

This appears to be Qwen's new best model, API only for the moment, which they say is better than DeepSeek v3.

It is available at https://chat.qwenlm.ai/, under the model selector.

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#9

Post by rfoo » Tue, Jan 28, 2025, 5:39 PM UTC

ecshafer wrote: post #2

A Chinese company announcing this on Spring Festival eve, that is very surprising. The deep seek announcement must have put a fire under them. I am surprised anything is being done right now in these Chinese tech companies.

Well, DeepSeek engineers are (desperately) fire-fighting as they don't have nearly as much capacity as needed. Competitors either already rushed release or decided to do an hush release of whatever they had in the pipeline. Sounds like everyone is working L

Re: Qwen2.5-Max: Exploring the intelligence of large-scale MoE model

#10

Post by BhavdeepSethi » Tue, Jan 28, 2025, 5:47 PM UTC

HuggingFace demo: https://huggingface.co/spaces/Qwen/Qwen2.5-Max-Demo

Source: https://x.com/Alibaba_Qwen/status/1884263157574820053