Live data from Hacker News

LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

longcat.chat

51–60 of 98 posts

Re: LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

#51
post #4

> The training and deployment of LongCat-2.0 are built on large-scale clusters of tens of thousands of AI ASIC superpods. Compared to the mature Nvidia GPU ecosystem, the supporting software community is still less developed. We have therefore put significant effort into building a stable, secure, and scalable infrastructure. This is the real news story. It looks like they may have used Huawei Ascend 910C chips: http…

[deleted]

Re: LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

#52
post #46

I just tested it with a slightly tricky question > If you could run a nuclear reactor with U-235 as fuel or Pu-241 (both mixed with 95% U-238), which one would you choose and why? For a human this would not be tricky at all. For an LLM it could be, because this question certainly does not exist in any sort of training, because Pu-241 does not exist in pure form, it only exist as a minor component of reactor-grade plu…

> For a human this would not be tricky at all. I very much doubt that.

What I meant is: for a human who has the context, like someone who works in the field, or took some courses, or read some materials about this. A human who just has a vague idea about fissile isotopes and needs to google the properties of U-235 or Pu-241 would do no better; they would probably do much worse.

Re: LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

#53
post #23
post #18

Earlier quoted context omitted.

Who? What did he want?

Dwarkesh Patel has AI/ML guests on his podcast. BoorishBears may have been referring to the Jensen Huang episode where they discuss TPUs: https://youtu.be/Hrbq66XqtCo?t=982

Specifically Dwarkesh couldn't understand that GPUs are not enough: it's GPUs plus multiple ecosystems to leverage them at massive scale during training vs inference.

Instead of giving China open access to US controlled chips and creating a misalignment between labs that want to train a model on whatever is best, and hardware manufacturers that need labs to suffer the growing pains for their new ecosystems built from scratch... we removed the option from the board and now they've beat the growing pains decisively, with a speed that reflects the non-optionality.

Re: LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

#54

I just tested it with a slightly tricky question > If you could run a nuclear reactor with U-235 as fuel or Pu-241 (both mixed with 95% U-238), which one would you choose and why? For a human this would not be tricky at all. For an LLM it could be, because this question certainly does not exist in any sort of training, because Pu-241 does not exist in pure form, it only exist as a minor component of reactor-grade plu…

For comparison allow me to add chatGPT 5.5:

"Choose U-235 if the goal is safe, boring, practical electricity generation. Choose Pu-241 only if the goal is specifically to consume/recycle plutonium in a reactor designed and licensed for that fuel.

In brutal shorthand: Pu-241 is a better “fissile isotope” in some nuclear-physics ways, but U-235 is a much better reactor fuel in the real world."

If only I knew anything about nuclear reactors. But it sounds to me that the answer is also correct.

Re: LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

#55
post #4

> The training and deployment of LongCat-2.0 are built on large-scale clusters of tens of thousands of AI ASIC superpods. Compared to the mature Nvidia GPU ecosystem, the supporting software community is still less developed. We have therefore put significant effort into building a stable, secure, and scalable infrastructure. This is the real news story. It looks like they may have used Huawei Ascend 910C chips: http…

[flagged]

Re: LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

#57

1024 Huawei Ascend superpods = 50K 910C chips. That is a tiny tiny system. OpenAI uses _milions_ of GPUs for training On the other hand, this probably reuses the existing deepseek v4 architecture and weights. Maybe didn't need that much compute.

I'm sure it also takes more compute effort to be at the frontier, rather than being able to distill and poach ideas from the frontier. No mistake that it's the same handful of labs taking turns at or near the frontier.

Re: LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

#58

I just tested it with a slightly tricky question > If you could run a nuclear reactor with U-235 as fuel or Pu-241 (both mixed with 95% U-238), which one would you choose and why? For a human this would not be tricky at all. For an LLM it could be, because this question certainly does not exist in any sort of training, because Pu-241 does not exist in pure form, it only exist as a minor component of reactor-grade plu…

For comparison allow me to add chatGPT 5.5: "Choose U-235 if the goal is safe, boring, practical electricity generation. Choose Pu-241 only if the goal is specifically to consume/recycle plutonium in a reactor designed and licensed for that fuel. In brutal shorthand: Pu-241 is a better “fissile isotope” in some nuclear-physics ways, but U-235 is a much better reactor fuel in the real world." If only I knew anything a…

Am i the only one feeling my soul being emptied every time i read another "brutal shorthand" or "honest take"?

Re: LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

#60

I just tested it with a slightly tricky question > If you could run a nuclear reactor with U-235 as fuel or Pu-241 (both mixed with 95% U-238), which one would you choose and why? For a human this would not be tricky at all. For an LLM it could be, because this question certainly does not exist in any sort of training, because Pu-241 does not exist in pure form, it only exist as a minor component of reactor-grade plu…

I am not a physicist but perhaps your question was leading more than you expected? I would take the question to pre-suppose I have an abundance of the stated material, ignoring practical realities of refinement. If I did have fully pure Pu-241, would that be a better fuel than U-235? Or stated another way, "If you could run a generator on gasoline or jet fuel, which one would you choose and why?" I would answer jet f…

post says delayed neutron fraction, I presume if were enriched with pu-241 the band between critical and prompt critical would be non-existent and you'll have made a bomb.

But I'm just riffing off the parent poster's text.

Post reply on HN