LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active

Post by mlmonkey » Tue, Jun 30, 2026, 5:09 PM UTC

credit_guy wrote: post #6

I just tested it with a slightly tricky question > If you could run a nuclear reactor with U-235 as fuel or Pu-241 (both mixed with 95% U-238), which one would you choose and why? For a human this would not be tricky at all. For an LLM it could be, because this question certainly does not exist in any sort of training, because Pu-241 does not exist in pure form, it only exist as a minor component of reactor-grade plu…

Post by chvid » Tue, Jun 30, 2026, 5:32 PM UTC

walrus01 wrote: post #41

chvid wrote: post #30

The bad ass “resume” of the founder - sounds like the Chinese guy from the Silicon Valley tv show (who ends up ruling the world from somewhere in the jungle): https://en.wikipedia.org/wiki/Wang_Xing Wang Xing (Chinese: 王兴; born 18 February 1979) is a Chinese businessman, who co-founded Meituan and has been serving as chief executive officer of Meituan since January 2010. He previously served as chief executive office…

Not Hotdog

Post by [deleted] » Tue, Jun 30, 2026, 6:15 PM UTC

jdiff wrote: post #71

smallmancontrov wrote: post #67

Earlier quoted context omitted.

Yeah, but the default is extreme yap mode. I prefer "in a sentence" or "rows, not paragraphs." "Brutal" sounds like bait from an influencer trying to sell me a $400 course about how 4AM workouts will make me a millionaire.

I don't even know how we got here. This isn't that deeply represented in the training data. Is this what RLHF hath wrought? A new dialect of English based on corporatespeak and influencers, two heavy-hitting bullshitters?

Post by genewitch » Tue, Jun 30, 2026, 6:25 PM UTC

dwa3592 wrote: post #69

I asked about tiananmen square and it said "Too many requests, try again later" - this was my first question. I understand this is one data point but still ;/

Post by genewitch » Tue, Jun 30, 2026, 6:32 PM UTC

nl wrote: post #65

hnfong wrote: post #27

Earlier quoted context omitted.

That's simply not true. ~70B models can run fine (albeit somewhat slow) on consumer hardware with 64GB RAM. There are heavily quantized (Q1.x) models that are still usable on similar hardware. Granted recently there haven't been a lot of models of this size, but still, 35B isn't really the practical limit. 35B is mostly the limit if you're using consumer grade GPUs with limited RAM and need the model to run fast. Peo…

Yes, this is true, but that's not what I'm saying. I'm saying that 64GB+ personal computers are vanishingly rare outside builds that were specifically done with AI in mind. Gamers never saw the need for them, and even in software development 32GB was the standard until AI came along. Yes, there were specialized use cases where they did exist, and yes, some people just wanted to max out the Macbooks but.. it was rare.