QwQ: Alibaba's O1-like reasoning LLM

Post by elashri » Thu, Nov 28, 2024, 3:58 AM UTC

miki123211 wrote: post #100

willy_k wrote: post #65

Earlier quoted context omitted.

Why so?

Because training usually requires bigger batches, doing a backward pass instead of just the forward pass, storing optimizer states in memory etc. This means it takes a lot more RAM than inference, so much more that you can't run it on a single GPU. If you're training on more than one GPU, the speed at which you can exchange data between them suddenly becomes your bottleneck. To alleviate that problem, you need extrem…

Post by Vampiero » Thu, Nov 28, 2024, 4:01 AM UTC

elashri wrote: post #18

Mistletoe wrote: post #14

Earlier quoted context omitted.

Weird, Gemini answers that just fine. What good is an LLM that has amnesia about history?

From the link > Performance and Benchmark Limitations: The model excels in math and coding but has room for improvement in other areas, such as common sense reasoning and nuanced language understanding.

Post by tofuziggy » Thu, Nov 28, 2024, 4:14 AM UTC

msoad wrote: post #50

Somehow o1-preview did not find the answer to the example question. It hallucinated a wrong answer as correct. It eventually came up with another correct answer: (1 + 2) × 3 + 4 × 5 + (6 × 7 + 8) × 9 = 479 Source: https://chatgpt.com/share/6747c32e-1e60-8007-9361-26305101ce...

Post by freediver » Thu, Nov 28, 2024, 4:19 AM UTC

tyre wrote: post #58

echelon wrote: post #53

Earlier quoted context omitted.

Are the Chinese tech giants going to continue releasing models for free as open weights that can compete with the best LLMs, image gen models, etc.? I don't see how this doesn't put extreme pressure on OpenAI and Anthropic. (And Runway and I suppose eventually ElevenLabs.) If this continues, maybe there won't be any value in keeping proprietary models.

I don’t see why they wouldn’t. If you’re China and willing to pour state resources into LLMs, it’s an incredible ROI if they’re adopted. LLMs are black boxes, can be fine tuned to subtly bias responses, censor, or rewrite history. They’re a propaganda dream. No code to point to of obvious interference.

Post by chipdart » Thu, Nov 28, 2024, 4:41 AM UTC

freediver wrote: post #117

tyre wrote: post #58

Earlier quoted context omitted.

I don’t see why they wouldn’t. If you’re China and willing to pour state resources into LLMs, it’s an incredible ROI if they’re adopted. LLMs are black boxes, can be fine tuned to subtly bias responses, censor, or rewrite history. They’re a propaganda dream. No code to point to of obvious interference.

That is a pretty dark view on almost 1/5th of humanity and a nation with a track record of giving the world important innovations: paper making, silk, porcelain, gunpowder and compass to name the few. Not everything has to be around politics.