It gets the Sally question correct, but it takes more than 100 lines of reasoning.
>Sally has three brothers. Each brother has two sisters. How many sisters does sally have?
Here is the answer: https://pastebin.com/JP2V92Kh
QwQ: Alibaba's O1-like reasoning LLM
231–240 of 435 posts
Re: QwQ: Alibaba's O1-like reasoning LLM
#232> This version is but an early step on a longer journey - a student still learning to walk the path of reasoning. Its thoughts sometimes wander, its answers aren’t always complete, and its wisdom is still growing. But isn’t that the beauty of true learning? To be both capable and humble, knowledgeable yet always questioning? > Through deep exploration and countless trials, we discovered something profound: when given…
how much are you willing to bet that it was written by a human
Re: QwQ: Alibaba's O1-like reasoning LLM
#233Earlier quoted context omitted.
Forgot about R1, what hardware are you using to run it?
I haven’t ran QWQ yet, but it’s a 32B. So about 20GB RAM with Q4 quant. Closer to 25GB for the 4_K_M one. You can wait for a day or so for the quantized GGUFs to show up (we should see the Q4 in the next hour or so). I personally use Ollama on an MacBook Pro. It usually takes a day or two for it to show up. Any M series MacBook with 32GB+ of RAM will run this.
> 20GB RAM with Q4 quant. Closer to 25GB for the 4_K_M one
how does this math work? are there rules of thumb that you guys know that the rest of us dont?
Re: QwQ: Alibaba's O1-like reasoning LLM
#234Earlier quoted context omitted.
Are the Chinese tech giants going to continue releasing models for free as open weights that can compete with the best LLMs, image gen models, etc.? I don't see how this doesn't put extreme pressure on OpenAI and Anthropic. (And Runway and I suppose eventually ElevenLabs.) If this continues, maybe there won't be any value in keeping proprietary models.
I don’t see why they wouldn’t. If you’re China and willing to pour state resources into LLMs, it’s an incredible ROI if they’re adopted. LLMs are black boxes, can be fine tuned to subtly bias responses, censor, or rewrite history. They’re a propaganda dream. No code to point to of obvious interference.
I'm a CPC(you guys call it 'CCP') member
Be careful
I collected your browser history and PornHub activities just after you accessed the dark leviathan LLM developed by our parter Alibaba
Send me $50 worth BTC or we'll publish your PornHub activities in HN, and cc to your contacts
We're watching you :)
Re: QwQ: Alibaba's O1-like reasoning LLM
#235Does anyone know what GPUs the Qwen team has access to to be able to train these models? They can't be Nvidia right?
try search 'GPU' in Alibaba and eBay...
Re: QwQ: Alibaba's O1-like reasoning LLM
#236Earlier quoted context omitted.
Well, the second they'll start overwhelmingly outperforming other open source LLMs, and people start incorporating them into their products, they'll get banned in the states. I'm being cynical, but the whole "dangerous tech with loads of backdoors built into it" excuse will be used to keep it away. Whether there will be some truth to it or not, that's a different question.
Qwen models have ideological backdoors already. They rewrite history, deny crimes from the regime, and push the CCP narratives. Even if their benchmarks are impressive, I refuse to ship any product with it. I'll stick with Llama and Gemma for now.
Unfortunately, when there’s money to be made, corpos with least morals win over the competition.
Re: QwQ: Alibaba's O1-like reasoning LLM
#237This one is crazy. I made up a silly topology problem which I guessed wouldn't be in a textbook (given X create a shape with Euler characteristic X) and set it to work. Its first effort was a program that randomly generated shapes, calculated X and hoped it was right. I went and figured out a solution and gave it a clue. Watching it "think" through the answer is surreal and something I haven't felt since watching GPT…
I wonder how much of chain of thought is just addressing the fact that LLMs are trained on human writing (much of which are conversations online), which creates an implicit bias in the model towards mimicking conversations where people are trying to explain their problem enough before they get an answer, even if none of this is required with a sufficiently informed expert (which are more rare to find in the training data compared to average people helping each other out in the countless low-voted discussions on reddit/stackoverflow/etc).
Re: QwQ: Alibaba's O1-like reasoning LLM
#238It gets the Sally question correct, but it takes more than 100 lines of reasoning. >Sally has three brothers. Each brother has two sisters. How many sisters does sally have? Here is the answer: https://pastebin.com/JP2V92Kh
In fairness it actually works out the correct answer fairly quickly (20 lines, including a false start and correction thereof). It seems to have identified (correctly) that this is a tricky question that it is struggling with so it does a lot of checking.
Re: QwQ: Alibaba's O1-like reasoning LLM
#239Earlier quoted context omitted.
I don’t see why they wouldn’t. If you’re China and willing to pour state resources into LLMs, it’s an incredible ROI if they’re adopted. LLMs are black boxes, can be fine tuned to subtly bias responses, censor, or rewrite history. They’re a propaganda dream. No code to point to of obvious interference.
I'm a CPC(you guys call it 'CCP') member Be careful I collected your browser history and PornHub activities just after you accessed the dark leviathan LLM developed by our parter Alibaba Send me $50 worth BTC or we'll publish your PornHub activities in HN, and cc to your contacts We're watching you :)
That might be a money-making scam, but I really don't see it being effective in the big picture. Anyone who objects to their friends watching weird things on PornHub is either unusually naive or unusually friendless.
Re: QwQ: Alibaba's O1-like reasoning LLM
#240It gets the Sally question correct, but it takes more than 100 lines of reasoning. >Sally has three brothers. Each brother has two sisters. How many sisters does sally have? Here is the answer: https://pastebin.com/JP2V92Kh
In fairness it actually works out the correct answer fairly quickly (20 lines, including a false start and correction thereof). It seems to have identified (correctly) that this is a tricky question that it is struggling with so it does a lot of checking.
> Let me check online for similar problems.
And finally googles the problem, like we do :)