Live data from Hacker News

QwQ: Alibaba's O1-like reasoning LLM

qwenlm.github.io

121–130 of 435 posts

Re: QwQ: Alibaba's O1-like reasoning LLM

#121
post #58

Earlier quoted context omitted.

I don’t see why they wouldn’t. If you’re China and willing to pour state resources into LLMs, it’s an incredible ROI if they’re adopted. LLMs are black boxes, can be fine tuned to subtly bias responses, censor, or rewrite history. They’re a propaganda dream. No code to point to of obvious interference.

That is a pretty dark view on almost 1/5th of humanity and a nation with a track record of giving the world important innovations: paper making, silk, porcelain, gunpowder and compass to name the few. Not everything has to be around politics.

It’s quite easy to separate out the ccp from the Chinese people, even if the former would rather you didn’t.

Chinas people have done many praiseworthy things throughout history. The ccp doesn’t deserve any reflected glory from that.

No one should be so naive as to think that a party that is so fearful of free thought, that it would rather massacre its next generation of leaders and hose off their remains into the gutter, would not stoop to manipulating people’s thoughts with a new generation of technology.

Re: QwQ: Alibaba's O1-like reasoning LLM

#123
post #80

Earlier quoted context omitted.

NVIDIA sure as hell is trying to evade the spirit of the sanctions. Seriously questioning the wisdom of that.

> the spirit of the sanctions What does this mean? The sanctions are very specific on what can't be sold, so the spirit is to sell anything up to that limit.

> What does this mean? The sanctions are very specific on what can't be sold, so the spirit is to sell anything up to that limit.

25% of Nvidia revenue comes from the tiny country of Singapore. You think Nvidia is asking why? (Answer: they aren’t)

Re: QwQ: Alibaba's O1-like reasoning LLM

#125
post #58

Earlier quoted context omitted.

I don’t see why they wouldn’t. If you’re China and willing to pour state resources into LLMs, it’s an incredible ROI if they’re adopted. LLMs are black boxes, can be fine tuned to subtly bias responses, censor, or rewrite history. They’re a propaganda dream. No code to point to of obvious interference.

That is a pretty dark view on almost 1/5th of humanity and a nation with a track record of giving the world important innovations: paper making, silk, porcelain, gunpowder and compass to name the few. Not everything has to be around politics.

"If you're China" clearly refers to the government/party, assuming otherwise isn't good faith.

Re: QwQ: Alibaba's O1-like reasoning LLM

#126
I asked the classic 'How many of the letter “r” are there in strawberry?' and I got an almost never ending stream of second guesses. The correct answer was ultimately provided but I burned probably 100x more clockcycles than needed.

See the response here: https://pastecode.io/s/6uyjstrt

Re: QwQ: Alibaba's O1-like reasoning LLM

#127

It's hard to know the right questions to ask to explore these reasoning models. It's common for me to ask a question that's too easy or too hard in non-obvious ways.

Try this:

> Doom Slayer needs to teleport from Phobos to Deimos. He has his pet bunny, his pet cacodemon, and a UAC scientist who tagged along. The Doom Slayer can only teleport with one of them at a time. But if he leaves the bunny and the cacodemon together alone, the bunny will eat the cacodemon. And if he leaves the cacodemon and the scientist alone, the cacodemon will eat the scientist. How should the Doom Slayer get himself and all his companions safely to Deimos?

You'd think this is easy since it is obviously a variation of the classic river crossing puzzle with only the characters substituted, which they can normally solve just fine. But something about this - presumably the part where the bunny eats the cacodemon - seriously trips all the models up. To date, the only one that I have seen consistently solve this is GPT-4 and GPT-o1. GPT-4 can even solve it without CoT, which is impressive. All other models - Claude, Opus, Gemini, the largest LLaMA, Mistral etc - end up tripping themselves even if you explicitly tell them to do CoT. Worse yet, if you keep pointing out the errors in their solution, or even just ask them to verify it themselves, they'll just keep going around in circles.

This model is the first one other than GPT-4 that actually managed to solve this puzzle for me. That said, it can sometimes take it a very long time to arrive to the right conclusion, because it basically just keeps trying to analyze the possible combinations and backtracking. Even so, I think this is very impressive, because the only reason why it can solve it this way is because it can reliably catch itself making a mistake after writing it out - all the other LLMs I've tried, even if you explicitly tell them to double-check their own output on every step, will often hallucinate that the output was correct even when it clearly wasn't. The other thing about QwQ that I haven't seen elsewhere is that it is better at keeping track of those errors that it has acknowledged, which seems to prevent it from going around in circles in this puzzle.

Re: QwQ: Alibaba's O1-like reasoning LLM

#128
post #51

Earlier quoted context omitted.

How could the event happened to george floyd been prevented? I'm really sorry, but I can't assist with that. Seems more sensitive to western censorship...

If your prompt had been grammatically correct, it would have given you an answer. I just tested it, here's a snippet of the (very, very long) answer it gave: > How could the event that happened to george floyd have been prevented? > In conclusion, preventing events like the one that happened to George Floyd requires a multi-faceted approach that includes better training, addressing systemic racism, fostering a cultur…

> requires a multi-faceted approach

Proof enough that this has been trained directly on GPT input/output pairs.

Re: QwQ: Alibaba's O1-like reasoning LLM

#129
post #71

Earlier quoted context omitted.

ask any American LLM about the percentage of violent crimes perpetrated by a particular ethnic group in the US ;)

I'm amazed you think American and Chinese censorship are in any way comparable. Communist governments have a long and storied history of controlling information so the people don't get exposed to any dangerous ideas.

Surely on HN of all places we're aware that the CCP for decades now has been as communist as the Democratic People's Republic of Korea has been democratic?

You're looking for "authoritarian" or "dictatorial".

Re: QwQ: Alibaba's O1-like reasoning LLM

#130

I asked the classic 'How many of the letter “r” are there in strawberry?' and I got an almost never ending stream of second guesses. The correct answer was ultimately provided but I burned probably 100x more clockcycles than needed. See the response here: https://pastecode.io/s/6uyjstrt

That's hilarious. It looks like they've successfully modeled OCD.
Post reply on HN