This one is pretty impressive. I'm running it on my Mac via Ollama - only a 20GB download, tokens spit out pretty fast and my initial prompts have shown some good results. Notes here: https://simonwillison.net/2024/Nov/27/qwq/
What hardware are you able to run this on?
QwQ: Alibaba's O1-like reasoning LLM
181–190 of 435 posts
Re: QwQ: Alibaba's O1-like reasoning LLM
#182Earlier quoted context omitted.
It’s quite easy to separate out the ccp from the Chinese people, even if the former would rather you didn’t. Chinas people have done many praiseworthy things throughout history. The ccp doesn’t deserve any reflected glory from that. No one should be so naive as to think that a party that is so fearful of free thought, that it would rather massacre its next generation of leaders and hose off their remains into the gut…
This "CCP vs people" model almost always lead to very poor result, to the point that there's no people part anymore: some would just exaggerate and consider CCP has complete control over everything China, so every researcher in China is controlled by CCP and their action may be propaganda, and even researchers in the States are controlled by CCP because they may still have grandpa in China (seriously, WTF?). I fully…
Re: QwQ: Alibaba's O1-like reasoning LLM
#183You must use math questions that have never entered the training data set for testing to know whether LLM has real reasoning capabilities. https://venturebeat.com/ai/ais-math-problem-frontiermath-ben...
Re: QwQ: Alibaba's O1-like reasoning LLM
#184I asked the classic 'How many of the letter “r” are there in strawberry?' and I got an almost never ending stream of second guesses. The correct answer was ultimately provided but I burned probably 100x more clockcycles than needed. See the response here: https://pastecode.io/s/6uyjstrt
Re: QwQ: Alibaba's O1-like reasoning LLM
#185Earlier quoted context omitted.
I don’t see why they wouldn’t. If you’re China and willing to pour state resources into LLMs, it’s an incredible ROI if they’re adopted. LLMs are black boxes, can be fine tuned to subtly bias responses, censor, or rewrite history. They’re a propaganda dream. No code to point to of obvious interference.
That is a pretty dark view on almost 1/5th of humanity and a nation with a track record of giving the world important innovations: paper making, silk, porcelain, gunpowder and compass to name the few. Not everything has to be around politics.
Re: QwQ: Alibaba's O1-like reasoning LLM
#186Re: QwQ: Alibaba's O1-like reasoning LLM
#187This one is pretty impressive. I'm running it on my Mac via Ollama - only a 20GB download, tokens spit out pretty fast and my initial prompts have shown some good results. Notes here: https://simonwillison.net/2024/Nov/27/qwq/
Re: QwQ: Alibaba's O1-like reasoning LLM
#188Re: QwQ: Alibaba's O1-like reasoning LLM
#189> How many words are in your response to this question?
> As an AI language model, I don't have a set number of words in my responses. The length of my responses depends on...
Re: QwQ: Alibaba's O1-like reasoning LLM
#190There's more token guessing here with a lot of unavoidable hallucinations.