I am right now playing with it running it locally using ollama.
It is a 19GB download and it runs nicely on a nvidia A100 GPU.
QwQ: Alibaba's O1-like reasoning LLM
291–300 of 435 posts
Re: QwQ: Alibaba's O1-like reasoning LLM
#292Is o1 even that good? It's doesn't even rank first on LMArena..
I haven’t been super impressed with it, and haven’t encountered any practical tasks I wanted to solve with an LLM where o1 worked any better than prompting 4o or Sonnet to use more extensive CoT. There might be some narrow band of practical problems in between what other LLMs can do and what o1 can’t, but I don’t think that really matters for most use cases, especially given how much slower it is. Day to day, you jus…
I think the true edge of CoT models will come from layman usability. While I can easily prompt Claude for examples and then manually modify the code to fill in the gaps, general domain knowledge and technical understanding is absolutely required from the human sitting in front of the screen. With o1, a layman can sit in front of the computer, and ask 'I want a website for tracking deliveries for my webshop and make it pretty', and the model will do it.
So it's not so much about increased capability, but removing the expert human in the loop.
Re: QwQ: Alibaba's O1-like reasoning LLM
#293I can't wait for Ebay to release theirs
Re: QwQ: Alibaba's O1-like reasoning LLM
#294Is Alibaba's LLM the "Chinese LLM"? It would appear to have been a U.S.-only game until now. As Eric Schmidt said in the YouTube lecture (that keeps getting pulled down), LLM's have been a rich-companies game.
[dead]
Re: QwQ: Alibaba's O1-like reasoning LLM
#295Is Alibaba's LLM the "Chinese LLM"? It would appear to have been a U.S.-only game until now. As Eric Schmidt said in the YouTube lecture (that keeps getting pulled down), LLM's have been a rich-companies game.
no, it is the opposite. China had versions of LLMs since before they were widely public. see the LLama family history chart for one example
Re: QwQ: Alibaba's O1-like reasoning LLM
#296Is their repo / model free of any undisclosed telemetry, ie is it purely weights
Re: QwQ: Alibaba's O1-like reasoning LLM
#297Is their repo / model free of any undisclosed telemetry, ie is it purely weights
Is it even possible to embed telemetry into a model itself, as opposed to the runtime environment / program (e.g. Ollama)?
I would be disinclined to believe that to be possible, but if anyone knows otherwise, please share.
Re: QwQ: Alibaba's O1-like reasoning LLM
#298Is Alibaba's LLM the "Chinese LLM"? It would appear to have been a U.S.-only game until now. As Eric Schmidt said in the YouTube lecture (that keeps getting pulled down), LLM's have been a rich-companies game.
you only think that because you haven’t been paying close attention qwen, deepseek, yi - there have been a number of high quality, open chinese competitors
Thanks. You're right, I am a layman. I may also have been focusing on the "open" LLMs since they seem to get the most talked about on HN.
Re: QwQ: Alibaba's O1-like reasoning LLM
#299Is Alibaba's LLM the "Chinese LLM"? It would appear to have been a U.S.-only game until now. As Eric Schmidt said in the YouTube lecture (that keeps getting pulled down), LLM's have been a rich-companies game.
What lecture is this?
Re: QwQ: Alibaba's O1-like reasoning LLM
#300I am right now playing with it running it locally using ollama. It is a 19GB download and it runs nicely on a nvidia A100 GPU. https://ollama.com/library/qwq
Runs nicely on my AMD 7900XTX too.