It's hard to know the right questions to ask to explore these reasoning models. It's common for me to ask a question that's too easy or too hard in non-obvious ways.
QwQ: Alibaba's O1-like reasoning LLM
21–30 of 435 posts
Re: QwQ: Alibaba's O1-like reasoning LLM
#22Re: QwQ: Alibaba's O1-like reasoning LLM
#23Does anyone know what GPUs the Qwen team has access to to be able to train these models? They can't be Nvidia right?
Re: QwQ: Alibaba's O1-like reasoning LLM
#24Earlier quoted context omitted.
> everyone Let's not disrespect the team working on Qwen, these folks have shown that they are able to ship models that are better than everybody else's in the open weight category. But fundamentally yes, OpenAI has no other moat than the ChatGPT trademark at this point.
They have the moat of being able to raise large funding rounds than everybody else: Access to capital.
But access to capital is highly dependent on how interesting you look to investors.
If you don't manage to create a technological gap when you are better funded than your competitors then your attractivity will start being questioned. They have dilapidated their “best team” asset with internal drama, and now that they see their technological advance being demolished by competitors, I'm not too convinced in their prospect for a new funding round unless they show that they can make money out of the consumer market which is where their branding is an unmatched asset (in which case it's not even clear that investing in being the state of the art model is a good business decision).
Re: QwQ: Alibaba's O1-like reasoning LLM
#25QwQ can solve a reverse engineering problem [0] in one go that only o1-preview and o1-mini have been able to solve in my tests so far. Impressive, especially since the reasoning isn't hidden as it is with o1-preview.
Re: QwQ: Alibaba's O1-like reasoning LLM
#26Earlier quoted context omitted.
> everyone Let's not disrespect the team working on Qwen, these folks have shown that they are able to ship models that are better than everybody else's in the open weight category. But fundamentally yes, OpenAI has no other moat than the ChatGPT trademark at this point.
They have the moat of being able to raise large funding rounds than everybody else: Access to capital.
many of these labs have more funding in theory than OpenAI. FAIR, GDM, Qwen all are subsidiaries of companies with $10s of billions in annual profits.
Re: QwQ: Alibaba's O1-like reasoning LLM
#27Does anyone know what GPUs the Qwen team has access to to be able to train these models? They can't be Nvidia right?
Nvidia still sells GPUs to China, they made special SKUs specifically to slip under the spec limits imposed by the sanctions:
https://www.tomshardware.com/news/nvidia-reportedly-creating...
Those cards ship with 24GB of VRAM but supposedly there's companies doing PCB rework to upgrade them to 48GB:
https://videocardz.com/newz/nvidia-geforce-rtx-4090d-with-48...
Assuming the regular SKUs aren't making it into China anyway through back channels...
Re: QwQ: Alibaba's O1-like reasoning LLM
#28Does anyone know what GPUs the Qwen team has access to to be able to train these models? They can't be Nvidia right?
Nvidia still sells GPUs to China, they made special SKUs specifically to slip under the spec limits imposed by the sanctions: https://www.tomshardware.com/news/nvidia-reportedly-creating... Those cards ship with 24GB of VRAM but supposedly there's companies doing PCB rework to upgrade them to 48GB: https://videocardz.com/newz/nvidia-geforce-rtx-4090d-with-48... Assuming the regular SKUs aren't making it into China an…
There was also a video where they are resoldering memory chips on gaming grade cards to make them usable for AI workloads.
Re: QwQ: Alibaba's O1-like reasoning LLM
#29Does anyone know what GPUs the Qwen team has access to to be able to train these models? They can't be Nvidia right?
Nvidia still sells GPUs to China, they made special SKUs specifically to slip under the spec limits imposed by the sanctions: https://www.tomshardware.com/news/nvidia-reportedly-creating... Those cards ship with 24GB of VRAM but supposedly there's companies doing PCB rework to upgrade them to 48GB: https://videocardz.com/newz/nvidia-geforce-rtx-4090d-with-48... Assuming the regular SKUs aren't making it into China an…
A company of Alibaba's scale probably isn't going to risk evading US sanctions. Even more so considering they are listed in the NYSE.
Re: QwQ: Alibaba's O1-like reasoning LLM
#30Earlier quoted context omitted.
Nvidia still sells GPUs to China, they made special SKUs specifically to slip under the spec limits imposed by the sanctions: https://www.tomshardware.com/news/nvidia-reportedly-creating... Those cards ship with 24GB of VRAM but supposedly there's companies doing PCB rework to upgrade them to 48GB: https://videocardz.com/newz/nvidia-geforce-rtx-4090d-with-48... Assuming the regular SKUs aren't making it into China an…
A company of Alibaba's scale probably isn't going to risk evading US sanctions. Even more so considering they are listed in the NYSE.
[deleted]