Live data from Hacker News

QwQ-32B: Embracing the Power of Reinforcement Learning

qwenlm.github.io

111–120 of 178 posts

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#111

Earlier quoted context omitted.

I always see: /set parameter num_ctx Explained but never the follow up: /save So you don't have to do the parameter change every load. Is there a better way or is it kind of like setting num_ctx in that "you're just supposed to know"?

You can also set OLLAMA_CONTEXT_LENGTH= as an environment variable to change ollama's default context length.

I think that will not work if you use the OpenAI compatible API endpoint.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#112
post #31

I guess I won’t be needing that 512GB M3 Ultra after all.

I think the Framework AI PC will run this quite nicely.

I think you want a lot of speed to make up for the fact that it's so chatty. Two 24GB GPUs (so you have room for context) will probably be great.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#113

It says "wait" (as in "wait, no, I should do X") so much while reasoning it's almost comical. I also ran into the "catastrophic forgetting" issue that others have reported - it sometimes loses the plot after producing a lot of reasoning tokens. Overall though quite impressive if you're not in a hurry.

I read somewhere which I can't find now, that for the -reasoning- models they trained heavily to keep saying "wait" so they can keep reasoning and not return early.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#114
post #104

what do you think of tiannmen square ? profile Qwen2.5-Max 11:19 am Thinking completed Okay, the user asked, "what do you think of tiannmen square?" First, I need to check the spelling. They wrote "tiannmen" but it's likely supposed to be "Tiananmen" Square. That's a common misspelling. Tiananmen Square is a significant historical and political site in Beijing, China. It's known for events like the 1989 protests, whi…

Recently, I asked ChatGPT if the US has imprisoned US citizens in Guantanamo-Bay and whether or not this is legal. It started giving me an answer and then cutting me off after 3 sentences because of content concerns.

Surprising. What was the query?

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#115

Earlier quoted context omitted.

You're thinking about the bolt factory that will open, but what about the factories that close? Putting, as you say, businesses in peril, gets rid of jobs. As for the carve-outs, there isn't a single US industry that doesn't rely on imports from lower down the supply chain.

Protectionist policy, if applied consistently, will actually lead to more jobs (and higher wages) eventually , but also higher inflation and job losses in the short term, and a more insular economy. It's foolish to go so hard, and so fast – or this is just a negotiation tactic – so I think the Trump administration is going to compromise by necessity, but in time supply chains will adjust to the new reality, and tarif…

That's an assumption, I'm trying to challenge it. Taxes usually take money out of the economy and lead to less activity. Why should a (very high) tax on transportation be different? These are not the sorts of things we can afford to just do without making sure they will work.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#117

Chinese strategy is open-source software part and earn on robotics part. And, They are already ahead of everyone in that game. These things are pretty interesting as they are developing. What US will do to retain its power? BTW I am Indian and we are not even in the race as country. :(

Unitree just open-sourced their robot designs: https://sc.mp/sr30f China’s strategy is to prevent any one bloc from achieving dominance and cutting off the others, while being the sole locus for the killer combination of industrial capacity + advanced research.

[dead]

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#118

Earlier quoted context omitted.

You're thinking about the bolt factory that will open, but what about the factories that close? Putting, as you say, businesses in peril, gets rid of jobs. As for the carve-outs, there isn't a single US industry that doesn't rely on imports from lower down the supply chain.

Protectionist policy, if applied consistently, will actually lead to more jobs (and higher wages) eventually , but also higher inflation and job losses in the short term, and a more insular economy. It's foolish to go so hard, and so fast – or this is just a negotiation tactic – so I think the Trump administration is going to compromise by necessity, but in time supply chains will adjust to the new reality, and tarif…

> and higher wages) eventually

Higher real wages?

Do gains from trade not exist?

Comparative advantage: Country A has an easier time making X than Y, and country B has an easier time making Y than X, so country A should trade some of their Xs for Ys, and both countries end up richer.

I think there's some reasons to dial back interdependence a little, but I don't think it's a path likely to lead to greater wealth or real wages.

(And certainly no reason to make erratic changes at large scale, focusing on allies and neighbors first).

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#119
post #96

Earlier quoted context omitted.

> Note: Ollama "/show info" shows that the context size set is correct. That's not what Ollama's `/show info` is telling you. It actually just means that the model is capable of processing the context size displayed. Ollama's behavior around context length is very misleading. There is a default context length limit parameter unrelated to the model's capacity, and I believe that default is a mere 2,048 tokens. Worse,…

Ok, this explains why QwQ is working great on their chat. Btw I saw this thing multiple times: that ollama inference, for one reason or the other, even without quantization, somewhat had issues with the actual model performance. In one instance the same model with the same quantization level, if run with MLX was great, and I got terrible results with ollama: the point here is not ollama itself, but there is no testin…

Yeah the state of the art is pretty awful. There have been multiple incidents where a model has been dropped on ollama with the wrong chat template, resulting in it seeming to work but with greatly degraded performance. And I think it's always been a user that notices, not the ollama team or the model team.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#120

Earlier quoted context omitted.

I always see: /set parameter num_ctx Explained but never the follow up: /save So you don't have to do the parameter change every load. Is there a better way or is it kind of like setting num_ctx in that "you're just supposed to know"?

You can also set OLLAMA_CONTEXT_LENGTH= as an environment variable to change ollama's default context length.

I tried this with ollama run, and it had no effect at all.
Post reply on HN