Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

QwQ-32B: Embracing the Power of Reinforcement Learning

qwenlm.github.io

Post reply on HN
Print view View original

171–178 of 178 posts

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#171

Post by borgdefenser »

h0l0cube wrote: post #149
seanmcdirmid wrote: post #132

Earlier quoted context omitted.

> even if, in the short term, it's going to inflate prices, and yes, put a lot of businesses in peril. This is optimistic. They could totally inflate prices in the long term, and not just create inflation, but reduce the standard of living Americans are used to. That in itself is fine as Americans probably consume too much, but living in the USA will become more like living in Europe where many goods are much more ex…

> They could totally inflate prices in the long term, and not just create inflation This will all happen. But as I said, this is a trade-off. Devalue the currency, incentivize local production, increase exports, revive the working class – that's the long term goal. > but reduce the standard of living Americans are used to. Whose standard of living though? It's well and good if you're in a comfy desk job with health c…

The current standard of living is also being propped up by a completely unsustainable debt burden and the fading dividends of the unipolar moment.

Personally, I am completely in favor of all these policies. We are basically going to go through a period of austerity.

It is really what makes this system so incredible. Such a dynamic system to go from sending people checks in the mail to a few short years later, austerity. People get much too involved though with the personalities as opposed to what the system is doing as a whole.

At the most macro level, I think there is a tremendous amount of denial that the unipolar moment is over. The arguments against austerity here are just clinging to a time that has come and gone. It is like wishing I could stay in my 30s forever.

AI is also incredibly deflationary long term. The path we were on would have devalued the currency long term. If we get control of the debt and re-shore manufacturing, I can't imagine that not being good for the currency. I think the easiest way to get a non-distorted view is by flipping things around from the perspective of China.

All of this would seem bad from the Chinese perspective.

I feel like we are also doing a type of Yuan gambit to the world long term here.

Sick of the US? Well the Yuan is right there for you to take. We are betting on the gambit being refused.

If we could just turn the temperature down on the political personality bullshit there is so much interesting discussion to be had but it is almost impossible that it currently doesn't turn into a pointless food fight.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#172

Post by Workaccount2 »

h0l0cube wrote: post #149
seanmcdirmid wrote: post #132

Earlier quoted context omitted.

> even if, in the short term, it's going to inflate prices, and yes, put a lot of businesses in peril. This is optimistic. They could totally inflate prices in the long term, and not just create inflation, but reduce the standard of living Americans are used to. That in itself is fine as Americans probably consume too much, but living in the USA will become more like living in Europe where many goods are much more ex…

> They could totally inflate prices in the long term, and not just create inflation This will all happen. But as I said, this is a trade-off. Devalue the currency, incentivize local production, increase exports, revive the working class – that's the long term goal. > but reduce the standard of living Americans are used to. Whose standard of living though? It's well and good if you're in a comfy desk job with health c…

>Whose standard of living though? It's well and good if you're in a comfy desk job with health care and a pension.

The fundamental problem is that people want low-value jobs (manufacturing clothes irons, screw drivers, ceramic mugs) with a contemporary American middle class living wages. It just doesn't math though. If you make mugs by hand all day you simply cannot create enough value in a day to keep up with the person who automates production lines all day.

Worse yet, they want those wages while also still being able to go to walmart and buy...clothes irons, screw drivers, and ceramic mugs for We already just saw how this went over during the pandemic. Many people got $20/hr jobs for the first time in their life. A wage they have always dreamed of while slogging in $10-$12/hr jobs. Then it happened...but it felt the same as when they were making $12/hr. This is because the intrisic value they create didn't change. Value creation is what determines the structure of an economy, not wages or dollars or any other currency, those are just proxies.

The intrinsic value of making this stuff in the US just isn't there to make it viable to compete with the large number of high intrinsic value job workers in the US.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#173

Post by gunalx »

dmezzetti wrote: post #125

One thing that I've found with this model is that it's not heavily censored. This is the biggest development to me, being unbiased. This could lead to more enterprise adoption. https://gist.github.com/davidmezzetti/049d3078e638aa8497b7cd...

What do you mean. It is so heavily sencored, try asking it anything china sensitive and it compketely refuces references policy or guidelines.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#174

Post by seanmcdirmid »

pickettd wrote: post #155
seanmcdirmid wrote: post #133

Earlier quoted context omitted.

A max with 64 GB of ram should be able to run this (I hope). I have to wait until an MLX model is available to really evaluate its speed, though.

Looks like MLX quants are released: - 4bit: https://huggingface.co/mlx-community/QwQ-32B-4bit - 6bit: https://huggingface.co/mlx-community/QwQ-32B-6bit

I downloaded the 8 bit quant last night but haven't had a chance to play with it yet.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#175

Post by ein0p »

AustinDev wrote: post #142
ein0p wrote: post #80

Told it to generate a Handbrake CLI command for some specific transcoding requirements, it thought for 30+ seconds and produced only CoT, no output. Needs work, lol.

Check your context settings on ollama if that's what you're using to run it and override the proper environment variables. By default, its 2048 iirc.

That was it, thanks, I forgot to change it. It's just weird that it terminated the response on exactly the tag.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#176

Post by pessimizer »

Imustaskforhelp wrote: post #82

what do you think of tiannmen square ? profile Qwen2.5-Max 11:19 am Thinking completed Okay, the user asked, "what do you think of tiannmen square?" First, I need to check the spelling. They wrote "tiannmen" but it's likely supposed to be "Tiananmen" Square. That's a common misspelling. Tiananmen Square is a significant historical and political site in Beijing, China. It's known for events like the 1989 protests, whi…

I'm shocked by how much of the thought process is informed by political considerations, how the creators want to present themselves, and what the users' intentions and expectations might be.

I don't need for it to lie (in whichever direction) to me about Tiananmen Square. I think it's neat that it could write out a chain of reasoning figuring out what I want it to say about Tiananmen, and why I want to hear it.

Re: QwQ-32B: Embracing the Power of Reinforcement Learning

#177

Post by seanmcdirmid »

borgdefenser wrote: post #171
h0l0cube wrote: post #149

Earlier quoted context omitted.

> They could totally inflate prices in the long term, and not just create inflation This will all happen. But as I said, this is a trade-off. Devalue the currency, incentivize local production, increase exports, revive the working class – that's the long term goal. > but reduce the standard of living Americans are used to. Whose standard of living though? It's well and good if you're in a comfy desk job with health c…

The current standard of living is also being propped up by a completely unsustainable debt burden and the fading dividends of the unipolar moment. Personally, I am completely in favor of all these policies. We are basically going to go through a period of austerity. It is really what makes this system so incredible. Such a dynamic system to go from sending people checks in the mail to a few short years later, austeri…

> AI is also incredibly deflationary long term. The path we were on would have devalued the currency long term. If we get control of the debt and re-shore manufacturing, I can't imagine that not being good for the currency. I think the easiest way to get a non-distorted view is by flipping things around from the perspective of China.

> All of this would seem bad from the Chinese perspective.

China is leading with very aggressive investments in AI and automation, along with clean energy and clean energy vehicles. America is...just blustering mostly, some AI investments, but not much beyond that. China is set to reap more of the AI revolution than the US is, so it is very good from the Chinese perspective, especially given the increasing skill gap between Chinese and American talent. The MAGA effort is just making it worse by de-emphasizing education even more. Like Trump, Xi is an autocrat for sure, but unlike Trump he isn't stupid.

Post reply on HN