Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

tomshardware.com

Post reply on HN
Print view View original

101–110 of 331 posts

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#101

Post by muddi900 »

larus_canus wrote: post #75
muddi900 wrote: post #70

Earlier quoted context omitted.

So we are in agreement, we should not take every thing at face value.

I just hope you extend this skepticism consistently.

I do. I don't know what gave people the impression that I was born an American and went to their schools. In "open societies" like the US, the form information control are rather sophisticated, but they are there. However, I grew up in a one TV channel country. I learned to never trust the news. This immunizes me from state propaganda a little bit.

I think I was more referring to general abundance of credulity that is thrown at all AI stories at HN. There are a lot of skeptics when an Ed Zitron blog is shared. But every time a "ChatGPT was worried about being shut down" story is shared, it gets hundreds of upvotes. This story is just as ridiculous. AliBaba claims to reduce usage of equipment from a business that is being banned by their government. Magically. And during a trade war.

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#103

Post by Workaccount2 »

segmondy wrote: post #6
hunglee2 wrote: post #2

The US attempt to slow down China's technological development succeeds on the basis of preventing China from directly following the same path, but may backfire in the sense it forces innovation by China in a different direction. The overall outcome for us all may be increase efficiency as a result of this forced innovation, especially if Chinese companies continue to open source their advances, so we may in the end h…

may backfire? it's a bit too late for that. go to 2024, western labs were crushing it. it's now 2025, and from china, we have deepseek, qwen, kimi, glm, ernie and many more capable models keeping up with western labs. there are actually now more chinese labs releasing sota models than western labs.

But they aren't keeping up

They are lauded for the ability to cost ratio, or their ability to parameter ratio, but virtually everyone using LLMs for productive work are using ChatGPT/Gemini/Claude.

They are kind of like Huffy bicycles. Good value, work well, but if you go to any serious event, no one will be riding one.

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#104

Post by natrys »

sspiff wrote: post #94
hunglee2 wrote: post #2

The US attempt to slow down China's technological development succeeds on the basis of preventing China from directly following the same path, but may backfire in the sense it forces innovation by China in a different direction. The overall outcome for us all may be increase efficiency as a result of this forced innovation, especially if Chinese companies continue to open source their advances, so we may in the end h…

Their are signs that China is not open sourcing their SOTA models anymore. Both Huawei and Qwen (Qwen-Max, WAN 2.5) and have launched flagship models which are yet to be opensourced.

Qwen's max series had always been closed weight, it's not a policy change like you are alluding.

What exactly is Huawei's flagship series anyway? Because their PanGu line is open-weight, but Huawei is as of yet not in the LLM making business, their models are only meant to signal that it's possible to do training and inference on their hardware, that's all. No one actually uses those models.

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#105

Post by muddi900 »

Yoric wrote: post #72
muddi900 wrote: post #32

[flagged]

I haven't read the paper yet, but it's here: https://ennanzhai.github.io/pub/sosp25-aegaeon.pdf aka https://dl.acm.org/doi/10.1145/3731569.3764815 . So, definitely not state media, probably not lying on the fundamentals. Of course, still presumably viewed favorably by the CCP, I'd imagine.

Well if it is real, we will surely see out Claude Code limits go back up.

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#106

Post by [deleted] »

wood_spirit wrote: post #88
onlyrealcuzzo wrote: post #20

Earlier quoted context omitted.

> History has shown that withholding technology from China does not significantly stop them and they'll achieve it (or better) in a small number of years. It's worked for a very long time for aircraft. China has been pushing to build its own aircraft for >23 years. It took 14 years for COMAC to get its first regional jet flying commercial flights on a Chinese airline, and 21 years to get a narrow-body plane flying a…

But at the same time they are fielding multiple new stealth aircraft and their jets and missiles outperformed western aircraft in the recent Pakistan India flare-up.

[deleted]

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#107

Post by lawlessone »

dlisboa wrote: post #11
hunglee2 wrote: post #2

The US attempt to slow down China's technological development succeeds on the basis of preventing China from directly following the same path, but may backfire in the sense it forces innovation by China in a different direction. The overall outcome for us all may be increase efficiency as a result of this forced innovation, especially if Chinese companies continue to open source their advances, so we may in the end h…

History has shown that withholding technology from China does not significantly stop them and they'll achieve it (or better) in a small number of years. In many senses there's hubris in the western* view of China accomplishments: most of what western companies have created has had significant contribution by Chinese scientists or manufacturing, without which those companies would have nothing. If you look at the name…

In a way withholding a tech becomes a signal saying "Hey this is important" so the result is China dedicates more resources to researching it lol.

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#108

Post by Workaccount2 »

sofixa wrote: post #30
dataviz1000 wrote: post #7

Earlier quoted context omitted.

I've been in Chile, Peru, Colombia, Panama, and Costa Rica. The streets are flooded with cheap Chinese cars and I see more BYD than American cars. If the car wasn't made in Japan or Korea which probably account for most of the cars, it was likely made in China. Moreover, I haven't been in countries with the closest ties to China.

> The streets are flooded with cheap Chinese cars and I see more BYD than American cars This isn't surprising in any way, American "cars" (quotes because the vast majority of what American manufacturers pump out isn't cars, it's trucks) haven't been competitive in decades. The only globally competitive vehicles were developed in Europe by GM Europe (Opel, since sold to PSA now Stellantis) or Ford Europe (which axed a…

The US couldn't compete anyway. The US is an advanced economy and will struggle to compete in non-advanced categories.

It's like trying to level your MMORPG character to 100 by only farming in lvl 30-40 mob areas. It's really not worth it and mostly forced.

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#109

Post by hmm37 »

ambicapter wrote: post #95
wood_spirit wrote: post #88

Earlier quoted context omitted.

But at the same time they are fielding multiple new stealth aircraft and their jets and missiles outperformed western aircraft in the recent Pakistan India flare-up.

So you'd think they'd be able to build a commercial jet liner, no?

But commercial jet liners aren't as important to China for security. They have high speed railroads for that.

Re: Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system

#110

Post by hshdhdhj4444 »

dlisboa wrote: post #11
hunglee2 wrote: post #2

The US attempt to slow down China's technological development succeeds on the basis of preventing China from directly following the same path, but may backfire in the sense it forces innovation by China in a different direction. The overall outcome for us all may be increase efficiency as a result of this forced innovation, especially if Chinese companies continue to open source their advances, so we may in the end h…

History has shown that withholding technology from China does not significantly stop them and they'll achieve it (or better) in a small number of years. In many senses there's hubris in the western* view of China accomplishments: most of what western companies have created has had significant contribution by Chinese scientists or manufacturing, without which those companies would have nothing. If you look at the name…

Ironically, the best way America could have prevented China’s rise in tech was by stapling green cards to diplomas of Chinese citizens who completed their higher education in the U.S. like the plan in the early 2010s.
Post reply on HN