811–820 of 965 posts
Datapoint from the cheap end of the market: I run local models on a couple of Orange Pi SBCs and a decade-old Optiplex with no GPU. What runs usably on that class of hardware is almost entirely Chinese open weights — Qwen's MoE builds (35B total, ~3B active) are the only thing that gives me acceptable speed on CPU, with Gemma as about the only western exception. I evaluated Kimi too and ruled it out purely on size. W…
I think a simple experiment is enough to understand why one would have some concern with a state-censored AI model : Just try asking them about atrocities committed by their state[1]. [1] : https://imgur.com/gallery/ai-models-on-atrocities-B7DKUXc
Earlier quoted context omitted.
> open models are inherently decelerationist I’m struggling to understand this perspective. Is he using the words accelerationist/decelerationist in a sense other than the obvious one? EDIT: I searched his twitter history and discovered that his argument is basically “if you drive down costs, then OpenAI will have less money to invest in development, slowing down the overall rate of AI progress.” IMO this take betray…
Nah, the point is that if models are commoditized and there's no hope of making significant profits, no one is going to be willing to make the massive investments necessary to continue pushing the scale frontier. How large a training run do you expect investors to fund out of the goodness of their hearts?
that sounds great to me. anything that slows down the pace and gives us a chance to prepare for, at best, massive job displacement, and at worst, robots turning us all into paperclips.
Earlier quoted context omitted.
[flagged]
And here I was believing the Red Scare was for the history books
Earlier quoted context omitted.
Agree, China believes in Climate change and are at least taking steps to address it. Personally this is making me trust them more than the USA because, facts. I mean lesser of two evils thinking, if one is intentionally leading us towards climate disaster, while the other isn't then yeah. What else can be said? Should I trust the authoritarian country who believes in engineering and science, or the one that doesn't?
China emits 3x more co2 than the US and last year their rate of increase was 2.5x that of the US. https://www.worldometers.info/co2-emissions/co2-emissions-by...
Earlier quoted context omitted.
[flagged]
Are the Marxists in the room with you now? Do you need assistance?
I think a simple experiment is enough to understand why one would have some concern with a state-censored AI model : Just try asking them about atrocities committed by their state[1]. [1] : https://imgur.com/gallery/ai-models-on-atrocities-B7DKUXc
Earlier quoted context omitted.
> Using a Chinese LLM will not put a Marxist under your bed. Interesting tangent - it might be taught to introduce stealthy backdoors in your company though. Maybe even across multiple PRs where each session puts a small chink in the armor, and together they allow unlimited access to the attacker who knows about them. After all, LLMs are mostly black boxes. How comfortable would you be running a Chinese compiler?
Whats different to US models then? They can also be taught to introduce stealthy backdoors. Its not like stealthy backdoors are a Chinese only topic.
Datapoint from the cheap end of the market: I run local models on a couple of Orange Pi SBCs and a decade-old Optiplex with no GPU. What runs usably on that class of hardware is almost entirely Chinese open weights — Qwen's MoE builds (35B total, ~3B active) are the only thing that gives me acceptable speed on CPU, with Gemma as about the only western exception. I evaluated Kimi too and ruled it out purely on size. W…
Is Gemma worse?