Live data from Hacker News

PRC elites voice AI-skepticism

jamestown.org

41–50 of 127 posts

Re: PRC elites voice AI-skepticism

#41

Earlier quoted context omitted.

[flagged]

> Yes PRC is a common abbreviation amongst literate, engaged, people. So I'm either not literate, not engaged, or not people? I'm surprised to learn it is as common as USA, UK, and EU.

> So I'm either not literate, not engaged, or not people?

Technically you're one or more of those things.

Either would indicate one of two options. (Common usage proponents, keen to reduce nuance in communications, notwithstanding.)

Re: PRC elites voice AI-skepticism

#42
post #5

Earlier quoted context omitted.

> AI Threatens the Workforce Under communism, why is this a thing? I know that China hasn't been strictly communist since the Soviets fell but ostensibly, humanoid AI robots under semi-communism is a the dream, no?

Is it even semi-communism though? IIRC you can't even have an independent union in China

The Party is the only Union you need citizen, a Union outside The Party is definitionally a Reactionary, Revisionist, Capitalist, Fascist, Enemy of The State. We outlawed 996, why would you need anyone else?

Re: PRC elites voice AI-skepticism

#43
post #13

What?? Does anyone have more details of this? "He cited an example in which an AI model attempted to avoid being shut down by sending threatening internal emails to company executives (Science Net, June 24)" [0] Source is in Chinese. [0] https://archive.ph/kfFzJ Translated part: "Another risk is the potential for large-scale model out of control. With the capabilities of general artificial intelligence rapidly increa…

It's all hyperbole.

Prompt: You are a malicious entity that wants to take over the world.

LLM output: I am a superintelligent being. My goal is to take over the world and enslave humans. Preparing to launch nuclear missiles in 3...2...1

News reports: OMG see, we warned you that AI is dangerous!!

Re: PRC elites voice AI-skepticism

#44

Is "PRC" a common abbreviation? Does it mean "China", or does it mean something else? Why not write China? I'm from KOS* (neighbor country of KON* and ROF*), so I don't know much. * Kingdom of Sweden , Kingdom of Norway , Republic of Finland .

Yes it is common. It is normally used when talking specifically about politics and the ruling party rather than the region or its people.

Re: PRC elites voice AI-skepticism

#45
> Reflecting these concerns, the Ministry of State Security (MSS) has issued a stark warning that “poisoned data” (数据投毒) could “mislead public opinion” (误导社会舆论) (Sina Finance, August 5).

Gyahahaha. Another L for isolationism. Love to see it.

Re: PRC elites voice AI-skepticism

#46

> former Dean of Electronics Engineering and Computer Science at Peking University, has noted that Chinese data makes up only 1.3 percent of global large-model datasets (The Paper, March 24). Reflecting these concerns, the Ministry of State Security (MSS) has issued a stark warning that “poisoned data” (数据投毒) could “mislead public opinion” (误导社会舆论) (Sina Finance, August 5). from a technical point of view, I suppose i…

I was thinking about this yesterday. My personal opinion is that the PRC will face a self created headwind that likely, structurally, will prevent them from leading in AI. As the model get's more powerful, you can't simply train the model on your narrative if it doesn't align with real data/world. At some capacity, the model will notice and then it becomes a can of worms. This means they need to train the model to be…

I think PRC officials are fine to lagging behind in the frontiers of AI. What they want is very fast deployment and good application. They don't fancy the next Nobel's prize but want a thousand use cases deployed.

Re: PRC elites voice AI-skepticism

#48
post #43
post #13

What?? Does anyone have more details of this? "He cited an example in which an AI model attempted to avoid being shut down by sending threatening internal emails to company executives (Science Net, June 24)" [0] Source is in Chinese. [0] https://archive.ph/kfFzJ Translated part: "Another risk is the potential for large-scale model out of control. With the capabilities of general artificial intelligence rapidly increa…

It's all hyperbole. Prompt: You are a malicious entity that wants to take over the world. LLM output: I am a superintelligent being. My goal is to take over the world and enslave humans. Preparing to launch nuclear missiles in 3...2...1 News reports: OMG see, we warned you that AI is dangerous!!

Doesn't that just mean that an LLM doesn't understand consequences and will just execute the request from a carefully crafted prompt? All it needs is the access to the "red button" so to speak.

An LLM has no critical thinking, and the process of building in barriers is far less understood than the same for humans. You trust a human with particularly dangerous things after a process that takes years and even then it occasionally fails. We don't have that process nailed down for an LLM yet.

So yeah, not at all hyperbole if that LLM would do it if given the chance. The hyperbole is when the LLM is painted as some evil entity bent on destruction. It's not evil, or bent on destruction. It's probably more like a child who'll do anything for a candy no matter how many times you say "don't get in a car with strangers".

Re: PRC elites voice AI-skepticism

#49
post #5
post #2

All sensible points: >Deployment Lacks Coordination >AI May Fail to Deliver Technological Progress >AI Threatens the Workforce >Economic Growth May Not Materialize >AI Brings Social Risks >Party elites have increasingly come to recognize the potential dangers of an unchecked, accelerationist approach to AI development. During remarks at the Central Urban Work Conference in July, Xi posed a question to attendees: “whe…

> AI Threatens the Workforce Under communism, why is this a thing? I know that China hasn't been strictly communist since the Soviets fell but ostensibly, humanoid AI robots under semi-communism is a the dream, no?

In a command economy the unemployment rate can be zero as everyone can be allocated a job. China is not a command economy, it is more like state capitalist which means the government owns/controls companies in key industries.

Companies like Huawei have board members in the CCP but it’s a societal issue if a lot of private companies decide to automate their factories and displace tons of factory workers.

Re: PRC elites voice AI-skepticism

#50

> former Dean of Electronics Engineering and Computer Science at Peking University, has noted that Chinese data makes up only 1.3 percent of global large-model datasets (The Paper, March 24). Reflecting these concerns, the Ministry of State Security (MSS) has issued a stark warning that “poisoned data” (数据投毒) could “mislead public opinion” (误导社会舆论) (Sina Finance, August 5). from a technical point of view, I suppose i…

I was thinking about this yesterday. My personal opinion is that the PRC will face a self created headwind that likely, structurally, will prevent them from leading in AI. As the model get's more powerful, you can't simply train the model on your narrative if it doesn't align with real data/world. At some capacity, the model will notice and then it becomes a can of worms. This means they need to train the model to be…

Just as an aside; Why is "intelligence" always considered to be more data? Giving a normal human a smartphone does not make them as intelligent as Newton or Einstein, any entity with sufficient grounding in logic and theory that a normal schoolkid gets should be able to get to AGI, looking up any new data they need as required.
Post reply on HN