Live data from Hacker News

Google drops pledge not to use AI for weapons or surveillance

washingtonpost.com

81–90 of 567 posts

Re: Google drops pledge not to use AI for weapons or surveillance

#81
post #64

I'm guessing this will be a somewhat controversial view here, but I think this is net good. The world is more turbulent than at any other time in my life, there is war in Europe, and the U.S. needs every advantage it can get to improve its defense. Companies like Google, OpenAI, Microsoft, can and should be working with the government on defense projects -- I would much rather the Department of Defense have access to…

> the U.S. needs every advantage it can get to improve its defense That’s one of the reasons for the turbulent times. Let’s face the truth, most of the defense can easily be used for offense and given the state of online security every progress gets into the wrong hands. Maybe it’s time to pause to make it more difficult for those wrong hands.

Just how do you propose to remove those tools from Putin's, Xi's, Khomeini's, or Kim Jong-Un's hands?

Re: Google drops pledge not to use AI for weapons or surveillance

#82

Earlier quoted context omitted.

The market solves all problems. ... or at least that's what these people have to be telling themselves at all times .

The market's objectives are wealth-weighted. This is a very important point to remember when assessing ideas like "Is it good to build swarms of murderbots to mow down rioting peasants angry over having expenses but no jobs?" Most people might answer "no," but if the people with money answer "yes," that becomes the market's objective. Then the incentives diffuse through the economy and you don't just get the murderbo…

Anduril already asked this question with a strong "fuck yes"

Edit: answered, not asked

Re: Google drops pledge not to use AI for weapons or surveillance

#84
post #2

I initially thought that this was an announcement for a new pledge and thought, "they're going to forget about this the moment it's convenient." Then I read the article and realized, "Oh, it's already convenient." Google is a megacorp, and while megacorps aren't fundamentally "evil" (for some definitions of evil), they are fundamentally unconcerned with goodness or morality, and any appearance that they are is purely…

“Drop” has really become ambiguous in headlines.

Re: Google drops pledge not to use AI for weapons or surveillance

#85
post #47
post #26

Earlier quoted context omitted.

> while megacorps aren't fundamentally "evil" (for some definitions of evil), I think megacorps being evil is universal. It tends to be corrupt cop evil vs serial killer evil, but being willing to do anything for money has historically been categorized as evil behavior. That doesn’t mean society would be better or worse off without them, but it would be interesting to see a world where companies pay vastly higher tax…

My problem with this take is that you forget, the corporations are made up of people, so in order for the corporation to be evil you have to take into account the aggregate desires and decision making of the employees and shareholders and, frankly, call them all evil. Calling them evil is kind of a silly thing to do anyway, but you can not divorce the actions of a company from those who run and support it, and I woul…

I don't really agree with some of your assumptions. At many companies, many of the people also are evil. Many people who hold shares and public office are also evil.

I don't think it's necessary to conclude that because a company is evil then everyone who works at the company is evil. But it's sort of like the evilness of the company is a weighted function of the evilness of the people who control it. Someone with a small role may be relatively good while the company overall can still be evil. Someone who merely uses the company's products is even more removed from the company's own level of evil. If the company is evil it usually means there is some relatively small group of people in control of it making evil decisions.

Now, I'm using phraseology here like "is evil" as a shorthand for "takes actions that are evil". The overall level of evilness or goodness of a person is an aggregate of their actions. So a person who works for an evil company or buys an evil company's products "is evil", but only insofar as they do so. I don't think this is even particularly controversial, except insofar as people may prefer alternative terms like "immoral" or "unethical" rather than "evil". It's clear people disagree about which acts or companies are evil, but I think relatively few people view all association with all companies totally neutrally.

I do agree with you that taking personal responsibility is a good step. And, I mean, I think people do that too. All kinds of people avoid buying from certain companies, or buy SRI funds or whatever, for various ethically-based reasons.

However, I don't entirely agree with the view that says it's useless or hypocritical to claim that reform is necessary unless you are going to "do something". Yes, on some level we need to "do something", but saying that something needs to be done is itself doing something. I think the idea that change has to be preceded or built from "saintly" grassroots actions is a pernicious myth that demotivates people from seeking large-scale change. My slogan for this is "Big problems require big solutions".

This means that it's unhelpful to say that, e.g., everyone who wants regulation of activities that Company X does has to first purge themselves of all association with Company X. In many cases a system arises which makes such purges difficult or impossible. As an extreme, if someone lives in an area with few places to get food, they may be forced to patronize a grocery store even if they know that company is evil. Part of "big solutions" means replacing the bad ways of doing things with new things, rather than saying that we first have to get rid of the bad things to get some kind of clean slate before we can build new good things.

Re: Google drops pledge not to use AI for weapons or surveillance

#86
post #2

I initially thought that this was an announcement for a new pledge and thought, "they're going to forget about this the moment it's convenient." Then I read the article and realized, "Oh, it's already convenient." Google is a megacorp, and while megacorps aren't fundamentally "evil" (for some definitions of evil), they are fundamentally unconcerned with goodness or morality, and any appearance that they are is purely…

What is Googs going to do, leave money on the table? And if Googs doesn't do it, someone else will, so it might as well be them that makes money for their shareholders. Technically, couldn't activist shareholders come together and claim by not going after this market the leadership should be replaced for those that would? After all, share prices is the only metric that matters

I don't buy that argument. There are things Google does better than competitors, so them doing an evil thing means they are doing it better. Also, they could be spending those resources on something less evil.

Re: Google drops pledge not to use AI for weapons or surveillance

#88
post #79

Earlier quoted context omitted.

What is Googs going to do, leave money on the table? And if Googs doesn't do it, someone else will, so it might as well be them that makes money for their shareholders. Technically, couldn't activist shareholders come together and claim by not going after this market the leadership should be replaced for those that would? After all, share prices is the only metric that matters

So "if I don't steal it someone else will"? I'd rate that as evil.

Maybe it's more like "If I don't do this job, someone else will"...

Re: Google drops pledge not to use AI for weapons or surveillance

#89
post #27

One of my chief worries about LLMs for intelligence agencies is the ability to scale textual analysis. Previously there at least had to be an agent taking an interest in you; today an LLM could theoretically read all text you've ever touched and flag anything from legal violations to political sentiments.

This has already been possible long before LLMs came along. I also doubt that an LLM is the best tool for this at scale, if you're talking about sifting through billions of messages it gets too expensive very fast.

LLMs can do more than whatever we had before. Sentiment analysis and keyword searches only worked so well; LLMs understand meaning and intent. Cost and scale are not bottlenecks for long.
Post reply on HN