Live data from Hacker News

Microsoft president: Orwell’s 1984 could happen in 2024

bbc.co.uk

101–110 of 182 posts

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#101
post #54
post #23

Earlier quoted context omitted.

I recommend reading Curtis Yarvin's recent writing on this exact topic [1]. [1]: https://graymirror.substack.com/p/there-is-no-ai-risk

I find his arguments very difficult to square with this article from 2015[1]. The prologue of [2] also paints a pretty compelling picture of how this might happen. Also > We don’t live in the world of Neuromancer and we never will. 99.9% of everything is mathematically invulnerable to hacking. Seriously made me chuckle. [1]: https://slatestarcodex.com/2015/04/07/no-physical-substrate-... [2]: https://www.amazon.com/L…

> Seriously made me chuckle.

Yea, assuming someone had enough resources to create a powerful AI, they would also have enough resources for a hefty collection of unreleased 0days...

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#102

I think it's important to note here that new technologies that have the potential for oppression can be used not only by authoritarian governments but by liberal-democratic ones as well (see: CIA programs, Snowden leaks, etc) and private companies.

Authoritarianism and democracy are not mutually exclusive.

Authoritarianism does imply reductions in democratic voting.

Democracy and the erosion of human rights are not mutually exclusive, which may be what you meant.

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#103

Earlier quoted context omitted.

AI is as much a threat to democracy as the newspaper is - they eventually become the only means of input and politicians adapt to catering to them so that they can remain on a level playing field in terms of getting their policies and (potentially sensational) messages to people.

The issue is that AI is going to make it even more economical to bombard your target with coherent information through an extremely effective means of influence (writing). Have you seen some of the posts recently about AIs getting better at writing?: https://news.ycombinator.com/item?id=27032828 It’s much more of a threat than a bogus newspaper. I can imagine a future where the signal is even more drowned out by nois…

It's not just bots writing articles, there are already bots posting in online forums. Most people tend to align with the predominant opinion, and these commenter bots make it seem like the public opinion goes a certain way when it doesn't. Bot-written articles might still have obvious tells, but can you tell if a two-sentence comment was written by a bot? No, you probably can't.

And of course, the next level of this is to tailor the articles you see, their content, and the response you get online specifically to you. Eventually, these systems will get progressively better and influencing your specific opinion. Social media giants can also affect things like which events you end up going to, the people you meet, who you end up in a relationship with, which jobs you apply to, etc. Soon it will be possible for corporations and governments to have sophisticated, subtle, relatively fine-grained influence over your life and that of your friends. You'd better hope Google and Facebook view your success and emotional well-being as good for their profits, otherwise, they could try to optimize your life for different outcomes.

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#104

My personal version of 1984 is someone smashing random quotes from 1984 into my face, forever. Has nobody seriously read another book in the last few decades? And Microsoft's president even gives us a stereotypically shoddy reading of the book > "You know the fundamental story…was about a government who could see everything that everyone did and hear everything that everyone said all the time. " The actually interest…

And the issue is not limited to governments. The person being interviewed in the article belongs to the most credible current real threat: giga-corporations. While Microsoft haven’t made it to the news recently, Twitter censorship is totally in line with was is depicted in the book. The ability to control information at large level from a few entities, that happens to all push the same ideology, is very worrying, much more than a buzzword or two related to hyperparameters tuning.

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#105
post #65

Earlier quoted context omitted.

I personally believe we crossed that Rubicon once we granted the play store our vaccination status, contact tracing strangers etc. That was the undeniable shift towards hard totalitarianism.

Um, clearly it's not undeniable, because I deny it. What precisely scares you so much about vaccination status being somewhat public? There's precisely zero threat to any real liberties there. And it's laughable to call this "hard totalitarianism". As an aside, this didn't even happen, of course; we didn't "grant the play store our vaccination status". Never happened.

Because it's practically being used to restrict travel, employment and access to many things.

What if you've already developed immunity through infection? Why should you be forced into it?

This received emergency authorisation when public debate on the matter was heavily censored through government and big tech partnerships and complicit centralized media outlets.

If treatments with drugs like invermectin were given a fair consideration then it's likely these vaccines couldn't have been authorised under the emergency use protocols. More on this here: https://www.nakedcapitalism.com/2021/05/i-dont-know-of-a-big...

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#106

My personal version of 1984 is someone smashing random quotes from 1984 into my face, forever. Has nobody seriously read another book in the last few decades? And Microsoft's president even gives us a stereotypically shoddy reading of the book > "You know the fundamental story…was about a government who could see everything that everyone did and hear everything that everyone said all the time. " The actually interest…

Doesn’t require A, but the I is absolutely required, intelligence is what the Stasi did. Automating what we know is a dangerous policy should not be treated as lightly as you’ve put it just because you are bored of people quoting 1984 to you. Have you considered the reason they are quoting it more and more lately might be because real life has been getting closer and closer to it?

Agree to an extent, but people are throwing it around in the context of vaccine passports and other state actions that are pretty reasonable.

Frankly the tossing around of 1984 has degraded discourse because its used way too much and often ignores nuance in favor of a slippery slope argument.

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#107

My personal version of 1984 is someone smashing random quotes from 1984 into my face, forever. Has nobody seriously read another book in the last few decades? And Microsoft's president even gives us a stereotypically shoddy reading of the book > "You know the fundamental story…was about a government who could see everything that everyone did and hear everything that everyone said all the time. " The actually interest…

I think the stasi world was actually more terrifying than an AI eye in the sky.

Because you couldn't trust anyone, not your friends or family. Everyone was part of a big network out to get you, so you were sort of locked in your own head.

The more realistic fear for me is ending up in a cyberpunk dystopia where the world is run by 3-4 big corporations. Which is ofc not something they like to bring up.

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#108
post #53

(It's already happening in current times;) China recently made a movie star apologize in public, to say effectively, 'Taiwan is not a country'. I don't care what the name is, but that island just a little bit off the coast of the big country known as China, should be recognized by the UN and member nations as a sovereign nation.

I think you're seriously underestimating how many Chinese people -- not just the government -- will get seriously pissed off at someone who proclaims that Taiwan should be its own independent country.

There's a saying that if China's government is democratic, then they would've launched an invasion yesterday.

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#109

My personal version of 1984 is someone smashing random quotes from 1984 into my face, forever. Has nobody seriously read another book in the last few decades? And Microsoft's president even gives us a stereotypically shoddy reading of the book > "You know the fundamental story…was about a government who could see everything that everyone did and hear everything that everyone said all the time. " The actually interest…

I think the stasi world was actually more terrifying than an AI eye in the sky. Because you couldn't trust anyone, not your friends or family. Everyone was part of a big network out to get you, so you were sort of locked in your own head. The more realistic fear for me is ending up in a cyberpunk dystopia where the world is run by 3-4 big corporations. Which is ofc not something they like to bring up.

Consider reading "To Destroy You Is No Loss". It's the only book to have ever made me cry while reading it. It's a true first hand account of the genocide in Cambodia in the 60s. I read it after having read 1984, and I could not help but pick up on the parallels. There was no AI technology, but it reminded me of what you said: "Everyone was part of a big network out to get you"

Re: Microsoft president: Orwell’s 1984 could happen in 2024

#110
Would supposedly intelligent people stop talking about 'AI' in this way? It's not, that, special, it's mostly just tech

Our laws, freedoms, responsibilities, civic attitudes, judiciary, journalistic institutions, governance - all of this is what establishes what we are going to be. Not 'tech'.

Tech does provide 'means not before possible' but it's our choice, and it's not really a story of AI.

Post reply on HN