From seeing AI beating humans handily in chess, I just can’t bet against it understanding most subjects better than humans. This isn’t even AGI, it’s just piecing data already on the net and have it ready. Chatgpt isn’t there yet but it’s a major proof of concept
ChatGPT and the AI Apocalypse
41–50 of 104 posts
Re: ChatGPT and the AI Apocalypse
#42> Roger Penrose wrote a very complex book The Emperors New Mind, which says that consciousness cannot arise in our computers, because consciousness cannot be "computed" using our computing methods.
The blog drops this as a matter of fact. Not so!
Yes, Penrose wrote that book, and suggests those things. But mainstream science is not taking Penrose's "quantum consciousness" theories seriously at all:
https://en.wikipedia.org/wiki/Penrose%E2%80%93Lucas_argument...
https://en.wikipedia.org/wiki/Shadows_of_the_Mind#Criticism
https://en.wikipedia.org/wiki/Orchestrated_objective_reducti...
Re: ChatGPT and the AI Apocalypse
#43This post seems to go a long way to make the following point: > So as I see it, the threat of modern AIs isn't them becoming self-aware and going rogue and deciding to kill humanity. Rather, I fear it will be put into critical positions and will start making stupid decisions that are harmful to humans or humanity. Yep, that's almost certainly the case. AI will be put in charge of "boring" decisions, but will have no…
> Uber's surge pricing algorithm caused prices to skyrocket in the middle of emergencies like shootings. [1] Not trying to defend corporations benefitting from tragedies, but isn't this just how a market works usually? There are only so many Uber drivers, you either get surge pricing or just no taxis are available (and scared people refreshing their phones in hope somebody picks up their ride instead of just deciding…
If Uber didn't surge-price during emergencies, the Uber drivers wouldn't disappear. Instead, a random selection of people would get an Uber - about as many as with surge pricing, probably - and the rest would see that they weren't available.
It's the randomness that makes it feel fair and prevents us from saving people based on their material wealth.
Re: ChatGPT and the AI Apocalypse
#44I really think the fact that these chatbots have been made public and are being given such high-profile treatment is a really positive thing for AI safety. The public results thus far have created some real skepticism of AI, which is one of the best safeguards we can have. If ChatGPT was 98% accurate and Bing didn't threaten users, people might just readily embrace it and not notice inaccuracies that would lead to se…
>Instead, we're starting from a place of societal distrust, which is probably more helpful in preventing rogue AI than a lot of technical solutions would be. A confounding factor for AI's success would be a scientific replication crisis occurring in the papers used to counter social distrust. Once we get past the sensational headline phase, that's what you've really got to watch out for.
I don't think scientific papers are nearly as relevant as headlines. Most of society isn't trying to get a deep understanding of how things work, they're just seeing Sydney threaten people and judging based on that.
Re: ChatGPT and the AI Apocalypse
#45Earlier quoted context omitted.
> This technology will kill all digital information exchange. This is a bit hyperbolic. We have strong encryption like PGP for media like email (although I suppose getting people to use it is the issue), and there will be plenty of incentive to develop other tech to counter the problems you mentioned.
PGP tells you you're talking to an entity which could set up PGP, it doesn't help you determine if the account ben_w is merely one of many government sock puppet accounts trying to push a specific meme into the minds of the general population. Knowing who to trust… was already hard-to-impossible with just normal social media; cheap LLMs will definitely make this harder, as more groups will be able to afford what was…
I was referring to PGP as a solution for being potentially MITM’d by an AI when trying to communicate with an entity you already trust.
Re: ChatGPT and the AI Apocalypse
#46Earlier quoted context omitted.
> This technology will kill all digital information exchange. This is a bit hyperbolic. We have strong encryption like PGP for media like email (although I suppose getting people to use it is the issue), and there will be plenty of incentive to develop other tech to counter the problems you mentioned.
PGP tells you you're talking to an entity which could set up PGP, it doesn't help you determine if the account ben_w is merely one of many government sock puppet accounts trying to push a specific meme into the minds of the general population. Knowing who to trust… was already hard-to-impossible with just normal social media; cheap LLMs will definitely make this harder, as more groups will be able to afford what was…
So we need to go back to talking to people irl. And basically assume that anything you read online is not written by real people unless proven otherwise.
Re: ChatGPT and the AI Apocalypse
#47This article is weird. It takes examples from science fiction, and makes them as plausible cases as to what an AI could do in the future. These kind of things need to stop. This analogy of Blindsight tries to prove a point by association, and create a sort of fear, the negative case which has no basis in reality[1]. Granted it calls them baseless towards the end, but there is a very clear analogy to be made. Ideally,…
I don't read that as necessarily meaning the president or political power. There are a lot of decision making processes people are already trying to offload to language models or other black box AI products. Things like hiring, medical diagnoses, insurance claims, etc.
There is good reason to be concerned about the potential societal consequences of deploying this at scale while AI explainability, training data bias, and alignment remain unresolved.
Re: ChatGPT and the AI Apocalypse
#48Earlier quoted context omitted.
> Uber's surge pricing algorithm caused prices to skyrocket in the middle of emergencies like shootings. [1] Not trying to defend corporations benefitting from tragedies, but isn't this just how a market works usually? There are only so many Uber drivers, you either get surge pricing or just no taxis are available (and scared people refreshing their phones in hope somebody picks up their ride instead of just deciding…
If Uber didn't surge-price during emergencies, the Uber drivers wouldn't disappear. Instead, a random selection of people would get an Uber - about as many as with surge pricing, probably - and the rest would see that they weren't available. It's the randomness that makes it feel fair and prevents us from saving people based on their material wealth.
> If Uber didn't surge-price during emergencies, the Uber drivers wouldn't disappear.
They would disappear from Uber if they could negotiate a much better price on the curbside.
Re: ChatGPT and the AI Apocalypse
#49This is mostly my point of view as well. With all the talk of AGI, the immediate threat is real and it is primitive AI. I suspect that primitive AI might becomes so self destructive to society that we never reach AGI. We are already approaching a point in time of unverifiable reality and truth. This is going to be very destabilizing to society. Another in depth view of the possible issues that may arrive even before…
> approaching a point in time of unverifiable reality and truth Malicious groups spreading misinformation to destabilize society has been a thing since at least the ancient Greeks. Unverifiable reality has been the topic of religious debate for centuries as well. The recent language models are cool but they are not better at lying than humans.
Bullshit asymmetry theory asks the question of 'is quantity a quality of its own'
Way back when those Greeks that were misinforming you had to eat sleep and shit at some point. You're making a statement about current language models while the tech industry is rapidly grinding away at making newer better models and applying an ever expanding amount of compute resources for it to run on. What are the limits here, how many misinformation bots can exist in this environment? Welcome to the 'dead internet prophecy'.
Re: ChatGPT and the AI Apocalypse
#50This is mostly my point of view as well. With all the talk of AGI, the immediate threat is real and it is primitive AI. I suspect that primitive AI might becomes so self destructive to society that we never reach AGI. We are already approaching a point in time of unverifiable reality and truth. This is going to be very destabilizing to society. Another in depth view of the possible issues that may arrive even before…
> approaching a point in time of unverifiable reality and truth Malicious groups spreading misinformation to destabilize society has been a thing since at least the ancient Greeks. Unverifiable reality has been the topic of religious debate for centuries as well. The recent language models are cool but they are not better at lying than humans.
They substantially lower the costs of generating and distributing misinformation. They also enable use cases like individualized misinformation like never before.
I totally disagree with you.