I agree that ChatGPT's ability to generate convincing arguments for complete BS is concerning. But I'm not convinced it's a clear negative, in the long run. Humans have been concocting convincing arguments for complete BS for millennia. Perhaps having non-humans generate such arguments will make humans less inclined to believe BS based on such arguments. Eventually AI's will be able to think logically, barring any catastrophes that prevent further improvements. And eventually, the AI alignment problem will either be solved or human civilization will fail in one way or another. In the meantime, things will be very strange, but not clearly better or worse.
ChatGPT Considered Harmful: Our Whole Society Is in Danger
11–19 of 19 posts
Re: ChatGPT Considered Harmful: Our Whole Society Is in Danger
#12ChatGPT, write a poem about "considered harmful" "Considered Harmful" A label too often placed, On thoughts and ideas unbraced, By those who fear the change it brings, And cling to what familiarity brings. But progress waits for none, And stagnation must be undone, For growth and evolution's sake, We must make the considered harmful, break. For every idea met with disdain, May hold the key to progress, attain, So let…
he's biased
Re: ChatGPT Considered Harmful: Our Whole Society Is in Danger
#13A bit of an overreaction. In time, ChatGPT will fade into obscurity like every other over-hyped AI offering.
I use it every day as my expert assistant in programming.
This will only get ever more useful.
Re: ChatGPT Considered Harmful: Our Whole Society Is in Danger
#14> Even the danger of nuclear energy is less harmful compared to ChatGPT because you still need many experts to build an atomic bomb or a very expensive power plant that potentially turns a large area unusable for thousands of years. It's not that we haven't had multiple incidents proving that point.
I'm sure the victims of nuclear weapons and accidents would very much like to disagree. Misinformation (which seems to be the most dangerous harm mentioned) is hardly comparable to these things, even taking into account the expertise needed to create a nuclear bomb or power plant.
Also, the author complains that in the past you could tell what was misinformation by identifying typos. Plenty of misinformation lacked misspellings and grammar mistakes before ChatGPT, and this very article contained a few of its own. If anything, this will stop people from relying on writing style as a way of verifying the validity of a statement (which is silly), and start using critical thinking to do so. In the end, this is the only way to ever find "the truth", especially in areas where you have no prior knowledge as the author worries about. People aren't helpless to good writing.
Re: ChatGPT Considered Harmful: Our Whole Society Is in Danger
#15I agree that ChatGPT's ability to generate convincing arguments for complete BS is concerning. But I'm not convinced it's a clear negative, in the long run. Humans have been concocting convincing arguments for complete BS for millennia. Perhaps having non-humans generate such arguments will make humans less inclined to believe BS based on such arguments. Eventually AI's will be able to think logically, barring any ca…
A problem I see is that humans are very susceptible to BS if it plays into their fears and biases (see: Hitler). The human mind seems pretty hackable and is exploited by people of power all the time. I'd wager that AI will become even better, more efficient and more precise at doing this.
Re: ChatGPT Considered Harmful: Our Whole Society Is in Danger
#16I agree that ChatGPT's ability to generate convincing arguments for complete BS is concerning. But I'm not convinced it's a clear negative, in the long run. Humans have been concocting convincing arguments for complete BS for millennia. Perhaps having non-humans generate such arguments will make humans less inclined to believe BS based on such arguments. Eventually AI's will be able to think logically, barring any ca…
The same technology used to write the bullshit will be used to spot it.
Re: ChatGPT Considered Harmful: Our Whole Society Is in Danger
#17I agree that ChatGPT's ability to generate convincing arguments for complete BS is concerning. But I'm not convinced it's a clear negative, in the long run. Humans have been concocting convincing arguments for complete BS for millennia. Perhaps having non-humans generate such arguments will make humans less inclined to believe BS based on such arguments. Eventually AI's will be able to think logically, barring any ca…
> But I'm not convinced it's a clear negative, in the long run. Humans have been concocting convincing arguments for complete BS for millennia. Perhaps having non-humans generate such arguments will make humans less inclined to believe BS based on such arguments. ... In the meantime, things will be very strange, but not clearly better or worse.
I think you're focusing on the wrong thing. It used to be expensive to concoct passable BS arguments, now it will be unbelievably cheap. The flood that enables could, for instance, block off the ability of constituents to communicate to their representatives. If a black-hat lobbyist can generate and sent 500 unique "constituent" letters a day to on representative, that representative will either be influenced by that BS or stop reading the letters altogether (because it's too much effort to try to sort them out).
I think what disinformation has taught us is that people isolate and disengage in the face of a torrent of BS, they don't engage more thoughtfully.
Re: ChatGPT Considered Harmful: Our Whole Society Is in Danger
#18Re: ChatGPT Considered Harmful: Our Whole Society Is in Danger
#19The AI superpersuaders are coming. There will be a market for AI depersuaders that will argue against the superpersuaders.