Seems Chat-GPT3 (free edition) is already feeling the heat:
"Currently we are receiving more requests than we are are comfortable with! To try your request again, come back in a short while and reload this page."
Pause Giant AI Experiments: An Open Letter
831–840 of 1001 posts
Re: Pause Giant AI Experiments: An Open Letter
#832Earlier quoted context omitted.
>It's likely the planet will become hostile to (human) life long before AI will be able to do us any harm. Sure, because the planet is already hostile. However, AI could potentially do much more harm much more quickly if we're not careful. In the pessimistic scenario we could all be dead in 10 years from now due to AI or experience a modern society ending event literally tomorrow. Climate change never posed such an i…
Sorry, how exactly is AI supposed to do that? Unless somebody has already built Skynet and is planning to give it the nuclear codes?
We already have several instances where social media was used to feed fake information and agitate people into rioting or acts of violence.
Imagine what would happen if we have these LLM tools, that aid in improving the story telling experience and generate and act as different personas. Having tools that can pretend to be a human even in limited capacity is quite dangerous.
Re: Pause Giant AI Experiments: An Open Letter
#833Earlier quoted context omitted.
> Climate change mitigation, which more closely resembles AI safety in both complexity and (lack of) barriers to entry, has been sporadic, inconsistent, and only enacted to the extent... Climate change mitigation is the perfect example. Nobody is doing anything, nobody seems to care, everyone cheats with ridiculous carbon credits or carbon offset vouchers made out of thin air, etc. It's likely the planet will become…
>It's likely the planet will become hostile to (human) life long before AI will be able to do us any harm. Sure, because the planet is already hostile. However, AI could potentially do much more harm much more quickly if we're not careful. In the pessimistic scenario we could all be dead in 10 years from now due to AI or experience a modern society ending event literally tomorrow. Climate change never posed such an i…
Do you really think china and other hostile countries will halt anything because Elon Musk, Steve Wozniak and some other guys signed a letter? Also what about Musks tesla itself they are using AI for FSD and no one bats an eye
Re: Pause Giant AI Experiments: An Open Letter
#834Earlier quoted context omitted.
>It's likely the planet will become hostile to (human) life long before AI will be able to do us any harm. Sure, because the planet is already hostile. However, AI could potentially do much more harm much more quickly if we're not careful. In the pessimistic scenario we could all be dead in 10 years from now due to AI or experience a modern society ending event literally tomorrow. Climate change never posed such an i…
Sorry, how exactly is AI supposed to do that? Unless somebody has already built Skynet and is planning to give it the nuclear codes?
If it has access to the internet (it more or less has) and its able to convincingly engage in conversation sounding like anyone in text or voice or video (it more or less can), it’s as able to contact people and convince them to do things as a human would be. From what I see of ChatGPT I would be surprised if the tech could do all that successfully enough at this stage, but in principle I don’t see why it wouldn’t be able to do quite a lot of scary things if for some reason it decided that was the right thing to do.
Re: Pause Giant AI Experiments: An Open Letter
#835Earlier quoted context omitted.
>It's likely the planet will become hostile to (human) life long before AI will be able to do us any harm. Sure, because the planet is already hostile. However, AI could potentially do much more harm much more quickly if we're not careful. In the pessimistic scenario we could all be dead in 10 years from now due to AI or experience a modern society ending event literally tomorrow. Climate change never posed such an i…
Do you really think china and other hostile countries will halt anything because Elon Musk, Steve Wozniak and some other guys signed a letter? Also what about Musks tesla itself they are using AI for FSD and no one bats an eye
Did you read the actual letter? It specifically calls out AI that is "more advanced than GPT-4"
Re: Pause Giant AI Experiments: An Open Letter
#836Best response to the current "AI" fad driven fear I've seen so far (not my words): These AI tools cannot do things. They create text (or images or code or what-have-you) in response to prompts. And that's it! It is impressive, and it is clearly passing the Turing Test to some degree, because people are confusing the apparent intelligence behind these outputs with a combination of actual intelligence and "will." Not o…
I agree that LLMs are not a threat to humanity, since they are trying to output text and not actually change the world, and even giving them agency via plugins is probably not going to lead to ruin because there's no real reason to believe that an LLM will try to "escape the box" in any meaningful sense. It just predicts text.
However, it's possible that in a few years we'll have models that are directly trying to influence the world, and possess the sort of intelligence that GPT has proven is possible. We should be very careful about proceeding in this space.
Re: Pause Giant AI Experiments: An Open Letter
#837Earlier quoted context omitted.
> To get this to work we need a far smarter entity with no physical limitations to still want us around... Why would an AI based on LLMs as we see today "want" or "not want" anything? It doesn't have the capacity to "want". We seem to imagine that "wanting" is something that will just emerge somehow, but I've seen no logical explanation for how that might work... I mean, we don't need to fully understand how the LLM…
One of this videos I watched explained it like this. “You can’t get a coffee if you’re dead”. To fulfill _any_ obligation a model might have then that model must survive. Therefore if a model gets to the point that it realizes this then surviving is a precursor to fulfilling its obligations. It doesn’t have to “want” or have “feelings” in order to seek power or destructive activities. It just has to see it as its pat…
One need only look at other NGIs (natural general intelligences) to see that this is obviously not true. Plenty of animals kill themselves to beget offspring (for two short examples, all sorts of male insects and arachnids are eaten while mating; octopuses and various other cephalopods die after caring for their young), or just to protect others in their group (bees and ants are some of the most common in this area, but many mammals are also willing to fight for their group). Humans throughout history have sacrificed themselves knowingly to help others or even for various other goals.
Re: Pause Giant AI Experiments: An Open Letter
#838Earlier quoted context omitted.
AI alignment is a philosophy problem, not an engineering one. For alignment to happen, we have to agree what it means. Given we have a hard enough time getting humans to “align”, I can’t imagine any successful attempt at alignment sort of complete castration.
Are there degrees of alignment? I'd like to think there's a pretty big range in there between made some decisions I didn't love and destroyed the world and everyone on it .
Re: Pause Giant AI Experiments: An Open Letter
#839Earlier quoted context omitted.
You already need authorization to rent A100s from cloud providers. There are, at most, four entities to control post-CHIPS act: Amazon, Microsoft, Google, and NVIDIA. Good news, they’re all American companies.
You can buy an A100 on eBay right now. If I had a few hundred grand I could have an A100 x8 box delivered to my house tomorrow.
You could probably run a model but not train a new one, especially one bigger than GPT-4. You'd need ten of thousand of A100 as a rough estimate.
Re: Pause Giant AI Experiments: An Open Letter
#840I love how OpenAI went from being open to being ProprietaryAI and a suppervillain