OpenAI Charter
blog.openai.com
OpenAI Charter
1–10 of 183 posts
Re: OpenAI Charter
#2>>"We are committed to providing public goods that help society navigate the path to AGI. Today this includes publishing most of our AI research, but we expect that _safety and security concerns will reduce our traditional publishing in the future_, while increasing the importance of sharing safety, policy, and standards research."
This seems like the key disclosure statement. I never reconciled how sharing A[G]I techniques with the general public increases AI safety in the long-term; now we know OpenAI has also come to the same conclusion.
Re: OpenAI Charter
#3The word 'ethic' doesn't appear in this document.
Re: OpenAI Charter
#4The word 'ethic' doesn't appear in this document.
This is a phrasing nitpick; the contents clearly say that they intend to act ethically, and say things about what they think acting ethically means. For example this paragraph:
> We commit to use any influence we obtain over AGI’s deployment to ensure it is used for the benefit of all, and to avoid enabling uses of AI or AGI that harm humanity or unduly concentrate power.
Re: OpenAI Charter
#5They didn't even mention several contingencies that, given the rest of the document, should certainly have been addressed:
1) Will they cooperate with aliens who offer humans AGI?
2) If a time traveler hands them AGI invented in the future, will they destroy it?
3) Do they support or oppose human/AGI marriage? How will they respond if one of their employees falls in love with an AGI and they plan to elope?
Also, in the unlikely event that AGI is some years away and in the meantime they come up with some statistical regression algorithms (what's known as state-of-the-art AI today, without the G, I guess), how do they address the harmful effects these algorithms already have on society?
This document does, however, make it clear that what we have to fear is not machine intelligence.
I am currently working on a fusion hyperdrive, and my charter (work in progress) is already shaping up to be far more comprehensive. They're phoning it in.
Re: OpenAI Charter
#6>> "We are committed to providing public goods that help society navigate the path to AGI. Today this includes publishing most of our AI research, but we expect that _safety and security concerns will reduce our traditional publishing in the future_, while increasing the importance of sharing safety, policy, and standards research." This seems like the key disclosure statement. I never reconciled how sharing A[G]I te…
To me this doesn't mean "Sharing traditional AI research is dangerous," but rather "Our efforts may be best spent on less popular topics such as safety, policy, and standards research, so you may see us do less traditional AI research." This seems in line with their stated goals around safety.
Re: OpenAI Charter
#7The word 'ethic' doesn't appear in this document.
This is a phrasing nitpick; the contents clearly say that they intend to act ethically, and say things about what they think acting ethically means. For example this paragraph: > We commit to use any influence we obtain over AGI’s deployment to ensure it is used for the benefit of all, and to avoid enabling uses of AI or AGI that harm humanity or unduly concentrate power.
I'll grant that it was a nitpick and they describe an ethics.
But I don't think I'm alone in being awfully tired of tech companies that talk about the benefit of all then sell our personal data or make military robots or manipulate our news. Where's the meat behind these promises and where's the accountability for not avoiding uses of AI that harm humanity?
Re: OpenAI Charter
#8They didn't even mention several contingencies that, given the rest of the document, should certainly have been addressed: 1) Will they cooperate with aliens who offer humans AGI? 2) If a time traveler hands them AGI invented in the future, will they destroy it? 3) Do they support or oppose human/AGI marriage? How will they respond if one of their employees falls in love with an AGI and they plan to elope? Also, in t…
C'mon, we "fail fast" around here, no time for your "waterfall" nonsense.
Re: OpenAI Charter
#9>> "We are committed to providing public goods that help society navigate the path to AGI. Today this includes publishing most of our AI research, but we expect that _safety and security concerns will reduce our traditional publishing in the future_, while increasing the importance of sharing safety, policy, and standards research." This seems like the key disclosure statement. I never reconciled how sharing A[G]I te…
To me this doesn't mean "Sharing traditional AI research is dangerous," but rather "Our efforts may be best spent on less popular topics such as safety, policy, and standards research, so you may see us do less traditional AI research." This seems in line with their stated goals around safety.
I interpret it as saying that they don't think sharing current AI research is dangerous, but they're keeping the option of withholding research open in anticipation of the possibility that could change.
(This is what I and others argued they should do in 2015: https://conceptspacecartography.com/openai-should-hold-off-o... )
Re: OpenAI Charter
#10Earlier quoted context omitted.
This is a phrasing nitpick; the contents clearly say that they intend to act ethically, and say things about what they think acting ethically means. For example this paragraph: > We commit to use any influence we obtain over AGI’s deployment to ensure it is used for the benefit of all, and to avoid enabling uses of AI or AGI that harm humanity or unduly concentrate power.
I'll grant that it was a nitpick and they describe an ethics. But I don't think I'm alone in being awfully tired of tech companies that talk about the benefit of all then sell our personal data or make military robots or manipulate our news. Where's the meat behind these promises and where's the accountability for not avoiding uses of AI that harm humanity?
Tech companies often find that profit incentives undermine the good intentions they started with. Fortunately, OpenAI is a nonprofit organization; it has no personal data to sell and no shady contracting jobs to turn away. That certainly doesn't fully immunize them from wrongdoing, but it should make it easier.