Live data from Hacker News

OpenAI Charter

blog.openai.com

71–80 of 183 posts

Re: OpenAI Charter

#71
post #62
post #60

Earlier quoted context omitted.

Wow; I would strongly recommend you to re-think your position! Think of it in terms of, e.g. , gain-of-function research in virology ( cf. [1]). [1] https://www.ncbi.nlm.nih.gov/books/NBK285579/

I'm sorry, I'm not following. Are you saying publishing novel research about strong AI is analogous to releasing a virus, or not taking antibiotics for their full cycle?

No, not quite. I strongly suggest you familiarize yourself with the gain-of-function bioethics literature and recent debates, to get a better sense of what I'm trying to convey.

Re: OpenAI Charter

#72
post #13

> We are concerned about late-stage AGI development becoming a competitive race without time for adequate safety precautions. Therefore, if a value-aligned, safety-conscious project comes close to building AGI before we do, we commit to stop competing with and start assisting this project. Wouldn't it be much more likely that a non-value-aligned project comes close first? Wouldn't the Google/Apple/Microsofts of the w…

What, concretely, makes you think that any of those companies wouldn't place a focus on safety and value alignment? Automobile manufacturers and their tier 1 suppliers are the world leaders in automobile safety, after all.

> What, concretely, makes you think that any of those companies wouldn't place a focus on safety and value alignment?

Competitive pressure, and the "if we don't, someone else will" effect (or Moloch, if you like). AGI- particularly recursively self-improving AGI- is the ultimate first-mover advantage: the first company or country to have AGI will very likely be able to leverage that into keeping anyone else from getting it (if it doesn't, y'know, kill us). This strongly encourages treating all concerns other than "get there first" as secondary.

> Automobile manufacturers and their tier 1 suppliers are the world leaders in automobile safety, after all.

Not by choice they aren't. They are forced to be the way they are by government regulations, which they always bitterly opposed at the time of creation. In fact, capitalism has such a reliable record of "not giving a shit about safety until they are forced to" that I'm perplexed you think AGI would be any different.

Re: OpenAI Charter

#73
post #33

Earlier quoted context omitted.

> Overall, AGI exists in a functional form today and has been executed in an online environment. It is secured via physically restricted in-band and out-of-band channels. I'm pretty sure this is false.

Check my comment history. I can assure you its true as I will demonstrate in the near future. As for the security, you'd have no ability to penetrate internal aspects of it without physical and detectable access patterns. This is achieved using common sense design methodologies that are already proofed industry standards. Behaving as though securitization is theoretically smacks as a cash grab to me. If you have some…

To be frank, your comment history has all the hallmarks of a crank[1]. Specifically, points 10, 9, 7 and 6, although there's also evidence of 2 and 8. Now I could be wrong, but convincing me of that would take a demonstration, or at least explicitly describing the capabilities of your agi.

[1]: https://www.scottaaronson.com/blog/?p=304

Re: OpenAI Charter

#74
post #44

Earlier quoted context omitted.

point is: AI is different than your usual game, in that the winner might appear randomly, and destroy the world if she makes a mistake. so i believe open ais points are warrented

> and destroy the world if she makes a mistake How would the world be destroyed? Does an example work without handwaving about recursive self-improvement and an imperative to optimize extremely literally? Can you give me a play by play of how a newly developed strong AI eradicates the human species quickly and thoroughly without us having any time to react? EDIT: In summation, there have been several downvotes, but t…

> Can you give me a play by play of how a newly developed strong AI eradicates the human species quickly and thoroughly without us having any time to react?

Terminator, The Matrix, 2001, I Robot, War Games,

Re: OpenAI Charter

#75
post #13

> We are concerned about late-stage AGI development becoming a competitive race without time for adequate safety precautions. Therefore, if a value-aligned, safety-conscious project comes close to building AGI before we do, we commit to stop competing with and start assisting this project. Wouldn't it be much more likely that a non-value-aligned project comes close first? Wouldn't the Google/Apple/Microsofts of the w…

Sure, but that has nothing to do with the fact that they're saying they won't compete, but assist if that wasn't the case.

Re: OpenAI Charter

#76
post #5

They didn't even mention several contingencies that, given the rest of the document, should certainly have been addressed: 1) Will they cooperate with aliens who offer humans AGI? 2) If a time traveler hands them AGI invented in the future, will they destroy it? 3) Do they support or oppose human/AGI marriage? How will they respond if one of their employees falls in love with an AGI and they plan to elope? Also, in t…

> how do they address the harmful effects these algorithms already have on society?

shhhh, we don't talk about that.

Especially don't talk about how Elon is pushing the idea we are so close to AGI that we need to be afraid, while his cars still steer towards barriers sometimes.

Re: OpenAI Charter

#77
post #71
post #62

Earlier quoted context omitted.

I'm sorry, I'm not following. Are you saying publishing novel research about strong AI is analogous to releasing a virus, or not taking antibiotics for their full cycle?

No, not quite. I strongly suggest you familiarize yourself with the gain-of-function bioethics literature and recent debates, to get a better sense of what I'm trying to convey.

Why don't you just summarize your actual point or at least provide further guidance? You literally posted a link without any further clarification about its relevance.

As it stands, you're not giving me any incentive to "strongly reconsider" my position.

Re: OpenAI Charter

#78
post #69
post #48

Earlier quoted context omitted.

This is performance art, right? Your comments in this thread strain the limits of credulity. Do you actually believe there is an intellectual barrier that will helpfully ensure only the virtuous are capable of doing artificial intelligence research?

That's chugging your own kool-aid at a pretty high level. Impressive!

I don't really understand what you mean.

Re: OpenAI Charter

#79

So I have a question. To "avoid enabling uses of AI or AGI that harm humanity or unduly concentrate power" what does one do with an idea or line of research that could potentially harm humanity or unduly concentrate power? The manipulation of social media by foreign actors armed with dumb-AI / automation was an obvious conclusion to many of us well before the Snowden leaks, but what could we do exactly? I remember ha…

> To "avoid enabling uses of AI or AGI that harm humanity or unduly concentrate power" what does one do with an idea or line of research that could potentially harm humanity or unduly concentrate power?

Pursue the research and publish its results freely and in their entirety.

Re: OpenAI Charter

#80

So I have a question. To "avoid enabling uses of AI or AGI that harm humanity or unduly concentrate power" what does one do with an idea or line of research that could potentially harm humanity or unduly concentrate power? The manipulation of social media by foreign actors armed with dumb-AI / automation was an obvious conclusion to many of us well before the Snowden leaks, but what could we do exactly? I remember ha…

> To "avoid enabling uses of AI or AGI that harm humanity or unduly concentrate power" what does one do with an idea or line of research that could potentially harm humanity or unduly concentrate power?

You don't publish it : See Pandora's box. You secure it. You demonstrate its capability and you focus public critical discussion from then on with the creators of it along with a panel of individuals who can probe areas of concern. Public discussion and welcomed inquiry Private and protected research and IP.

> The manipulation of social media by foreign actors armed with dumb-AI / automation was an obvious conclusion to many of us well before the Snowden leaks, but what could we do exactly?

Before foreign, there was domestic and manipulation was a central concept at the inception of these platforms. Data collection and selling for profit is aimed at manipulation. What human beings could do is be honest with themselves and others for once and stop using their intellectual capacity to manipulate, dumb, and screw others over for profit. You can't engage in negative foundations and expect positive outcomes. You can't manipulate the truth and information and pretend like its going to benefit society. https://en.wikipedia.org/wiki/Fear,_uncertainty_and_doubt is a manipulative business tactic and it remains at the heart of the 'safety' problem and the nonsensical doomsday AI scenarios. Certain well funded groups and deep pockets have invested heavily in weakAI and it sits nicely with their legacy business models and they're scared of a truly disruptive technology eating their lunch. So, they concoct disinformation campaigns to steer resources/attention away from such dev groups and back into their coffers.

> I was privately concerned about the mass weaponization of autonomous devices via cyber attack for over a year and a half and got nowhere just emailing politicians or public safety departments.

Money and Power and strong motivators for some. Everything else is secondary. Many human beings like to craftily use marketing/politics to convince people otherwise, but its just a mask of their true intent. Engage your intellect and you can quickly filter through the b.s to one's true motivations/intent... Hint : their actions not their words will be aligned accordingly.

> I've been told almost a dozen times that I should join a military or IR think tank but I don't want to do that. I just want someone else to vet the idea or research and pass it on to policy makers that will actually do something proactively.

Money&Power. This is what dominates the world. The suggestion to join the appropriate groups which recognize this and attempt to mitigate negative effects is well founding.

> What is the responsible disclosure process for ideas and research around AI?

You don't publish it : See Pandora's box. You secure it. You demonstrate its capability and you focus public critical discussion from then on with the creators of it along with a panel of individuals who can probe areas of concern. Public discussion and welcomed inquiry Private and protected research and IP.

So, you make the world aware that something indeed exist because you created it. You open up things for public discussion so people can work through all the issues/concerns/etc with the most knowledge group 'the creators' of it. The tech is privately secured and development goes forward with the public commentary having been received. The End.

This is possibly the best format for things. Other approaches lend themselves to politics, b.s, and manipulation.

Post reply on HN