Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's Researchers: Protecting Against AI’s Existential Threat

wsj.com

Post reply on HN
Print view View original

61–62 of 62 posts

Re: OpenAI's Researchers: Protecting Against AI’s Existential Threat

#61

Post by astrofinch »

tlb wrote: post #50
cjbprime wrote: post #46

Earlier quoted context omitted.

Because I would think that they're currently making unsafe AI more likely rather than less likely, contradicting their stated goal.

How so? What should they do differently?

http://benjaminrosshoffman.com/openai-makes-humanity-less-sa...

Personally, I think making AI tech broadly available could be a bad idea if AI tech changes warfare so that offense works better than defense: https://news.ycombinator.com/item?id=10721621 (This is already true, but I think it's likely that further technological development will make it even more true.)

Re: OpenAI's Researchers: Protecting Against AI’s Existential Threat

#62

Post by erasmuse »

cjbprime wrote: post #19

There should be a word for this phenomenon where organizations are created to ameliorate a perceived risk, and then they do work that is unequivocally directly massively increasing that risk while writing articles that say that they feel kind of bad about the risk. o_O I'm not very worried about AI safety. But if I was, it'd be hard to think of groups like OpenAI as working on the same side.

Yes. We are irrational in rearing and educating human children for example.

Sandboxing. Is it like this?

http://www.ptaugustacsc.sa.edu.au/images/sandpit.jpg

Or like this?

https://s3.amazonaws.com/audreywatters/factory_counting.jpg

Yet such things are done by apparently good and nice people trying to work in the best interests of humanity. So how can we expect to somehow get it right in the case of an AGI without turning him into a resentful demon?

Post reply on HN