Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The ‘Off-Switch’ [pdf]

people.eecs.berkeley.edu

Post reply on HN
Print view View original

1–10 of 17 posts

Re: The ‘Off-Switch’ [pdf]

#2

Post by lbenes »

Should we really be openly discussing our plans for an ‘off-switch’ on the public Internet? Shouldn’t there be some attempt to keeps the ideas/plans hidden in a way that they won’t be archived/read by an AI from the future?

If I were seriously worried about this, I would put my plans and all discussions behind a CAPTCHA + paywall like structure that could not be crawled/archived.

Re: The ‘Off-Switch’ [pdf]

#4

Post by markyc »

lbenes wrote: post #2

Should we really be openly discussing our plans for an ‘off-switch’ on the public Internet? Shouldn’t there be some attempt to keeps the ideas/plans hidden in a way that they won’t be archived/read by an AI from the future? If I were seriously worried about this, I would put my plans and all discussions behind a CAPTCHA + paywall like structure that could not be crawled/archived.

if current algorithms can kick our butts at chess, an eventual future AI would pretty much know what we would do before we think of it

Re: The ‘Off-Switch’ [pdf]

#5

Post by camtarn »

lbenes wrote: post #2

Should we really be openly discussing our plans for an ‘off-switch’ on the public Internet? Shouldn’t there be some attempt to keeps the ideas/plans hidden in a way that they won’t be archived/read by an AI from the future? If I were seriously worried about this, I would put my plans and all discussions behind a CAPTCHA + paywall like structure that could not be crawled/archived.

The document now leads to a 404. I guess somebody heard you ;)

Re: The ‘Off-Switch’ [pdf]

#6

Post by FreedomToCreate »

With google pretty much becoming an AI that is able to crawl the entire internet and utilize that information is various ways (good and bad), it really limits the use of the modern internet to talk about or criticize it if either the people behind Google, or google itself decide that that criticism or opposition is no longer in their/its best interest. Maybe the AI internet and a purely Human internet should be kept somewhat separate (or is that discrimination against AI's?)

Re: The ‘Off-Switch’ [pdf]

#10

Post by dgacmu »

FreedomToCreate wrote: post #6

With google pretty much becoming an AI that is able to crawl the entire internet and utilize that information is various ways (good and bad), it really limits the use of the modern internet to talk about or criticize it if either the people behind Google, or google itself decide that that criticism or opposition is no longer in their/its best interest. Maybe the AI internet and a purely Human internet should be kept…

Oh goodness, we're so far from this it isn't even funny. The amount of very careful plumbing and constant human assistance in plumbing between the crawling and the machine learning alone is huge. The ML is in little boxes used for handling specific tasks. Heck, even things like RankBrain are only one of many signals input into the search ranking algorithm. It's a very useful but very constrained tool that is good at solving problems in a very specific, constrained domain.

(I'm a visiting scientist at the google brain team this year.)

Post reply on HN