Viewing profile — robbensinger

The thing I'm pointing to is that there are certain (relatively) specialized tasks like 'par-human biotech innovation' that require more or less the same kind of thinking that you'…

Eliezer's Q was, "What is the least impressive milestone you feel very, very confident will not be achieved in the next 2 years?" It's true that "least" will make it harder to come…

I think there are two questions here: (1) "Is general intelligence even a thing you can invent? Like, is there a single set of faculties underlying humans' ability to build softwar…

I agree that "that's Pascal's wager!" isn't a reasonable response to someone arguing that, say, a 1% or 10% extinction risk is worth taking seriously. If you think the probability …

Speaking very roughly, fuzzy logic applies in cases where the degree of truth of a statement is in question. Logical uncertainty (about decidable sentences) applies in cases where …

Speaking as a MIRI employee, I can say that MIRI isn't trying to build AI that's mathematically provable to be safe. This misconception comes from the same place the "AI safety eng…

The problems aren't completely unprecedented (else we'd have basically no knowledge about them), but they become more severe in the scenarios Bostrom/Russell/etc. are talking about…

Stuart Russell (co-author of AI:MA, one of MIRI's research advisors) argues on http://edge.org/conversation/the-myth-of-ai#26015 that AI systems with "the ability to make high-qual…

I replied to this here: https://news.ycombinator.com/item?id=10721068 . Short answer is that collaborations don't look unlikely, and we'll be able to say more when OpenAI's been up…

MIRI employee here! We're on good terms with the people at OpenAI, and we're very excited to see new AI teams cropping up with an explicit interest in making AI's long-term impact …