Earlier quoted context omitted.
> a much younger Eliezer Yudkowsky cautioning that Doug Lenat should have perceived a non-zero chance of hard takeoff at the moment of its birth Why is Yudkowsky taken seriously? This stuff is comparable to the "LHC micro black holes will destroy Earth" hysteria. There are actual concerns around AI like deep fakes, a deluge of un-filterable spam, mass manipulation via industrial scale propaganda, mass unemployment cr…
> "LHC micro black holes will destroy Earth" hysteria. I will be heavily downvoted for this, but here is how I remember it: 1) LHC was used to study blackholes and prove things like Hawking radiation 2) LHC was supposed to be safe due to Hawking radiation (that was only an unproven theory at the time) So the unpopular question: what if Hawking radiation didnt actually exist? Wouldnt there be a risk of us dying? A sma…
You shouldn't use "theory" when it comes to science unless you know what that means. Gravity is a "theory." "Theory" means that it has a working model, comes with a ton of observational evidence in line with predictions, and it has yet to be replaced by anything better. Outside of math, nothing is ever proven. Any leading scientific theory is, at best, "yet to be disproven." And it stays in the lead until something better comes along: more accurate, extending over a greater domain, etc.
Hawking radiation has yet to be observed.
And if you're worried about micro black holes, well, even an iron atom has a non-zero chance of tunneling to a micro black hole state. No collider needed.
Cyc isn't secretive, it's proprietary, the way the Microsoft codebase is, the Adobe codebase is, and so on.