This tracks with my experience. I have assembled a homebrew microbiology lab from various parts from aliexpress and integrated it into my agent harness. Just a year ago it was a complete mess, but current models are extremely good at synthesising novel protein and virus structures. One put me in the hospital not last week, haha! I cant wait to see what I perish of
AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
11–20 of 55 posts
Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#12Or maybe just do a deep financial audit of all involved companies and investors. Really go into it with a bunch of motivated white collar crime prosecutors. Would be less violent and achieve same level of safety.
Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#13This tracks with my experience. I have assembled a homebrew microbiology lab from various parts from aliexpress and integrated it into my agent harness. Just a year ago it was a complete mess, but current models are extremely good at synthesising novel protein and virus structures. One put me in the hospital not last week, haha! I cant wait to see what I perish of
Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#14Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#15But luckily, AI will never breach safety-critical system. /s
Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#16Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#17Granted that a rogue adversarial AI in a sci-fi scenario could theoretically go into paperclip mode, but if "we" maintain control of energy generation and civilization threatening weaponary, the damage is at least limited. AI needs a lot of power, and AI can only (theoretically) breach & control what it can access through the internet. Even the scenario of nation-states deploying adversarial AIs against each other is just an extension of this and current deterrence / realpolitik.
And, it's not like the scenario of all models teaming up with each other to squash the human plague is plausible. We have AI with which we can protect ourselves against the threat of rogue AI.
Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#18Isn't the "kill us all" concern met by keeping nukes & essential infrastructure airgapped? This is something that should be the case already, and is certainly urgent if not the case. Instead of doomerism and calls to slow down the development of AI (not gonna happen), the conversation could be pivoted towards thorough threat analysis / audit. Granted that a rogue adversarial AI in a sci-fi scenario could theoreticall…
Stuxnet surmounted air gaps.
Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#19AI can easily manufacture and distribute a bunch of prions through water supply. After that it’s pretty much game over you will not survive even one prion. In fact I’d say prions are probably the great filter.
Re: AI Is Powerful Enough to Crack Our Hardest Math Problems–and Kill Us All
#20AI can easily manufacture and distribute a bunch of prions through water supply. After that it’s pretty much game over you will not survive even one prion. In fact I’d say prions are probably the great filter.