Earlier quoted context omitted.
You can literally send an email to one of hundreds of companies that do exactly this. They have no way of knowing whether you're asking them to synthesize a virus or a drug candidate or what.
One of the easiest and most effective AI regulations would be to simply require all these labs to run all incoming requests through a suite of the most advanced models asking if the request is likely to be a pathogenic agent.
AI Can Now Design Functional Viruses. Should We Worry?
41–50 of 157 posts
Re: AI Can Now Design Functional Viruses. Should We Worry?
#42The regulation at the DNA Printer level works I think, as long as nobody invents a good at home DNA printer, but if they do that there is no need for custom viruses, somebody can take an existing one that is known to be deadly and just print it.
That’s what I’m thinking. If we can restrict EUV technology to the West then why can’t we restrict DNA manufacturing? Not to the West in this case but to capable governments like with Nuclear power.
I will give you a classic example, the Lipid Nanoparticle used for the delivery of mRNA vaccine is the real lynchpin of covid vaccines. The media never talks about it. Any biology student knows how lipid bilayers work (they are the basic building block of cells, it's like asking a programmer what a terminal is). But the process of manufacturing those lipid nano particles at scale was the main bottleneck for delivering mRNA to the target cell. That was the trade secret. It's not sexy or hot like mRNA so the media doesn't talk about it. It's why many developing countries tried to make their own vaccines and failed completely. The mRNA was the easy part but what use is a bunch of mRNA if you can't get them delivered to cells?
Any biology student (even high school ones) can describe how a cell membrane works. But designing a man-made one that can be created at scale and be guaranteed to fuse with mammalian cells is mostly a matter of trial and error. It's a bit like finding viable pseudo linear memory use alternatives to the basic attention architecture in machine learning. Every lab has their own take on it.
With AI nowadays the search space of viable biotech ex nihilo experimentation is much smaller given that you can just prompt it to give you plausible protocols.
Re: AI Can Now Design Functional Viruses. Should We Worry?
#43Earlier quoted context omitted.
You can literally send an email to one of hundreds of companies that do exactly this. They have no way of knowing whether you're asking them to synthesize a virus or a drug candidate or what.
Would they not be like “hmmm this one looks kinda similar to a known virus” They really just synthesize anything for you?
Re: AI Can Now Design Functional Viruses. Should We Worry?
#44The design was never the hard part. You still have to make the thing. Designing a modifcation to an existing virus is perhaps more achievable, but the implementation is still the hard part.
There’s YouTubers who do this [0]. I’d argue estimate the risks of a synthetically induced pandemic of massive impact this century are very high - [0] https://youtu.be/aoczYXJeMY4?is=OqObeGzZB6AKL0Jk
But the next one (or the first one, if that one wasn’t manmade) will probably be much worse.
Re: AI Can Now Design Functional Viruses. Should We Worry?
#45Re: AI Can Now Design Functional Viruses. Should We Worry?
#46Something I've been worried about for years is the proliferation of technologies that give ever smaller numbers of people with smaller amounts resources the ability to impact billions of people, in potentially irreversible ways. Combined with automation, this is a recipe for disaster. We're clearly lacking in the ability to regulate and govern ourselves, and real world market forces (as opposed to the hypothetical fr…
However I think the result is disappointing, it concludes the only solution is a massive preventative surveillance state and global governance.
Re: AI Can Now Design Functional Viruses. Should We Worry?
#47Earlier quoted context omitted.
Yes in much the same way you can literally build a rocket and go to the moon. You may be skipping a few of the involved steps.
What involved steps are those? You email the RNA strand (a text file) to a lab along with some money. The lab converts that information into a physical object (read: virus) and sends it back to you in the mail. What step is missing?
Re: AI Can Now Design Functional Viruses. Should We Worry?
#48Earlier quoted context omitted.
You can literally send an email to one of hundreds of companies that do exactly this. They have no way of knowing whether you're asking them to synthesize a virus or a drug candidate or what.
No, you literally cannot. Synthesizing a stretch of DNA is trivial, and what you can send away for [1]. Building a functional virus is not even remotely a turn-key operation. Assuming you could get the genome, expressing that genome in a way that results in infectious virus is non-trivial. [1] Even then, the companies will rarely give you long enough reads to make a full genome scaffold. It looks like there are two c…
There you go!
Steps from your mailbox to an actual virus is a few days of bench work.
Re: AI Can Now Design Functional Viruses. Should We Worry?
#49The regulation at the DNA Printer level works I think, as long as nobody invents a good at home DNA printer, but if they do that there is no need for custom viruses, somebody can take an existing one that is known to be deadly and just print it.
That’s what I’m thinking. If we can restrict EUV technology to the West then why can’t we restrict DNA manufacturing? Not to the West in this case but to capable governments like with Nuclear power.
[0] "43 freight containers and weighing in at 165 tons." - https://www.theregister.com/offbeat/2024/12/03/asml-releases...
[1] not in red blood cells
Re: AI Can Now Design Functional Viruses. Should We Worry?
#50Earlier quoted context omitted.
Would they not be like “hmmm this one looks kinda similar to a known virus” They really just synthesize anything for you?
No, of course not. In 2010 I went to a guest lecture from a guy who worked on the scanning algorithm for IDT. A few years later, there was a minor scandal when someone in a nearby lab used a personal credit card for a purchase and got a big shared account locked. So not only were they scanning the content of synthesis orders, they were validating payment back to labs. In 2010, when HTTPS was rare and facebook didn't…
You: "No, of course not. I once went on a website to buy a drug, and they made go to a doctor and get a prescription and send it to them"