It’s an interesting problem to test but performed in a non-reproducible setting, so everything needs to be taken with a grain of salt
Building an early warning system for LLM-aided biological threat creation
11–20 of 190 posts
Re: Building an early warning system for LLM-aided biological threat creation
#12OpenAI seems to be transitioning from an AI lab to an AI fearmongering regulatory mouthpiece. As someone who lived through the days when encryption technology was highly regulated, I am seeing parallels. The Open Source cows have left the Proprietary barn. Regulation might slow things. It might even create a new generation of script kiddies and hackers. But you aren't getting the cows back in the barn.
"However, the obtained effect sizes were not large enough to be statistically significant, and our study highlighted the need for more research around what performance thresholds indicate a meaningful increase in risk." "We also discuss the limitations of statistical significance as an effective method of measuring model risk" Seriously?
It’s not a null result if the PR person writes the paper. It’s the fundamental mathematical nature of statistics that’s wrong!
Re: Building an early warning system for LLM-aided biological threat creation
#13Open AI is clearly overestimating the capabilities of its product. It is kind of funny actually.
I also think it’s ludicrous to the point of hilarity; but it’s also harmful as people who can make laws and big decisions are buying this horse shit.
You do have to appreciate the Machiavellian cleverness of this approach to marketing.
Re: Building an early warning system for LLM-aided biological threat creation
#14Open AI is clearly overestimating the capabilities of its product. It is kind of funny actually.
Are they? Or is this marketing genius in several ways?
Re: Building an early warning system for LLM-aided biological threat creation
#15Earlier quoted context omitted.
I also think it’s ludicrous to the point of hilarity; but it’s also harmful as people who can make laws and big decisions are buying this horse shit.
You do have to appreciate the Machiavellian cleverness of this approach to marketing.
Nah, a true Machiavellian would fool smart people too - this has the sophistication of jangling keys in front of an infant. I’m a bit embarrassed for them.
Re: Building an early warning system for LLM-aided biological threat creation
#16OpenAI seems to be transitioning from an AI lab to an AI fearmongering regulatory mouthpiece. As someone who lived through the days when encryption technology was highly regulated, I am seeing parallels. The Open Source cows have left the Proprietary barn. Regulation might slow things. It might even create a new generation of script kiddies and hackers. But you aren't getting the cows back in the barn.
"However, the obtained effect sizes were not large enough to be statistically significant, and our study highlighted the need for more research around what performance thresholds indicate a meaningful increase in risk." "We also discuss the limitations of statistical significance as an effective method of measuring model risk" Seriously?
I understand the second sentence but the first is flawed. Effects can be statistically significant at any size.
Re: Building an early warning system for LLM-aided biological threat creation
#17Open AI is clearly overestimating the capabilities of its product. It is kind of funny actually.
[deleted]
Re: Building an early warning system for LLM-aided biological threat creation
#18Funny company, creates problems for itself to solve.
They are developing new tech in responsible way, unlike other companies just creating problems for others.
Re: Building an early warning system for LLM-aided biological threat creation
#19Earlier quoted context omitted.
You do have to appreciate the Machiavellian cleverness of this approach to marketing.
Nah, a true Machiavellian would fool smart people too - this has the sophistication of jangling keys in front of an infant. I’m a bit embarrassed for them.
They are fooling lots of smart but not technical people. You may not be one of them, but there are many.
Re: Building an early warning system for LLM-aided biological threat creation
#20Open AI is clearly overestimating the capabilities of its product. It is kind of funny actually.
This will likely be used as evidence to justify regulating open weight models. It doesn’t matter if the models are actually dangerous, the messaging is a means to an end.