Live data from Hacker News

SB-1047 will stifle open-source AI and decrease safety

answer.ai

41–50 of 201 posts

Re: SB-1047 will stifle open-source AI and decrease safety

#41

(f) “Covered model” means an artificial intelligence model that meets either of the following criteria: (1) The artificial intelligence model was trained using a quantity of computing power greater than 10^26 integer or floating-point operations. (2) The artificial intelligence model was trained using a quantity of computing power sufficiently large that it could reasonably be expected to have similar or greater perf…

Forget ints. What FP precision? That alone could skew numbers.

Re: SB-1047 will stifle open-source AI and decrease safety

#42
post #3

The politicians are gunning extremely hard for open source AI. It's crazy. "Soros argued that synergy like that between corporate and government AI projects creates a more potent threat than was posed by Cold War–era autocrats, many of whom spurned corporate innovation. “The combination of repressive regimes with IT monopolies endows those regimes with a built-in advantage over open societies,” Soros said. “They pose…

It all depends on whether the AI proponents are right or not. If they're right, then of course it's a massive destabilizing threat. Even a weaker version, where there is no autonomy at all and it's all just the result of prompts, is going to be seriously destabilizing if it delivers on its promises. We really are not ready for a world of near zero cost fake everything.

On the other hand, like existing ITAR, this will manifest in extremely weird rules that have very little to do with actual safety.

Re: SB-1047 will stifle open-source AI and decrease safety

#44
post #35

this feels a lot like Uber/Lyft whining about rideshare regulation, or Musk whining about self-driving regulation. Howard does a miserable job attempting to explain what, exactly, this legislation will do to impact open source development and clearly hasnt read the specifics for open-source development in the bill. things like dual use/ITAR apply explicitly to commercial products, but he attempts to conflate them wit…

> nowhere does it state open source developers need "required shutdowns" or burdensome reporting for open source.

Any reporting to a gov agency is burdensome. It all exists to stifle private development.

Re: SB-1047 will stifle open-source AI and decrease safety

#45
post #37

I disagree on "Focus on Usage, Not Development". > Regulate the use of AI in high-risk areas such as healthcare, criminal justice, and critical infrastructure, where the potential for harm is greatest This suggests, for example, image generation should be unregulated, but potential for harm of deepfake is great. In general, regulation needs to be feasible to implement, and even if it is ideal to regulate use not deve…

Deepfakes are already possible and entirely convincing with existing technology, I don't see the benefits of stifling the development of open source transformer models for fear of deep fakes.

Re: SB-1047 will stifle open-source AI and decrease safety

#46
post #8

Since it’s not mentioned in the blog: >On February 7, 2024, Senator Scott Wiener introduced Senate Bill 1047 (SB-1047) – known as the Known as the Safe and Secure Innovation for Frontier Artificial Intelligence Systems Act (the Act) – into the California State Legislature. Aiming to regulate the development and use of advanced artificial intelligence (AI) models, the Act mandates developers to make certain safety det…

The Scott Wiener Congressional Exploratory Cmte received $8,600 from OpenAI.

https://www.opensecrets.org/orgs/openai/summary?id=D00008425...

Re: SB-1047 will stifle open-source AI and decrease safety

#47

(f) “Covered model” means an artificial intelligence model that meets either of the following criteria: (1) The artificial intelligence model was trained using a quantity of computing power greater than 10^26 integer or floating-point operations. (2) The artificial intelligence model was trained using a quantity of computing power sufficiently large that it could reasonably be expected to have similar or greater perf…

More exciting snippets from the bill

> 22603. (a) Before initiating training of a covered model that is not a derivative model, a developer of that covered model may determine whether ... if the covered model will have lower performance on all benchmarks

because I know how it will perform before training?

Re: SB-1047 will stifle open-source AI and decrease safety

#48
post #34

> The creator of a model can not ensure that a model is never used to do something harmful – any more so that the developer of a web browser, calculator, or word processor could. Placing liability on the creators of general purpose tools like these mean that, in practice, such tools can not be created at all, except by big businesses with well funded legal teams. This matches my thoughts on why this is ultimately a b…

Too bad there isn’t an NRA for LLM’s. So far at least nobody has been literally murdered using an LLM, as far as I’ve heard.

Re: SB-1047 will stifle open-source AI and decrease safety

#49
post #34

> The creator of a model can not ensure that a model is never used to do something harmful – any more so that the developer of a web browser, calculator, or word processor could. Placing liability on the creators of general purpose tools like these mean that, in practice, such tools can not be created at all, except by big businesses with well funded legal teams. This matches my thoughts on why this is ultimately a b…

As I understand this law does not mandate you to ensure anything. It requires you to follow best practices (to be determined), report safety incidents, etc. You are not even liable for safety incidents, you just need to report them, although it may be embarrassing. Overall, it seems highly reasonable.

Re: SB-1047 will stifle open-source AI and decrease safety

#50

Earlier quoted context omitted.

> The politicians are gunning extremely hard for open source AI. It's crazy. I hope someone has / can do some investigative journalism to check out their links with commercial / closed source AI; I can imagine the investors and those that benefit from companies like "Open"AI have close links with politicians. There's probably no direct links, they've become really good at obscuring those and plausible deniability.

You'll hear about it in 10 years in an article about "why did open source Ai die? ... once blossoming along closed source AI, open source AI disappeared after XXYYZ AI ACT. Turns out, Senator X and Senator Y were both in the pocket of closed source AI (and ended up in cushy jobs in Microsoft and Xai, not a coincidence) ... "

Regardless of your perspective on Musk, X AI is currently producing open source AI with permissive licensing, and seems very likely to continue open source releases in the near future.

https://github.com/xai-org

Microsoft, Amazon, OpenAI, others are driving regulatory capture behind the scenes. The usual suspects are dropping all sorts of money on establishing control and rent seeking - actual open source AI with end user control makes it much harder for these asshats to extract money and exert influence over people, and they desperately want both. AI, like search, will be a powerful influence vector for politics and marketing.

Post reply on HN