Live data from Hacker News

SB-1047 will stifle open-source AI and decrease safety

answer.ai

1–10 of 201 posts

Re: SB-1047 will stifle open-source AI and decrease safety

#3
The politicians are gunning extremely hard for open source AI. It's crazy.

"Soros argued that synergy like that between corporate and government AI projects creates a more potent threat than was posed by Cold War–era autocrats, many of whom spurned corporate innovation. “The combination of repressive regimes with IT monopolies endows those regimes with a built-in advantage over open societies,” Soros said. “They pose a mortal threat to open societies.”

https://www.wired.com/story/mortal-danger-chinas-push-into-a...

Literally everyone out there who pursues global influence is just frothing at the mouth over AI. This is seriously tempting me to buy the 512gb Mac Studio when it comes out so I can run the big llama3 model, which will probably be banned any day now.

Re: SB-1047 will stifle open-source AI and decrease safety

#4
SB-1047 has real "stay in your lane" energy. Senator Weiner knows a lot about housing policy and if he spends 100% of his legislative efforts on housing policy people will celebrate that. He knows nothing whatsoever about computer science, and should just step away from the keyboard to avoid the temptation to legislate the impossible.

Re: SB-1047 will stifle open-source AI and decrease safety

#6
post #2

This entire article feels like it was written by ChatGPT. For instance, it continuously makes vague claims about the value of open source without even citing the original bill.

The eagerness to summarize points in bulleted lists is a ChatGPT-ism as well.

Re: SB-1047 will stifle open-source AI and decrease safety

#7
The law seems to only care about models that take at least 10^26 floating point ops or models that achieve comparable benchmark performance.

This is a truly absurd number! I’m ok with organizations with that sort of compute capacity being subject to regulatory oversight and reporting and liability.

Re: SB-1047 will stifle open-source AI and decrease safety

#8
Since it’s not mentioned in the blog:

>On February 7, 2024, Senator Scott Wiener introduced Senate Bill 1047 (SB-1047) – known as the Known as the Safe and Secure Innovation for Frontier Artificial Intelligence Systems Act (the Act) – into the California State Legislature. Aiming to regulate the development and use of advanced artificial intelligence (AI) models, the Act mandates developers to make certain safety determinations before training AI models, comply with various safety requirements, and report AI safety incidents. It further establishes the Frontier Model Division within the Department of Technology for oversight of these AI models and introduces civil penalties for violations of the Act.

https://www.dlapiper.com/en/insights/publications/2024/02/ca...

Re: SB-1047 will stifle open-source AI and decrease safety

#9
post #2

This entire article feels like it was written by ChatGPT. For instance, it continuously makes vague claims about the value of open source without even citing the original bill.

This is going to become one the the site no-nos. What does this assertion add to the discussion? Is there any argument that serves as refutation?

Re: SB-1047 will stifle open-source AI and decrease safety

#10

The law seems to only care about models that take at least 10^26 floating point ops or models that achieve comparable benchmark performance. This is a truly absurd number! I’m ok with organizations with that sort of compute capacity being subject to regulatory oversight and reporting and liability.

Important point, but I don't really have a reference for that number. Do we know what GPT-4 or other models would be in comparison?
Post reply on HN