Live data from Hacker News

Gavin Newsom vetoes SB 1047

gov.ca.gov

431–440 of 514 posts

Re: Gavin Newsom vetoes SB 1047

#431

Earlier quoted context omitted.

> - Blog you've never heard of? Right. That checks out. There's a certain sect of the far right that is easily convinced by one guy saying "The media is lying to you! This is what's really happening!" followed by the most insane shit you've read in your life. They love to rant about the Deep State.

When people say, "The Deep State", what they really mean is, "unelected lifelong government employees who can create regulations that have the force of law". And that is a problem. Congress makes laws, not government agencies like the FDA, EPA, USDA, etc. We've seen a near-total abdication of responsibility from Congress on highly charged matters that'll piss off someone , somewhere in their constituency, because the…

That's one of the difficult things when dealing with any sort of conspiracy theory or major discussion about fundamental issues with government - there _are_ significant issues, so straight dismissing "The Deep State" isn't possible because there actually are instances of that sort of fundamental corruption. But then you have people who jump from those very real issues to moon landing hoax conspiracies, flat earth conspiracies, etc. etc., using that grain of truth of The Deep State to justify whatever belief they want.

It's related to a fundamental issue with discussing scientific principles in a non-scientific setting - yes, gravity is a _theory_ in the scientific sense, but that doesn't you can say "scientists don't know anything! they say gravity is just a theory, so what's stopping us from floating off into space tomorrow!?". Adapt the examples there to whatever you want...

And yes, that sounds fairly judgy of me - I am, alas, human, thus subject to the same fallacies and traps that I recognize in others, and being aware of those issues doesn't guarantee I can avoid them...

Re: Gavin Newsom vetoes SB 1047

#432
Here is the text of the PDF:

"OFFICE OF THE GOVERNOR

SEP 29 2024

To the Members of the California State Senate:

I am returning Senate Bill 1047 without my signature.

This bill would require developers of large artificial intelligence (Al) models, and those providing the computing power to train such models, to put certain safeguards and policies in place to prevent catastrophic harm . The bill would also establish the Board of Frontier Models - a state entity - to oversee the development of these models. California is home to 32 of the world's 50 leading Al companies , pioneers in one of the most significant technological advances in modern history. We lead in this space because of our research and education institutions, our diverse and motivated workforce, and our free-spirited cultivation of intellectual freedom. As stewards and innovators of the future, I take seriously the responsibility to regulate this industry. This year, the Legislature sent me several thoughtful proposals to regulate Al companies in response to current, rapidly evolving risks - including threats to our democratic process, the spread of misinformation and deepfakes, risks to online privacy, threats to critical infrastructure, and disruptions in the workforce. These bills, and actions by my Administration, are guided by principles of accountability, fairness , and transparency of Al systems and deployment of Al technology in California.

SB 1047 magnified the conversation about threats that could emerge from the deployment of Al. Key to the debate is whether the threshold for regulation should be based on the cost and number of computations needed to develop an Al model, or whether we should evaluate the system's actual risks regardless of these factors. This global discussion is occurring as the capabilities of Al continue to scale at an impressive pace. At the same time, the strategies and solutions for addressing the risk of catastrophic harm are rapidly evolving.

By focusing only on the most expensive and large-scale models, SB 1047 establishes a regulatory framework that could give the public a false sense of security about controlling this fast-moving technology. Smaller, specialized models may emerge as equally or even more dangerous than the models targeted by SB 1047 - at the potential expense of curtailing the very innovation that fuels advancement in favor of the public good.

Adaptability is critical as we race to regulate a technology still in its infancy. This will require a delicate balance. While well-intentioned, SB 1047 does not take into account whether an Al system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data. Instead, the bill applies stringent standards to even the most basic functions - so long as a large system deploys it. I do not believe this is the best approach to protecting the public from real threats posed by the technology.

Let me be clear - I agree with the author - we cannot afford to wait for a major catastrophe to occur before taking action to protect the public. California will not abandon its responsibility. Safety protocols must be adopted. Proactive guardrails should be implemented, and severe consequences for bad actors must be clear and enforceable. I do not agree, however, that to keep the public safe, we must settle for a solution that is not informed by an empirical trajectory analysis of Al systems and capabilities. Ultimately, any framework for effectively regulating Al needs to keep pace with the technology itself.

To those who say there's no problem here to solve, or that California does not have a role in regulating potential national security implications of this technology, I disagree. A California-only approach may well be warranted - especially absent federal action by Congress - but it must be based on empirical evidence and science. The U.S. Al Safety Institute, under the National Institute of Science and Technology, is developing guidance on national security risks, informed by evidence-based approaches, to guard against demonstrable risks to public safety. Under an Executive Order I issued in September 2023, agencies within my Administration are performing risk analyses of the potential threats and vulnerabilities to California's critical infrastructure using Al. These are just a few examples of the many endeavors underway, led by experts, to inform policymakers on Al risk management practices that are rooted in science and fact. And endeavors like these have led to the introduction of over a dozen bills regulating specific, known risks posed by AI, that I have signed in the last 30 days.

I am committed to working with the Legislature, federal partners, technology experts, ethicists, and academia, to find the appropriate path forward, including legislation and regulation. Given the stakes - protecting against actual threats without unnecessarily thwarting the promise of this technology to advance the public good - we must get this right.

For these reasons, I cannot sign this bill.

Sincerely, Gavin Newsom.".

Re: Gavin Newsom vetoes SB 1047

#433

The immediate danger of large AI models isn't that they'll turn the earth to paperclips it's that we'll create fraud as a service and have a society where nothing can be trusted. I'd be all for a law (however clumsy) that made image, audio or video content produced by models with over X parameters to be marked with metadata saying it's AI generated. Creating models that don't tag their output as such would be banned.…

> Creating models that don't tag their output as such would be banned. This is just silly. Anyone would be able to disable this tagging in an open model.

> Anyone would be able to disable this tagging in an open model.

Metadata (I assume it's file metadata and not a watermark) can be removed from a final product (image, video, text) so open and closed models are equally affected.

Re: Gavin Newsom vetoes SB 1047

#434

Excellent move by Newsom. We have a very active legislature, but it's been extremely bandwagon-y in recent years. I support much of Wiener's agenda, particularly his housing policy, but this bill was way off the mark. It was basically a torpedo against open models. Market leaders like OpenAI and Anthropic weren't really worried about it, or about open models in general. Its supporters were the also-rans like Musk [1]…

why would Google, Microsoft and OpenAI oppose a torpedo against open models? Aren't they positioned to benefit the most?

because it was a stupid law which would hurt AI innovation

Re: Gavin Newsom vetoes SB 1047

#435

Earlier quoted context omitted.

The data you're showing doesn't appear to differentiate between "Can read English" and "Can read in some language ". Big immigrant population, same with New York. Having grown up in California I can tell you that there aren't 28% of kids coming out of public school who can't read anything. Edit to add: my own hometown had a lot of people who couldn't speak English. Lots of elderly mothers of Chinese immigrants whose…

Did you go to school in Oakland or Central Valley? That’s where most of the illiterate children are going to school. I’ve never heard of a Chinese student in the US growing up illiterate, even if their parents don’t know English at all.

South Bay. And I didn't specify but I meant that the people who immigrated from abroad were not English speakers - younger than 50 or so even if born abroad all seemed to be at least proficient in English.

We had lots of Hispanic kids but not many who were super super fresh to the country. I'm sure the central valley was a whole different ball game.

Re: Gavin Newsom vetoes SB 1047

#436

Earlier quoted context omitted.

This is the ideal, but it's often false in meaningful ways. In several US elections, for example, we've seen audio leaked of politicians promising policies to their donors that would be embarrassing if widely publicly known by the electorate. This suggests that politicians and donors sometimes collude to deliberately misrepresent their views to the public in order to secure election.

worse.. a first-hand quote from inside a California Senate committee hearing chamber.. "Don't speak it if you can nod, and don't nod if you can wink" .. translated, that means that in a contentious situation with others in the room, if allies can signal without speaking the words out loud, that is better.. and if the signal can be hidden, better still.

This is an old saying in politics and you're misinterpreting it - it's not about signaling to allies, it's about avoiding being held to any particular positions.

You're also missing the first half, "don't write if you can speak, don't speak if you can nod, and don't nod if you can wink." The point is not to commit to anything if you don't have to.

Re: Gavin Newsom vetoes SB 1047

#437

Earlier quoted context omitted.

I’d advise anyone to conduct their career under the assumption that all data was public.

As a wise SysAdmin once told me when I was struggling with my tone in writing: “assume what you’re writing will be read aloud in Court someday.”

As someone who was once asked under oath "What did you mean when you sent the email describing the meeting as a 'complete clusterfuck'?" I can attest to the wisdom of those words.

Re: Gavin Newsom vetoes SB 1047

#438

Earlier quoted context omitted.

It's funny that it has Fox news as center to me. I watched them back when Obama was president a couple times and some of the shows would play Nazi videos while talking about him. Nevermind birtherism. I haven't watched them in over a decade, but I assume they haven't gotten any better.

I think if you look at the actual news reporting on Fox News, it could be closer to center. But when you factor in their opinion "reporting" it's very clearly heavily right-leaning. Problem is, most of their viewership can't tell the difference.

Also while many individual stories might be in the center, bias is also exhibited in which stories they choose to print, or not to, as well as in esitorialized headlines.

Re: Gavin Newsom vetoes SB 1047

#439

Earlier quoted context omitted.

It's troubling that you are saying things about the bill which are false, and then speculating on the motives of someone just pointing out that what you are saying is false.

why not tell us? Or point out what is actually false? You rebutted the points that the flop limit will not actually limit anyone by saying that gpt4 is out of reach of startups. Is OpenAI a startup? Is Anthropic? Is Grok? Is Perplexity? Is SSI? You ignored the counter points that advanced technology exponentially raises flop limits and changes costs. You said that the flop limit can be raised over time. So startups s…

What's false is the idea that the limit is going to be a burden on small companies, because you can ignore the flop limit if you're spending less than a hundred million dollars. (Big companies, in contrast, can use a percent of their budget for compliance.)

Being able to ignore the flop limit makes basically everything else you've said irrelevant. But just to quickly go through: I don't want to argue about what a 'startup' is but they're not 'small guys'. Advanced tech can be compensated for, but also it doesn't change the fact that staying under $100 million keeps you excluded. Export controls have nothing to do with this discussion, and they involve a completely different kind of 'flop limit'.

Re: Gavin Newsom vetoes SB 1047

#440

Excellent move by Newsom. We have a very active legislature, but it's been extremely bandwagon-y in recent years. I support much of Wiener's agenda, particularly his housing policy, but this bill was way off the mark. It was basically a torpedo against open models. Market leaders like OpenAI and Anthropic weren't really worried about it, or about open models in general. Its supporters were the also-rans like Musk [1]…

why would Google, Microsoft and OpenAI oppose a torpedo against open models? Aren't they positioned to benefit the most?

First they came for the open models…
Post reply on HN