California is taking steps to establish first-in-the-nation safety measures for the largest artificial intelligence systems, with the proposal aimed at reducing potential risks associated with AI technology that could be used for harm.
The legislation calls for companies to test their AI models and publicly disclose safety protocols to prevent misuse scenarios such as sabotaging the state’s electric grid or aiding in the development of chemical weapons.
The big picture: The bill, authored by Sen. Scott Wiener (D–San Francisco), targets AI systems that require more than $100 million in data to train, setting ground rules for large-scale AI models in the United States.
- Despite facing opposition from venture capital firms and tech giants like OpenAI, Google, and Meta, the bill narrowly passed in the Assembly and awaits a final Senate vote before reaching Governor Gavin Newsom’s desk for approval.
Why it matters: Supporters argue that the legislation is essential for holding Big Tech accountable and ensuring safety in a rapidly evolving AI landscape, while critics suggest that federal regulations should govern AI safety measures rather than state laws.
Driving the news: Anthropic, an AI startup backed by Amazon and Google, endorsed the bill after modifications were made to address concerns, including removing a perjury provision and restricting the state attorney general’s power to sue violators.
- Elon Musk, owner of social media platform X, also voiced support for the proposal, emphasizing the importance of preventing catastrophic misuse of powerful AI systems.
- The legislation is part of a broader effort by California lawmakers to address algorithmic discrimination, deepfakes, and other AI-related issues, reflecting the state’s proactive stance in regulating AI technologies.
- With California being home to numerous AI companies and implementing AI tools for various purposes, the debate over AI regulation underscores the challenge of balancing innovation and risk mitigation without stifling technological progress.
What they’re saying: “Innovation and safety can go hand in hand—and California is leading the way,” Weiner said in a statement.
