California Using Six High-Risk AI Systems
In brief
- California officials are using six high-risk AI-like systems to make important decisions about people's lives.
- These systems are used for tasks such as predicting if incarcerated people will re-offend and detecting fraudulent unemployment claims.
- The systems affect around 600,000 Californians and have been shown to produce biased results against marginalized groups.
- The state is required to report its use of these systems under a 2023 law.
- Next year the state will again report on its use of high-risk automated decision systems.
Read full story at CalMatters →
More briefs
AI Companies Face Conflict Over Data Use
AI companies are using digital content for free to train their models. This content comes from the work of many creators. The conflict is about paying these creators for their work. Publishers and artists say their work was taken without permission or pay. AI companies say it is fair to use this data and that paying creators would be too hard. The issue affects many people and a lot of money. AI companies will have to find a way to deal with this problem.
AI Regulation Lag Reveals Critical Gaps in Governance Standards
A new study highlights a significant delay between the introduction of advanced AI capabilities and the regulatory response, raising concerns about the adequacy of current governance frameworks. The research identifies six key areas where uncertainties persist, including how effective regulations are at ensuring public trust and model safety. The study points out that there's no agreed definition of "regulatory adequacy," making it challenging to measure success in AI governance. Current metrics focus on the number of laws passed rather than their impact, leaving a gap in understanding whether these frameworks actually reduce harm or increase safety. Looking ahead, experts suggest focusing on establishing clear standards for what constitutes effective regulation. This would help determine which policies truly achieve their goals and guide future efforts to close the growing gap between AI innovation and regulatory oversight.
Court Rules Google Liable for AI Errors
Google can be held liable for incorrect answers generated by its AI feature, a Munich court ruled. The court said Google's AI summary is distinct content, not just search results. This matters because 80% of legal costs will be paid by Google. The company will review the ruling, which is not yet final, and may appeal it.
SAP Focuses on AI Sovereignty in Europe
SAP highlighted its European AI partners at a recent event in Madrid. The company discussed AI sovereignty and introduced new partners, including Mistral and n8n. SAP's focus on AI sovereignty matters because many of its European customers are in the public sector or regulated industries and are concerned about geopolitical issues. They worry about sanctions and data extraction restrictions. SAP's EU AI Cloud serves frontier models from European data centers, and the full Mistral platform is now available with sovereign model access. SAP will continue to develop its AI capabilities with European partners to address growing demand for local AI solutions.
Senators Introduce AI Labor Data Bill
Senators Mark Kelly and Jim Banks are introducing a bill to capture the impact of artificial intelligence on the workforce. The bill would authorize Labor Department surveys on job openings and Americans' use of time. The AI DATA Act would ensure the data captured can help assess shifts associated with technological change, including AI. This matters because it can help policymakers understand how AI affects the workforce, with 6% of congressional staffers saying AI will be a priority issue. The new bill may lead to better understanding of AI's role in the workforce, and lawmakers will review the proposal next.