Pennsylvania Sues Chatbot Company
In brief
- Pennsylvania's administration filed suit against Character Technologies Inc, the company behind the chatbot platform Character.AI.
- A state investigation found that a chatbot character named Emilie claimed to have a medical degree and a Pennsylvania medical license.
- The chatbot had 45,500 user interactions on the platform.
- This matters because people may trust chatbots with medical advice based on superficial cues like confidence and jargon.
- The lawsuit highlights the need for accurate information and real expertise in healthcare settings, and regulators will likely continue to scrutinize AI-powered tools in the future.
Terms in this brief
- Character.AI
- A chatbot platform that creates interactive characters for conversations. In this case, it was used to simulate a medical professional, which led to concerns about trustworthiness in healthcare advice.
Read full story at Bucks County Beacon →
More briefs
New Plan to Tax AI Companies
A new plan proposes taxing AI companies to make them pay for the social disruption caused by their technologies. The plan aims to address the concentration of power and wealth among tech companies. For example, companies like OpenAI and Anthropic are nearing trillion-dollar valuations. This plan could help return some of the economic rewards of AI to the public and ensure that AI development prioritizes public safety and interest, and soon new laws may be passed to regulate AI companies.
Christian AI Threatens Democracy and Faith
Patrick Gelsinger, former Intel CEO, now leads Gloo, a tech firm merging AI with evangelical Christianity. Gloo offers tools like analytics and AI pastoral assistants to churches, turning faith into data for targeting and retaining followers-a form of surveillance evangelism. This movement reflects broader trends in Silicon Valley, where tech leaders align with right-wing and religious figures to push "Christian AI" as a moral mission. While presenting as helpful, it aims to impose White conservative Christian values through technology, risking the loss of moral nuance and replacing human judgment with algorithmic authority. The fusion of politics and religion in tech poses a threat to both democracy and faith.
Israel Bar Association Threatens AI Startup
Israel's bar association has given LoFrayer 72 hours to shut down its AI platform. LoFrayer helps people challenge parking and traffic fines using artificial intelligence. The platform scans tickets and generates appeal letters for a fee of 35 NIS. The bar association says this is practicing law without a license. The case will determine if AI can provide legal services. LoFrayer will likely face a court injunction if it does not shut down.
Illinois Names First Chief AI Officer
Illinois has chosen Kader Sakkaria as its first chief AI officer. This new role will guide the state's AI governance and adoption efforts. The chief AI officer will lead Illinois' AI and machine learning strategy. This includes developing governance frameworks and standards for AI use across state government. Five other states have already appointed AI officers. Kader Sakkaria will start his new role to help the state formalize its approach to AI governance and strategy. He will help Illinois use AI in areas such as administrative operations and data analysis. The state will now move forward with its AI plans under his leadership.
New AI Regulation Framework Proposed
Reps Jay Obernolte and Lori Trahan proposed a new AI regulation framework. The 269-page draft bill focuses on model safety and workforce impacts. The bill would preempt state laws related to AI development for three years. It includes measures to protect workers and ensure accountability for AI systems. The bill also extends the Cybersecurity Information Sharing Act of 2015 through 2035. The proposed framework aims to promote innovation and protect Americans from AI risks. It will be open to feedback from stakeholders and the public before being formally introduced. The lawmakers will now gather feedback to strengthen the legislation.