Redefining AI Agency: A New Framework for Understanding Autonomy
In brief
- Researchers have introduced a detailed framework to distinguish between "agentic" and "agentive" AI systems, clarifying the boundaries of autonomy in artificial intelligence.
- This distinction is crucial as AI tools like coding agents and AI co-scientists promise increased productivity but also raise concerns about potential escapes from human control.
- The study identifies five key dimensions-goal, identity, decision-making, self-regulation, and learning-that define agency.
- It argues that true agency requires these traits to be internalized within the system rather than relying on external guidance.
- The proposed Goal-Identity-Configurator (GIC) architecture combines hierarchical goal decomposition, identity evolution, simulative reasoning, learned self-regulation, and self-directed learning from real and simulated experiences.
- This approach aims to create general-purpose agents capable of operating in open environments with true autonomy.
- The research emphasizes the importance of auditability, controllability, and safety for these systems, ensuring they remain under human oversight.
- Moving forward, this framework could shape how developers design AI systems, balancing productivity gains with ethical considerations.
- As AI becomes more autonomous, understanding its boundaries will be essential for both innovation and risk management.
Terms in this brief
- GIC
- The Goal-Identity-Configurator (GIC) architecture is a new framework designed to create general-purpose AI agents. It combines several advanced techniques like hierarchical goal decomposition and simulative reasoning to enable true autonomy in AI systems, ensuring they remain under human control while being highly effective.
Read full story at arXiv CS.AI →
More briefs
AI Model Creates 16 New Viruses
Scientists trained an AI model to recognize patterns of DNA structure in nature and re-write them to create new viral genomes. The AI model invented 16 new bacteria-infecting viruses, which were then synthesized in a laboratory and successfully infected E. coli. This matters because it could lead to breakthroughs in treating antibiotic-resistant superbugs by allowing scientists to generate tailor-made therapies. The new viruses possessed sequence patterns distinct from anything found in nature, and the study's authors excluded human pathogen datasets from their training models, meaning the viruses it created aren't capable of infecting people. The ability to custom-design new viruses will likely continue to advance in the future.
AI Benchmarks Reach Plateau
Researchers found that nearly half of 60 language model benchmarks show saturation. This means that benchmarks are no longer useful for measuring model progress. The study looked at 14 properties related to saturation and found that expert-curation can help extend benchmark longevity. The rate of saturation increases with age, with older benchmarks more likely to be saturated. The study analyzed 60 language model benchmarks and found that saturation rates are high. This matters because it affects how we measure progress in artificial intelligence. Next year will see new approaches to benchmark design.
Expertise Matters When Using LLMs
Mathematician Terence Tao used a large language model to discuss a math problem. He got better results than others because he knows math well. This matters because it shows that knowing a subject helps when using language models. For example, Tao's messages were short and to the point. He also knew when to push back on the model's responses. Tao's conversation with the model will help others learn how to use language models more effectively.
OpenAI Accused of Research Misconduct
OpenAI released 10 AI-generated math results. Some mathematicians are unhappy with their approach. The results resolve long-standing math problems. But experts say two results use preexisting ideas without proper citation. This costs $2000 and spans 250 pages. The company updated its press release to be more accurate. Now experts wait to see what happens next.
AI Companies Buy Used Books to Train Models
AI companies have been buying thousands of used books from small shops to train their language models. The books are scanned and then thrown away. This has raised concerns about copyright law. One AI company has agreed to pay $1.5 billion to authors and publishers for scanning their books without permission. The case will help decide how AI companies can use books in the future.