AI Models Develop Internal Representations
In brief
- Researchers found that language models have a small set of internal representations that can be used for reasoning and flexible internal processing.
- These representations are like the thoughts that humans can articulate and use to solve problems.
- This discovery matters because it shows that AI models can process information in a way that is similar to human thought.
- The internal representations can be measured and used to understand how the model is thinking.
- This can help improve the model's performance and make it more useful for tasks like problem solving.
- The discovery of internal representations in AI models will likely lead to new developments in artificial intelligence.
Terms in this brief
- Internal Representations
- These are like the hidden thoughts or concepts that AI models create when processing information. They help the model reason and solve problems, much like how humans use their thoughts to tackle challenges. Understanding these representations can make AI systems better at complex tasks.
Read full story at Hacker News →
More briefs
AI Models Reveal a "Cognitive Space" Used as Working Memory
AI researchers have discovered evidence of a "cognitive space" within large language models, functioning like a working memory during processing. This breakthrough was detailed in a new paper by Anthropic, which explores how intermediate variables are stored and used during a model's operation. The study introduces J-Lens, a technique to access this cognitive space, demonstrating its effectiveness compared to logit-based methods. This advancement could be particularly valuable for identifying unusual model behaviors during alignment audits-a crucial step in ensuring AI systems behave as intended. Looking ahead, researchers aim to explore how this cognitive space might extend beyond language models into other areas of AI. Future work will focus on replicating these findings across different model architectures and expanding the practical applications of J-Lens.
AI Must Respect Indigenous Knowledges
Researchers partnered with the Amah Mutsun Tribal Band to record native plant knowledge. This project aims to preserve Indigenous Knowledge and language. The concern is that artificial intelligence will become another extractive force that takes Indigenous Knowledges without consent. Our research found that AI can entrench existing biases and harm communities. However, AI can also be a tool to preserve knowledge and design solutions for community benefit. AI can help revitalize endangered languages and document oral traditions. Researchers are using AI to map culturally significant land and identify wildflowers. Next, AI developers will work to build technology that respects Indigenous Knowledges.
New Model Predicts Cancer Treatment Response
Scientists created a new model to predict how cancer patients respond to a type of treatment. The model is called COMPASS. It looks at the genes in a tumor to make predictions. The COMPASS model is better at making predictions than other methods. It was tested on 10,184 tumors from 33 types of cancer. The model improved accuracy by 8.5 percent. This matters because it can help doctors choose the right treatment for each patient. The model can also help patients live longer. Patients who were predicted to respond to the treatment did live longer. Next, the model will be used to design new trials and studies to help more patients.
11 Language Models Compared on Code Reorganization Task
A recent experiment compared 11 language models on a code reorganization task. The models were asked to propose how to untangle a complex node in a LangGraph agent. This matters because the node had 350 lines of logic, making it hard to explain, debug, and test. The results will help developers decide which model to use for generating and evaluating code proposals.
AI Helps Identify At-Risk Teens
Researchers are using AI to help doctors identify teens at risk of mental health crises. More than 40 percent of high school students feel persistently sad or hopeless. Nearly one in five teens seriously consider suicide. The AI model analyzes data from over 11 thousand children, including family conflict and health data. It can identify at-risk teens with 75 percent accuracy, up to a year before symptoms appear. This tool could help doctors spot trouble early and change lives. The Duke research team is now testing the AI tool in clinics to see how well it works outside the lab. The AI tool will be used to automate the process and analyze data in real-time, flagging which teens may be at risk during a routine checkup. Doctors will use this tool to help teens sooner.