MIT and Microsoft Unveil System to Optimize AI Workflows
In brief
- Researchers from MIT and Microsoft have developed a new system called Murakkab that streamlines the design and deployment of complex AI workflows.
- These workflows, which involve chaining together multiple AI models and tools, are increasingly critical for tasks like video analysis but often suffer from inefficiencies leading to wasted resources.
- The Murakkab system allows developers to describe their desired workflow in plain language without specifying detailed technical requirements upfront.
- It then automatically selects the optimal models, tools, hardware configurations, and resource allocations based on user priorities such as cost or speed.
- The innovation significantly reduces computational units needed, cutting energy consumption and costs without compromising performance.
- This breakthrough addresses a major challenge for cloud providers who rely on these workflows to power their services while facing growing concerns over energy usage and resource allocation efficiency.
- The system dynamically adjusts configurations in real-time to ensure optimal resource use, making it a win-win solution for both developers and service providers.
- This development marks an important step toward more efficient AI-powered systems, with potential applications across industries.
- As cloud providers continue to adopt advanced workflows, tools like Murakkab could play a crucial role in minimizing costs and improving sustainability.
Terms in this brief
- Murakkab
- A system developed by MIT and Microsoft to optimize AI workflows by automatically selecting the best models, tools, hardware configurations, and resource allocations based on user priorities like cost or speed. It allows developers to describe their desired workflow in plain language without detailed technical requirements upfront.
Read full story at MIT News AI →
More briefs
11 Language Models Compared on Code Reorganization Task
A recent experiment compared 11 language models on a code reorganization task. The models were asked to propose how to untangle a complex node in a LangGraph agent. This matters because the node had 350 lines of logic, making it hard to explain, debug, and test. The results will help developers decide which model to use for generating and evaluating code proposals.
AI Helps Identify At-Risk Teens
Researchers are using AI to help doctors identify teens at risk of mental health crises. More than 40 percent of high school students feel persistently sad or hopeless. Nearly one in five teens seriously consider suicide. The AI model analyzes data from over 11 thousand children, including family conflict and health data. It can identify at-risk teens with 75 percent accuracy, up to a year before symptoms appear. This tool could help doctors spot trouble early and change lives. The Duke research team is now testing the AI tool in clinics to see how well it works outside the lab. The AI tool will be used to automate the process and analyze data in real-time, flagging which teens may be at risk during a routine checkup. Doctors will use this tool to help teens sooner.
Students Show Low 'Epistemic AI Literacy' When Using Generative AI for Coding
A new study reveals that most students lack "epistemic AI literacy" when using generative AI tools for programming. Researchers analyzed over 10,000 interactions between students and AI systems during coding tasks. They found that 78.8% of these interactions relied on non-mastery-oriented goals, with students often outsourcing work or seeking simple explanations rather than deeply understanding the AI's processes. The study highlights a significant gap in how students engage with generative AI. Only 11.1% demonstrated high epistemic engagement, combining mastery goals with advanced strategies like justifying their reasoning and carefully monitoring prompts. This suggests that most students are not effectively developing the critical thinking skills needed to work alongside AI systems. Looking ahead, educators will need to focus on teaching these advanced epistemic strategies to better prepare students for collaboration with generative AI tools in programming and other fields.
New Protocol Boosts AI Transparency and Auditability
A breakthrough protocol called Manifestation Units has been developed, enhancing how neural network components are analyzed and utilized. This system introduces a structured format that organizes component statistics into fields, allowing for easier querying and actionability. It supports various models like GPT-2 and CNNs, showing significant improvements over older methods in retrieval tasks. The protocol's key innovation is its typed structure, which outperforms unstructured approaches by making data more accessible and useful for auditing or intervening in AI systems. It also ensures that retrieved components meet causal criteria under controlled conditions, reducing redundancy and interference. This development marks a step forward in making AI mechanisms clearer and more manageable, with potential for broader applications. Future updates will focus on expanding its use across different models and refining its efficiency.
AI Reasoning Methods Simplified: Three Approaches Are Variations of One Core Idea
Three widely-used techniques for teaching language models to reason-GRPO, Dr. GRPO, and DAPO-are actually just different ways of tweaking a single setting: the standard deviation. This dial measures how much the model's answers to a prompt disagree with each other. When this disagreement is high, it means the model is learning effectively because its answers split between right and wrong. If all answers agree, there’s no learning happening. This discovery matters because it shows that these methods aren’t as distinct as they seemed. By adjusting one dial, researchers can control where and how much the model learns. For example, a high disagreement means the problem is harder to solve, so the model needs more tries. Conversely, if all answers are correct or wrong, the model either has mastered the task or hasn’t learned anything new. Looking ahead, this insight could streamline AI training by reducing the need for multiple methods. It also opens the door for simpler, more efficient algorithms that focus on adjusting this one key setting to achieve better learning outcomes.