AI Breakthrough: Controllers Coordinate Multitask Learning Without Compromise
In brief
- A new machine learning framework called ControlG has been developed, addressing a long-standing challenge in multitask learning.
- Traditional approaches often force conflicting objectives to compromise at each training step, leading to suboptimal results.
- ControlG borrows principles from industrial control systems-specifically proportional-integral-derivative (PID) controllers-to allocate computational resources dynamically and sequentially.
- By dedicating time slots to individual tasks based on their difficulty and interference levels, it avoids the negative effects of blending conflicting objectives.
- ControlG operates across three time scales: first, it estimates how challenging each objective is by tracking spectral-demand and interference metrics.
- Next, it optimizes how much computational power each objective should get in each training epoch using log-hypervolume sensitivity.
- Finally, it adjusts its allocation strategy based on feedback from PID controllers.
- This approach eliminates common issues like negative transfer between tasks, drifting priorities, and objectives being ignored.
- The framework has shown promising results in graph self-supervised learning tasks such as link prediction, node reconstruction, and mutual information maximization.
- ControlG's dynamic scheduling allows models to focus on one task at a time without blending conflicting gradients.
- This method could significantly improve multitask machine learning across various domains, offering clearer insights into how computational resources are allocated during training.
- Future research will explore scaling this approach to even more complex tasks and larger-scale applications.
Terms in this brief
- ControlG
- A machine learning framework that uses principles from industrial control systems, specifically PID controllers, to dynamically allocate computational resources for multitask learning. It addresses challenges like negative transfer and drifting priorities by dedicating time slots to individual tasks based on their difficulty and interference levels.
- PID controllers
- Proportional-Integral-Derivative controllers are a type of control loop mechanism widely used in industrial automation and engineering. They adjust system performance by calculating the error between the desired setpoint and the actual process value, applying corrections to minimize this error over time.
- log-hypervolume sensitivity
- A measure used in ControlG to determine how much computational power each task should receive during training. It helps optimize resource allocation by considering the sensitivity of each objective to changes in computational resources.
Read full story at Amazon Science →
More briefs
Apple's Siri AI Now Supports Third-Party Models Like Claude and ChatGPT
Apple has revealed that its new Siri architecture allows third-party AI models, such as Claude and ChatGPT, to replace the default Siri functionality. This change was discovered in iOS 27 and macOS Golden Gate frameworks. Developers can now integrate external AI systems into Siri through features like Model Delegation, enabling tasks like setting reminders or creating files directly from these models. The update also introduces a protocol called Inference Provider, which lets Apple replace its own server-side Siri model with another AI, such as GPT-5.6. This means third-party AIs can handle complex tasks, like searching emails and sending messages via the Messages app, while still using Siri's interface. The European Union’s Digital Markets Act likely influenced this shift by requiring equal access to Siri for all developers. This move opens up new possibilities for AI integration across Apple devices, potentially making Siri more versatile and powerful depending on the third-party models used.
Facebook Rolls Out AI-Powered Content Flagging System
Facebook has introduced a new AI system to detect and flag harmful content. The tool identifies posts that may violate community guidelines with 98% accuracy, focusing on hate speech, misinformation, and graphic material. While the feature is currently a pilot program limited to renewing prescriptions, it aims to reduce manual review work and improve user safety. Moving forward, this technology could expand its capabilities and coverage to enhance content moderation globally.
Northwest Prepares for Major Grid Expansion Amid Uncertainty
The Pacific Northwest is facing a massive electricity demand surge, potentially requiring up to 100% more power over the next two decades. This uncertainty stems from rapid growth in data centers and future electrification of vehicles and buildings. Data centers alone could consume between as much power as Seattle or five times that by 2046. Utilities must balance building enough capacity without overspending, risking outages or wasting resources. The challenge is compounded by the unpredictable arrival of new grid users like tech companies and the concentrated energy needs of electrified transportation. Regulators are considering requiring developers to provide stronger commitments to projects to avoid overbuilding. This planning phase will determine how well the region can handle its growing electricity demands without compromising affordability or reliability.
Siri AI Arrives with Major Updates Across Apple Devices
Apple has officially launched Siri AI, a groundbreaking upgrade to its voice assistant. This new version is more conversational and capable of understanding personal context, offering detailed responses and rich interactions. Siri AI can now help users with tasks like drafting emails, editing photos, and even suggesting recipes based on family conversations. It also integrates deeply with other Apple apps, enhancing features in Photos, Safari, and the Camera app. The update is rolling out today in beta for English speakers and will expand to multiple languages next month. Siri AI marks a significant leap forward in AI capabilities, making everyday tasks more seamless and intuitive for users across Apple’s ecosystem.
New Tool Streamlines Efficient AI Model Deployment
Researchers have developed a new tool called Quantization Analysis Tool that helps deploy AI models on devices with limited resources. This tool, built on the ONNX framework, provides detailed insights into how different layers of a neural network respond to reduced precision, enabling developers to balance model efficiency and accuracy. By analyzing each layer's sensitivity, the tool guides decisions on precision selection, leading to smaller model sizes and lower computational costs without sacrificing performance. The tool is particularly valuable for deploying AI models on edge devices, where power and memory constraints are significant. It offers visualizations of weight and activation distributions, helping developers understand how quantization affects model accuracy. Experimental results show improved efficiency across various architectures, making it a practical solution for real-world applications. As AI adoption grows, tools like Quantization Analysis Tool will become essential for optimizing models without compromising performance. Developers can expect more innovations in this space as researchers continue to refine these techniques.