Editorial · AI Safety
What Nobody Is Saying About Microsoft's Co-Author Feature
Microsoft's new co-authored-by Copilot feature in VS Code has sparked concerns about privacy. The tool accesses data from Microsoft products like Bing and Edge to personalize your interactions with Copilot, but this comes at a cost to user control.
The feature, designed to enhance personalization, automatically pulls data from other Microsoft services. This includes browsing history and past interactions. While the intention is to make the AI more helpful by understanding your context, it raises questions about consent and oversight.
Some users worry that the constant data collection could lead to unintended consequences. For instance, if Copilot learns too much about you, it might inadvertently share sensitive information or use it in ways not intended by Microsoft's privacy policies.
To address these concerns, Microsoft has provided options to disable certain features. However, many users are unaware of these settings, and the default opt-in model may leave them exposed without their knowledge.
Moving forward, the key question is whether the benefits of a more personalized AI outweigh the risks to privacy. As Copilot becomes more integrated into our workflows, we must demand transparency and control over how our data is used. Balancing innovation with user autonomy will be crucial for Microsoft's success in this space.
Editorial perspective - synthesised analysis, not factual reporting.
Terms in this editorial
- Copilot
- A tool integrated into VS Code that uses AI to assist with coding by suggesting completions and writing code. It's trained on vast amounts of data, including your interactions with Microsoft services like Bing and Edge, which can make its suggestions more personalized but also raise privacy concerns.
If you liked this
More editorials.
The Future of Robotics Safety: NVIDIA's Halos for a Safer Tomorrow
The rapid integration of AI into robotics is transforming industries, but it also raises critical questions about safety. How can robots operate alongside humans without posing risks? NVIDIA's Halos for Robotics addresses this challenge with a groundbreaking full-stack safety system designed specifically for physical AI. This innovation isn’t just a technical advancement-it’s a leap forward in ensuring that the next generation of robots can coexist safely with human workers. NVIDIA, renowned for its work in autonomous vehicles, has extended its expertise to robotics. The Halos platform combines AI compute, sensor connectivity, and safety software into a unified architecture. This system is built on over 18,600 engineering years of autonomous vehicle safety development, making it a robust foundation for robotic applications. By leveraging NVIDIA’s proven track record in automotive safety, Halos sets a new standard for robotics reliability. One of the standout features of Halos is its modular design. It includes the IGX Thor computing platform and Holoscan Sensor Bridge, which provide industrial-grade AI compute and real-time sensor connectivity. These components ensure that robots can process vast amounts of data quickly and make decisions based on their surroundings. The Halos OS software stack further enhances safety by offering a comprehensive suite of tools for system-level functions and applications. This includes Halos Core, which supports safety-related operations and integrates seamlessly with external cameras and AI agents to dynamically adjust robot behavior in industrial settings. Agility Robotics, a leader in humanoid robotics, is already putting Halos into action. Their Digit robot, designed for logistics and manufacturing, is being deployed by major companies like Amazon and Toyota. By integrating Halos into their safety systems, Agility ensures that these robots can operate safely alongside human workers. This partnership highlights the practical benefits of NVIDIA’s innovation and underscores its potential to revolutionize industrial automation. The future of robotics lies in collaboration-between humans and machines. As AI becomes more sophisticated, the demand for safe, reliable robotic systems will only grow. NVIDIA’s Halos platform not only meets this demand but also raises the bar for safety in physical AI. By providing a standardized, unified architecture, Halos empowers developers to build safer robots faster and deploy them with confidence. Looking ahead, the integration of Halos into industrial settings signals a new era of responsible automation. With its comprehensive approach to safety, NVIDIA is paving the way for robots that can work alongside humans without compromising their well-being. As more companies adopt this technology, we can expect to see safer, more efficient workplaces-where robots and humans coexist harmoniously. The future of robotics is here, and it’s safer than ever thanks to NVIDIA’s Halos for Robotics.
Why Anthropic's Safety Superpower Is About to Get Much Better
Anthropic's recent breakthrough in AI safety demonstrates a promising path forward for the industry. By leveraging Direct Preference Optimization (DPO), the company has significantly reduced text degeneration rates across various models, including its Claude chatbot. This technique not only addresses a critical failure mode but also opens new possibilities for safer and more reliable AI systems. The issue of text degeneration has long plagued AI models, causing them to repeat phrases endlessly instead of providing meaningful responses. Traditional fine-tuning methods like Supervised Fine-Tuning (SFT) have shown limited success in mitigating this problem. However, Anthropic's DPO approach turns these failures into a training opportunity. By labeling failed outputs as incorrect, DPO creates a clear preference signal that helps models learn to avoid degeneration loops. This shift in methodology is particularly noteworthy because it moves beyond the limitations of SFT, which evaluates predictions token by token without considering the broader context. DPO, on the other hand, treats each full output as a unit, allowing the model to recognize and penalize repetitive sequences more effectively. This approach not only improves text quality but also lays the groundwork for addressing other systemic issues in AI safety. While Anthropic's focus on OCR models may seem unrelated to chatbots, the underlying principles of DPO apply across various applications. The company's ability to identify and leverage failure modes represents a significant leap forward in AI safety research. As the industry continues to grapple with challenges like alignment and ethical behavior, Anthropic's innovations offer a roadmap for building more resilient systems. Looking ahead, the implications of Anthropic's work are vast. By refining DPO and extending its applications, the company could help create AI models that not only avoid degeneration but also resist other harmful patterns. This forward-thinking approach positions Anthropic as a leader in safety-conscious AI development, paving the way for a future where AI systems are both powerful and reliable. In conclusion, Anthropic's recent advancements highlight the potential for meaningful progress in AI safety. By embracing innovative techniques like DPO, the company is setting a new standard for responsible AI development-one that prioritizes robustness and reliability over mere performance metrics. As the field evolves, Anthropic's contributions will serve as a crucial reminder of the importance of proactive safety measures in shaping the future of artificial intelligence.
The Rise of Multi-Agent AI Safety Research: A Call for Collaboration and Innovation
The rapid advancement of artificial intelligence (AI) has ushered in a new era where millions of AI agents will soon interact across digital environments, presenting both opportunities and risks. As these systems grow more complex, ensuring their safety and stability becomes paramount. Recent initiatives by leading tech companies and research institutions highlight the urgency of addressing multi-agent AI safety. Recent funding announcements, such as Google DeepMind's $10 million call for multi-agent AI safety research, underscore the growing recognition of this critical field. This initiative aims to understand how large-scale AI systems behave collectively and develop frameworks to mitigate potential risks. The collaboration between DeepMind, Schmidt Sciences, the Cooperative AI Foundation, ARIA, and Google.org reflects a shared commitment to advancing safety research. One key focus area is building realistic testbeds to evaluate agent interactions. These environments will allow researchers to study how collective capabilities emerge and scale, identify vulnerabilities, and develop robust safety measures. For instance, simulating marketplaces or ecosystems can reveal unpredictable behaviors that could lead to economic disruptions or security threats. By fostering diverse research communities, these efforts ensure that safety standards are inclusive and transparent. Another critical aspect is strengthening agent infrastructure. This involves designing protocols for identity, reputation, and commitment that enable secure cross-platform interactions. For example, Okta's integration with Amazon Bedrock demonstrates how assigning dedicated identities to AI agents can enhance governance and control. Such innovations provide a foundation for managing agent behavior while maintaining accountability. Looking ahead, the future of multi-agent AI safety depends on collaboration between academia, industry, and policymakers. By pooling resources and expertise, researchers can tackle challenges such as predicting emergent behaviors and developing scalable monitoring tools. This collective effort is essential to building a resilient AI ecosystem that benefits society without compromising stability. In conclusion, the rise of multi-agent AI presents both promise and peril. Through concerted research and innovation, we can navigate this transformative era responsibly. By prioritizing safety and fostering collaboration, we ensure that AI remains a force for good in an increasingly interconnected world.
What Nobody Is Saying About India's Use of Home Videos to Train AI Robots
The use of home videos to train AI robots in India has sparked a growing concern among workers who feel their jobs are being threatened by the very technology they are helping to create. Every morning, hundreds of workers in textile factories strap on small recording devices to track and record their every move, from adjusting machine levers to calibrating moving parts. This exercise, known as egocentric data collection, is meant to teach machines how people perform physical tasks, but it has also exposed a sharp imbalance of power between workers and factory management. Workers are often not told what is being recorded, where the footage is going, or how it may eventually be used. They are simply asked to wear the devices throughout their shift, with no control over how their data may be used to automate parts of their job or replace them altogether. This lack of transparency has led to feelings of unease and mistrust among workers, who are already struggling to make ends meet in a highly competitive industry. The fact that they are being asked to generate behavioural data, including years of tacit skill and muscle memory, without any say in how it will be used, is a clear indication of the power dynamics at play. The demand for egocentric data is on the rise, with robotics labs needing between 100 million to 1 billion hours of pre-training data over the next two to three years. This has created a lucrative market for companies that collect and sell such data, often without considering the impact on the workers who are generating it. The end goal of collecting such data is to build robots that can operate in the real world with human-like adaptability and precision, but it is unclear whether the benefits of this technology will trickle down to the workers who are making it possible. The use of home videos to train AI robots also raises important questions about the future of work and the impact of automation on employment. As machines become more advanced and capable of performing complex tasks, there is a real risk that workers will be replaced by robots, leading to widespread unemployment and social unrest. This is particularly concerning in countries like India, where the job market is already highly competitive and workers are struggling to make ends meet. The fact that workers are being asked to generate data that may ultimately be used to replace them is a stark reminder of the need for greater transparency and accountability in the development and deployment of AI technology. As we look to the future, it is clear that the use of home videos to train AI robots is a trend that is here to stay. However, it is imperative that we consider the impact of this technology on workers and take steps to ensure that they are protected and empowered. This may involve providing workers with greater control over their data, ensuring that they are fairly compensated for their contributions, and implementing measures to mitigate the negative effects of automation on employment. Only by taking a more nuanced and equitable approach to the development and deployment of AI technology can we ensure that its benefits are shared by all, rather than just a privileged few.
AI Alignment and Ethical Computing: A Call for Interdisciplinary Dialogue
Recent advancements in artificial intelligence (AI) have sparked significant discussions about how these technologies can be aligned with human values while maintaining ethical standards. The MIT Ethics of Computing Research Symposium, held on June 5, 2026, brought together experts from various fields to explore the social and ethical implications of AI. This event emphasized the importance of collaboration between computer scientists, philosophers, policymakers, and educators to ensure that AI technologies are developed and deployed responsibly. The symposium featured a keynote address by Jon Kleinberg, the Tisch University Professor of Computer Science and Information Science at Cornell University. Kleinberg discussed the challenges of algorithm-human handoffs, highlighting the need for clear communication and mutual understanding between humans and AI systems. He stressed that while AI can enhance decision-making processes, it must always remain under human oversight to prevent unintended consequences. One of the key panels focused on AI alignment, a topic that raises fundamental questions about governance and accountability. Dylan Hadfield-Menell, an associate professor of Electrical Engineering and Computer Science (EECS) at MIT, moderated a discussion where experts debated how to instill "human values" into AI systems. Iason Gabriel, a philosopher and research scientist at Google DeepMind, argued that AI should be designed to interpret human moral values rather than mimic them perfectly. He likened this approach to a judge's role, where the system adheres to rules while also considering context and fairness. Bailey Flanigan, an assistant professor of political science with a joint appointment in the MIT Schwarzman College of Computing, emphasized the need for broader societal input in determining who gets to govern AI systems. She highlighted the importance of establishing clear guidelines and regulatory frameworks to ensure that AI technologies benefit all segments of society equitably. The symposium also showcased student research during an afternoon poster session. These projects demonstrated the diverse ways in which ethical considerations are being integrated into AI development. For instance, one team presented a framework for responsible computer vision deployment, focusing on issues like bias mitigation and transparency. Another project explored the use of AI in air pollution forecasting, aiming to create more accurate and accessible tools for public health officials. Looking ahead, the symposium serves as a reminder that ethical computing is not just an afterthought but a core component of technological progress. As AI becomes more pervasive, it will be essential to foster interdisciplinary dialogue and collaboration. This approach ensures that technical advancements are paired with thoughtful reflection on their societal impact. The MIT Schwarzman College of Computing's Social and Ethical Responsibilities of Computing (SERC) initiative is leading the charge in this effort. By supporting cutting-edge research and creating platforms for open discussion, SERC is helping to shape a future where AI technologies are developed with accountability and empathy. As computing and AI continue to evolve, initiatives like these will play a crucial role in guiding the field toward ethical and inclusive innovation. In conclusion, the symposium underscored the importance of viewing AI not just as a tool for efficiency but as a technology that requires careful stewardship. By embracing an interdisciplinary approach, we can ensure that AI systems are aligned with human values and contribute to a more equitable and just society. The challenges ahead are complex, but through collaboration and thoughtful dialogue, they are surmountable.