Editorial · General AI News
The Internet's Quiet Revolution: How AI Bots Are Redefining Web Traffic and Publisher Strategies
The internet is undergoing a quiet revolution. For the first time in its history, machines now generate more web traffic than humans. According to Cloudflare’s radar dashboard, bots account for 57.5% of all HTTP requests to HTML content, while humans make up just 42.5%. This shift is not driven by traditional scrapers or search crawlers but by agentic AI-bots that act on behalf of users rather than merely scraping data. These AI-driven agents are transforming the way we interact with the internet, creating new challenges and opportunities for publishers, advertisers, and tech companies alike.
The rise of AI bots has accelerated faster than anyone expected. Just a few years ago, agentic AI made up only 1.7% of automated traffic. By the end of 2025, it had grown by an astonishing 8,000%, making it the dominant force in internet traffic. This shift is not just about volume; it’s about behavior. Unlike traditional bots, these agents are indistinguishable from human activity in many ways. They visit multiple sites on behalf of users, navigate complex tasks, and mimic user intent with remarkable precision.
Publishers and advertisers are grappling with the implications. Traditional metrics like pageviews, session times, and conversion rates were built for human interaction. But AI agents don’t generate these metrics-they visit thousands of URLs in fractions of the time it takes a human to complete a single task. This mismatch is causing significant revenue losses for publishers who rely on programmatic advertising and SaaS conversion funnels designed for human engagement.
Cloudflare CEO Matthew Prince has described this transition as a platform shift comparable to the move from desktop to mobile-but at a breakneck speed. To address the challenges, Cloudflare introduced tools like Pay Per Crawl and Pay Per Use, allowing publishers to charge AI companies for content access or compensation when their material is used in AI products. These innovations aim to give publishers more control over how their content is consumed by bots while reducing unnecessary traffic.
The future of internet governance will hinge on how well we can balance the needs of humans and machines. Publishers must adopt new strategies to monetize bot traffic without compromising human user experiences. Advertisers need to rethink their metrics and measurement frameworks to account for AI-driven interactions. And tech companies must continue innovating tools that empower publishers to manage bot traffic effectively while preserving the internet’s original purpose: serving human needs.
As we navigate this new era, one thing is clear: the internet was built for humans, but it’s increasingly being shaped by machines. The challenge-and opportunity-lies in finding a way to serve both without losing sight of what makes the internet so powerful: its ability to connect and engage people in meaningful ways.
Editorial perspective - synthesised analysis, not factual reporting.
Terms in this editorial
- agentic AI
- Agentic AI refers to AI systems that operate with a degree of autonomy and initiative, often acting on behalf of users to perform tasks similar to human decision-making. These bots are designed to mimic user intent and carry out complex actions across the internet.
If you liked this
More editorials.
The Hidden Cost of AI in Healthcare: What Nobody Is Saying About Nurses at Montefiore Hospital
Artificial intelligence is rapidly transforming the healthcare industry, with some hospitals like Montefiore even replacing nurses with AI. While this shift may seem like a leap into the future, it hides a critical truth: the human touch that nurses provide is irreplaceable. Nurses aren't just caregivers; they are the backbone of patient care, offering emotional support, personalized attention, and crucial clinical judgment that goes beyond mere data processing. The integration of AI in healthcare has been touted as a solution to staffing shortages and administrative burdens. For instance, AI can handle routine tasks like monitoring vital signs or managing patient records. However, this move at Montefiore Hospital raises serious concerns about the quality of care. Studies show that patients who receive more personalized attention from nurses report higher satisfaction and better health outcomes. Replacing these roles with technology may lead to a colder, less empathetic healthcare system. Moreover, while AI can process data quickly, it lacks the ability to adapt to unexpected situations or understand complex human emotions. Nurses bring a unique perspective shaped by their experience and intuition. This is especially critical in emergency rooms where split-second decisions often mean the difference between life and death. The cost of losing this human element could be far greater than any financial savings from reduced staffing. Looking ahead, it's clear that AI has its place in healthcare-simplifying tasks rather than replacing them. Instead of cutting nursing staff, hospitals should focus on integrating AI to augment nurses' abilities, not replace them. This approach would maintain the high standard of care while embracing technology's benefits. The future of healthcare lies in collaboration between humans and machines, where empathy and efficiency go hand in hand. In conclusion, the move to replace nurses with AI at Montefiore Hospital is a shortsighted step that overlooks the irreplaceable value nurses bring to patient care. While technology can enhance healthcare delivery, it should never come at the expense of compassion and personalized attention. The true measure of progress lies not just in innovation but in how well we preserve the human connection at the heart of medicine.
AI's Role in Unlocking the Secrets of Ancient Scrolls
The world of archaeology and history has long been constrained by the physical limitations of artifacts-fragile scrolls, carbonized parchment, and other relics that crumble at the touch. But a quiet revolution is underway, one where artificial intelligence (AI) is breaking these barriers, allowing us to peek into the past with unprecedented clarity. This editorial explores how AI is transforming our understanding of ancient texts, focusing on its application to the famously enigmatic Herculaneum scrolls. For centuries, scholars have grappled with the charred remains of scrolls buried by Mount Vesuvius in 79 CE. These scrolls, found in a luxury villa near Pompeii, contain invaluable insights into Roman culture, philosophy, and science. Yet, their fragile state has made them nearly impossible to read without risking further damage. Traditional methods of unrolling or imaging these scrolls have yielded limited results-until now. Recent advancements in AI-powered imaging technology are changing the game. By using machine learning algorithms to analyze high-resolution scans of the scrolls, researchers can "virtually unwrap" these ancient texts without touching them. These tools detect subtle patterns in the ink and parchment, revealing letters and words that were previously hidden. In 2023, a breakthrough allowed scientists to read portions of one scroll with remarkable accuracy-marking the first time any Herculaneum text had been fully deciphered since its discovery. This progress is not just about solving ancient puzzles; it's about democratizing access to knowledge. By digitizing and analyzing these texts, AI makes them available to researchers worldwide, fostering collaboration and innovation. Imagine a future where scholars in India or Brazil can contribute equally to the study of Roman history-thanks to technology that bridges gaps of geography and resources. Looking ahead, the implications for historical research are profound. AI could unlock not just the Herculaneum scrolls but other ancient texts, such as cuneiform tablets or Mayan codices. The technology's ability to detect patterns and recognize damaged text will only improve with time. This isn't about replacing human scholars; it's about amplifying their capabilities. However, we must approach this cautiously. Over-reliance on AI risks overshadowing the importance of traditional scholarship. No algorithm can fully capture the nuance of historical context or the interpretive skills that make a scholar an expert. The balance between technology and humanity will be key to maximizing these tools' potential. In conclusion, AI is not just a tool for reading ancient scrolls-it's a gateway to understanding our shared history in ways we've never imagined. By combining human expertise with machine intelligence, we can unlock secrets buried for centuries and rewrite the story of civilization. The future of historical research lies at this intersection of technology and tradition-a future where the past becomes more accessible than ever before.
Stop Pretending AI in Education Is a Simple Solution
The decision by Dartmouth's Tuck School to mandate an AI course for its students is a trend that is gaining momentum in business schools across the country. This move is not just about keeping up with the latest technology, but about acknowledging the complex role AI is playing in education. On one hand, AI tools like ChatGPT are being used by students to improve their efficiency and personalize their learning experience. They are using these tools to summarize articles, generate examples, and explain complex theories in simpler language. However, this convenience comes with a cost, as students are increasingly reliant on AI to do their work for them, rather than learning the material themselves. The use of AI in education also raises important questions about equity and access. Students who have access to premium AI tools have a significant advantage over their peers who do not. This creates a new form of educational inequality, where those who can afford the best tools have a better chance of succeeding. Furthermore, the shift towards AI literacy in education is not just about teaching students how to use AI tools, but also about teaching them how to think critically and use these tools responsibly. This is a complex task that requires a nuanced approach, rather than a simple solution. The move towards AI literacy in education is not just limited to business schools. Many institutions are now focusing on teaching students how to use AI responsibly and effectively. This includes partnering with companies to provide students with hands-on experience with AI tools, as well as offering courses on AI literacy and digital citizenship. For example, some universities are offering graduate certificates in applied AI, while others are providing AI-focused education labs for students. These efforts are aimed at preparing students for a workforce where AI is increasingly prevalent. Despite these efforts, there are still many challenges to be addressed. One of the main concerns is that students are not learning the underlying material, but rather relying on AI to do the work for them. This raises important questions about the value of a degree, and whether students are truly prepared for the workforce. Additionally, the use of AI in education also raises concerns about academic integrity, as students may be using these tools to cheat or plagiarize. To address these challenges, educators need to take a proactive approach to teaching AI literacy, and ensure that students are using these tools responsibly and effectively. The decision by Dartmouth's Tuck School to mandate an AI course is a step in the right direction, but it is only the beginning. As AI continues to play a larger role in education, it is essential that educators take a nuanced approach to teaching AI literacy. This includes addressing the complex issues surrounding equity, access, and academic integrity, as well as ensuring that students are learning the underlying material, rather than just relying on AI to do the work for them. By taking a proactive and responsible approach to AI in education, we can ensure that students are prepared for a workforce where AI is increasingly prevalent, and that they have the skills and knowledge they need to succeed.
The Brain's Language: Unlocking the Secrets Through AI and Neuroscience
In recent years, large language models (LLMs) have revolutionized our understanding of how the human brain processes language. These models can predict brain activity with remarkable accuracy, offering insights into which regions light up in response to specific words or concepts. However, this success comes with a critical challenge: the models themselves are black boxes-vast collections of learned parameters that reveal little about the actual mechanisms at work. While we know that certain brain areas respond to language, we struggle to explain what exactly they are picking up on-whether it’s food, places, numbers, or something else entirely. Generative causal testing (GCT), a groundbreaking framework developed by Microsoft Research and collaborating universities, is tackling this explainability crisis head-on. By distilling the predictions of brain-prediction models into short, readable explanations, GCT bridges the gap between abstract data and concrete understanding. For example, if a model predicts that a specific brain region lights up in response to phrases like “food preparation” or “location names,” GCT verifies this by generating new stories tailored to activate those regions. When subjects hear these stories in a scanner, their brain activity is measured-offering confirmation or refutation of the initial hypothesis. This approach not only validates existing knowledge but also reveals new layers of complexity in how our brains process language. For instance, GCT has teased apart neighboring place-processing regions once thought interchangeable and uncovered tiny prefrontal micro-regions tuned to specific concepts like dialogue, clock times, and measurements. These findings underscore the potential for GCT to transform computational neuroscience by turning black-box models into testable theories rooted in human language and cognition. Looking ahead, the implications of this research are profound. As AI continues to evolve, our ability to understand and explain its inner workings will become increasingly vital. By leveraging GCT, scientists can unlock new insights into the brain’s architecture and function-ultimately paving the way for advancements in education, mental health treatment, and artificial intelligence development. The future of language neuroscience is not just about predicting brain activity; it’s about translating those predictions into meaningful, actionable knowledge that benefits us all.
AI Just Solved a Problem We've Had for Years - Rare Disease Diagnosis Is Finally Getting the Breakthrough It Deserves
For years, families like Jordan Avi Ogman's have faced an excruciating wait for answers. Diagnosed with TECPR2, a fatal neurodegenerative disease, it took nearly four years of confusion and emotional strain to finally identify his condition. This delay is not uncommon-on average, rare disease patients wait five to seven years for an accurate diagnosis. By then, crucial opportunities for treatment may have already slipped away. But now, artificial intelligence is changing the game. Recent advancements in AI tools like OpenAI's o3 Deep Research model and Microsoft's Talos platform are revolutionizing rare disease diagnosis. These systems analyze vast genomic datasets to identify patterns that human researchers might miss. In a study published in NEJM AI, OpenAI's model helped diagnose 18 children at Boston Children's Hospital who had been previously undiagnosed. The AI identified new diagnoses for neurodevelopmental and neuromuscular disorders, among others, achieving a diagnostic yield of nearly 5%. This may seem modest, but consider the context: these cases had already been analyzed multiple times without success. Talos, developed by Microsoft in collaboration with leading research institutions, takes this a step further. By automating reanalysis of genomic data, Talos has delivered over 241 new diagnoses across nearly 5,000 patients. It operates on a simple principle: as our understanding of the genome evolves, so should the analysis of existing genetic data. Unlike traditional methods that rely on manual review, Talos flags only the most likely candidates for human expertise, reducing the workload while maintaining accuracy. The implications are profound. For Jordan and others like him, this means faster access to care and potentially life-saving treatments. By cutting down diagnosis times from years to seconds, AI is not just a tool-it's a lifeline. These breakthroughs highlight the power of combining human expertise with machine learning. While AI does the heavy lifting of sifting through data, doctors can focus on what they do best: interpreting results and providing compassionate care. The future looks promising. As more genetic associations are discovered and AI systems improve, we can expect even greater progress in rare disease diagnosis. Tools like Talos and OpenAI's model demonstrate that automation is not just an efficiency gain-it's a moral imperative. Every delay in diagnosis is a missed opportunity for treatment, and every second saved means hope for families who have waited too long. In the coming years, we can expect AI to play an increasingly vital role in rare disease research. Already, systems like Talos are proving that reanalysis doesn't have to be a one-time effort. By automating this process, we ensure that no genetic data goes unused. This shift represents more than just technological progress-it's a fundamental change in how we approach healthcare challenges. The journey for families like Jordan's is far from over, but the tools emerging from Microsoft and OpenAI offer real hope. Rare disease diagnosis is finally getting the breakthrough it deserves-a future where no one has to wait years for answers.