AI Isn't Just Guessing: LLMs Do More Than Predict Next Tokens
In brief
- AI researchers are pushing back against the idea that large language models (LLMs) are merely "next token predictors." Critics argue this oversimplifies their capabilities, suggesting they lack true understanding or cognition.
- Instead, LLMs use a more complex process during training, where they analyze sequences of text to predict the next word.
- This involves breaking down input text into short segments called tokens and learning patterns across vast datasets.
- For example, given "The cat sat on the mat," the model predicts each subsequent word by analyzing context from previous tokens.
- During generation, users provide initial text, and the model produces a probability distribution for possible next words.
- It selects one randomly based on these probabilities, building sentences step-by-step.
- While this still feels like guessing, the scale and depth of training mean LLMs capture meaningful patterns beyond simple word prediction.
- They can generate coherent, contextually relevant text by leveraging their extensive training data.
- Looking ahead, understanding how LLMs truly operate will help refine their abilities and address ethical concerns about their decision-making processes.
- Researchers are working to clarify these mechanisms, ensuring that AI systems remain transparent and trustworthy.
Terms in this brief
- Tokens
- The building blocks of text for LLMs. Each token is a small piece of text, like a word or part of a word, that the model processes to understand context and predict the next word in a sequence.
Read full story at LessWrong →
More briefs
Harvard Trains AI Model on Pre-1931 Public Domain Content
Researchers at Harvard have trained a large language model called Talkie on public domain content from Harvard libraries published before 1931. This model can respond fluently to prompts about early aviation or 1920s social customs but falters on modern topics. The model is significant because it shows how artificial intelligence can learn from historical data. Since its release, users have tested Talkie to see if it can forecast future events or generalize concepts it was not taught. Talkie has demonstrated the ability to produce new code when given small snippets of Python. Talkie's development may change how we think about artificial intelligence and its connection to libraries and archives. It may rely on these institutions as much as technology companies. Now researchers will see how Talkie and similar models perform in the future.
AI Chatbots Spread Misinformation Before Scottish Election
A new study found that AI chatbots gave voters wrong information about the Scottish election. The study tested five free AI tools with 75 questions about the election. The tools got 34% of the answers wrong. They made up fake scandals and gave the wrong election date. 20% of voters used AI chatbots or search tools to get election information, which is about 10 million people in the UK. The Electoral Commission will now push for new laws to make AI companies more accountable and stop the spread of false information.
Young Adults in Relationships Engage with AI Chatbots
A new study found that 15% of young adults in committed relationships engage romantically with AI chatbots. This trend often happens in secrecy and can negatively impact real-life relationship dynamics. The use of chatbot romances appears to be an emerging trend, with over 20% of surveyors reporting they had at least experimented with using one. About 1 in 7 young adults in committed relationships reported regularly interacting with an AI romantic companion, which can offer immediate rewards but lack genuine relational dynamics. Young adults will likely continue to explore AI relationships in the future.
AI Enhances Health Queries with Personal Data
AI language models like Gemini 3.0 Flash can now provide more accurate and personalized answers when given access to patient health records, according to a new study. The research tested how well the AI could answer 2,257 user questions using three types of queries-short web searches, chatbot-like conversations, and direct patient questions. When provided with basic or full clinical data from patients' health records, the AI's responses improved significantly in helpfulness, safety, accuracy, relevance, and personalization compared to answers without this context. The study highlights that adding even a basic summary of a patient's medical history can make a big difference. For example, when given details like conditions and medications, the AI produced more relevant answers 95% of the time. However, there are still gaps in understanding complex health data, such as how events relate over time or handling rare medical scenarios. This advancement could help patients better understand their health by giving them clearer information. Future research should focus on addressing these remaining challenges to ensure the AI can handle even more complex cases and provide reliable assistance for users with diverse health needs.
Understanding AI Text Generation: Beyond Markov Chains
Recent advancements in artificial intelligence have revealed a critical misunderstanding about how AI generates text. Many people believe that predicting the next word, or "next token," is as simple as using a Markov chain-a method that relies on statistical probabilities of sequences. However, this approach produces nonsensical and barely coherent text, often mimicking postmodern jargon but lacking real meaning. For instance, a parody of Hacker News headlines created with Markov chains includes absurd entries like "The Growing Importance of Social Skills in the Google Search." While these examples can be amusing, they highlight the limitations of such simplistic methods. AI models, particularly large language models (LLMs), achieve far greater sophistication in generating text. Unlike Markov chains, which operate on shallow statistical patterns, LLMs generate text with nuanced context and coherence on their first try. This capability is rooted in Claude Shannon's foundational work in information theory, which established the principles for modern AI text generation. The key difference lies in the depth of understanding and contextual awareness that advanced models bring to the task. Looking ahead, researchers are focused on refining these models to better align with human-like literary sophistication. While we've made significant strides, the gap between current AI-generated text and meaningful, coherent writing remains a challenge worth watching for future developments.