Introducing Claude 2.1

Our latest modelClaude 2.1is now available over API in our Console and is powering our claude.ai chat experience. Claude 2.1 delivers advancements in key capabilities for enterprises—including an industry-leading 200K token context windowsignificant reductions in rates of model hallucinationsystem prompts and our new beta feature: tool use. We are also updating our pricing to improve cost efficiency for our customers across models.

200K Context Window

Since our launch earlier this yearClaude has been used by millions of people for a wide range of applications—from translating academic papers to drafting business plans and analyzing complex contracts. In discussions with our usersthey’ve asked for larger context windows and more accurate outputs when working with long documents.

In responsewe’re doubling the amount of information you can relay to Claude with a limit of 200,000 tokenstranslating to roughly 150,000 wordsor over 500 pages of material. Our users can now upload technical documentation like entire codebasesfinancial statements like S-1sor even long literary works like The Iliad or The Odyssey. By being able to talk to large bodies of content or dataClaude can summarizeperform Q&Aforecast trendscompare and contrast multiple documentsand much more.

Processing a 200K length message is a complex feat and an industry first. While we’re excited to get this powerful new capability into the hands of our userstasks that would typically require hours of human effort to complete may take Claude a few minutes. We expect the latency to decrease substantially as the technology progresses.

2x Decrease in Hallucination Rates

Claude 2.1 has also made significant gains in honestywith a 2x decrease in false statements compared to our previous Claude 2.0 model. This enables enterprises to build high-performing AI applications that solve concrete business problems and deploy AI across their operations with greater trust and reliability.

We tested Claude 2.1’s honesty by curating a large set of complexfactual questions that probe known weaknesses in current models. Using a rubric that distinguishes incorrect claims (“The fifth most populous city in Bolivia is Montero”) from admissions of uncertainty (“I’m not sure what the fifth most populous city in Bolivia is”)Claude 2.1 was significantly more likely to demur rather than provide incorrect information.

Claude 2.1 has also made meaningful improvements in comprehension and summarizationparticularly for longcomplex documents that demand a high degree of accuracysuch as legal documentsfinancial reports and technical specifications. In our evaluationsClaude 2.1 demonstrated a 30% reduction in incorrect answers and a 3-4x lower rate of mistakenly concluding a document supports a particular claim.

While we are encouraged by these accuracy improvementsenhancing the precision and dependability of outputs for our users remains a top priority for our product and research teams.

API Tool Use

By popular demandwe’ve also added tool usea new beta feature that allows Claude to integrate with users' existing processesproductsand APIs. This expanded interoperability aims to make Claude more useful across our users’ day-to-day operations.

Claude can now orchestrate across developer-defined functions or APIssearch over web sourcesand retrieve information from private knowledge bases. Users can define a set of tools for Claude to use and specify a request. The model will then decide which tool is required to achieve the task and execute an action on their behalfsuch as:

• Using a calculator for complex numerical reasoning
• Translating natural language requests into structured API calls
• Answering questions by searching databases or using a web search API
• Taking simple actions in software via private APIs
• Connecting to product datasets to make recommendations and help users complete purchases

Tool use is currently in early development—we are building developer features and prompting guidelines for easier integration into your applications. We encourage users to share feedback on tool use to help shape and improve the product.

Developer Experience

We’ve been working to simplify our developer Console experience for Claude API users while making it easier to test new prompts for faster learning. Our new Workbench product enables developers to iterate on prompts in a playground- experience and access new model settings to optimize Claude’s behavior. They can create multiple prompts and navigate between them for different projectsand revisions are saved as they go to retain historical context. Developers can also generate code snippets to use their prompts directly in one of our SDKs.

We’re also introducing system promptswhich allow users to provide custom instructions to Claude in order to improve performance. System prompts set helpful context that enhances Claude’s ability to take on specified personalities and roles or structure responses in a more customizableconsistent way aligned with user needs.

Claude 2.1 is available now in our APIand is also powering our chat interface at claude.ai for both the free and Pro tiers. Usage of the 200K token context window is reserved for Claude Pro userswho can now upload larger files than ever before. We can't wait to see the use cases these new features inspire as we work to build the safest and most technically sophisticated AI systems in the industry.