# What is a token in AI?

A token is the smallest unit of text a language model works with: a word, part of a word, a character or a byte. Models read and write tokens, so context limits and API prices are counted in tokens rather than words.

## Tokens and words

How many characters make a token depends on the model and the language. Anthropic's glossary gives about 3.5 English characters per token for its earlier models, and says its newer tokenizer (Claude 4.7 and later) produces about 30% more tokens for the same text. For exact numbers, providers offer token counting for the model you use.

## Why you meet them

- **Limits**: the [context window](https://ai-powered.com/academy/glossary/context-window) is a number of tokens.
- **Prices**: API usage is billed per input and output token.
- **Speed**: longer outputs mean more tokens to generate.

## Sources

Official documentation, checked on 19 November 2026:

- [Glossary (Claude docs)](https://platform.claude.com/docs/en/about-claude/glossary)

## Related terms

- [LLM](https://ai-powered.com/academy/glossary/llm): An LLM (large language model) is an AI model with a very large number of parameters, trained on vast amounts of text, that generates text: it can answer questions, summarise, write and more. AI assistants are built on LLMs that are further trained to be helpful.
- [Context window](https://ai-powered.com/academy/glossary/context-window): The context window is the amount of text a language model can look at while it writes a reply: your messages, files, tool results and its own earlier answers. It is the model's working memory, separate from what it learned in training, and it is measured in tokens.
