# What is an LLM (large language model)?

An LLM (large language model) is an AI model with a very large number of parameters, trained on vast amounts of text, that generates text: it can answer questions, summarise, write and more. AI assistants are built on LLMs that are further trained to be helpful.

## How an LLM gets useful

A model is first **pretrained** to predict the next piece of text across a huge collection of documents. That alone doesn't make a good assistant, so it is then trained further, for example with **fine-tuning** and **RLHF** (reinforcement learning from human feedback, where people rank answers and the model learns to prefer the better ones). Anthropic's glossary describes Claude this way.

## What it means for you

An LLM writes a likely, useful continuation of what you give it. It doesn't look facts up unless the app gives it a search or [RAG](https://ai-powered.com/academy/glossary/rag) step, which is why answers need checking. What it can take in at once is limited by its [context window](https://ai-powered.com/academy/glossary/context-window), measured in [tokens](https://ai-powered.com/academy/glossary/token).

Model names change almost every week, so this glossary doesn't rank them. See [What is an AI assistant, and which should I use?](https://ai-powered.com/academy/ai-basics/what-is-an-ai-assistant)

## Sources

Official documentation, checked on 19 November 2026:

- [Glossary (Claude docs)](https://platform.claude.com/docs/en/about-claude/glossary)

## Related terms

- [Token](https://ai-powered.com/academy/glossary/token): A token is the smallest unit of text a language model works with: a word, part of a word, a character or a byte. Models read and write tokens, so context limits and API prices are counted in tokens rather than words.
- [Context window](https://ai-powered.com/academy/glossary/context-window): The context window is the amount of text a language model can look at while it writes a reply: your messages, files, tool results and its own earlier answers. It is the model's working memory, separate from what it learned in training, and it is measured in tokens.
- [RAG](https://ai-powered.com/academy/glossary/rag): RAG (retrieval-augmented generation) is a technique where relevant documents are fetched from a knowledge base when you ask a question and passed to the language model with it, so the answer is grounded in that material instead of the model's memory.
