Context Window

What is Context Window?

The maximum amount of text (in tokens) an LLM can consider at one time. If exceeded, the model 'forgets' the start of the conversation.

Where did the term "Context Window" come from?

Defined by model architecture memory limits.

How is "Context Window" used today?

Moving from 4k to 1M+ (Gemini/Llama).

Related Terms

• llm
• KV Cache (Key-Value Cache)