Context Window
The amount of text an LLM can process in a single request. Context window sizes vary by model and affect how much information can be included in a prompt. Managing context windows is essential for RAG and conversation systems.
Core Concept
The amount of text an LLM can process in a single request. Context window sizes vary by model and affect how much information can be included in a prompt. Managing context windows is essential for RAG and conversation systems.
Related Services
Ready to Turn Your AI Idea Into a Working System?
Tell us what you want AI to do. We will help you determine whether AI is the right approach and how to build it.