All terms
Frameworks & Tools
LLMOps
The tools and practices for deploying, monitoring, and maintaining language models in production.
Definition
LLMOps is the set of tools and practices for running large language models in production — managing prompts, evaluation pipelines, cost, safety monitoring, and versioning, and coping with the fact that outputs vary run to run. It extends traditional MLOps (the equivalent discipline for machine-learning systems) to the quirks of language models.