All terms
Frameworks & Tools
Ray
An open-source framework for parallelizing Python and scaling ML across clusters.
Definition
Ray is an open-source compute framework from Anyscale for parallelizing Python code and scaling machine learning across clusters. Its libraries cover distributed training, hyperparameter search, model serving, and data preprocessing. Many LLM inference systems, including vLLM, rely on Ray to coordinate work across multiple machines and GPUs.