All terms
Inference & Serving
Batch Processing
Running many jobs together in bulk, often cheaper but slower than one at a time.
Definition
Batch processing runs many tasks together as a group rather than one at a time in real time. AI providers often offer cheaper batch options for large jobs — like labeling a million records — that can wait, since the work can be scheduled when spare capacity is available. It trades speed for lower cost.