All terms
Training
Training Step
One parameter update during training, processing a single batch of data.
Definition
A training step is a single parameter update during training. In each step the model processes one batch of data, computes the loss, derives gradients through backpropagation, and the optimizer adjusts the weights. Training runs are measured in thousands or millions of these steps, and an epoch is one full pass over the dataset.