A parameter update is the adjustment of a model’s learned values during training. It typically occurs after computing gradients or other learning signals in an iteration of the training process.
The operation of adjusting a model's parameters during training, typically within a single iteration of gradient descent.