A rater is a human who evaluates examples, labels data, or judges model outputs. Raters are often used in supervised learning, evaluation, and reinforcement learning from human feedback, where their consistency and guidelines affect dataset and model quality.
A human who provides labels for examples. "Annotator" is another name for rater. See Categorical data: Common issues in Machine Learning Crash Course for more information.