Also known as: Cross entropy
Кросс-энтропия — это loss function, которая измеряет различие между predicted probability distribution и target distribution. Она широко используется в classification и language modeling, включая multi-class tasks.
A generalization of Log Loss to multi-class classification problems. Cross-entropy quantifies the difference between two probability distributions. See also perplexity.