Un modèle de langage est un modèle qui estime ou génère des séquences de langage. Il apprend des représentations statistiques ou neuronales de mots, tokens ou phrases et peut soutenir des tâches telles que la prédiction, la génération, la traduction, le résumé et le dialogue.
A probabilistic model that manipulates natural language.
A model that estimates the probability of a token or sequence of tokens occurring in a longer sequence of tokens. Though counterintuitive, many models that evaluate text are not language models . For example, text classification models and sentiment analysis models are not language models. See What is a language model? in Machine Learning Crash Course for more information.