Also known as: GPT
Generative Pretrained Transformer (GPT) ist eine Art großes Sprachmodell auf Basis der Transformer-Architektur, das darauf trainiert ist, Text durch Vorhersage von Tokens zu erzeugen. Es wird zunächst auf großen Textkorpora vortrainiert und kann anschließend für Dialog, Befolgung von Anweisungen oder spezialisierte Aufgaben angepasst werden.
A large language model based on the transformer architecture that generates text. It is first pretrained to predict the next token in texts (a token is typically a word, subword, or punctuation). After their pretraining, GPT models can generate human-like text by repeatedly predicting the token that they would expect to follow. GPT models are usually also fine-tuned, for example with reinforcement learning from human feedback to reduce hallucination or harmful behaviour, or to format the output in a conversationnal format.
A family of Transformer-based large language models developed by OpenAI. GPT variants can apply to multiple modalities, including: - image generation (for example, ImageGPT) - text-to-image generation (for example, DALL-E).