Also known as: GPT
Generative Pretrained Transformer (GPT) is a type of large language model based on the Transformer architecture and trained to generate text by predicting tokens. It is first pretrained on large text corpora and may then be adapted for dialogue, instruction following, or specialized tasks.
A large language model based on the transformer architecture that generates text. It is first pretrained to predict the next token in texts (a token is typically a word, subword, or punctuation). After their pretraining, GPT models can generate human-like text by repeatedly predicting the token that they would expect to follow. GPT models are usually also fine-tuned, for example with reinforcement learning from human feedback to reduce hallucination or harmful behaviour, or to format the output in a conversationnal format.
A family of Transformer-based large language models developed by OpenAI. GPT variants can apply to multiple modalities, including: - image generation (for example, ImageGPT) - text-to-image generation (for example, DALL-E).