Probabilistic describes systems, methods, or decisions that are based on likelihoods rather than fixed certainty. In generative AI, probabilistic models select outputs according to probability distributions, so settings such as temperature can affect how predictable or varied the response becomes.
In general, any situation in which decisions are made based on likelihoods or odds. LLMs are probabilistic systems, generating the next word or sentence in a response based on probabilities. If the temperature is relatively low, an LLM will choose words or sentences having high probabilities. If the temperature is relatively high, an LLM will be more "creative," sometimes choosing words or sentences having lower probabilities.