Also known as: Test dataset · Testing Data
Ein Test Set ist ein reservierter Datensatz, der eine unabhängige Evaluation eines trainierten Modells oder KI-Systems ermöglicht. Er sollte von Trainings- und Validierungsdaten getrennt sein, damit Leistungsschätzungen das Verhalten auf ungesehenen Daten vor Bereitstellung oder Veröffentlichung besser widerspiegeln.
‘data used to assess the performance of a final model’ ISO/IEC 22989.
A subset of the dataset reserved for testing a trained model. Traditionally, you divide examples in the dataset into the following three distinct subsets: - a training set - a validation set - a test set Each example in a dataset should belong to only one of the preceding subsets. For instance, a single example shouldn't belong to both the training set and the test set. The training set and validation set are both closely tied to training a model. Because the test set is only indirectly associated with training, test loss is a less biased, higher quality metric than training loss or validation loss. See Datasets: Dividing the original dataset in Machine Learning Crash Course for more information.
A side-by-side comparison of Training Data and Test Set. Understand why the data used to fit a model must be separated from the reserved data used to evaluate it.
A side-by-side comparison of Validation Data and Test Set. Understand why development tuning data must remain separate from independent evaluation data.
A side-by-side comparison of Test Set and Holdout Data. Understand how a reserved test set relates to the broader category of data excluded from training for validation or evaluation.