Also known as: Self supervised Learning
Self-supervised learning — подход machine learning, создающий training signals из самих unlabeled data. Он преобразует аспекты unsupervised problem в supervised learning путем generating surrogate labels, что полезно, когда labeled data scarce, но unlabeled data abundant.
A family of techniques for converting an unsupervised machine learning problem into a supervised machine learning problem by creating surrogate labels from unlabeled examples. Some Transformer-based models such as BERT use self-supervised learning. Self-supervised training is a semi-supervised learning approach.