Safe Semi-Supervised Learning
الملخص
Semi-supervised algorithms have been shown to possibly have a worse performance than the corresponding supervised model. This may be due to a violation of the assumptions on the data that are introduced in most classification systems. We study an approach that was previously shown to have guarantees of improvement for the LDA classifier in terms of log-likelihood on the full data-set of labeled and unlabeled observations. This method is based on two key concepts: contrast and pessimism. We extend this approach to a broader class of probabilistic generative models, in which the class conditional distributions can be modeled with any parametric class that belongs to the exponential family. In this case, we prove that the classifier is never worse and, under mild assumptions, strictly improves the log-likelihood on the complete data-set. The case of Gaussian densities is analyzed in detail, both for LDA and QDA. Moreover, we study this method in the case of least squares classification. In terms of square loss we prove the contrastive pessimistic classifier is guaranteed not to degrade the performance and, with a further requirement on the data, it strictly outperforms the supervised model. Finally, we apply contrast and pessimism to the task of parameter estimation of a multivariate Gaussian density in a missing data framework. We fully characterize the case of a missing block of data and we show that a strictly increased likelihood on the complete data-set is obtained for any monotone sample. In other terms, the contrastive pessimistic estimates are guaranteed to fit better the complete data-set composed of both observed and hidden components.
الكلمات المفتاحية
غير متوفر
التخصصات
رسائل وأطاريح مشابهة
- Improving Human Behavior Understanding with Semi-supervised Learning Bruno Manuel Degardin · 2026
- Self- and semi-supervised machine learning techniques for discovering novel ocular and neuroimaging biomarkers of Alzheimer's disease Charlene Z. L. Ong · Nanyang Technological University · 2025
- Semi-Self-Supervised Learning for Deep Models: Reducing Annotation Costs in Dense-Pattern Agricultural Image Analysis Najafian, Keyhan · University of Saskatchewan · 2025
- Learning semantic representations of language, vision and code for visualization-oriented dialogue Henrik Voigt · 2026
- SELF-SUPERVISED LEARNING FOR REFRIGERATION SYSTEM MONITORING IN IIOT Xavier Alexander Lopez · 2026
- Transformers and contrastive semi-supervised learning for medical image segmentation Qianying Liu · The University of Glasgow · 2026
