Self Labeling Refinement procedure in Self-Supervised framework Bootstrap Your Own Latent (BYOL)
Introduced two new loss functions for learning robust image representations for doing self-labeling refinement.
- Cross-cosine Similarity Loss (CCSL)
- Cross-Sigmoid Similarity Loss (CSSL)
Following are the screenshots from the paper
As we can see that the proposed loss functions, CCSL and CSSL are outperforming the vanilla BYOL setup on STL classification dataset for linear evaluation protocol.