Papers of the day   All papers

Self-Supervised Learning of Pretext-Invariant Representations


Dec 10 2019 Yann LeCun

There are now 3 papers that successfully use Self-Supervised Learning for visual feature learning: MoCo: PIRL: And this, below. All three use some form of Siamese net.
3 replies, 1094 likes

Dec 09 2019 Aäron van den Oord

Unsupervised pre-training now outperforms supervised learning on ImageNet for any data regime (see figure) and also for transfer learning to Pascal VOC object detection
4 replies, 778 likes

Dec 05 2019 Yann LeCun

SSL FTW! Pretext-Invariant Representation Learning: a self-supervised method based on Siamese nets for visual feature learning from FAIR. Beats supervised pre-training & all previous SSL methods on ImageNet, VOC-07-12, etc.
2 replies, 144 likes

Dec 10 2019 Alf @ 𝑣ʳIPS

The revolution, which is unsupervised, has started! Join us! 👊🏻
1 replies, 8 likes