Papers of the day   All papers

Self-Supervised Learning of Pretext-Invariant Representations

Comments

Dec 10 2019 Yann LeCun

There are now 3 papers that successfully use Self-Supervised Learning for visual feature learning: MoCo: https://arxiv.org/abs/1911.05722 PIRL: https://arxiv.org/abs/1912.01991 And this, below. All three use some form of Siamese net.
3 replies, 1093 likes


Dec 09 2019 Aäron van den Oord

Unsupervised pre-training now outperforms supervised learning on ImageNet for any data regime (see figure) and also for transfer learning to Pascal VOC object detection https://arxiv.org/abs/1905.09272v2 https://t.co/cciL5Db73x
4 replies, 778 likes


Dec 05 2019 Yann LeCun

SSL FTW! Pretext-Invariant Representation Learning: a self-supervised method based on Siamese nets for visual feature learning from FAIR. Beats supervised pre-training & all previous SSL methods on ImageNet, VOC-07-12, etc. https://arxiv.org/abs/1912.01991
2 replies, 144 likes


Dec 10 2019 Alf @ 𝑣ʳIPS

The revolution, which is unsupervised, has started! Join us! 👊🏻
1 replies, 8 likes


Feb 15 2020 MONTREAL.AI

Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra, Laurens van der Maaten: https://arxiv.org/abs/1912.01991 #ArtificialIntelligence #DeepLearning #UnsupervisedLearning https://t.co/DIUc9yOMZY
0 replies, 7 likes


Content