Papers of the day   All papers

Data-Efficient Image Recognition with Contrastive Predictive Coding


May 23 2019 DeepMind

Deep learning has so far relied on massive amounts of supervision. We show that unsupervised representation learning with Contrastive Predictive Coding greatly improves data-efficiency: By @olivierhenaff @catamorphist @CarlDoersch @arkitus and @avdnoord
6 replies, 803 likes

May 23 2019 Ali Eslami

Getting closer to the dream! A network that uses unlabelled images to boost performance when labels are scarce (new SOTA), and it's no worse than ResNet when labels are plentiful. Also: Unsupervised net + just a linear on top outperforms original AlexNet!
5 replies, 402 likes

May 23 2019 Aäron van den Oord

Excited to share our latest results on Contrastive Predictive Coding! -A linear classifier on CPC features yield 61% ACC, outperforming the original AlexNet result with unsupervised learning. -New state of the art in semi-supervised learning w 1% labels.
3 replies, 370 likes

May 24 2019 Kriegeskorte Lab

unsupervised learning is the missing cake under the icing of supervision. zhuang, zhai & @dyamins describe a method for deep learning of locally clustered embeddings ( and henaff, al., et @avdnoord use spatial contrastive predictive coding...
1 replies, 15 likes

May 24 2019 Daisuke Okanohara

They improve the contrastive predictive coding by using 1) a larger network 2) bidirectional prediction 3) data augmentation (color dropping, random flip, jitter), and achieving new SOTA of semi-sup and even frozen features are competitive to fine-tuning
0 replies, 8 likes

May 27 2019 Heuritech Research

"Data-Efficient Image Recognition with Contrastive Predictive Coding": learns to distinguish different patches of the current image among negatives patches. Amazing performance that scale well with the number of labeled examples! #DeepLearning
0 replies, 6 likes

May 31 2019 l̴o̴o̴p̴u̴l̴e̴a̴s̴a̴

Wow, @DeepMindAI breaks records at image classification, learning the class after only 13 examples per class! Very data efficient. Getting very close to human babies.
1 replies, 2 likes

May 31 2019 Kirill Dubovikov

DeepMind's self-supervised CNN achieves AlexNets accuracy with only 13 images per class
0 replies, 2 likes

May 23 2019 TAMART

The unsupervised revolution has begun?
0 replies, 1 likes

May 23 2019 Amr Farahat

This looks great!
0 replies, 1 likes

Jun 03 2019 Andrew Cutler

Pretty cool paper. You need less training data if you encourage representations of one part of an image to contain information about (unseen) other parts of the image.
1 replies, 0 likes