Papers of the day   All papers

CONTRASTIVE LEARNING OF STRUCTURED WORLD MODELS

Comments

Nov 28 2019 Thomas Kipf

Excited to share our work on Contrastive Learning of Structured World Models! C-SWMs learn object-factorized models & discover objects without supervision, using a simple loss inspired by work on graph embeddings Paper: http://arxiv.org/abs/1911.12247 Code: https://github.com/tkipf/c-swm 1/5 https://t.co/2n38bhOaKc
3 replies, 527 likes


Dec 20 2019 Thomas Kipf

Our paper on Structured World Models got accepted to #ICLR2020 as a long talk! @iclr_conf https://openreview.net/forum?id=H1gax6VtDB Congrats to amazing co-authors @ElisevanderPol @wellingmax
5 replies, 283 likes


Nov 28 2019 hardmaru

Contrastive Learning of Structured World Models A structured understanding of our world in terms of objects, relations and hierarchies is an important part of human cognition. This paper explores using graph neural nets to learn structured world models. https://arxiv.org/abs/1911.12247 https://t.co/8NwzQoSMZW
1 replies, 240 likes


Jan 14 2020 mat kelcey

been hacking for awhile on the idea of training an embedding based YOLO with self supervision contrastive loss. have never had a good solution for unsupervised object detection piece.... until now!!! "Contrastive Learning of Structured World Models" https://arxiv.org/abs/1911.12247 https://t.co/k2h4I6mkrF
1 replies, 166 likes


Nov 28 2019 Elise van der Pol

👇This! Happy with our new work on learning object-factorized models without labels.
0 replies, 43 likes


Nov 29 2019 Jesse Engel

I'm a big fan of object oriented generative/world models so it's great to see all the progress in this area.
0 replies, 25 likes


Nov 28 2019 Adam Kosiorek

very cool paper :)
0 replies, 18 likes


Nov 28 2019 Sjoerd van Steenkiste

Interesting to see that one can learn about objects without reconstructing in pixel-space! I wonder if contrastive learning in this way will allow us to overcome the limitations of existing object-centric approaches in coping with complex backgrounds that are hard to reconstruct.
0 replies, 17 likes


Nov 28 2019 Daniel Daza

Unsupervised learning: ✅ Object decomposition: ✅ No ELBO or Markov chains: ✅ Contrastive loss in latent space: ✅ Plenty of reasons to be excited!
0 replies, 10 likes


Dec 25 2019 hardmaru

@ngutten @yudapearl @jsusskin @LeCun I think @thomaskipf’s paper that looks at building unsupervised, structured world models might be also a good way forward at evaluating unseen interventions. In their paper they propose a metric that might have similar motivations as this discussion~ https://twitter.com/thomaskipf/status/1200000165068902400?s=21
1 replies, 9 likes


Dec 25 2019 hardmaru

@ngutten @yudapearl @jsusskin @LeCun I think @thomaskipf’s paper that looks at building unsupervised, structured world models might be also a good way forward at evaluating unseen interventions. In their paper they propose a metric that might have similar motivations as this discussion. https://arxiv.org/abs/1911.12247
0 replies, 6 likes


Content