Papers of the day   All papers

Episodic Memory in Lifelong Language Learning

Comments

Oct 24 2019 DeepMind

Our new work uses episodic memory to learn language tasks in a lifelong setting. The episodic memory is used in two ways: sparse experience replay during training and local adaptation during inference. Paper: http://arxiv.org/abs/1906.01076 Cyprien, @seb_ruder, @ikekong & @DaniYogatama https://t.co/ST3FjUfadG
2 replies, 692 likes


Sep 08 2019 Sebastian Ruder

1/ Our paper Episodic Memory in Lifelong Language Learning with Cyprien de Masson d'Autume, @ikekong, and @DaniYogatama was accepted to @NeurIPSConf. We go beyond MTL and tackle lifelong learning where models need to acquire new information continually: https://arxiv.org/abs/1906.01076 https://t.co/SCcz9hgGm8
3 replies, 415 likes


Jun 11 2019 Sebastian Ruder

In our new paper (my first collaboration at DeepMind, yay!) with Cyprien, @ikekong, & @DaniYogatama, we leverage episodic memory during training (sparse replay) and inference (local adaptation) for continual learning (on QA and classification tasks). https://arxiv.org/abs/1906.01076 https://t.co/ZHdl3yAu72
2 replies, 259 likes


Jun 05 2019 Dani Yogatama

We think episodic memory is a key component of general linguistic intelligence models. In this work, we use it for sparse experience replay and local adaptation to mitigate catastrophic forgetting in textcat and QA: https://arxiv.org/abs/1906.01076 (with Cyprien, @seb_ruder , @ikekong)
0 replies, 149 likes


Sep 19 2019 Thomas Scialom

Episodic Memory in Lifelong Language Learning https://arxiv.org/pdf/1906.01076.pdf Motivation: prevent catastrophic forgettingĀ in neural networks The authors proposed an episodic memory model that performs sparse experience replay and local adaptation with the following components:
3 replies, 102 likes


Jul 29 2019 IntuitionMachine

Paper on reducing catastrophic forgetting in language learning (from DeepMind) https://arxiv.org/abs/1906.01076 https://t.co/6RBu5rN91v
0 replies, 3 likes


Sep 09 2019 Deepak Garasangi

And you all should definitely check his new paper on episodic memory here ! https://arxiv.org/abs/1906.01076
1 replies, 2 likes


Content