Papers of the day   All papers

Large Associative Memory Problem in Neurobiology and Machine Learning

Comments

John Hopfield: Dense Associative Memories, aka modern Hopfield networks, have a huge memory storage capacity. But are they biologically realistic? In our new paper with @DimaKrotov we argue that they can be written in terms of biological variables. https://arxiv.org/abs/2008.06996 https://t.co/dGp4npMRo2

1 replies, 337 likes


hardmaru: Large Associative Memory Problem in Neurobiology and Machine Learning Biological plausible explanation of “Hopfield Networks is All You Need” by Krotov and Hopfield Paper: https://arxiv.org/abs/2008.06996 Discussion: https://redd.it/icjcfk https://t.co/tDWf4QgYpE

3 replies, 171 likes


Dmitry Krotov: New microscopic theory of Dense Associative Memory aka modern Hopfield network can be reduced to the model proposed in “Hopfield Networks is All You Need’’ paper, which is equivalent to self-attention mechanism of Transformers. Work with @HopfieldJohn https://arxiv.org/abs/2008.06996 https://t.co/212qRx9JrQ

1 replies, 155 likes


ALife Papers: Large Associative Memory Problem in Neurobiology and Machine Learning "our proposed microscopic theory is a valid model of large associative memory with a degree of biological plausibility" https://arxiv.org/abs/2008.06996 https://t.co/ro6U2Xgi37

0 replies, 33 likes


IARAI: Interesting paper by @DimaKrotov and @HopfieldJohn. #HopfieldNetworksIsAllYouNeed

0 replies, 6 likes


Johannes Brandstetter: New cool paper on Dense Associative Memories by @DimaKrotov and @HopfieldJohn (no need to say more)

1 replies, 4 likes


Johannes Brandstetter: New cool paper on microscopic theory of Dense Associative Memory

0 replies, 2 likes


Eilif B. Muller: "Large Associative Memory Problem in Neurobiology and Machine Learning" https://arxiv.org/pdf/2008.06996.pdf

0 replies, 1 likes


Content

Found on Aug 18 2020 at https://arxiv.org/pdf/2008.06996.pdf

PDF content of a computer science paper: Large Associative Memory Problem in Neurobiology and Machine Learning