Papers of the day   All papers

Experience Grounds Language


Ari Holtzman: "You can't learn language from the radio." 📻 Why does NLP keep trying to? In we argue that physical and social grounding are key because, no matter the architecture, text-only learning doesn't have access to what language is *about* and what it *does*.

18 replies, 644 likes

Ari Holtzman: We’ll be presenting an updated and expanded version of “Experience Grounds Language” at EMNLP 2020! We’ve greatly appreciated all the conversations both here on Twitter and in individual meetings.

6 replies, 58 likes

Mark Riedl | I stand with international students: Is there something in the water in the AI community? A strong theme of questioning “understanding” in AI systems: 1. @MelMitchell1 2. @emilymbender 3. @ybisk @_jessethomason_ 4. Me

2 replies, 51 likes

Adam Santoro: "Experience Grounds Language" Some really nice thoughts on language grounding! I'm totally on board with this agenda, though I do have a few minor quibbles:

1 replies, 36 likes

Jay Alammar: I've been thinking that Tesla is potentially the world's most exciting NLP company. The next breakthroughs in massive language models are likely to come from perception and embodiment ( Telling you car "Hey Tesla, follow that car" is, like, GPT5. 1/n

2 replies, 32 likes

David Schlangen: This looks like an interesting paper! It's a bit of an indictment of our field that this relatively obvious fact needs to be made again and again, but on the other hand the fact that it is being made more often recently is a good sign perhaps.

4 replies, 22 likes

Fabian Offert: Must-read from #NLP essentially doing #DH's job. Also echoes many conversations on "meaning" I had in the past year, with @alanyliu, @Peter_Bell77, and others.

1 replies, 11 likes

Pierre-Yves Oudeyer: On the topic of grounding language in action and social context, the work and roadmap made 10 years ago in development robotics (Italk EU project) is still fully relevant for #AI, #NPL and #DeepRL. Turn off the radio and go explore the world :)

0 replies, 10 likes

arXiv CS-CL: Experience Grounds Language

0 replies, 9 likes

Laura Graesser: Happy to see this. In the words of Terry Winograd & Fernando Flores: "Language and cognition are fundamentally social. Maturana, Gadamer, and Heidegger all argue that our ability to think and give meaning to language is rooted in our participation in a society and a tradition."

1 replies, 8 likes

ALife Papers: Experience Grounds Language " we consider work on the contextual foundations of language: grounding, embodiment, and social interaction. [...] history and possible progression of how contextual information can factor into our representations"

0 replies, 6 likes

Steffen Christensen: Want to understand what #GPT3 is doing? Check out the links in this awesome thread! #AI #semanticAI #governance #econ /c @supergovernance @ArmineYalnizyan

0 replies, 5 likes

Rowan Zellers: Neat opinion piece + framework about the limitations of NLP today -- and what we should do next

0 replies, 5 likes

MT Group at FBK: Our pick of the week: Bisk et al. #emnlp2020 paper "Experience Grounds Language". By @BeatriceSavoldi #nlproc @ybisk @universeinanegg @_jessethomason_ @jacobandreas @aggielaz @jonathanmay @npinto @turian

0 replies, 5 likes

Giosuè Baggio: NLP/AI rediscovers/reworks old ideas about “grounding, embodiment, and social interaction”—perhaps they will succeed where philosophy and psychology have failed… ‘Experience Grounds Language’, by @ybisk et al. @arxiv

0 replies, 5 likes

BeatriceSavoldi: In the GPT-3 hype, let's revisit the differences between human language understanding and current NLU systems in the paper: "Experience Grounds Language" Spoiler alert: the authors put forward some exciting ideas for future research @fbk_mt

0 replies, 4 likes

Felix Hill: Great work now updated

0 replies, 3 likes

Ari Holtzman: @yoavgo Agreed! I think our theme paper got rejected for being a bit less safe (, so I think that's information towards the shape of the filter, though of course there's noise/other possible objections to our work.

1 replies, 2 likes

Seth Stafford: Fun and informative chat with @emilymbender on TWiML with @samcharrington ! She recommended this impressive manifesto on the essential role of sensory experience/action in grounding language. The rhetorical salvo below (pic) is an apt summary.

1 replies, 2 likes

Dr Catherine Breslin: Experience grounds language - Language understanding ought to be related to the “physical world it describes and to the social interactions it facilitates”

0 replies, 1 likes

Jordi Armengol: Thought experiment: you find large text documents from an alien civilization. Somehow, you manage to discretize/tokenize the raw input and use it to train a SOTA language model. Yet, you don’t understand a thing of the alien language (nor does the language model). #grounding

0 replies, 1 likes


Found on Apr 22 2020 at

PDF content of a computer science paper: Experience Grounds Language