Papers of the day   All papers

Experience Grounds Language

Comments

Ari Holtzman: "You can't learn language from the radio." 📻 Why does NLP keep trying to? In https://arxiv.org/abs/2004.10151 we argue that physical and social grounding are key because, no matter the architecture, text-only learning doesn't have access to what language is *about* and what it *does*.

18 replies, 644 likes


Ari Holtzman: We’ll be presenting an updated and expanded version of “Experience Grounds Language” at EMNLP 2020! https://arxiv.org/abs/2004.10151 We’ve greatly appreciated all the conversations both here on Twitter and in individual meetings.

6 replies, 58 likes


Mark Riedl | I stand with international students: Is there something in the water in the AI community? A strong theme of questioning “understanding” in AI systems: 1. @MelMitchell1 https://melaniemitchell.me/PapersContent/AIMagazine2020.pdf 2. @emilymbender https://pdfs.semanticscholar.org/5650/868ac053b71c25c4b1dd7816f38b801e70eb.pdf 3. @ybisk @_jessethomason_ https://arxiv.org/abs/2004.10151 4. Me https://youtu.be/YemciyRtYeI

2 replies, 51 likes


Adam Santoro: "Experience Grounds Language" https://arxiv.org/abs/2004.10151 Some really nice thoughts on language grounding! I'm totally on board with this agenda, though I do have a few minor quibbles:

1 replies, 36 likes


Jay Alammar: I've been thinking that Tesla is potentially the world's most exciting NLP company. The next breakthroughs in massive language models are likely to come from perception and embodiment (https://arxiv.org/pdf/2004.10151.pdf). Telling you car "Hey Tesla, follow that car" is, like, GPT5. 1/n

2 replies, 32 likes


David Schlangen: This looks like an interesting paper! It's a bit of an indictment of our field that this relatively obvious fact needs to be made again and again, but on the other hand the fact that it is being made more often recently is a good sign perhaps.

4 replies, 22 likes


Fabian Offert: Must-read from #NLP essentially doing #DH's job. Also echoes many conversations on "meaning" I had in the past year, with @alanyliu, @Peter_Bell77, and others.

1 replies, 11 likes


Pierre-Yves Oudeyer: On the topic of grounding language in action and social context, the work and roadmap made 10 years ago in development robotics (Italk EU project) is still fully relevant for #AI, #NPL and #DeepRL. Turn off the radio and go explore the world :) https://www.fose1.plymouth.ac.uk/socem/crns/italk/publications/Cangelosi-etal-Roadmap-IEEETAMD.pdf https://t.co/8VCnEn1qg5

0 replies, 10 likes


arXiv CS-CL: Experience Grounds Language http://arxiv.org/abs/2004.10151

0 replies, 9 likes


Laura Graesser: Happy to see this. In the words of Terry Winograd & Fernando Flores: "Language and cognition are fundamentally social. Maturana, Gadamer, and Heidegger all argue that our ability to think and give meaning to language is rooted in our participation in a society and a tradition."

1 replies, 8 likes


ALife Papers: Experience Grounds Language " we consider work on the contextual foundations of language: grounding, embodiment, and social interaction. [...] history and possible progression of how contextual information can factor into our representations" https://arxiv.org/pdf/2004.10151.pdf https://t.co/6PXSIO83jN

0 replies, 6 likes


Steffen Christensen: Want to understand what #GPT3 is doing? Check out the links in this awesome thread! #AI #semanticAI #governance #econ /c @supergovernance @ArmineYalnizyan

0 replies, 5 likes


Rowan Zellers: Neat opinion piece + framework about the limitations of NLP today -- and what we should do next

0 replies, 5 likes


MT Group at FBK: Our pick of the week: Bisk et al. #emnlp2020 paper "Experience Grounds Language". By @BeatriceSavoldi https://arxiv.org/pdf/2004.10151.pdf #nlproc @ybisk @universeinanegg @_jessethomason_ @jacobandreas @aggielaz @jonathanmay @npinto @turian

0 replies, 5 likes


Giosuè Baggio: NLP/AI rediscovers/reworks old ideas about “grounding, embodiment, and social interaction”—perhaps they will succeed where philosophy and psychology have failed… ‘Experience Grounds Language’, by @ybisk et al. @arxiv https://arxiv.org/abs/2004.10151

0 replies, 5 likes


BeatriceSavoldi: In the GPT-3 hype, let's revisit the differences between human language understanding and current NLU systems in the paper: "Experience Grounds Language" https://arxiv.org/pdf/2004.10151.pdf Spoiler alert: the authors put forward some exciting ideas for future research @fbk_mt

0 replies, 4 likes


Felix Hill: Great work now updated

0 replies, 3 likes


Ari Holtzman: @yoavgo Agreed! I think our theme paper got rejected for being a bit less safe (https://arxiv.org/abs/2004.10151), so I think that's information towards the shape of the filter, though of course there's noise/other possible objections to our work.

1 replies, 2 likes


Seth Stafford: Fun and informative chat with @emilymbender on TWiML with @samcharrington ! She recommended this impressive manifesto on the essential role of sensory experience/action in grounding language. The rhetorical salvo below (pic) is an apt summary. https://arxiv.org/abs/2004.10151 https://t.co/c8ZkvtQtNA

1 replies, 2 likes


Dr Catherine Breslin: Experience grounds language - Language understanding ought to be related to the “physical world it describes and to the social interactions it facilitates” https://arxiv.org/pdf/2004.10151.pdf

0 replies, 1 likes


Jordi Armengol: Thought experiment: you find large text documents from an alien civilization. Somehow, you manage to discretize/tokenize the raw input and use it to train a SOTA language model. Yet, you don’t understand a thing of the alien language (nor does the language model). #grounding

0 replies, 1 likes


Content

Found on Apr 22 2020 at https://arxiv.org/pdf/2004.10151.pdf

PDF content of a computer science paper: Experience Grounds Language