Ari Holtzman: "You can't learn language from the radio." 📻
Why does NLP keep trying to?
In https://arxiv.org/abs/2004.10151 we argue that physical and social grounding are key because, no matter the architecture, text-only learning doesn't have access to what language is *about* and what it *does*.
17 replies, 634 likes
Adam Santoro: "Experience Grounds Language"
Some really nice thoughts on language grounding! I'm totally on board with this agenda, though I do have a few minor quibbles:
1 replies, 36 likes
Emily M. Bender: My @twimlai episode's premiere is now complete, but you can catch the episode anytime here:
Thanks again @samcharrington!
#nlproc #linguistics #ethnlp #catsoflinguists
2 replies, 32 likes
David Schlangen: This looks like an interesting paper!
It's a bit of an indictment of our field that this relatively obvious fact needs to be made again and again, but on the other hand the fact that it is being made more often recently is a good sign perhaps.
4 replies, 22 likes
Fabian Offert: Must-read from #NLP essentially doing #DH's job. Also echoes many conversations on "meaning" I had in the past year, with @alanyliu, @Peter_Bell77, and others.
1 replies, 11 likes
Pierre-Yves Oudeyer: On the topic of grounding language in action and social context, the work and roadmap made 10 years ago in development robotics (Italk EU project) is still fully relevant for #AI, #NPL and #DeepRL. Turn off the radio and go explore the world :)
0 replies, 10 likes
Laura Graesser: Happy to see this. In the words of Terry Winograd & Fernando Flores:
"Language and cognition are fundamentally social. Maturana, Gadamer, and Heidegger all argue that our ability to think and give meaning to language is rooted in our participation in a society and a tradition."
1 replies, 8 likes
ALife Papers: Experience Grounds Language
" we consider work on the contextual foundations of language: grounding, embodiment, and social interaction. [...] history and possible progression of how contextual information can factor into our representations"
0 replies, 6 likes
Giosuè Baggio: NLP/AI rediscovers/reworks old ideas about “grounding, embodiment, and social interaction”—perhaps they will succeed where philosophy and psychology have failed…
‘Experience Grounds Language’, by @ybisk et al. @arxiv
0 replies, 5 likes
Rowan Zellers: Neat opinion piece + framework about the limitations of NLP today -- and what we should do next
0 replies, 5 likes
Seth Stafford: Fun and informative chat with @emilymbender on TWiML with @samcharrington !
She recommended this impressive manifesto on the essential role of sensory experience/action in grounding language. The rhetorical salvo below (pic) is an apt summary.
1 replies, 2 likes
Jordi Armengol: Thought experiment: you find large text documents from an alien civilization. Somehow, you manage to discretize/tokenize the raw input and use it to train a SOTA language model. Yet, you don’t understand a thing of the alien language (nor does the language model). #grounding
0 replies, 1 likes
Found on Apr 22 2020 at https://arxiv.org/pdf/2004.10151.pdf