Papers of the day   All papers

Adversarial NLI: A New Benchmark for Natural Language Understanding

Comments

Nov 01 2019 Douwe Kiela

Excited (in my 1st tweet ever!) to announce Adversarial NLI: a new large-scale benchmark dataset for NLU, and a challenge to the community. Great job by @EasonNie, together with @adinamwilliams @em_dinan @mohitban47 and @jaseweston. https://arxiv.org/abs/1910.14599
5 replies, 304 likes


Nov 01 2019 Gary Marcus

"A growing body of evidence shows that state-of-the-art models learn to exploit spurious statistical patterns in datasets .. instead of learning meaning in the flexible and generalizable way that humans do" -- Adversarial NLI: A New Benchmark for NLU https://arxiv.org/abs/1910.14599
8 replies, 209 likes


Nov 01 2019 Mohit Bansal

Exciting work by @EasonNie (+@adinamwilliams @em_dinan @jaseweston @douwekiela)! Adversarial NLI, a large dataset collected via a multi-round adversarial (weakness-finding) human-&-model-in-the-loop process; allows moving/lifelong-learning target for NLU😀 https://arxiv.org/abs/1910.14599 https://t.co/eoZpeLIsRq
1 replies, 48 likes


Nov 01 2019 Kyunghyun Cho

ahahahaha "there is something rotten in the state of the art"
0 replies, 22 likes


Nov 01 2019 Grady Booch

I feel a chill in the air. https://t.co/eHDcSdjlnX
2 replies, 20 likes


Nov 01 2019 Matt Gardner

Glad to see this actually done; I've wanted to do something similar for reading comprehension, but it's hard to get right. Nice work! Question, though: the paper says that NLI is "arguably the most canonical task in NLU". Is it? Should it be? Why or why not?
1 replies, 17 likes


Nov 01 2019 MUNOZRICK

Most #AI tech seems more akin to muscle memory or capturing instinctive behavior, rather than actual learning or intelligence. More cerebellum than prefrontal cortex
0 replies, 12 likes


Nov 01 2019 claps for anyone 👏👏👏

I would hope everyone knows this already by now.
1 replies, 8 likes


Nov 01 2019 Beth Carey

Meaning is represented for machines by #Patom Theory + #RRG=NLU. Once machines have meaning represented, applications like #chatbots and #digitalassistants can leverage context in conversation - common sense and reasoning are by products.
0 replies, 5 likes


Nov 02 2019 arXiv CS-CL

Adversarial NLI: A New Benchmark for Natural Language Understanding http://arxiv.org/abs/1910.14599
0 replies, 1 likes


Content