Papers of the day   All papers

BERT Rediscovers the Classical NLP Pipeline

Comments

May 24 2019 Thomas Wolf

BERT Rediscovers the Classical NLP Pipeline by I. Tenney, D. Das & E. Pavlic is 4 pages of great insights https://arxiv.org/abs/1905.05950 Such a constant source of fascinating papers from Ellie Pavlick & her collaborators! Here's BERT correcting his prediction along the model depth🤯 https://t.co/470iLBBEJW
2 replies, 458 likes


May 16 2019 Thomas Lahore

BERT Rediscovers the Classical NLP Pipeline "regions responsible for each step appear in the expected sequence: POS tagging, parsing, NER, semantic roles, then coreference" https://arxiv.org/abs/1905.05950 https://t.co/jxMtQndMVA
0 replies, 215 likes


May 14 2019 Dipanjan Das

2/2 Paper titled "BERT Rediscovers the Classical NLP Pipeline" with @GoogleAI co-authors @iftenney and Ellie Pavlick has been accepted at ACL 2019! (Stay tuned for a draft of this really cool paper.)
7 replies, 208 likes


May 16 2019 Ian Tenney

1/3 Check out our draft on arXiv! https://arxiv.org/abs/1905.05950 (with @dipanjand and Ellie Pavlick)
1 replies, 50 likes


Jul 21 2019 Fernando Pereira

@MelMitchell1 Fine-tuning a large pre-trained model on a small task-specific training set will of course overfit. OTOH: https://arxiv.org/abs/1905.05950
2 replies, 26 likes


Jun 14 2019 Tal Linzen

Anthology of Bertology (thread)
0 replies, 20 likes


May 16 2019 Dipanjan Das

Thanks to @iftenney, the draft of this paper is now online: https://arxiv.org/pdf/1905.05950.pdf https://twitter.com/dipanjand/status/1128240845629554689
1 replies, 18 likes


Jun 12 2019 Jelle Zuidema

Authors of that new paper (https://arxiv.org/abs/1906.04341) are @clark_kev @ukhndlwl @omerlevy @chrmanning Some more BERTology papers include: https://arxiv.org/abs/1906.01698 https://arxiv.org/abs/1905.05950 and our own: https://arxiv.org/abs/1906.01539 Many will be presented at @ACL2019_Italy and #BlackboxNLP
2 replies, 6 likes


Sep 23 2019 Suzan Verberne 🤹‍♀️

@pbloemesquire This one? BERT rediscovers the classical NLP pipeline. https://arxiv.org/abs/1905.05950
1 replies, 4 likes


Jun 14 2019 Jelle Zuidema

For completeness: Yongjie Lin, Yi Chern Tan, Robert Frank Open Sesame: Getting Inside BERT's Linguistic Knowledge, BlackboxNLP19 http://arxiv.org/abs/1906.01698 Ian Tenney, Dipanjan Das, Ellie Pavlick BERT Rediscovers the Classical NLP Pipeline, ACL2019 https://arxiv.org/abs/1905.05950
1 replies, 4 likes


Jul 01 2019 Giorgio Patrini 🛡️👾

"BERT Rediscovers the Classical NLP Pipeline" https://arxiv.org/abs/1905.05950 Trend: we are working on more experimental/behavioural tools for understanding how deep nets work from the outside. Same will happen for trained RL agents. Will these be useful to neuroscience one day? https://t.co/rbQglT7aA8
0 replies, 4 likes


May 17 2019 arXiv in review

#acl2019nlp BERT Rediscovers the Classical NLP Pipeline. (arXiv:1905.05950v1 [cs\.CL]) http://arxiv.org/abs/1905.05950
0 replies, 3 likes


May 16 2019 午後のarXiv

"BERT Rediscovers the Classical NLP Pipeline", Ian Tenney, Dipanjan Das, Ellie Pavlick https://arxiv.org/abs/1905.05950
0 replies, 1 likes


May 24 2019 Hamlet 🇩🇴

🤯
0 replies, 1 likes


Content