Papers of the day   All papers

RobBERT: a Dutch RoBERTa-based Language Model

Comments

Sebastian Ruder: Transfer learning is increasingly going multilingual with language-specific BERT models: - 🇩🇪 German BERT https://deepset.ai/german-bert - 🇫🇷 CamemBERT https://arxiv.org/abs/1911.03894, FlauBERT https://arxiv.org/abs/1912.05372 - 🇮🇹 AlBERTo http://ceur-ws.org/Vol-2481/paper57.pdf - 🇳🇱 RobBERT https://arxiv.org/abs/2001.06286

19 replies, 613 likes


Pieter Delobelle: We are proud to present our Dutch BERT model called RobBERT, achieving state-of-the-art results for several Dutch language tasks (w/ @thomas_wint) 📝 Paper: https://arxiv.org/abs/2001.06286 🤖 Model & Code: https://github.com/iPieter/RobBERT 🌐 Website: https://people.cs.kuleuven.be/~pieter.delobelle/robbert/ https://t.co/s1NDNWE8J9

3 replies, 92 likes


Hugging Face: You can now find most of them here: https://huggingface.co/models https://twitter.com/seb_ruder/status/1221851361811128321?s=20

0 replies, 53 likes


Pieter Delobelle: Happy to announce that we released RobBERT v2! Achieving SOTA results for many different Dutch NLP tasks, especially when dealing with small datasets (accepted at EMNLP Findings, w @thomas_wint) 📜 Updated paper: https://arxiv.org/abs/2001.06286 🤖 Model & code: https://github.com/iPieter/RobBERT https://t.co/BODf7t0xz3

5 replies, 27 likes


Jay Alammar جهاد العمار: Somebody please make AraBERT happen!

3 replies, 13 likes


roadrunner01: RobBERT: a Dutch RoBERTa-based Language Model pdf: https://arxiv.org/pdf/2001.06286.pdf abs: https://arxiv.org/abs/2001.06286 github: https://github.com/iPieter/RobBERT https://t.co/GvV0lPqaWv

0 replies, 5 likes


Thomas Winters: Fun little trick for NLP researchers: unsure what to call your new BERT-based model? Make your model come up with its own name! https://twitter.com/pieterdelobelle/status/1219256149847019520 https://t.co/dXhjtuGdjW

1 replies, 4 likes


Kory Mathewson - Montreal 🇨🇦: Brilliant work by friend and colleague @thomas_wint -- excited to see what this means for future interactions with @improbotics

0 replies, 1 likes


Content

Found on Jan 27 2020 at https://arxiv.org/pdf/2001.06286.pdf

PDF content of a computer science paper: RobBERT: a Dutch RoBERTa-based Language Model