Papers of the day   All papers

RobBERT: a Dutch RoBERTa-based Language Model


Sebastian Ruder: Transfer learning is increasingly going multilingual with language-specific BERT models: - 🇩🇪 German BERT - 🇫🇷 CamemBERT, FlauBERT - 🇮🇹 AlBERTo - 🇳🇱 RobBERT

19 replies, 613 likes

Pieter Delobelle: We are proud to present our Dutch BERT model called RobBERT, achieving state-of-the-art results for several Dutch language tasks (w/ @thomas_wint) 📝 Paper: 🤖 Model & Code: 🌐 Website:

3 replies, 92 likes

Hugging Face: You can now find most of them here:

0 replies, 53 likes

Pieter Delobelle: Happy to announce that we released RobBERT v2! Achieving SOTA results for many different Dutch NLP tasks, especially when dealing with small datasets (accepted at EMNLP Findings, w @thomas_wint) 📜 Updated paper: 🤖 Model & code:

5 replies, 27 likes

Jay Alammar جهاد العمار: Somebody please make AraBERT happen!

3 replies, 13 likes

roadrunner01: RobBERT: a Dutch RoBERTa-based Language Model pdf: abs: github:

0 replies, 5 likes

Thomas Winters: Fun little trick for NLP researchers: unsure what to call your new BERT-based model? Make your model come up with its own name!

1 replies, 4 likes

Kory Mathewson - Montreal 🇨🇦: Brilliant work by friend and colleague @thomas_wint -- excited to see what this means for future interactions with @improbotics

0 replies, 1 likes


Found on Jan 27 2020 at

PDF content of a computer science paper: RobBERT: a Dutch RoBERTa-based Language Model