Papers of the day   All papers

Large-scale multilingual audio visual dubbing


Yannis Assael: Here is our latest work on automated video translation! @yangyi02, @BrendanShilling, @MiaosenWang, Wendi Liu, @yutianc, Yu Zhang, Eren Sezener, Luis C. Cobo, @notmisha, @yusufaytar, @NandoDF

2 replies, 180 likes

πŸ‘©β€πŸ’» Paige Bailey @ 🏠: πŸ—£οΈ Ladies and gentlemen: Yannis and team have built the Babelfish from Hitchhiker's Guide, and the universal translator from Star Trek. Imagine having this model applied to educational materials (ex: @coursera). I am so honored to have been a (small) part of their project! β™₯οΈπŸ™Œ

6 replies, 130 likes

Nando de Freitas: Most of the world has limited access to educational video content partly because of language barriers. In this work, my colleagues contribute novel engineering insights to help research communities addressing this problem.

2 replies, 105 likes

René Schulte: WOW! AI Auto-translated clips look and sound perfect! 🀯 I need this NOW! 😍 This new #AI by @DeepMind and @GoogleAI translates educational videos to multiple languages with synthetic audio and synced lip movement. ✨ Demo: Paper:

6 replies, 67 likes

Kyunghyun Cho: this is awesome! great job, team! i just wanted to plug in a project from the capstone project last year at @NYUDataScience done by a team of master's students (Jimin Tan, Chenqin Yang, Yakun Wang, Yash Deshpande) which was on unsupervised video dubbing

1 replies, 32 likes

Naomi Wu ζœΊζ’°ε¦–ε§¬: Witchcraft! I want it...

1 replies, 27 likes

Martin Skarzynski: Wow! @DynamicWebPaige, your Spanish is really good!

0 replies, 3 likes

Alasdair Allan: Translating videos automatically to another language, while maintaining the speakers voice style, and generating the corresponding lip movements. #MachineLearning #DeepFake

0 replies, 2 likes

matt harrison: This is pretty impressive πŸ‘

0 replies, 2 likes

RenΓ© Schulte: This #AI breakthrough got a bit too less attention yesterday. πŸ€” This new #DeepLearning work can automatically translate educational videos with perfect speaker voice audio and lip sync! 🀯 This will make educational content accessible for many more people in the world. πŸ’–

0 replies, 2 likes

Rob Scott: Star Trek Universal Translator is just AR glasses + the below working in real time. CHANGE MY MIND.

0 replies, 1 likes


Found on Nov 09 2020 at

PDF content of a computer science paper: Large-scale multilingual audio visual dubbing