Papers of the day   All papers

Large-scale multilingual audio visual dubbing

Comments

Yannis Assael: Here is our latest work on automated video translation https://arxiv.org/abs/2011.03530! @yangyi02, @BrendanShilling, @MiaosenWang, Wendi Liu, @yutianc, Yu Zhang, Eren Sezener, Luis C. Cobo, @notmisha, @yusufaytar, @NandoDF

2 replies, 180 likes


πŸ‘©β€πŸ’» Paige Bailey @ 127.0.0.1 🏠: πŸ—£οΈ Ladies and gentlemen: Yannis and team have built the Babelfish from Hitchhiker's Guide, and the universal translator from Star Trek. Imagine having this model applied to educational materials (ex: @coursera). I am so honored to have been a (small) part of their project! β™₯οΈπŸ™Œ

6 replies, 130 likes


Nando de Freitas: Most of the world has limited access to educational video content partly because of language barriers. In this work, my colleagues contribute novel engineering insights to help research communities addressing this problem.

2 replies, 105 likes


René Schulte: WOW! AI Auto-translated clips look and sound perfect! 🀯 I need this NOW! 😍 This new #AI by @DeepMind and @GoogleAI translates educational videos to multiple languages with synthetic audio and synced lip movement. ✨ Demo: https://www.youtube.com/watch?v=jNbkVlMJy-o&list=PLSi232j2ZA6_1Exhof5vndzyfbxAhhEs5 Paper: https://arxiv.org/abs/2011.03530 https://t.co/YSbBDAdivC

6 replies, 67 likes


Kyunghyun Cho: this is awesome! great job, team! i just wanted to plug in a project from the capstone project last year at @NYUDataScience done by a team of master's students (Jimin Tan, Chenqin Yang, Yakun Wang, Yash Deshpande) which was on unsupervised video dubbing https://tanjimin.github.io/unsupervised-video-dubbing/

1 replies, 32 likes


Naomi Wu ζœΊζ’°ε¦–ε§¬: Witchcraft! I want it...

1 replies, 27 likes


Martin Skarzynski: Wow! @DynamicWebPaige, your Spanish is really good!

0 replies, 3 likes


Alasdair Allan: Translating videos automatically to another language, while maintaining the speakers voice style, and generating the corresponding lip movements. #MachineLearning #DeepFake

0 replies, 2 likes


matt harrison: This is pretty impressive πŸ‘

0 replies, 2 likes


RenΓ© Schulte: This #AI breakthrough got a bit too less attention yesterday. πŸ€” This new #DeepLearning work can automatically translate educational videos with perfect speaker voice audio and lip sync! 🀯 This will make educational content accessible for many more people in the world. πŸ’–

0 replies, 2 likes


Rob Scott: Star Trek Universal Translator is just AR glasses + the below working in real time. CHANGE MY MIND.

0 replies, 1 likes


Content

Found on Nov 09 2020 at https://arxiv.org/pdf/2011.03530.pdf

PDF content of a computer science paper: Large-scale multilingual audio visual dubbing