Papers of the day   All papers

Towards a Human-like Open-Domain Chatbot

Comments

Quoc Le: New paper: Towards a Human-like Open-Domain Chatbot. Key takeaways: 1. "Perplexity is all a chatbot needs" ;) 2. We're getting closer to a high-quality chatbot that can chat about anything Paper: https://arxiv.org/abs/2001.09977 Blog: https://ai.googleblog.com/2020/01/towards-conversational-agent-that-can.html https://t.co/5SOBa58qx3

28 replies, 1808 likes


Google AI: Check out Meena, a new state-of-the-art open-domain conversational agent, released along with a new evaluation metric, the Sensibleness and Specificity Average, which captures basic, but important attributes for normal conversation. Learn more below! https://goo.gle/36zB8Wj

25 replies, 1299 likes


Kyle McDonald: um.. google's latest chatbot is 😳 https://arxiv.org/abs/2001.09977 https://t.co/XpOkp0Pd5E

23 replies, 1261 likes


Jeremy Howard: Amazing work. PS: we're all so screwed.

16 replies, 791 likes


Hugging Face: The 101 for text generation! 💪💪💪 This is an overview of the main decoding methods and how to use them super easily in Transformers with GPT2, XLNet, Bart, T5,... It includes greedy decoding, beam search, top-k/nucleus sampling,...: https://huggingface.co/blog/how-to-generate by @PatrickPlaten https://t.co/Jw0z92IAL1

12 replies, 637 likes


Thang Luong: Introducing #MeenaBot, a 2.6B-param open-domain chatbot with near-human quality. Remarkably, we show strong correlation between perplexity & humanlikeness! Paper: https://arxiv.org/abs/2001.09977 Sample conversations: https://github.com/google-research/google-research/tree/master/meena https://t.co/3xNSV4r4uB

14 replies, 354 likes


Oriol Vinyals: seq2seq still delivers : ) Incredible how far we've gotten in ~5 years of progress in neural conversational models, with relatively small changes. More exciting is that there's still LOTS to be done! Paper: https://arxiv.org/abs/2001.09977 Blog: https://ai.googleblog.com/2020/01/towards-conversational-agent-that-can.html https://t.co/HUfbgtOCZW

4 replies, 289 likes


Daniel Adiwardana: Enabling people to converse with chatbots about anything has been a passion of a lifetime for me, and I'm sure of others as well. So I'm very thankful to be able to finally share our results with you all. Hopefully, this will help inform efforts in the area. (1/4)

2 replies, 169 likes


Thang Luong: sample-and-rerank as proposed in #MeenaBot (https://arxiv.org/abs/2001.09977) is a simple strategy that gives both diversity and quality for the generation, especially if your model has low perplexity!

0 replies, 137 likes


Matthew Kenney: https://arxiv.org/pdf/2001.09977.pdf 😂😂 this had me in stitches https://t.co/d2YVABFave

2 replies, 98 likes


Tim Hwang: 👀 "We were unable to find this in the data"

3 replies, 71 likes


Károly Zsolnai-Fehér 📜: Google’s Chatbot: Almost Perfect ▶️Full video (ours): https://youtu.be/3Wppf_CNvD0 📜Source paper: https://arxiv.org/abs/2001.09977 #ai #deeplearning #science #twominutepapers #meena https://t.co/PkxI4lPhXX

1 replies, 49 likes


Dan Nguyen: didn't anticipate the dad joke industry would be first victim of automation

1 replies, 46 likes


Erik Brynjolfsson: Impressive work by @GoogleAI. Chatbots like Meena are increasingly able to provide sensible and specific responses. It will be harder and harder to tell whether we are talking to another human or a machine. HT: @jeremyphoward #AI #MachineLearning #2MA #chatbot #Election2020 https://t.co/n2kFi6hhev

6 replies, 36 likes


Quoc Le: @xpearhead @lmthang My favorite conversation is below. The Hayvard pun was funny but I totally missed the steer joke at the end until it was pointed out today by @Blonkhart https://t.co/AmTobwf9A0

2 replies, 35 likes


Μatthew Alampay Davis: Google's new chatbot has developed an avant-garde sense of humor that its creators mistakenly believe is a bug https://arxiv.org/pdf/2001.09977.pdf https://t.co/TxZ8mEosnM

1 replies, 29 likes


Quoc Le: @xpearhead @lmthang You can find some sample conversations with the bot here: https://github.com/google-research/google-research/blob/master/meena/meena.txt

1 replies, 26 likes


ΜΔDΞRΔS: #CyberpunkisNow "Meena" is a chatbot Google says conducts near human-level conversation. "SSA" is a Google metric to grade a chatbot's capacity for conversation/judgement vs an average human: Avg Human 86% SSA Other Chatbots 31% to 56% SSA Meena 79% SSA https://arxiv.org/pdf/2001.09977.pdf https://t.co/rcJP4lqn1P

1 replies, 26 likes


Aran Komatsuzaki: Towards a Human-like Open-Domain Chatbot: Near-human level open-domain chatbot is achieved with a Transformer LM with 2.6B parameters. Notably, they showed there's a strong correlation between ppl and human-likeness. https://arxiv.org/abs/2001.09977 https://t.co/cT45Kre3Ur

0 replies, 21 likes


Trieu H. Trinh: Had the chance to sit next to Daniel @xpearhead in the early days of the project and tried out the interactive Meena. It has always been *this* surprising and funny :) BIG Congrats to the team with this publication. The possibilities to build up from here is endless.

1 replies, 21 likes


davidberreby: 'Do horses go to Harvard?' a human asked a neural net. 'Horses go to HAYvard' it replied. h/t @jackclarkSF, who reports Google is wary for now of releasing code for a bot this good at sounding human. (Other firms have been similarly cautious) https://arxiv.org/abs/2001.09977

0 replies, 18 likes


Károly Zsolnai-Fehér 📜: Google’s Chatbot: Almost Perfect 🤖 ▶️Full video (ours): https://youtu.be/3Wppf_CNvD0 📜Source paper: https://arxiv.org/abs/2001.09977 #ai #deeplearning #science #twominutepapers #meena https://t.co/qJLZeMz6ko

0 replies, 18 likes


Jason Wu: [Towards a Human-like Open-Domain Chatbot] "We trained our best model for 30 days on a TPUv3 Pod (2,048 TPU cores) on the Meena dataset containing 40B words." This is not institution-anonymous... LOL https://arxiv.org/pdf/2001.09977.pdf

1 replies, 15 likes


Christian R. Jänsch: Meena — a new open-domain chatbot (with a 2.6B parameter NN) pioneered by Google🔝 @theomitsa @postoff25 @Victoryabro @Droit_IA @baski_LA @mvollmer1 @jrzaranoid @AshokNellikar @sallyeaves @ShiCooks @evankirstel @techpearce2 @data_nerd See also: https://arxiv.org/abs/2001.09977

0 replies, 10 likes


Dat Tran: Pretty impressive! Google AI just released Meena, a 2.6bn parameter neural-network chatbot that is able to conduct human-like conversations. Very interesting results and paper. Check it out! 📝 Paper: https://arxiv.org/abs/2001.09977

0 replies, 9 likes


Jelle Zuidema: Impressive looking example conversations and numbers from Google AI's new chatbot Meena. Uses the Evolved Transformer, lots of parameters, lots of data, distillation and good old perplexity as the objective.

1 replies, 9 likes


Rose Eveleth ▷▷: okay but this is actually a really funny joke?

2 replies, 8 likes


Şerife (Sherry) Wong: Holy guacamole Batman this chatbot is outstanding in its field.

1 replies, 5 likes


Delaney Hall: I love a good multi-turn joke in an open-domain setting

0 replies, 5 likes


BioDecoded: Towards a Conversational Agent that Can Chat About…Anything | Google AI Blog https://ai.googleblog.com/2020/01/towards-conversational-agent-that-can.html https://arxiv.org/abs/2001.09977 #NLP #chatbot https://t.co/lENOrgsbRJ

0 replies, 4 likes


Connor Leahy: Oh boy

1 replies, 4 likes


Victor Dibia: New results from Google on open domain chat bots

0 replies, 3 likes


Marcus Borba: New paper: Towards a Human-like Open-Domain #Chatbot. Key takeaways: 1. "Perplexity is all a chatbot needs" ;) 2. We're getting closer to a high-quality chatbot that can chat about anything Paper: https://arxiv.org/abs/2001.09977 Blog: https://ai.googleblog.com/2020/01/towards-conversational-agent-that-can.html via @quocleix #ML #AI https://t.co/rBj6MNLJcd

0 replies, 3 likes


Edward Dixon: A stunning #NLP paper from @GoogleAI on a chatbot that manages a pretty neat joke that really does seem to be original (see below, "Horses go to Hayvard"). https://t.co/FezkVBYe4s

0 replies, 3 likes


_n ⚔️: Suddenly thousands of dads are like "shit we gotta up our joke game"

0 replies, 2 likes


M.O. Gewaltig: The race of brute-force conversation bots continues...

0 replies, 2 likes


Gerardo Montoya aka Rénròu Sōusuǒ: 86% vs 79% #SujetosHíbridos

0 replies, 2 likes


Radamés Ajna: this is getting interesting

0 replies, 2 likes


Ashwin Ram: Making progress towards human-like open-domain Conversational #AI that can chat about anything, along with a new evaluation metric that captures key elements of good conversation. Nice work by @quocleix and team at @GoogleAI. Paper available on @arXiv. https://venturebeat.com/2020/01/28/meena-is-googles-attempt-at-making-true-conversational-ai/

0 replies, 2 likes


Manish Chablani: Great insight from recent google paper on chatbots: "Meena has a single Evolved Transformer encoder block and 13 decoder blocks. We discovered that a more powerful decoder was the key to higher conversational quality." https://arxiv.org/abs/2001.09977

1 replies, 1 likes


Carl Carrie: Say hello to Mena "Meena was trained on a whopping 341 gigabytes of public social-media chatter" https://arxiv.org/abs/2001.09977 https://t.co/iIoEADNObA

0 replies, 1 likes


CsUtil.com: Google released Meena, an end-to-end, neural conversational model that learns to respond sensibly to a given conversational context. Source: https://ai.googleblog.com/2020/01/towards-conversational-agent-that-can.html The extracts from the conversations in the paper ( https://arxiv.org/pdf/2001.09977.pdf ) are impressive, see second image 😲 https://t.co/B0RU0YA0XR

0 replies, 1 likes


Epsilon Guanlin Lee: Wow, wonder how this compare to XiaoIce from MSRA @znculee

0 replies, 1 likes


Moja Afroughi: Great work!

0 replies, 1 likes


RainbowSecret: Wow!

0 replies, 1 likes


Joshua Baker: Comedians, Google’s chatbots are coming for you https://twitter.com/kcimc/status/1222378902821068800?s=21

0 replies, 1 likes


arXiv CS-CL: Towards a Human-like Open-Domain Chatbot http://arxiv.org/abs/2001.09977

0 replies, 1 likes


Ward Plunet: Seems to be a jump forward in terms of human like conversations/chats.

0 replies, 1 likes


Dr.Sultan Al-Yahyai: #عالمنا_في_4IR_ربيع_2020

0 replies, 1 likes


Raphaël Millière: New from @GoogleAI: "Towards a Human-like Open-Domain Chatbot" Sample conversations are really impressive (although cherry-picked). https://arxiv.org/abs/2001.09977

1 replies, 0 likes


Content

Found on Jan 28 2020 at https://arxiv.org/pdf/2001.09977.pdf

PDF content of a computer science paper: Towards a Human-like Open-Domain Chatbot