Papers of the day   All papers

Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions

Comments

Sergey Levine: Can we view RL as a series of economic transactions between primitives/actions? We present an RL method based on auctions, where primitives "buy" states and "sell" next states w/ @mmmbchang, @SKaushi16236143, Weinberg, Griffiths https://arxiv.org/abs/2007.02382 https://bair.berkeley.edu/blog/2020/07/11/auction/ https://t.co/rEAmdxVCfp

2 replies, 420 likes


Pablo Samuel Castro: Before coming back to RL in Google Brain, I worked for Google ads, and a lot of my work was in auction theory. This looks like a super interesting idea! Very excited to dig into this paper, I never thought I'd see RL and "Vickrey auction" mentioned in the same paragraph!

2 replies, 94 likes


Michael Chang: 1/ Check out our latest work on societal decision-making which we will present next week at ICML 2020. Very grateful to my collaborators and advisors @SKaushi16236143, Matt Weinberg, Tom Griffiths, and @svlevine.

3 replies, 76 likes


Michael Chang: The code for Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions is now released: https://github.com/mbchang/decentralized-rl. Thank you to my collaborators and advisors @SKaushi16236143, Matthew Weinberg, Tom Griffiths (@cocosci_lab), @svlevine!

0 replies, 59 likes


Pablo Samuel Castro: Wasn't able to attend session for this paper @ #ICML2020 , so here's a thread on this super interesting paper. Each primitive action is considered as an independent "agent" in a special type of auction, where it turns out the Nash equilibrium is for agents to bid precisely Q*!

2 replies, 56 likes


Michael Chang: Come check out our virtual poster session/Q&A for "Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions" tomorrow (July 16) at either 9:00am or 8:00pm Pacific Time https://icml.cc/Conferences/2020/PosterSchedule#3099 https://icml.cc/virtual/2020/poster/6293

0 replies, 24 likes


MONTREAL.AI: Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions Chang et al.: https://arxiv.org/abs/2007.02382 #MachineLearning #GameTheory #ReinforcementLearning https://t.co/8MTIUHG0Vd

0 replies, 17 likes


Kovas Boguta: Love this. Tried to get a similar model working 15 years ago with cellular automata, but could never figure out a reasonable currency

0 replies, 5 likes


Content

Found on Jul 11 2020 at https://arxiv.org/pdf/2007.02382.pdf

PDF content of a computer science paper: Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions