Sergey Levine: Can we view RL as a series of economic transactions between primitives/actions? We present an RL method based on auctions, where primitives "buy" states and "sell" next states
w/ @mmmbchang, @SKaushi16236143, Weinberg, Griffiths
2 replies, 420 likes
Pablo Samuel Castro: Before coming back to RL in Google Brain, I worked for Google ads, and a lot of my work was in auction theory.
This looks like a super interesting idea! Very excited to dig into this paper, I never thought I'd see RL and "Vickrey auction" mentioned in the same paragraph!
2 replies, 94 likes
Michael Chang: 1/ Check out our latest work on societal decision-making which we will present next week at ICML 2020. Very grateful to my collaborators and advisors @SKaushi16236143, Matt Weinberg, Tom Griffiths, and @svlevine.
3 replies, 76 likes
Michael Chang: The code for Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions is now released: https://github.com/mbchang/decentralized-rl. Thank you to my collaborators and advisors @SKaushi16236143, Matthew Weinberg, Tom Griffiths (@cocosci_lab), @svlevine!
0 replies, 59 likes
Pablo Samuel Castro: Wasn't able to attend session for this paper @ #ICML2020 , so here's a thread on this super interesting paper.
Each primitive action is considered as an independent "agent" in a special type of auction, where it turns out the Nash equilibrium is for agents to bid precisely Q*!
2 replies, 56 likes
Michael Chang: Come check out our virtual poster session/Q&A for "Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions" tomorrow (July 16) at either 9:00am or 8:00pm Pacific Time
0 replies, 24 likes
MONTREAL.AI: Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions
Chang et al.: https://arxiv.org/abs/2007.02382
#MachineLearning #GameTheory #ReinforcementLearning https://t.co/8MTIUHG0Vd
0 replies, 17 likes
Kovas Boguta: Love this. Tried to get a similar model working 15 years ago with cellular automata, but could never figure out a reasonable currency
0 replies, 5 likes
Found on Jul 11 2020 at https://arxiv.org/pdf/2007.02382.pdf