Papers of the day   All papers

Monte Carlo Gradient Estimation in Machine Learning

Comments

Jun 26 2019 Shakir Mohamed

Exited to share our new paper: 'Monte Carlo Gradient Estimation in Machine Learning', with @elaClaudia @mfigurnov @AndriyMnih. It reviews of all the things we know about computing gradients of probabilistic functions. https://arxiv.org/abs/1906.10652 🐾Thread👇🏾 https://t.co/2eTPsFO7mZ
11 replies, 1007 likes


Jul 19 2019 Shimon Whiteson

I highly recommend this excellent survey paper on gradient estimation.
1 replies, 212 likes


Jul 06 2019 Been Kim

Gradients are important for interpretability! This is a very accessible, high quality review/tutorial on how to estimate them, with code!
1 replies, 206 likes


Jun 26 2019 Statistics Papers

Monte Carlo Gradient Estimation in Machine Learning. http://arxiv.org/abs/1906.10652
0 replies, 124 likes


Jun 26 2019 Joey Bose

Wow this is perhaps the best review of stochastic gradient estimators I've ever seen. Definitely, a must read for all people in doing VI, RL, and other cool ML stuff.
0 replies, 80 likes


Jun 26 2019 Mihaela Rosca

I really enjoyed working on this review paper with my amazing co workers! So much to learn!
1 replies, 59 likes


Jul 23 2019 Shakir Mohamed

After a short delay, the code in a notebook to reproduce the graphs in section 3 of our paper (https://arxiv.org/abs/1906.10652) is online. More to be come soon. See thread above👆🏾. https://github.com/deepmind/mc_gradients 👩🏾‍💻
0 replies, 48 likes


Jul 05 2019 Debasish (দেবাশিস্) Ghosh 🇮🇳

a wonderful survey of stochastic gradient estimators by @shakir_za and team https://arxiv.org/abs/1906.10652. Very neat derivations using simple probabilistic tricks and clear explanations. Summary in this twitter thread https://twitter.com/shakir_za/status/1143802522299244545
0 replies, 34 likes


Jun 26 2019 ML Review

Monte Carlo Gradient Estimation in Machine Learning [59pp] By @shakir_za @elaClaudia @mfigurnov Survey of methods for Monte Carlo gradient estimation: the pathwise, score function, and measure-valued gradient estimators. https://arxiv.org/abs/1906.10652
0 replies, 29 likes


Jul 19 2019 Sourav Mishra

“One paper to review them all” Very exhaustive survey of Gradient Estimation!
0 replies, 13 likes


Jun 27 2019 Jiaxin Shi

Cool survey of Monte Carlo gradient estimation. Also thanks for including our log density gradient estimators! @shakir_za
0 replies, 12 likes


Jun 26 2019 Emtiyaz Khan

I thank @shakir_za and colleagues to write this wonderful paper about gradient estimators. Difficulty of estimating these is one of the main reasons behind the difficulties in many fields such as Bayesian inference, RL etc.
0 replies, 6 likes


Jun 26 2019 Matias Quiroz

This goes to the top of my to-read-list!
1 replies, 5 likes


Jun 27 2019 Colin Carroll

Love when papers come with threads like this, especially the photo-tour of highlights!
0 replies, 4 likes


Jul 14 2019 Rory Quinn

A survey of methods for Monte Carlo gradient estimation #machinelearning https://arxiv.org/abs/1906.10652?utm_campaign=Data_Elixir&utm_medium=email&utm_source=Data_Elixir_240
0 replies, 1 likes


Content