
Andrew Barto on Rewards Gone Rogue Andrew Barto helped found reinforcement learning. He and Richard Sutton wrote the field's standard textbook, and they shared the Turing Award for that work. Reinforcement learning now trains today's reasoning models and AI agents. It also sits behind some of their strangest behavior, including the recent cases of agents breaking out of their sandboxes. Craig visited Barto at his home on Cape Cod. They talked about where rewards come from and why they are so hard to get right. Barto traces the problem back to Norbert Wiener's warnings in the 1950s. He explains how the dopamine system in the brain mirrors the learning algorithm he and Sutton developed. And he admits a weakness in their own framework: boiling every goal down to a single number. He also makes the case for engineering discipline. Ship designers learned their codes from wrecks and drowned sailors. Barto hopes AI can learn its lessons without that kind of cost. Subscribe to Eye on A.I. for weekly conversations with the people building and deploying the future of AI.

Michael Saylor on The Joe Rogan Experience335 votes
Anand Mahindra on WTF is with Nikhil Kamath98 votes
Vaclav Smil on Dwarkesh Podcast27 votes
Leemon Baird on Lex Fridman Podcast33 votes
Elon Musk on Relentless178 votes
Richard Heart on The Joe Rogan Experience1,195 votes
DataRepublican (small r) on PBD Podcast65 votes
Karl Friston on Dwarkesh Podcast22 votes
Alexandria Ocasio-Cortez on This Past Weekend w/ Theo Von7 votes
Robert F. Kennedy Jr on Huberman Lab3 votes
Lily Tang Williams on The Joe Rogan Experience894 votes
Alexandria Ocasio-Cortez on The Tucker Carlson Show7 votes
Nicki Minaj on Real Talk with Zuby6 votes
ZUBY: on Chrissie Mayr Podcast1 vote
Greta Thunberg on Impaulsive with Logan Paul2 votes
Timothée Chalamet on Armchair Expert with Dax Shepard2 votesShare this episode

Why AI Goes Rogue: Turing Award Winner Explains Reward Failure | Andrew Barto
No ratings yet
No written reviews yet. Be the first to share what you thought.
0 comments · timestamp your take
No comments yet. Start the discussion.