01 · A life in computing
The person behind the work
Richard Sutton developed central ideas in reinforcement learning, including temporal-difference methods that learn predictions from the difference between successive estimates. His work also investigated how learning, planning, and action can be integrated within one agent. He collaborated with Andrew Barto on foundational research and their widely used textbook. His affiliations at Alberta and Keen Technologies reflect continued work on general learning systems after the field became widely influential.
The contribution, explained
Andrew Barto and Richard Sutton established conceptual and algorithmic foundations of reinforcement learning. An agent acts, observes what happens and uses reward signals to improve future behaviour. Temporal-difference learning updates a prediction using both an immediate outcome and a revised prediction of what follows.
Why it matters
Learning through interaction became a central approach to decision-making systems, from games to control.