LATENT LIBRARY FUNDAMENTALS ReinforcementLearningExplained Learning From Rewards, Step by Step LATENT LIBRARY EDITORIAL

Reinforcement Learning Explained

Learning From Rewards, Step by Step

Latent Library Editorial

IntroductionIntroduction

Most machine learning learns from examples with correct answers. Reinforcement learning (RL) learns from experience: an agent tries actions, receives rewards or penalties, and gradually discovers which behaviour pays off. It is how computers learned to play board games and video games at superhuman level, how robots learn to walk in simulation, and part of how language models are shaped to be helpful.

This book explains reinforcement learning clearly and concretely. It starts with the simplest setting, choosing between slot machines, and builds up through Markov decision processes, value functions, dynamic programming, Monte Carlo and temporal-difference learning, Q-learning, deep reinforcement learning and policy gradients. Later chapters cover reinforcement learning from human feedback, safety problems such as reward hacking, real-world applications and when RL is the wrong tool.

Small grid-world examples make every algorithm concrete, and all calculations are shown.

How the book is organised

Chapter 1Learning From Rewards

An agent interacts with an environment. At each step it observes a state, takes an action, receives a reward and moves to a new state. Its goal is to maximise total reward over time.

Examples:

AgentActionsReward
Game playerMovesPoints, winning
RobotMotor commandsProgress towards a goal, minus energy use
RecommenderItems to showEngagement or satisfaction
ThermostatHeating levelsComfort minus energy cost

You have reached the end of the free sample.
The full book continues with 58 more chapters, plus the appendices.

Get the full book