Richard S. Sutton Andrew G. Barto Reinforcement Learning (Hardback) A nice touch in this textbook is the running glossary in the margins.
