Reinforcement Learning, second edition: An Introduction (Adaptive Computation us You will find that this textbook has a clean layout that is easy on the eyes.
