Reinforcement Learning, second edition: An Introduction (Adaptive Computation You will find that this textbook has plenty of margin space for taking notes.
