Reinforcement Learning An Introduction (second edition) by Sutton & Barto

You will find that this textbook includes a list of online resources for extra help.