Probability and Statistical Inference: Volume 1: Probability

A nice touch in this textbook is the list of common mistakes to avoid.