"Reinforcement Learning: An Introduction," co-authored by Richard Sutton and Andrew Barto, is known in the industry as the RL bible, and its second edition is freely available online.