A paper on a learning system using traditional RL applied to multiple video games.

http://cs229.stanford.edu/proj2012/JohnsonRobertsFisher-LearningToPlay2DVideoGames.pdf