Ms. Pac-Man Framework Icon

Ms. Pac-Man Framework

Using reinforcement learning with relative input to train Ms. Pac-Man

Add a Review
0 Downloads (This Week)
Last Update:
  Browse Code SVN Repository



This Java-application contains all required components to simulate a game of Ms. Pac-Man and let an agent learn intelligent playing behaviour using reinforcement learning and either Q-Learning or SARSA.

The framework was developed by Luuk Bom and Ruud Henken, under supervision of Marco Wiering, Department of Artificial Intelligence, University of Groningen. It formed the basis of a bachelor's thesis titled "Using reinforcement learning with relative input to train Ms. Pac-Man", L.A.M. Bom (2012).

Ms. Pac-Man Framework Web Site


  • (Graphical) simulation of the game Ms. Pac-Man
  • Uses a small number of clever relative inputs to represent the game environment
  • Reinforcement learning with either Q-Learning or SARSA
  • Highly configurable and easy to tweak
  • Results can be exported to .CSV or plotted in graphs
  • Extensive documentation


Other Useful Business Software

Is your app at the top of its class? Icon

Recognized in the industry for leading IaaS, PaaS, and SaaS. Start building your next intelligent app today with a $200 credit.

Is your app at the top of its class? Icon
Use the tools and open source technologies you already know and trust, because Azure supports a broad selection of operating systems, programming languages, frameworks, databases, and devices. Azure offers hybrid consistency everywhere: in application development, management and security, identity management, and across the data platform.
Write a Review

User Reviews

Be the first to post a review of Ms. Pac-Man Framework!

Additional Project Details

User Interface

Java Swing, Java AWT

Programming Language




Thanks for helping keep SourceForge clean.

Screenshot instructions:
Red Hat Linux   Ubuntu

Click URL instructions:
Right-click on ad, choose "Copy Link", then paste here →
(This may not be possible with some types of ads)

More information about our ad policies

Briefly describe the problem (required):

Upload screenshot of ad (required):
Select a file, or drag & drop file here.

Please provide the ad click URL, if possible:

Get latest updates about Open Source Projects, Conferences and News.

No, thanks