Vanga reads a screen — live or captured — and resolves it to an action. You describe the interface in plain YAML: tokens are pictures matched under a discipline, lexemes their spatial arrangements, with OCR for the content that changes. On a match it drives the GUI (click, type, route text); the logic turns a recognized screen into what to do — a watched value with prose rules, or a neighbourhood rule table over a tiled grid. The shipped examples are pure grammar, no Java: a calculator automator and a Minesweeper solver. Java 21, MIT-licensed. See VANGA_DESIGN.md.
Features
- Recognize GUI screens from pixels
- Describe screens in plain YAML — no code required
- OCR reads the content that changes
- Solve tiled UIs with neighbourhood rules (e.g. Minesweeper)
- Drives the live pointer and restores it after acting
License
MIT LicenseOther Useful Business Software
Demo Series - Small Business Backup By Veeam
Watch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Vanga!