Vanga

Vanga reads a screen — live or captured — and resolves it to an action. You describe the interface in plain YAML: tokens are pictures matched under a discipline, lexemes their spatial arrangements, with OCR for the content that changes. On a match it drives the GUI (click, type, route text); the logic turns a recognized screen into what to do — a watched value with prose rules, or a neighbourhood rule table over a tiled grid. The shipped examples are pure grammar, no Java: a calculator automator and a Minesweeper solver. Java 21, MIT-licensed. See VANGA_DESIGN.md.

Features

Recognize GUI screens from pixels
Describe screens in plain YAML — no code required
OCR reads the content that changes
Solve tiled UIs with neighbourhood rules (e.g. Minesweeper)
Drives the live pointer and restores it after acting

Project Activity

See All Activity >

License

MIT License

Follow Vanga

Vanga Web Site

Other Useful Business Software

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Learn More

Rate This Project

User Reviews

Be the first to post a review of Vanga!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Intended Audience

Developers, Education, Quality Engineers, Testers

User Interface

JavaFX

Programming Language

Java

Related Categories

Java Compilers, Java QA Automation Software, Java Task Runners

Registered

2011-06-01

Similar Business Software

Titan

Titan is the all-in-one, Salesforce-first platform for building customer-facing workflows directly on Salesforce. Create portals, forms, surveys, document generation, eSignatures, and contract processes that write back in real time, keeping Salesforce as your system of record. Titan AI turns...

See Software
Highcharts

Highcharts is a JavaScript charting library that allows developers to create interactive and visually appealing charts for web applications. It offers a wide range of chart types, including line charts, bar charts, pie charts, scatter plots, and more. It also supports different types of data,...

See Software
SurveyJS

SurveyJS is an embeddable, self-hosted, white-label form builder for teams building custom forms, surveys, questionnaires, and other data collection tools inside web applications. It runs entirely on the client and is fully compatible with all modern JavaScript frameworks, including React,...

See Software
AddSearch

AddSearch is a unified search, AI-answers, and conversational-AI platform used by 1,800+ organizations. Three layers in one platform: keyword search with AI ranking and personalization; content-grounded AI answers with no hallucinations; conversational AI with multi-turn dialogue. Built for...

See Software
Grafana Cloud

Grafana Labs delivers the leading AI-powered observability platform, built around Grafana—the world’s most widely adopted open source technology for dashboards and visualization. Recognized as a Leader in the 2026 Gartner® Magic Quadrant™ for Observability Platforms (3x) and furthest in...

See Software
Eurekos

Eurekos is the customer training LMS built to educate the world outside your organization – partners, distributors and resellers. Most companies spend years perfecting their product, then hand customers a repurposed employee training course and hope for the best. When those customers churn,...

See Software