SIA is a self-improving AI framework designed to improve the performance of models or agents on benchmark tasks. It uses an iterative loop where a meta-agent creates or updates a task-specific target agent, while a feedback agent studies results and proposes improvements. The framework can refine both the harness around the task and the agent implementation itself. It is aimed at research and experimentation across tasks such as machine learning benchmarks, legal classification, code optimization, and scientific workflows. It includes built-in tasks, a command-line runner, and a visual dashboard for following generations as they evolve. It also lets users define custom providers, profiles, seed agents, and task directories without changing the core code.

Features

  • Self-improvement loop using meta, target, and feedback agents
  • Built-in benchmark tasks such as GPQA, LawBench, LongCoT Chess, and Spaceship Titanic
  • CLI commands for running improvement cycles and serving the visualizer
  • Per-generation artifacts including target agent code, logs, and improvement notes
  • Live web dashboard with scores, prompts, execution trajectories, and code views
  • Custom provider, profile, seed agent, and task directory support

Project Samples

Project Activity

See All Activity >

Categories

Frameworks

License

MIT License

Follow SIA

SIA Web Site

Other Useful Business Software
Our Free Plans just got better! | Auth0 Icon
Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of SIA!

Additional Project Details

Programming Language

Python

Related Categories

Python Frameworks

Registered

2026-06-11