ASSERT
Requirement-driven evaluation harness for AI agents and LLM
...The pipeline derives behavior categories, generates single-turn and multi-turn test cases, runs them against a target system, and uses an LLM judge to score conversations against the stated policies. It can evaluate hosted models, custom agents, multi-agent systems, REST clients, and frameworks such as LangGraph, CrewAI, AutoGen, DSPy, LlamaIndex, and OpenAI Agents SDK. ASSERT is designed to close the gap between what a system is supposed to do and what evaluation actually measures. It is useful for responsible AI teams, product teams, and developers who need traceable, spec-aligned testing.