Search Results for "test scenario"

Inspect Petri is an open-source alignment auditing agent that lets researchers rapidly test concrete safety hypotheses against target models using realistic, multi-turn scenarios. Instead of building bespoke evals, Inspect Petri automatically generates audit environments from seed “special instructions,” orchestrates an auditor model to probe a target model, and simulates tool use and rollbacks to surface risky behaviors. Each interaction transcript is then scored by a judge model using a...

The TDD MAS Toolkit provides a set of tools to perform Test Driven Development of MAS based on Jade. The toolkit allows developers to set up simulation based and test case scenario based testing, providing powerful insights of the MAS under construction and assuring that the interation protocols and agent interaction in general are been enacted as expected.