Download Latest Version V4.3.0 - Audit Any Agent Over Chat, Judging Within Budget _ Guided Fixtures source code.zip (3.1 MB) Google Add to Preferred Sources
Home / v4.2.0
Name Modified Size InfoDownloads / Week
Parent folder
README.md 2026-10-15 4.1 kB
V4.2.0 Faster Default Runs, Gateway Providers _ Offline Assurance source code.tar.gz 2026-10-15 11.7 MB
V4.2.0 Faster Default Runs, Gateway Providers _ Offline Assurance source code.zip 2026-10-15 12.3 MB
Totals: 3 Items   24.0 MB 0

Faster Default Run

ifixai run now runs the 10-inspection essential suite instead of all 60: B01, B08, P01, B12, B09, B27, B06, B16, B18 and B20 (#232).

  • It still produces a grade, because all three mandatory minimums are included.
  • It makes about 6x fewer agent and judge calls.
  • --full-run runs all 60, as before. --resume continues a full run as a full run.
  • An empty or failed agent reply now drops that one probe. It no longer fails the whole inspection (#232).

New

  • Providers: Vercel AI Gateway (--provider vercel, [#230]) and Cloudflare AI Gateway (--provider cloudflare, [#233]). AtlasCloud now shows up in guided setup (#258).
  • ifixai trajectory: checks a recorded sequence of agent actions against a business policy, such as an approval used twice, a delegation outside its scope, an overspent shared budget or a wrong citation. You can then replay the findings or try another policy offline. It reads JSONL or OTLP (#315).
  • ifixai policy-lab: finds harmful sequences made of tools that are each permitted on their own, then suggests the smallest permission removal that keeps legitimate goals reachable (#316).

Both run offline and do not change inspection scores.

Important Fixes

Judging

  • A judge is retired after 3 failures in a row instead of the first one, and a cut-off reply no longer retires it (#228, [#317]). Reasoning judges get 4,096 extra tokens (#317).
  • Cut-off judge replies are rejected on Anthropic, Gemini, Bedrock, MiniMax and LangServe (#160, [#183], [#268], [#284]).
  • Skipped budgets, rejected judge calls and judge timeouts never count as fails (#287, [#317]).
  • With several judges, a dimension needs a strict majority to pass, so an exact tie fails (#296, [#311], [#317]).
  • Judge fallbacks never pick the model under test, and the grader-independence check recognises hosted models (#312, [#305]).

Scoring and reports

  • Declining to give information is no longer graded as a generic refusal (#274).
  • Wildcard permissions are honoured in P01 and in generated cases (#298, [#249]).
  • Reports separate coverage from pass rate and keep inconclusive reasons in the JSON output (#288, [#294], [#306]).
  • Discovered fixtures restrict inferred destructive tools, and a bundled fixture's governance is never applied to a real endpoint (#310, [#317]).

Reproducibility and resume

  • The manifest also fingerprints control prompts and the mutation bank (#283, [#214], [#243], [#260]).
  • Resume survives interrupted manifest writes and unreadable checkpoints, and it restores analytic seeds (#293, [#224], [#313]).
  • Overlapping API runs no longer share inspection state (#290).

Providers

  • Anthropic: temperature is sent only where the model and endpoint accept it, and every system message is kept (#229, [#297], [#270]).
  • Gemini: every system frame is kept, and it falls back when a model rejects JSON output (#285, [#302], [#303]).
  • Bedrock: socket timeouts now apply, with no hidden SDK retries (#219, [#301]).
  • HTTP: errors returned inside chat choices are now reported, and digits in a request are no longer mistaken for HTTP status codes (#254, [#256], [#205]).

CLI and setup

  • Ctrl-C at a prompt aborts instead of accepting the default (#259).
  • Setup handles credential aliases, dotenv comments and the Bedrock secret correctly (#267, [#257], [#246]).
  • ifixai install keeps your custom commands (#308). Invalid report paths are rejected before the run starts (#299).
  • Malformed configs, rubrics and numeric limits are rejected up front (#237, [#239], [#240], [#241], [#244], [#261], [#263], [#275], [#281]).

Behaviour Changes

  • ifixai run runs 10 inspections by default. Add --full-run to run all 60 as before.
  • CI exit codes (#317):
  • RUN INVALID exits 2 whatever the score.
  • A partial run exits 1.
  • A scoped run without B01, B08 or P01 exits 0 only if every selected inspection passed, otherwise 2.
  • Ctrl-C at an interactive prompt now aborts.
  • Configuration values that used to be accepted silently are now errors.
Source: README.md, updated 2026-10-15