Alternatives to iFixAi
Compare iFixAi alternatives for your business or organization using the curated list below. SourceForge ranks the best alternatives to iFixAi in 2026. Compare features, ratings, user reviews, pricing, and more from iFixAi competitors and alternatives in order to make an informed decision for your business.
-
1
F5 AI Guardrails is a runtime AI security solution designed to protect AI models, applications, agents, and connected data throughout deployment and operation. The platform helps organizations defend against adversarial threats such as prompt injection, jailbreak attacks, harmful outputs, and unauthorized AI behavior. It provides real-time monitoring and enforcement of security policies to prevent data leakage, compliance violations, and misuse of AI systems. Organizations can implement predefined guardrails or create customized policies tailored to specific business requirements and AI use cases. The platform also delivers observability, auditing, and governance capabilities that help organizations maintain visibility into AI interactions and regulatory compliance. By combining threat protection, data security, and AI governance, F5 AI Guardrails helps enterprises operate AI systems more safely and responsibly.
-
2
Ante
Antigma Labs
Ante is a self-contained coding agent that lives in your terminal and self-organizes. One ~15MB Rust binary, zero runtime dependencies, works with 12+ providers or fully offline with local GGUF models. Continuously evaled in public: #1 same-model agent on Terminal-Bench 2.1, every result pinned to a build you can download and audit.Starting Price: $0 -
3
asqav
asqav
asqav is an AI governance and security platform designed to make AI agents audit-ready by providing real-time monitoring, enforcement, and verifiable proof of every action taken by an agent. It introduces a lightweight SDK that allows developers to integrate governance directly into their agents in just a few lines of code, enabling continuous oversight across the full lifecycle of AI operations. It includes behavioral monitoring to detect issues such as drift, rate limits, and scope violations, along with advanced threat detection that identifies prompt injections, exposure of sensitive data, toxic outputs, and other risks. It enforces policy through configurable “policy gates,” which apply per-agent rules, preflight checks, and dynamic approvals before actions are executed, ensuring that agents operate within defined boundaries. asqav also provides automated incident response capabilities, including the ability to suspend, quarantine, or escalate risky agents.Starting Price: $39 per month -
4
Phinite
Phinite AI
Phinite provides shared infrastructure for building, deploying, and governing AI agents across orchestration, security, observability, lifecycle management, and environment promotion — so engineering teams don't rebuild these layers for every new agent use case. Core capabilities: Orchestration for multi-agent systems (agent-to-agent, nested calls) Deep session-level observability: execution timelines, decision variables, tool calls, latency/cost tracking Private Agent Registry for skill discoverability Eval suite for accuracy/safety benchmarking Dev-to-Production workflow with environment promotion Kubernetes-native deployment, VPC-internal deployability SOC 2 Type 2 complianceStarting Price: $20/month -
5
Flint AI
SandboxAQ
Flint AI is a local-first, framework-agnostic AgentOps CLI that helps developers determine whether an AI agent is reliable before it reaches production. One command, flintai scan, analyzes Python source code for security vulnerabilities, misconfigurations, risky tool access, missing guardrails, and quality issues, then uses AI reasoning to triage likely false positives. A second command, flintai eval, sends functional and adversarial prompts to a running agent and scores its responses across more than 35 built-in evaluations, including factual accuracy, instruction adherence, prompt injection resistance, jailbreak resilience, and other runtime behaviors. Each agent receives a reliability score, with findings mapped to OWASP Agentic Security Initiative risks ASI01 through ASI10 and severity scored using CVSS v4.0. Flint AI works with agent frameworks and SDKs including Claude Agents SDK, LangChain, CrewAI, Anthropic SDK, OpenAI SDK, MCP servers, and AutoGen.Starting Price: Free -
6
Maxim
Maxim
Maxim is an agent simulation, evaluation, and observability platform that empowers modern AI teams to deploy agents with quality, reliability, and speed. Maxim's end-to-end evaluation and data management stack covers every stage of the AI lifecycle, from prompt engineering to pre & post release testing and observability, data-set creation & management, and fine-tuning. Use Maxim to simulate and test your multi-turn workflows on a wide variety of scenarios and across different user personas before taking your application to production. Features: Agent Simulation Agent Evaluation Prompt Playground Logging/Tracing Workflows Custom Evaluators- AI, Programmatic and Statistical Dataset Curation Human-in-the-loop Use Case: Simulate and test AI agents Evals for agentic workflows: pre and post-release Tracing and debugging multi-agent workflows Real-time alerts on performance and quality Creating robust datasets for evals and fine-tuning Human-in-the-loop workflowsStarting Price: $29/seat/month -
7
BiG EVAL
BiG EVAL
The BiG EVAL solution platform provides powerful software tools needed to assure and improve data quality during the whole lifecycle of information. BiG EVAL's data quality management and data testing software tools are based on the BiG EVAL platform - a comprehensive code base aimed for high performance and high flexibility data validation. All features provided were built by practical experience based on the cooperation with our customers. Assuring a high data quality during the whole life cycle of your data is a crucial part of your data governance and is very important to get the most business value out of your data. This is where the automation solution BiG EVAL DQM comes in and supports you in all tasks regarding data quality management. Ongoing quality checks validate your enterprise data continuously, provide a quality metric and supports you in solving the quality issues. BiG EVAL DTA lets you automate testing tasks in your data oriented project. -
8
AgentOps
AgentOps
Industry-leading developer platform to test and debug AI agents. We built the tools so you don't have to. Visually track events such as LLM calls, tools, and multi-agent interactions. Rewind and replay agent runs with point-in-time precision. Keep a full data trail of logs, errors, and prompt injection attacks from prototype to production. Native integrations with the top agent frameworks. Track, save, and monitor every token your agent sees. Manage and visualize agent spending with up-to-date price monitoring. Fine-tune specialized LLMs up to 25x cheaper on saved completions. Build your next agent with evals, observability, and replays. With just two lines of code, you can free yourself from the chains of the terminal and instead visualize your agents’ behavior in your AgentOps dashboard. After setting up AgentOps, each execution of your program is recorded as a session and the data is automatically recorded for you.Starting Price: $40 per month -
9
Trusys AI
Trusys
Trusys.ai is a unified AI assurance platform that helps organizations evaluate, secure, monitor, and govern artificial intelligence systems across their full lifecycle, from early testing to production deployment. It offers a suite of tools: TRU SCOUT for automated security and compliance scanning against global standards and adversarial vulnerabilities, TRU EVAL for comprehensive functional evaluation of AI applications (text, voice, image, and agent) assessing accuracy, bias, and safety, and TRU PULSE for real-time production monitoring with alerts for drift, performance degradation, policy violations, and anomalies. It provides end-to-end observability and performance tracking, enabling teams to catch unreliable output, compliance gaps, and production issues early. Trusys supports model-agnostic evaluation with a no-code, intuitive interface and integrates human-in-the-loop reviews and custom scoring metrics to blend expert judgment with automated metrics.Starting Price: Free -
10
Valid Eval
Valid Eval
Complex group deliberations don't have to be painful. Whether you're tasked with ranking hundreds of competing proposals, judging a dozen live pitches, or managing a multi-phase innovation program, there's an easier way. A better way. Valid Eval is an online evaluation system for organizations that make and defend tough decisions. It's a secure SaaS platform that works efficiently at virtually any scale so you can involve as many applicants, subjects, domain experts, and judges as it takes to do the job right. Combining best practices from the learning sciences and systems engineering, Valid Eval delivers defensible, data driven results and provides robust reporting tools that help you measure and monitor performance and demonstrate mission alignment. Best of all, it provides an unprecedented degree of transparency that promotes accountability and builds trust in the process. -
11
Timbal
Timbal
Timbal is the end-to-end AI ecosystem for enterprises; a production AI platform that enterprise teams use to build, deploy, and govern agents, workflows, interfaces, and knowledge bases on the models they choose. Teams can define behavior in code or in Studio, run on the model and provider of their choice, and ship to chat, email, voice, and product UI from a single runtime. Timbal brings together the full production stack: a typed Python framework, a Studio for building visually, a runtime that orchestrates agents and workflows, governance and evals for enterprise rollout, and integrations with the systems teams already use. Agents provide autonomous AI for real work with reasoning, tools, and memory, while workflows create deterministic AI pipelines that chain steps, branch on logic, retry failed steps, stream outputs, and guarantee outcomes. Interfaces let teams ship custom AI experiences from chat to dashboards to voice, and knowledge bases connect company context.Starting Price: €25 per month -
12
Galileo
Cisco
Galileo is an AI observability and eval engineering platform that helps teams measure, protect, and improve AI systems in development and production. Now part of Cisco, the platform turns offline evaluations into production guardrails so teams can stop AI failures instead of only monitoring them. Galileo helps users build datasets from synthetic, development, and live production data, while capturing subject matter expert annotations as ground truth. The platform includes more than 20 out-of-the-box evals for RAG, agents, safety, security, and custom evaluation workflows. Its Luna models distill expensive LLM-as-judge evaluators into lower-cost, low-latency guardrails that can monitor production traffic. Built for enterprises and developers, Galileo helps teams debug failures, improve agent behavior, enforce AI policies, and ship AI applications with more confidence. -
13
DeepEval
Confident AI
DeepEval is a simple-to-use, open source LLM evaluation framework, for evaluating and testing large-language model systems. It is similar to Pytest but specialized for unit testing LLM outputs. DeepEval incorporates the latest research to evaluate LLM outputs based on metrics such as G-Eval, hallucination, answer relevancy, RAGAS, etc., which uses LLMs and various other NLP models that run locally on your machine for evaluation. Whether your application is implemented via RAG or fine-tuning, LangChain, or LlamaIndex, DeepEval has you covered. With it, you can easily determine the optimal hyperparameters to improve your RAG pipeline, prevent prompt drifting, or even transition from OpenAI to hosting your own Llama2 with confidence. The framework supports synthetic dataset generation with advanced evolution techniques and integrates seamlessly with popular frameworks, allowing for efficient benchmarking and optimization of LLM systems.Starting Price: Free -
14
Agnost AI
Agnost AI
Agnost AI is a product analytics platform for conversational agents that helps teams catch silent failures before users leave. It reads every agent conversation alongside its traces to show where the agent fails, where users get frustrated, what they are asking for, and where churn begins. Thousands of chats are automatically clustered into recurring problems and intents, ranked by impact and linked back to the exact conversations and traces behind each pattern. It detects hallucinations, broken promises, quality issues, policy violations, compliance problems, rising friction, and situations where a technical trace may show success even though the user did not get a useful result. Instead of stopping at dashboards, Agnost identifies the highest-impact fixes and provides supporting evidence, recommended changes, and evals needed to ship improvements safely. It can also generate self-improvement suggestions and open pull requests against system prompts, agent harnesses, etc.Starting Price: $49 per month -
15
Kayba
Kayba
Kayba makes AI agents self-improve from experience. It learns from an agent’s execution traces to detect failures, fix them, and measure whether the fix actually worked. Instead of relying on generic evals that cannot explain why an agent failed, Kayba derives failure modes from the agent’s own traces and builds custom benchmarks for the user’s domain, so teams can measure improvement against real production failure patterns. Kayba wires tracing into an agent with one line of setup, watches it around the clock, and flags the moment a step stops being recorded. Even good tracing rots as teams ship changes, and steps can quietly stop being captured; Kayba checks the tracing users already have, shows exactly what is broken, points to the file that needs attention, and sends the gap to a coding agent through MCP. The coding agent patches the issue, and Kayba verifies that the trace is actually closed.Starting Price: Free -
16
Proofpoint AI Security
Proofpoint
Proofpoint AI Security is a unified platform designed to help enterprises govern, monitor, and protect the use of AI systems, large language models, and autonomous agents across the organization. It provides visibility into both sanctioned and unsanctioned AI usage, enabling security teams to discover shadow AI tools, observe prompts and responses, and understand how AI interacts with sensitive data in real time. It applies intent-based detection and behavioral analysis to identify anomalies, prompt injection attempts, and risky interactions, while enforcing policies directly during runtime to prevent data leakage and misuse. It reconstructs full AI transactions, from user input to agent actions and outcomes, giving organizations complete traceability and audit readiness. With controls that extend across endpoints, browsers, and AI agent connections, it enables granular access governance and ensures that AI systems only access and share appropriate information. -
17
Oqoqo
Oqoqo
Oqoqo is a platform for building evals and custom benchmarks for real-world agentic tasks, letting teams run experiments at scale in realistic environments on fully managed cloud infrastructure. Users can define private task sets and rubrics, test whether agents can use products such as skills, MCP servers, CLIs, SDKs, APIs, documentation, and files, and compare agents, models, treatments, and effort levels under the same conditions. Each task runs independently in its own isolated environment with the project state, context, files, tools, and credentials it needs. Oqoqo captures the full trajectory of every run, including commands, tool calls, errors, files, and where an agent stopped, then reports pass or fail results, pass rates, lift, token usage, and friction. Teams can use these insights to identify product interface issues, token inefficiencies, and performance differences, fix what failed, and rerun the experiment.Starting Price: $20 per month -
18
JetStream Security
JetStream
JetStream Security is a security-first AI governance platform designed to give enterprises full visibility, control, and accountability over their AI systems by turning them from opaque, fragmented tools into managed, traceable infrastructure. It acts as a centralized control plane that connects identity, runtime governance, observability, and financial oversight into a single system, allowing organizations to “see every AI action, tie actions to accountable owners, [and] keep workflows inside approved boundaries” while enforcing policy at runtime. It introduces agentic identity, binding human, agentic, and non-human identities to specific actions and access permissions, ensuring every invocation, tool call, or workflow can be traced and governed through least-privilege access principles. Through continuous runtime governance, JetStream compares live AI behavior against approved blueprints, using immutable logging and real-time observability to detect drift. -
19
EvalsOne
EvalsOne
An intuitive yet comprehensive evaluation platform to iteratively optimize your AI-driven products. Streamline LLMOps workflow, build confidence, and gain a competitive edge. EvalsOne is your all-in-one toolbox for optimizing your application evaluation process. Imagine a Swiss Army knife for AI, equipped to tackle any evaluation scenario you throw its way. Suitable for crafting LLM prompts, fine-tuning RAG processes, and evaluating AI agents. Choose from rule-based or LLM-based approaches to automate the evaluation process. Integrate human evaluation seamlessly, leveraging the power of expert judgment. Applicable to all LLMOps stages from development to production environments. EvalsOne provides an intuitive process and interface, that empowers teams across the AI lifecycle, from developers to researchers and domain experts. Easily create evaluation runs and organize them in levels. Quickly iterate and perform in-depth analysis through forked runs. -
20
Rithmo
Rithmo
Rithmo is the fact-checker for AI agents. It helps organizations prevent autonomous and managed agents from acting on stale, conflicting, or superseded business information. Rithmo continuously reconciles decisions made across meetings, messages, and operational systems so agents can work from the current business truth rather than simply the information they retrieve. When context changes, Rithmo can identify the discrepancy, provide the resolved answer with provenance, and prevent an agent from proceeding when the conflict cannot be safely resolved. As part of the AI agent governance and agent reliability stack, Rithmo provides decision history, provenance, supersession, and an audit trail showing what changed and why. Rithmo complements AI agent memory, orchestration, observability, security, and enterprise search by addressing a different problem: whether the business context driving an agent’s action is still true. -
21
EvalFlow
EvalFlow
EvalFlow — Performance Management Software for Distributed SMB Teams. EvalFlow is an AI-native performance management platform designed for small and mid-sized businesses with distributed, field-based, and operations-driven workforces — the segment that enterprise tools like Lattice and 15Five systematically price out and underserve. EvalFlow brings together the full performance management cycle in a single platform: structured review cycles, continuous feedback, OKR and goal tracking with hierarchy and ownership, peer recognition, pulse surveys, 1:1 meeting management, and project and task tracking. The platform supports multi-entity team structures and is accessible in English, French, and Spanish — making it one of the only performance management tools with native Spanish-language support for US Hispanic SMB teams.Starting Price: $6/month/user -
22
Maetra
Maetra
Maetra is an AI governance and compliance control plane for teams operating tool-using AI agents. Discover inventories agents and capabilities; Comply maps systems to applicable frameworks and keeps reusable evidence current; Govern evaluates consequential actions against versioned policies and routes human approval when required. Secure scans prompts, messages, model outputs, and tool calls for prompt injection, data exposure, unsafe actions, and policy violations. Task Guard detects task drift, scope changes, and mismatched effects. Interaction Guard protects supported browser-AI prompts and files, while Audit preserves linked decision, approval, runtime, and change evidence. Teams can adopt modules separately or together through the web app, REST APIs, SDKs, and MCP. A 14-day no-card trial is available, with paid plans from $20/month.Starting Price: $20/month -
23
Orbit Eval
Turning Point HR Solutions Ltd
Orbit Eval is part of the Orbit Software Suite and is analytical job evaluation software. Job evaluation is a consistent & systematic process for defining the relative size or ranking of jobs within an organisation, by applying a consistent set of criteria to job roles. Analytical schemes offer a higher degree of rigour and objectivity. They enable a systematic approach to be applied providing a rationale as to why jobs are ranked differently. Application of the same method throughout the evaluation ensures consistency while minimising subjectivity and gender bias Orbit Eval is easy to use, very transparent and ensures consistency. The tool has been designed to be ‘owned’ by the organisation & requires minimal amounts of training. . It is hosted in the cloud with access permission levels. You can also input your current paper based scheme into the web-based data storage facility in Orbit Eval© to accommodate various systems including: NJC, GLPC & others. -
24
URL2PNG
URL2PNG
URL2PNG is a screenshots as a service platform that provides a reliable, API-first way to capture snapshots of any publicly accessible website and embed those images directly into applications, dashboards, or workflows by making simple HTTP requests to its RESTful service; developers can generate high-fidelity website screenshots in PNG (and optionally JPEG) format with control over full-page capture or thumbnail sizes, viewport dimensions, user agent strings, and optional delay settings so they can tailor captures to specific use cases such as marketing previews, quality assurance, monitoring, documentation, or design validation. The API lets users override default rendering behavior with custom CSS injection, control viewport and device simulation, and automate thumbnail or full-page renders without maintaining their own screenshot infrastructure, and it supports common developer workflows with example code for languages.Starting Price: $29 per month -
25
LayerLens
LayerLens
LayerLens is an independent AI model evaluation platform for understanding how models perform through verified results across benchmarks, prompt-level results, agentic benchmarks, and audit-ready comparisons across vendors. It helps teams compare more than 200 AI models side by side, with transparent benchmarks, model comparison tools, and consistent evaluation methods for accuracy, latency, behavior, and real-world applicability. LayerLens is built for deep model analysis through Spaces, where teams can group benchmarks and evaluations, explore task strengths, and track performance patterns in context. It supports continuous evaluation by running ongoing evals across model versions, prompt changes, judge updates, and live traces, helping teams detect quality regressions, drift, silent failures, contamination, and policy issues before they affect production. -
26
EvalExpert
AlgoDriven
EvalExpert empowers dealerships by giving them the vehicle appraisal tools to make data-driven decisions about used cars. We offer a fully automated, single platform for vehicle appraisal, price guidance and analysis. Our industry leading data, partnered with proprietary algorithms; help reduce paperwork, eliminate mistakes of manual entry, improve productivity & provide great service to your customers. Using our propriety algorithms and industry leading data, EvalExpert streamlines the appraisal process with our easy to use, 3 step appraisal process - scan the vehicles registration or VIN, take photos, enter current information & condition details - done! EvalExpert’s Web Dashboard instantly syncs all your dealerships evaluations from any device. It provides overview statistics for the dealership and sales team with the most advanced reporting tools available in the market. -
27
eVal
eVal
eVal's free data and peer company analysis tools include historic valuation multiples, historical share price data, company financial information, and Valuation Multiples by Industry sector reports, for use in investment and business valuations. In addition to the provision of financial data and peer company analysis tools, eVal provides investment and company valuations. eVal offers expert business, investment, and company valuations based on our proprietary data-driven valuation software and platform. Our investment and business valuation service is tailored for valuation professionals, business owners, investors, and investment advisors. If you're a business owner and require a business valuation; or if you're an investor and require a private company valuation for your portfolio, please contact us directly regarding our business valuation service. Our outlier detection tool provides an overview of the peer group valuation multiples.Starting Price: Free -
28
20 Dollar Eval
SVI
With its user-friendly interface, 20 Dollar Eval provides easy-to-follow prompts and automated features, requiring no technical expertise to operate. 20 Dollar Eval is powered by SVI, an organizational development company that focuses on creating irresistible companies and extraordinary people. Over the years, SVI has launched thousands of performance reviews within some of the world’s largest and most complex organizations. You can rest comfortably knowing that, while the price is low, the system and industry expertise supporting it are proven to be best-in-class.Starting Price: $20 per review -
29
Jozu
Jozu
Jozu is an AI supply chain security platform that verifies artifacts before execution, governs agent activity at runtime, and preserves proof of what happened afterward. Jozu Hub provides a self-hosted registry for models, agents, MCP servers, and skills, centralizing each artifact with cryptographic signatures, attestations, scanning, policy controls, and audit records. Its AI-specific security analysis covers threats such as executable code hidden in model packages, backdoored weights, data poisoning, prompt injection, compromised tools, and license violations. Policies can be authored once, distributed as signed OCI artifacts, and enforced when artifacts are pulled, promoted, admitted, or executed. Jozu Agent Guard runs alongside workloads on servers, desktops, edge devices, and air-gapped systems, applying local prompt and input-output filtering, tool-access controls, approval requirements, and runtime policy enforcement. -
30
GuardionAI
GuardionAI
GuardionAI is an Agent and MCP Security Gateway that provides unified security for AI agents and Model Context Protocol tools operating on enterprise data. It sits in the execution path to discover, redact sensitive data, enforce protection, and give teams visibility into actions that traditional SIEM, DLP, and identity layers cannot see. Every agent action is inspected, enforced, and logged at the protocol level across AI agents, LLM apps, RAG systems, chatbots, coding agents, MCP servers, internal tools, databases, operating systems, and cloud environments. GuardionAI protects against critical AI threats such as prompt injection, system override, web attacks, MCP tool poisoning, malicious code execution, NSFW content, PII and credential exposure, confidential data leakage, off-topic drift, and unauthorized access, mapped to OWASP LLM Top 10 and agentic AI threat frameworks. Its gateway provides four layers of protection. -
31
Plurai
Plurai
Plurai is the real-world trust platform for AI agents, built for simulation-driven evaluation, protection, and optimization that turns agents into trusted, continuously improving production systems. It helps teams train evals and guardrails tailored to their use case, bridging the gap from prototype to reliable production at scale. Plurai’s simulation platform prepares agents for the real world, not the lab, with hyper-realistic, product-tailored experimentation and evaluation that covers production complexity. It generates authentic multi-turn scenarios, personas, required artifacts, and tool mocking, using organizational PRDs, relevant sources, and policies to build a knowledge graph and expand edge-case coverage. Instead of relying on static datasets, manual test creation, or inconsistent LLM-as-a-judge methods, Plurai groups evaluations into structured, runnable experiments so teams can test new versions, measure regressions, and validate improvements before release.Starting Price: Free -
32
Traccia
Algen AI
Traccia is an OpenTelemetry-native observability, governance, and policy enforcement platform for production AI agents. It gives engineering teams complete visibility into every LLM call, tool invocation, decision, token, and dollar spent across frameworks like LangChain, CrewAI, OpenAI Agents SDK, AutoGen, and LlamaIndex. Beyond tracing, Traccia helps organizations govern AI systems with runtime policies that can detect and block unsafe behavior, runaway costs, restricted model usage, and PII exposure before incidents reach production. Accurate cost attribution, agent health monitoring, a unified agent registry, and EU AI Act evidence generation make it suitable for enterprise deployments. With a lightweight open-source SDK and managed platform, Traccia enables teams to build, debug, monitor, and govern AI agents at scale without vendor lock-in, using standard OpenTelemetry instrumentation.Starting Price: $99/month -
33
EarlyCore
EarlyCore
EarlyCore is a security platform built for AI agents. It automates pre-production attack testing, real-time monitoring, and compliance reporting across the full agent lifecycle. Scans agents against thousands of attack scenarios covering prompt injection, jailbreaking, data exfiltration, tool misuse, and supply chain threats. In production, tracks every agent action, establishes behavioral baselines, and flags anomalies in real time. Alerts push to Slack, email, or webhooks. Compliance docs generate automatically, mapped to ISO 42001, NIST AI RMF, EU AI Act, SOC 2, and GDPR. Always audit-ready. Deploys in 15 minutes with zero code changes. Integrates with AWS Bedrock, Gemini Enterprise Agent Platform, LangChain, and more. Multi-tenant support for agencies and MSSPs. Built for security teams, agencies, and MSSPs securing AI agents at scale.Starting Price: $100/month -
34
Tapt Health
Tapt Health
Tapt Health completes your documentation while you treat. Leverage AI to better engage patients, expedite evals, and minimize after-hours documentation.Starting Price: $91/month/user -
35
NVIDIA Open Agent Safety Platform is an open reference design for continuously monitoring and governing AI agent behavior, helping organizations keep agents isolated, observable, auditable, and within defined operational boundaries. It combines runtime governance, continuous threat detection, and hardware-isolated policy enforcement to secure enterprise AI agents from testing through deployment. NVIDIA OpenShell provides an open-source runtime that separates how agents execute from how they reach data, tools, and external systems, using sandboxed execution and deterministic, zero-trust policy enforcement to control what agents can see, do, and interact with. Policies are enforced outside the agent process, helping limit the impact of unexpected behavior. NVIDIA Sentry adds an independent security layer that observes agent requests and responses, establishes verifiable agent identities, continuously governs access to data, tools, APIs, and services, and can quarantine agents.
-
36
neatlogs
neatlogs
neatlogs is a collaborative debugging and AI reliability platform that provides all the tools your team needs to identify, understand, and fix AI agent issues efficiently Here’s what you can do today: - Trace and replay: See what your agent did, step by step. - Detect failures: Automatically flag traces using conditions, patterns, and classifiers. - Investigate: Ask Neat AI to investigate runs and turn its findings into fixes. - Evals: Route traces to human or AI reviewers and measure quality over time. - Experiment: Version prompts, test changes, and evaluate them against datasets. - Fix: Review AI-generated fixes and dispatch them to your coding agent. - Connect your tools: Connect your apps through Tools and MCPs so Copilot and Neat Agent can use them on your behalf. - Track production: Monitor cost, latency, errors, tools, and detection trends across your traces. Unlike other tools that are built only for technical audiences, neatlogs is accessible and understandabl -
37
Llama 3
Meta
We’ve integrated Llama 3 into Meta AI, our intelligent assistant, that expands the ways people can get things done, create and connect with Meta AI. You can see first-hand the performance of Llama 3 by using Meta AI for coding tasks and problem solving. Whether you're developing agents, or other AI-powered applications, Llama 3 in both 8B and 70B will offer the capabilities and flexibility you need to develop your ideas. With the release of Llama 3, we’ve updated the Responsible Use Guide (RUG) to provide the most comprehensive information on responsible development with LLMs. Our system-centric approach includes updates to our trust and safety tools with Llama Guard 2, optimized to support the newly announced taxonomy published by MLCommons expanding its coverage to a more comprehensive set of safety categories, code shield, and Cybersec Eval 2.Starting Price: Free -
38
Constellation Gate AI
Constellation Gate AI
Constellation Gate AI is a drop-in defense layer for AI agents, built to sit between the agent and the model while screening every request for attacks and leaks. Gate acts as an inline gateway for coding agents and model APIs, protecting workflows without requiring major code changes. Users can point existing tools such as Claude Code, Cursor, OpenClaw, Codex, or OpenCode at Gate and inherit prompt-injection defense, secret scanning, PII redaction, token optimization, and a verifiable audit trail. The platform is designed around three real risks: prompt injection, credential and PII leakage, and hijacked tool calls. Instead of relying on the model to defend itself, Gate blocks attacks before they reach the model, redacts secrets before responses return, and stops attacker-controlled tool outputs before an agent acts on them. Gate accepts the same calls an agent already makes, forwards them to the model, scans every call and response in both directions. -
39
AgentShield
AgentShield
AgentShield is a next-generation identity platform built to verify both human users and AI agents acting on their behalf. It enables organizations to confirm who an agent is, whether the person behind the agent has provided explicit authority, and that the agent is trustworthy, all through APIs and JavaScript integrations. The product includes tools that detect agentic sessions on a website. and enforces identity and permission checks for agent-to-agent or agent-to-service interactions under the open Model Context Protocol Identity (MCP-I) specification. With KYA, businesses can securely manage agent identities and permissions, institute audit-trails, automation workflows, and finely-tuned access control for autonomous systems, thereby protecting themselves from misuse of digital identities and ensuring transparency when AI systems act on behalf of users. -
40
LangProtect
LangProtect
LangProtect is an AI-native security and governance platform that protects LLM and Generative AI applications from prompt injection, jailbreaks, sensitive data leakage, and unsafe or non-compliant outputs. Built for production GenAI, it enforces real-time runtime controls at the AI execution layer by inspecting prompts, model responses, and tool/function calls as they happen. This allows teams to block high-risk behavior before it reaches end users, triggers downstream actions, or exposes confidential data. LangProtect integrates into existing LLM stacks via an API-first approach with minimal latency and supports cloud, hybrid, and on-prem deployments for enterprise security and data residency needs. It also secures modern architectures such as RAG pipelines and agentic workflows with policy-driven enforcement, continuous visibility, and audit-ready governance. -
41
VoltusWave
VoltusWave
VoltusWave is an enterprise AI agent workforce platform designed to move beyond isolated automation tools by combining intelligent agents with a full execution layer where they can operate end-to-end business processes. It provides a unified system where AI agents can read documents, make decisions, execute workflows, and escalate exceptions, all with full auditability and human override built in. It is powered by six interconnected engines, including process orchestration, rules enforcement, document generation, integration infrastructure, no-code application building, and a governed AI agent workforce, enabling organizations to run complex operations such as procure-to-pay or enterprise-to-cash cycles with minimal manual intervention. AI agents operate across these layers to handle documents, approvals, reconciliations, compliance checks, and customer interactions, while a rules engine ensures that every action follows predefined logic with version control and traceability. -
42
AI Security Guard
AI Security Guard
AI Security Guard is a multi-faceted platform for securing autonomous AI, combining a protection SDK, product tooling, education, and original research on the agentic future. - Protection SDK: Integration-friendly API wrapper designed to shield AI agents from jailbreaks, prompt injection, and other harmful content before it reaches your models. - AgentGuard360: Built on the API: Intercepts AI traffic in real time before malicious content reaches your agents. Two-tier content scanning, supply chain protection, and device hardening in one tool. Privacy-first: Content stays local unless you request premium analysis. - Research: Original analysis on the autonomous AI future and the security, privacy, and safety issues that follow, including reports like Shipping the Future. -
43
Martian
Martian
By using the best-performing model for each request, we can achieve higher performance than any single model. Martian outperforms GPT-4 across OpenAI's evals (open/evals). We turn opaque black boxes into interpretable representations. Our router is the first tool built on top of our model mapping method. We are developing many other applications of model mapping including turning transformers from indecipherable matrices into human-readable programs. If a company experiences an outage or high latency period, automatically reroute to other providers so your customers never experience any issues. Determine how much you could save by using the Martian Model Router with our interactive cost calculator. Input your number of users, tokens per session, and sessions per month, and specify your cost/quality tradeoff. -
44
Revolution FTO
Wayne Enterprises
Documenting the training of new officers is serious business. Liability is generally determined by training or the lack of it. Our police and sheriff FTO evaluation software was created by sworn officers having over 23 years of experience in managing FTOs and training new officers. This software is web-based and allows your training officers to document all daily and monthly activities of your newer officers. Through an annual contract with your agency, we can provide 24/7 phone, web, and onsite technical support. You will get direct assistance from a developer of the software. Create evaluations in half the time. FTO's can only change the evals they create. Finalization prevents changes in evaluations. Use from any computer inside the department. Use dailies to create monthlies, trainees can log on and sign evals without FTO. Chronological one-button approval of evaluations. Create statistical reports and track the effectiveness of police academies. -
45
ProdEval
Texas Computer Works
There is no such thing as a typical user of this system. Users include; independent reservoir engineers doing reserve reports, production engineers working up AFE’s and monitoring daily production, bank engineers tracking petroleum loan packages, CFOs tracking their borrowing base, property tax professionals assessing ad-valorem value, plus investors buying and selling producing properties. TCW’s ProdEval software is a quick and comprehensive Economic Evaluation system for both reserve reporting and prospect analysis. ProdEval has a very easy-to-use and straightforward approach to economic analysis and this methodology serves the user well. For example, the projecting of future production using sophisticated curve fitting techniques that allow the user to simply adjust the curves is one of the big factors that new users find attractive. The system is a rather open-ended system in that it accepts data from many sources; excel worksheets, commercial data sources. -
46
Vizcab Eval
Vizcab
Vizcab Eval is the solution to allow you to produce reliable, robust building ACV studies and percussive in one minimum time. Import your DPGF-type measurements and your RSET in a few clicks. Complete your entry using our research panel by keyword. Automatically associate your components and make simple corrections with our alert system. View results globally or in batches in real-time in the form of tables and graphs and validate compliance with thresholds. Identify at a glance the most impactful cards of your project, and bring efficient optimizations. Choose the most virtuous products with our scoring system of FDES. Work together and exchange easily with our fashion collaborative. Export your results in the form of graphs, and study reports according to your needs. Recover one RSEE export from your study to Excel format. You import your data directly into Vizcab Eval, and your components are automatically associated with plugs. -
47
Langfuse
Langfuse
Langfuse is an open source LLM engineering platform to help teams collaboratively debug, analyze and iterate on their LLM Applications. Observability: Instrument your app and start ingesting traces to Langfuse Langfuse UI: Inspect and debug complex logs and user sessions Prompts: Manage, version and deploy prompts from within Langfuse Analytics: Track metrics (LLM cost, latency, quality) and gain insights from dashboards & data exports Evals: Collect and calculate scores for your LLM completions Experiments: Track and test app behavior before deploying a new version Why Langfuse? - Open source - Model and framework agnostic - Built for production - Incrementally adoptable - start with a single LLM call or integration, then expand to full tracing of complex chains/agents - Use GET API to build downstream use cases and export dataStarting Price: $29/month -
48
Onyx Security
Onyx Security
Onyx is a secure AI control plane for discovering, protecting, governing, optimizing, and measuring AI agents and models across the enterprise. It gives security, governance, and AI teams visibility into sanctioned and shadow AI across SaaS, cloud, endpoints, and code, including prompts, responses, and agent actions. AI Security helps strengthen posture, identify vulnerabilities, and enforce real-time safeguards against threats and misuse, while AI Governance supports security standards and regulatory requirements with opt-in coverage and policy controls defined in natural language. AI Orchestration reduces friction when setting up agents and MCPs and helps optimize for cost, accuracy, and latency. AI ROI measures adoption, sets goals, and tracks outcomes across departments. The Onyx Guardian Agent acts as a supervisory AI that continuously identifies risks and remediates issues across the platform, helping organizations manage large numbers of agents at scale. -
49
Purple Fabric
Purple Fabric
Purple Fabric is an advanced enterprise AI platform developed by IntellectAI, designed to enable financial institutions to swiftly create, deploy, and manage AI-driven solutions through a low-code, self-service approach. Leveraging the eMACH.ai framework, Purple Fabric integrates structured and unstructured data, regulatory information, market insights, and tacit knowledge into a unified system, facilitating the development of AI agents that enhance decision-making and operational efficiency. It emphasizes ethical AI by providing comprehensive governance, audit trails, and data lineage, ensuring transparency and compliance. Its modular architecture includes components like PF Imagine for AI solution design, PF Govern for governance and compliance, PF DIMS for document intelligence, PF Expert Agent for autonomous decision-making, and PF Triad for unbiased decision support. Purple Fabric's capabilities have been successfully applied in various financial services scenarios. -
50
Noteweave
Noteweave
Noteweave is an Intelligent Research Machines platform that helps teams go from research to executable production plans. It is built to stress-test scientific research, translate papers into validated experiments, and run R&D faster from one research-first workspace. Deep Analysis pressure-tests methods, evaluations, and robustness so failure modes surface before they reach production, helping teams detect production faults in academic papers pre-emptively, find missing evals, set up discrepancies, or misleading robustness trends, and identify technical faults faster. Explore searches across millions of papers, datasets, and code repositories, then synthesizes them into runnable production plans with traceable evidence. Noteweave helps users discover relevant research signals across 3 million+ AI/ML publications, optimize plans against constraints such as GPU utilization, translate academic methods into reproducible steps, and validate evaluation strategies more reliably.Starting Price: $18.99 per month
