Scorable
Scorable is an AI evaluation and monitoring platform designed to help developers measure, control, and improve the behavior of applications built with large language models. It enables teams to create customized automated evaluators, sometimes referred to as AI “judges”, that assess how an AI system responds to users and whether its outputs meet defined quality standards such as accuracy, relevance, helpfulness, tone, and policy compliance. Developers can describe what they want to measure in plain language, and the platform generates a tailored evaluation stack that tests AI outputs against context-specific criteria rather than generic benchmarks. These evaluators can be embedded directly into application code, allowing AI systems such as chatbots, retrieval-augmented generation (RAG) systems, or autonomous agents to be continuously monitored in production environments.
Learn more
Fiddler AI
Fiddler is a pioneer in Model Performance Management for responsible AI. The Fiddler platform’s unified environment provides a common language, centralized controls, and actionable insights to operationalize ML/AI with trust. Model monitoring, explainable AI, analytics, and fairness capabilities address the unique challenges of building in-house stable and secure MLOps systems at scale.
Unlike observability solutions, Fiddler integrates deep XAI and analytics to help you grow into advanced capabilities over time and build a framework for responsible AI practices. Fortune 500 organizations use Fiddler across training and production models to accelerate AI time-to-value and scale, build trusted AI solutions, and increase revenue.
Learn more
Openlayer
Openlayer is an enterprise AI governance platform that helps organizations discover, test, monitor, secure, and control AI systems from development through production.
The platform brings AI evaluation, observability, governance, guardrails, compliance, gateway enforcement, and cost controls together in one place. Teams can evaluate LLMs, agents, RAG applications, and traditional ML systems using 175+ out-of-the-box evaluations across quality, safety, security, performance, cost, fairness, and compliance.
In production, Openlayer provides end-to-end tracing and continuous monitoring of AI behavior, including prompts, responses, tool calls, agent workflows, latency, and cost. Real-time guardrails can detect and block issues such as prompt injection, jailbreak attempts, PII or PHI exposure, and other unsafe behavior before it reaches a model or end user.
Openlayer Governance connects organizational AI policies to technical controls. Teams can maintain an AI inventory, assign own
Learn more
Cisco AI Defense
Cisco AI Defense is a comprehensive security solution designed to enable enterprises to safely develop, deploy, and utilize AI applications. It addresses critical security challenges such as shadow AI—unauthorized use of third-party generative AI apps—and application security by providing full visibility into AI assets and enforcing controls to prevent data leakage and mitigate threats. Key components include AI Access, which offers control over third-party AI applications; AI Model and Application Validation, which conducts automated vulnerability assessments; AI Runtime Protection, which implements real-time guardrails against adversarial attacks; and AI Cloud Visibility, which inventories AI models and data sources across distributed environments. Leveraging Cisco's network-layer visibility and continuous threat intelligence updates, AI Defense ensures robust protection against evolving AI-related risks.
Learn more