Dynamiq
Dynamiq is a platform built for engineers and data scientists to build, deploy, test, monitor and fine-tune Large Language Models for any use case the enterprise wants to tackle.
Key features:
🛠️ Workflows: Build GenAI workflows in a low-code interface to automate tasks at scale
🧠 Knowledge & RAG: Create custom RAG knowledge bases and deploy vector DBs in minutes
🤖 Agents Ops: Create custom LLM agents to solve complex task and connect them to your internal APIs
📈 Observability: Log all interactions, use large-scale LLM quality evaluations
🦺 Guardrails: Precise and reliable LLM outputs with pre-built validators, detection of sensitive content, and data leak prevention
📻 Fine-tuning: Fine-tune proprietary LLM models to make them your own
Learn more
Deepchecks
Release high-quality LLM apps quickly without compromising on testing. Never be held back by the complex and subjective nature of LLM interactions. Generative AI produces subjective results. Knowing whether a generated text is good usually requires manual labor by a subject matter expert. If you’re working on an LLM app, you probably know that you can’t release it without addressing countless constraints and edge-cases. Hallucinations, incorrect answers, bias, deviation from policy, harmful content, and more need to be detected, explored, and mitigated before and after your app is live. Deepchecks’ solution enables you to automate the evaluation process, getting “estimated annotations” that you only override when you have to. Used by 1000+ companies, and integrated into 300+ open source projects, the core behind our LLM product is widely tested and robust. Validate machine learning models and data with minimal effort, in both the research and the production phases.
Learn more
Scorable
Scorable is an AI evaluation and monitoring platform designed to help developers measure, control, and improve the behavior of applications built with large language models. It enables teams to create customized automated evaluators, sometimes referred to as AI “judges”, that assess how an AI system responds to users and whether its outputs meet defined quality standards such as accuracy, relevance, helpfulness, tone, and policy compliance. Developers can describe what they want to measure in plain language, and the platform generates a tailored evaluation stack that tests AI outputs against context-specific criteria rather than generic benchmarks. These evaluators can be embedded directly into application code, allowing AI systems such as chatbots, retrieval-augmented generation (RAG) systems, or autonomous agents to be continuously monitored in production environments.
Learn more
NVIDIA NeMo Guardrails
NVIDIA NeMo Guardrails is an open-source toolkit designed to enhance the safety, security, and compliance of large language model-based conversational applications. It enables developers to define, orchestrate, and enforce multiple AI guardrails, ensuring that generative AI interactions remain accurate, appropriate, and on-topic. The toolkit leverages Colang, a specialized language for designing flexible dialogue flows, and integrates seamlessly with popular AI development frameworks like LangChain and LlamaIndex. NeMo Guardrails offers features such as content safety, topic control, personal identifiable information detection, retrieval-augmented generation enforcement, and jailbreak prevention. Additionally, the recently introduced NeMo Guardrails microservice simplifies rail orchestration with API-based interaction and tools for enhanced guardrail management and maintenance.
Learn more