promptfoo Integrations

Claude Duet is a proactive AI agent that helps professionals manage work across connected apps. It delivers a morning brief, monitors connected accounts for items needing attention, and accepts tasks by text or voice in a continuing conversation. The agent can schedule meetings, draft replies and reminders, prepare payroll and agreements, create reports and dashboards, and help build forecasts or web apps. Work continues in a cloud-based virtual machine while the user is away; Claude Duet sends updates when a task is complete or needs review. It carries over Claude account memory, skills, and connected apps, and supports more than 6,000 marketplace connectors and plugins. Before sensitive actions such as sending messages, paying, signing, or deleting, it requests approval. The research-preview app is available on iOS, Android, and the web for eligible Claude Pro and Max subscribers in the United States.

OpenAI’s mission is to ensure that artificial general intelligence (AGI)—by which we mean highly autonomous systems that outperform humans at most economically valuable work—benefits all of humanity. We will attempt to directly build safe and beneficial AGI, but will also consider our mission fulfilled if our work aids others to achieve this outcome. Apply our API to any language task — semantic search, summarization, sentiment analysis, content generation, translation, and more — with only a few examples or by specifying your task in English. One simple integration gives you access to our constantly-improving AI technology. Explore how you integrate with the API with these sample completions.

Claude is a next-generation AI assistant developed by Anthropic to help individuals and teams solve complex problems with safety, accuracy, and reliability at its core. It is designed to support a wide range of tasks, including writing, editing, coding, data analysis, and research. Claude allows users to create and iterate on documents, websites, graphics, and code directly within chat using collaborative tools like Artifacts. The platform supports file uploads, image analysis, and data visualization to enhance productivity and understanding. Claude is available across web, iOS, and Android, making it accessible wherever work happens. With built-in web search and extended reasoning capabilities, Claude helps users find information and think through challenging problems more effectively. Anthropic emphasizes security, privacy, and responsible AI development to ensure Claude can be trusted in professional and personal workflows.

evalship helps engineering teams test LLM-powered software with a review of their evals at setup and a report on every pull request. The review checks scorers, judges and prompts for flaws, such as a judge that scores 1.0 when its call fails, and gives each flaw a fix with code references. Setup is a prompt for your coding agent: it configures GitHub Actions and opens a setup pull request. On later pull requests, evalship compares results with the default branch, reports the evals a change really broke and the likely cause, sets flaky evals aside, and flags changed prompts or LLM calls that no eval exercises. Its check can block a merge that breaks an eval. It reads results from pytest, Vitest, Jest, promptfoo, Langfuse, Braintrust and LangSmith, with no SDK to add. Evals run in the customer's own GitHub Actions with their own model API keys; evalship only reads the results. Teams get a dashboard with each eval's history and a weekly report by email. Public repositories are free.

Cake AI is a comprehensive AI infrastructure platform that enables teams to build and deploy AI applications using hundreds of pre-integrated open source components, offering complete visibility and control. It provides a curated, end-to-end selection of fully managed, best-in-class commercial and open source AI tools, with pre-built integrations across the full breadth of components needed to move an AI application into production. Cake supports dynamic autoscaling, comprehensive security measures including role-based access control and encryption, advanced monitoring, and infrastructure flexibility across various environments, including Kubernetes clusters and cloud services such as AWS. Its data layer equips teams with tools for data ingestion, transformation, and analytics, leveraging tools like Airflow, DBT, Prefect, Metabase, and Superset. For AI operations, Cake integrates with model catalogs like Hugging Face and supports modular workflows using LangChain, LlamaIndex, and more.

Omega is an internally developed AI agent integrated directly into Slack to supercharge sales workflows by handling routine tasks, surfacing insights, and nudging team members toward best practices, all with minimal friction. It seamlessly connects with core tools like Slack, Google Drive, Apollo, Salesforce, and transcript systems to automate time-consuming chores, generating call agendas, summarizing expert calls, locating relevant documents, and tracking deal progression. Omega operates as a modular, multi-agent system, utilizing specialized roles orchestrated via frameworks like AutoGen to plan, execute, and validate actions within the workflow. This architecture runs on a cloud-native, serverless stack using AWS Lambda and Step Functions, enabling flexibility and scale. Observability and iteration are supported through tools like Langfuse, Promptfoo, CI/CD pipelines, and Terraform.

Claude for Legal is an AI assistant from Anthropic that legal professionals can use to work with documents and research materials. It can summarize lengthy files, extract and compare information, draft and revise text, and assist with contract and document analysis. Law firms and in-house legal teams can use Claude for Legal for recurring knowledge and document workflows, providing relevant context and source materials and reviewing generated responses as part of their work. Claude for Legal is available online and through desktop and mobile apps. It supports information processing and drafting; users remain responsible for checking outputs, applying professional judgment, and making legal decisions.