Search Results for "test"
Sort By:
Showing 352 open source projects for "test"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Qodo Cover
AI tool that generates tests to improve code coverage quickly
...It supports scanning entire repositories to automatically detect test files, gather relevant context, and extend test suites accordingly. -
2
GoogleTest
Google Testing and Mocking Framework
...Since they were so closely related, they were merged to create an even better GoogleTest. GoogleTest features an xUnit test framework, a rich set of assertions, user-defined assertions, death tests, among many others. It's been used on a variety of platforms, including Cygwin, Symbian, MinGW and PlatformIO. -
3
TTRL
Test-Time Reinforcement Learning
TTRL is an open-source framework for test-time reinforcement learning in large language models, with a particular focus on reasoning tasks where ground-truth labels are not available during inference. The project addresses the problem of how to generate useful reward signals from unlabeled test-time data, and its central insight is that common test-time scaling practices such as majority voting can be repurposed into reward estimates for online reinforcement learning. ... -
4
Ragas
Supercharge Your LLM Application Evaluations
Objective metrics, intelligent test generation, and data-driven insights for LLM apps. Ragas is your ultimate toolkit for evaluating and optimizing Large Language Model (LLM) applications. Say goodbye to time-consuming, subjective assessments and hello to data-driven, efficient evaluation workflows. Don't have a test dataset ready? We also do production-aligned test set generation. -
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
5
Codex with ChatGPT
ChatGPT thinks. Codex works. Use ChatGPT as the planning brain
...It uses a secure, read-only MCP bridge instead of uploading the repository or giving ChatGPT write access. ChatGPT can request only the workspace information, files, search results, Git status, diffs, test status, and execution records it needs. After Codex makes changes, ChatGPT can independently inspect the actual diff and test evidence before continuing the loop. The bridge uses OAuth, one-time pairing, workspace boundaries, path containment, and sensitive-file blocking to limit access. Setup and updates are designed to be largely automated through a Codex skill, with Cloudflare tunneling used to expose the local read-only bridge when needed. -
6
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI
...Run experiments with different prompts and evaluate against a test set. Choose and run pre-configured evaluation metrics or define your own with our convenient SDK library. Consult built-in LLM judges for complex issues like hallucination detection, factuality, and moderation. -
7
Groq Desktop
Local Groq Desktop chat app with MCP support
...The app is built with modern web technologies and packaged for native distribution, making it accessible even to non-developer users who just want to experiment with Groq models without writing code. Developers can also use groq-desktop-beta as a lightweight interface to test prompts, media inputs, or function-calling capabilities before embedding them into larger projects. The project offers installable builds (including via Homebrew on macOS) and supports easy setup, giving quick access to Groq’s inference services without needing to spin up a full backend. -
8
CodiumAI Cover-Agent
CodiumAI Cover-Agent: An AI-Powered Tool for Automated Test Generation
CodiumAI Cover Agent aims to help efficiently increasing code coverage, by automatically generating qualified tests to enhance existing test suites. -
9
promptfoo
Evaluate and compare LLM outputs, catch regressions, improve prompts
...Use built-in metrics, LLM-graded evals, or define your own custom metrics. Compare prompts and model outputs side-by-side, or integrate the library into your existing test/CI workflow. Use OpenAI, Anthropic, and open-source models like Llama and Vicuna, or integrate custom API providers for any LLM API. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
XcodeBuildMCP
A Model Context Protocol (MCP) server
XcodeBuildMCP is a Model Context Protocol server that exposes Xcode operations as typed tools and resources so AI assistants can build, test, and debug iOS apps programmatically. It’s organized with a modern plugin architecture and workflow-scoped tool directories, covering common developer actions across projects, schemes, targets, simulators, real devices, and Swift packages. The server aims to be “agent-ready,” surfacing capabilities (build, clean, test, archive, install, run, log collection) with explicit schemas instead of brittle prompt instructions. ... -
11
Superpowers
An agentic skills framework & software development methodology
Superpowers Framework is a widely-used agentic skills framework and methodology for software development that equips coding agents like Claude Code with structured capabilities to plan, develop, test, and review code systematically. Instead of simply generating code, Superpowers drives an AI through a thoughtful software engineering workflow that starts with clarifying project intent, teasing out a detailed specification, and creating an implementation plan that is readable and actionable. It incorporates test-driven development, task planning, and sub-agent orchestration so that each engineering task is executed, checked, and iterated upon with rigor rather than ad-hoc improvisation. ... -
12
Goose
AI coding agent that's more than suggestions - install, execute, edit+
Goose is an open-source, extensible AI agent that enhances the software development process by going beyond traditional code suggestions. It allows developers to install, execute, edit, and test code with any large language model (LLM), facilitating a more efficient and streamlined workflow. Designed to operate locally within a developer's environment, Goose integrates seamlessly with various tools and platforms, providing a customizable and powerful assistant for coding tasks. Its architecture supports extensibility, enabling users to tailor the agent to their specific needs and preferences. ... -
13
GitHub Copilot CLI
GitHub Copilot CLI brings the power of Copilot coding agent
GitHub Copilot CLI is a command-line interface tool. It brings AI-powered coding assistance directly into your terminal. GitHub Copilot CLI allows you to build, debug, refactor, and understand code via natural language conversations. You can have these conversations within the Active Directory. It integrates tightly with your GitHub context—repositories, issues, pull requests. The Copilot can leverage repository context when making suggestions. The tool is currently in public preview and is... -
14
Codex-X
Codex Switch & Instruct desktop manager
...It replaces repeated manual file editing with a visual interface for prompts, providers, sessions, skills, MCP servers, and TOML settings. Users can categorize, import, edit, enable, disable, cache, and synchronize Markdown instruction templates. Provider tools store multiple API configurations, test connections, retrieve models, and switch between official and third-party services. Session management can search, group, inspect, synchronize, and permanently delete local Codex histories. The application also displays authentication and configuration files while creating backups before important changes. Packages are offered for macOS, Windows, and Linux through a Tauri-based desktop application. -
15
Giskard
Collaborative & Open-Source Quality Assurance for all AI models
...Giskard automatically generates relevant tests based on the vulnerabilities detected by the scan. You can easily customize the tests depending on your use case by defining domain-specific data slicers and transformers as fixtures of your test suites. -
16
Ludwig
A codeless platform to train and test deep learning models
Ludwig is a toolbox built on top of TensorFlow that allows to train and test deep learning models without the need to write code. All you need to provide is a CSV file containing your data, a list of columns to use as inputs, and a list of columns to use as outputs, Ludwig will do the rest. Simple commands can be used to train models both locally and in a distributed way, and to use them to predict on new data. -
17
Deta Surf
Personal AI Notebooks. Organize files & webpages and generate notes
Surf is an open-source AI-driven development tool designed to simplify the process of building and experimenting with artificial intelligence applications. The platform provides a streamlined development environment where developers can test models, run experiments, and deploy small AI services with minimal infrastructure overhead. It focuses on simplicity and speed, allowing developers to prototype ideas quickly without managing complex cloud configurations. Surf integrates modern AI workflows such as prompt-based applications, lightweight APIs, and automated deployment pipelines. ... -
18
PML
The easiest way to use deep metric learning in your application
This library contains 9 modules, each of which can be used independently within your existing codebase, or combined together for a complete train/test workflow. To compute the loss in your training loop, pass in the embeddings computed by your model, and the corresponding labels. The embeddings should have size (N, embedding_size), and the labels should have size (N), where N is the batch size. The TripletMarginLoss computes all possible triplets within the batch, based on the labels you pass into it. ... -
19
Paddler
Open-source LLM load balancer and serving platform for hosting LLMs
...Paddler also includes tools for monitoring, request buffering, and autoscaling integration so that deployments can adapt dynamically to changing workloads. A built-in administrative interface allows developers and operations teams to manage models, observe system performance, and test inference endpoints. -
20
FuzzyAI Fuzzer
A powerful tool for automated LLM fuzzing
...The framework can be integrated into development pipelines to continuously test AI APIs and detect weaknesses before deployment. FuzzyAI provides testing tools, datasets, and evaluation workflows that help researchers measure how well models resist harmful instructions or attempts to bypass safety mechanisms. -
21
MiniMax Code
An open-source coding agent for your terminal, powered by MiniMax
MiniMax Code is an open-source terminal coding agent that can inspect projects, modify files, run commands, and verify changes without leaving the command line. It can authenticate with MiniMax accounts or connect to custom OpenAI- and Anthropic-compatible model providers. A terminal UI supports interactive coding sessions, while a headless mode enables scripted and automated workflows. Built-in capabilities include search, multimodal tools, MCP integrations, managed connectors, and... -
22
Kheish
Kheish: A multi-role LLM agent for tasks like code auditing
Kheish is a framework designed for cybersecurity professionals to automate penetration testing tasks, providing tools to streamline security assessments. -
23
AIBuildAI
An AI agent that automatically builds AI models
...It provides a structured environment for orchestrating agents that can plan, execute, and refine tasks such as code generation, system design, and iterative improvement loops. The framework is designed to support experimentation with self-improving AI pipelines, allowing developers to test concepts like automated architecture search or adaptive system evolution. It integrates multiple components including prompt management, execution control, and feedback loops to ensure that generated outputs can be evaluated and improved over time. -
24
LangWatch
The platform for LLM evaluations and AI agent testing
...The platform includes dashboards that visualize model behavior, enabling teams to monitor trends in response quality and reliability over time. It also provides evaluation tools that allow developers to test prompts and compare outputs across different models or configurations. Through integration with popular AI development frameworks, LangWatch can be embedded directly into AI pipelines to provide continuous monitoring and evaluation. -
25
Easy DataSet
A powerful tool for creating datasets for LLM fine-tuning
...The system includes automated question-generation capabilities, hierarchical label trees, and answer generation pipelines that use LLM APIs to produce coherent paired data with customizable templates. Beyond dataset creation, Easy-dataset also provides a built-in evaluation system with model testing and blind-test features, helping teams validate model performance using curated test sets.
