Search Results for "source testing unit testing" - Page 3
Sort By:
Showing 142 open source projects for "source testing unit testing"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
TextAttack
Python framework for adversarial attacks, and data augmentation
Generating adversarial examples for NLP models. TextAttack is a Python framework for adversarial attacks, data augmentation, and model training in NLP. -
2
ChatDev
Create Customized Software using Natural Language Idea
ChatDev is an AI-powered development tool designed to simulate the software development lifecycle using multi-agent collaboration. It allows multiple AI agents to take on roles such as product managers, developers, and testers to collaboratively generate, refine, and evaluate software code. This project explores how AI can be leveraged to automate and optimize development workflows. -
3
npcpy
The AI toolkit for the AI developer
npcpy is a Python-based agent framework and command-line toolkit (the NPC Shell) for developers to build, test, and integrate AI agents into their workflows, including both command-line and GUI interfaces via NPC Studio. Welcome to npcpy, the core library of the NPC Toolkit that supercharges natural language processing pipelines and agent tooling. npcpy is a flexible framework for building state-of-the-art applications and conducting novel research with LLMs. The structure of npcpy also... -
4
DoWhy
DoWhy is a Python library for causal inference
DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks. Much like machine learning libraries have done for prediction, DoWhy is a Python library that aims to spark causal thinking and analysis. DoWhy provides a wide variety of algorithms for effect estimation, causal structure learning, diagnosis of causal... -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
Loki Mode
Multi-agent autonomous startup system for Claude Code
Loki Mode is a multi-agent autonomous execution system designed to take structured product requirements or specifications and autonomously drive the creation, testing, deployment, and scaling of complex software projects using a large team of specialized AI agents. It orchestrates dozens of agent types across swarms that handle designated roles — such as architecture, coding, QA, deployment, and business workflows — running in parallel to cover both engineering and operational tasks without... -
6
Hephaestus
Semi-Structured Agentic Framework. Workflows build themselves
Hephaestus is an open-source semi-structured agentic framework designed to orchestrate multiple AI agents working together on complex tasks. Instead of relying entirely on predefined workflows, the framework allows agents to dynamically create tasks as they explore a problem space. Developers define high-level phases such as analysis, implementation, and testing, while agents generate specific subtasks within those phases. -
7
AI-DLC
AI-Driven Life Cycle (AI-DLC) adaptive workflow steering rules for AI
AI-DLC is an open-source workflow framework from AWS Labs designed to structure software development around AI-assisted engineering processes. The project promotes an “AI-Driven Life Cycle” methodology where coding assistants, IDE agents, and automation systems participate directly in planning, implementation, testing, and operational workflows. Rather than focusing on a single model or IDE, the framework provides reusable rules, templates, and orchestration patterns compatible with tools such as Amazon Q Developer, Claude Code, Cursor, GitHub Copilot, and Cline. ... -
8
Claude Ads
Comprehensive paid advertising audit & optimization skill
Claude Ads is an AI-powered auditing and optimization tool designed to analyze paid advertising campaigns across multiple platforms using Claude Code. It processes user-provided data such as exports or screenshots and evaluates campaigns using hundreds of predefined checks. The system generates structured reports, identifies inefficiencies, and suggests optimization strategies based on industry benchmarks. It supports platforms like Google Ads, Meta Ads, TikTok, LinkedIn, and more, offering... -
9
Simple Evals
Lightweight framework for evaluating large language model performance
simple-evals is a lightweight evaluation framework developed by OpenAI for quickly testing models against small, focused benchmarks. It is designed to help researchers and developers run targeted evaluations without the complexity of large-scale pipelines. By emphasizing simplicity, the framework makes it easy to define new tasks, run evaluations, and interpret results in a reproducible way. It is particularly useful for sanity checks, exploratory research, and comparing performance across... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
Agent Behavior Monitoring
The open source post-building layer for agents
Agent Behavior Monitoring is an open-source framework designed to monitor, evaluate, and improve the behavior of AI agents operating in real or simulated environments. The system focuses on agent behavior monitoring by collecting interaction data and analyzing how agents perform across different scenarios and tasks. Developers can use the framework to observe agent actions in both online production environments and offline evaluation settings, making it useful for debugging and performance... -
11
Prometheus-Eval
Evaluate your LLM's response with Prometheus and GPT4
Prometheus-Eval is an open-source framework designed to evaluate the outputs of large language models using specialized evaluator models known as Prometheus. The project provides tools, datasets, and scripts that allow developers and researchers to measure the quality of LLM responses through automated scoring rather than relying solely on human evaluators. It implements an “LLM-as-a-judge” approach in which a dedicated language model analyzes instruction–response pairs and assigns scores or... -
12
RamaLama
Simplifies the local serving of AI models from any source
...Developers can use familiar container commands to pull, run, and interact with AI models from any source, treating models similarly to how container images are handled in OCI workflows. RamaLama supports multiple model registries and offers a REST API or chatbot interface for interacting with running models, making it flexible for local development, testing, or integration into larger systems. -
13
ToolUniverse
Democratizing AI scientists with ToolUniverse
...Instead of requiring custom pipelines or fine-tuning, ToolUniverse wraps around existing models and enables them to reason, experiment, and iterate on complex workflows such as drug discovery, data analysis, and hypothesis testing. The platform abstracts tool usage behind a consistent interface, allowing AI agents to compose multi-step workflows, refine tool definitions automatically, and even generate new tools from natural language descriptions. -
14
Get Physics Done (GPD)
The first open-source agentic AI physicist
Get Physics Done (GPD) is an open-source project designed to accelerate scientific research in physics by leveraging modern computational tools and automation techniques. It aims to simplify the process of performing simulations, calculations, and experimental analysis by providing structured workflows that integrate computational physics methods with reproducible research practices. The project focuses on reducing the friction involved in setting up experiments, running simulations, and... -
15
WeClone
One-stop solution for creating your digital avatar from chat history
...By processing large volumes of conversation data, WeClone can build a profile of an individual’s writing tone, vocabulary preferences, and conversational tendencies. Developers can use the resulting model to create chatbots that simulate a specific user’s communication patterns for testing or research purposes. Overall, WeClone explores the idea of digital identity replication through machine learning and conversational modeling. -
16
Nerfstudio
A collaboration friendly studio for NeRFs
Nerfstudio provides a simple API that allows for a simplified end-to-end process of creating, training, and testing NeRFs. The library supports a more interpretable implementation of NeRFs by modularizing each component. With more modular NeRFs, we hope to create a more user-friendly experience in exploring the technology. This is a contributor-friendly repo with the goal of building a community where users can more easily build upon each other’s contributions. Nerfstudio initially launched... -
17
PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model
PaddleSpeech is an open-source toolkit on PaddlePaddle platform for a variety of critical tasks in speech and audio, with state-of-art and influential models. Via the easy-to-use, efficient, flexible and scalable implementation, our vision is to empower both industrial application and academic research, including training, inference & testing modules, and deployment process. -
18
RecBole
A unified, comprehensive and efficient recommendation library
...We implement more than 100 commonly used recommendation algorithms and provide formatted copies of 28 recommendation datasets. We support a series of widely adopted evaluation protocols or settings for testing and comparing recommendation algorithms. RecBole is developed based on Python and PyTorch for reproducing and developing recommendation algorithms in a unified, comprehensive and efficient framework for research purpose. It can be installed from pip, conda and source, and is easy to use. We have implemented more than 100 recommender system models, covering four common recommender system categories in RecBole and eight toolkits of RecBole2.0, including General Recommendation, Sequential Recommendation, Context-aware Recommendation, and Knowledge-based Recommendation and sub-packages. -
19
ARC-AGI-1 Task Generator
Generates original ARC-AGI-1-style tasks distribution-matched
ARC-AGI-1 Task Generator creates new ARC-style reasoning tasks whose distribution is designed to resemble the public ARC-AGI-1 evaluation set. It provides fresh problems that models are less likely to have encountered during training or previous evaluation. The project is intended to complement public benchmark scores by testing whether reasoning abilities transfer to newly generated examples. Generated tasks use the standard ARC train-and-test JSON structure. This makes the output... -
20
ASSERT
Requirement-driven evaluation harness for AI agents and LLM
ASSERT is a requirement-driven evaluation harness for AI agents and LLM applications. It turns natural-language specifications, policies, product requirements, and launch criteria into structured tests that can be reviewed, executed, scored, and improved. The pipeline derives behavior categories, generates single-turn and multi-turn test cases, runs them against a target system, and uses an LLM judge to score conversations against the stated policies. It can evaluate hosted models, custom... -
21
SERA CLI
A tool to use the Ai2 Open Coding Agents Soft-Verified Agents
SERA CLI is a command-line tool created by AllenAI to enable developers to interact with the SERA (Soft-Verified Efficient Repository Agents) model family using Claude Code as the execution front end. It provides a convenient interface for deploying, testing, and using SERA models without needing to write scaffold code from scratch, acting as both a proxy and utility wrapper to simplify workflows that involve large agent models. Through sera-cli, users can connect to local or cloud-hosted... -
22
Sapiens
High-resolution models for human tasks
Sapiens is a research framework from Meta AI focused on embodied intelligence and human-like multimodal learning, aiming to train agents that can perceive, reason, and act in complex environments. It integrates sensory inputs such as vision, audio, and proprioception into a unified learning architecture that allows agents to understand and adapt to their surroundings dynamically. The project emphasizes long-horizon reasoning and cross-modal grounding—connecting language, perception, and... -
23
Mosec
A high-performance ML model serving framework, offers dynamic batching
Mosec is a high-performance and flexible model-serving framework for building ML model-enabled backend and microservices. It bridges the gap between any machine learning models you just trained and the efficient online service API. -
24
Cangjie Skill
Distill high-value content like books, long videos, podcasts, and more
cangjie-skill is a workflow for converting books and other long-form knowledge into executable AI skill packs. Its goal is structured reuse rather than producing another summary or set of reading notes. The seven-stage RIA-TV++ pipeline analyzes the full source, extracts candidate frameworks, verifies them, constructs skill modules, links related ideas, pressure-tests behavior, and prepares delivery files. Each accepted skill records supporting material, a reconstructed explanation,... -
25
OpenFold
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
OpenFold carefully reproduces (almost) all of the features of the original open source inference code (v2.0.1). The sole exception is model ensembling, which fared poorly in DeepMind's own ablation testing and is being phased out in future DeepMind experiments. It is omitted here for the sake of reducing clutter. In cases where the Nature paper differs from the source, we always defer to the latter. OpenFold is trainable in full precision, half precision, or bfloat16 with or without DeepSpeed, and we've trained it from scratch, matching the performance of the original. ...
