Search Results for "test cases"
Sort By:
13 projects for "test cases" with 2 filters applied:
-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
1
gpt-prompt-engineer
Experimental prompt optimization toolkit built around notebooks
gpt-prompt-engineer is an experimental prompt optimization toolkit built around notebooks and LLM-assisted evaluation. It lets users describe a task, provide test cases, and generate many candidate prompts automatically. The system then tests those prompts against the examples and ranks their performance through an ELO-style scoring process. The repository includes versions for general prompt generation, classification tasks, Claude-based workflows, and model-to-model prompt conversion. It is meant to make prompt engineering more systematic than manual trial and error. ... -
2
AICGSecEval
A.S.E (AICGSecEval) is a repository-level AI-generated code security
...The project was developed to address concerns that AI-assisted programming tools may produce insecure code containing vulnerabilities such as injection flaws or unsafe logic. The framework constructs evaluation tasks based on real-world software repositories and known vulnerability cases derived from CVE records. By simulating realistic development scenarios, the benchmark assesses how well AI code generation systems handle security-sensitive programming tasks. AICGSecEval combines static and dynamic evaluation techniques to analyze generated code for vulnerabilities and functional correctness. The framework includes datasets, test cases, and evaluation metrics that measure how AI programming tools perform across multiple programming languages and vulnerability categories. -
3
ASSERT
Requirement-driven evaluation harness for AI agents and LLM
...It turns natural-language specifications, policies, product requirements, and launch criteria into structured tests that can be reviewed, executed, scored, and improved. The pipeline derives behavior categories, generates single-turn and multi-turn test cases, runs them against a target system, and uses an LLM judge to score conversations against the stated policies. It can evaluate hosted models, custom agents, multi-agent systems, REST clients, and frameworks such as LangGraph, CrewAI, AutoGen, DSPy, LlamaIndex, and OpenAI Agents SDK. ASSERT is designed to close the gap between what a system is supposed to do and what evaluation actually measures. ... -
4
Micro Agent
AI CLI agent that writes code by iterating until tests pass
Micro Agent is a command-line tool designed to generate and refine code using a test-driven approach powered by large language models. Instead of producing one-shot code outputs, it creates or uses test cases and repeatedly iterates on the generated code until those tests pass successfully. This workflow emphasizes reliability by using structured feedback from failing tests to guide improvements, reducing the need for manual debugging and iteration. -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
5
Rogue
AI Agent Evaluator & Red Team Platform
Rogue is an open-source evaluation and red-team framework designed to test the reliability, safety, and policy compliance of AI agents. The platform automatically interacts with an AI agent by generating dynamic scenarios and multi-turn conversations that simulate real-world interactions. Instead of relying solely on static test scripts, Rogue uses an agent-as-a-judge architecture where one agent probes another agent to detect failures or unexpected behaviors. The system allows developers to... -
6
LabClaw
Operating Layer for LabOS (Stanford-Princeton AI Co-Scientists)
...LabClaw is designed to integrate with various large language models and external tools, enabling flexible configurations that adapt to different use cases such as automation, research, and product prototyping. It also includes logging and observability features that help developers track agent decisions and debug behavior during execution. -
7
FlowLens MCP
Open-source MCP server that gives your coding agent
FlowLens MCP Server is an open-source tool designed to give AI-powered coding agents (like Claude Code, Cursor, GitHub Copilot / Codex, and others) full, replayable browser context to dramatically improve debugging, bug reporting, and regression testing for web applications. It works together with a companion browser extension: when a user reproduces a bug or a complicated UI interaction, the extension captures a rich session log, including screen/video recording, network traffic, console... -
8
Microsoft Agent Skills
Skills, MCP servers, Custom Agents, Agents.md for SDKs
Microsoft Agent Skills is an actively maintained repository of skills, custom agents, templates, and MCP configuration files designed to extend AI coding assistants with deep knowledge about Azure SDKs and Microsoft AI Foundry services. The project bundles over a hundred domain-specific skills that teach AI agents how to perform tasks like Azure resource provisioning, SDK usage patterns, infrastructure setup, and common DevOps workflows, bridging the gap between agent reasoning and... -
9
OpenAI Quickstart Python
Python example app from the OpenAI API quickstart tutorial
...It provides practical, beginner-friendly examples to help developers quickly learn how to send requests, handle responses, and build basic applications using the OpenAI Python SDK. The examples folder includes small, self-contained projects showcasing common use cases like chat completions, tool usage, and interactive interfaces. Each example is designed to be easily runnable with minimal setup—requiring only Python, a virtual environment, and an API key. The repository also includes environment setup guides and example scripts, such as a simple Flask web app for chat interactions, allowing developers to test OpenAI API integrations locally. ... -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
10
MOEA Framework
A Free and Open Source Java Framework for Multiobjective Optimization
The MOEA Framework is a free and open source Java library for developing and experimenting with multiobjective evolutionary algorithms (MOEAs) and other general-purpose multiobjective optimization algorithms. The MOEA Framework supports genetic algorithms, differential evolution, particle swarm optimization, genetic programming, grammatical evolution, and more. A number of algorithms are provided out-of-the-box, including NSGA-II, NSGA-III, ε-MOEA, GDE3 and MOEA/D. In addition, the MOEA... -
11
TDD MAS Toolkit
A set of powerful tools to perform TDD on MAS based on JADE
The TDD MAS Toolkit provides a set of tools to perform Test Driven Development of MAS based on Jade. The toolkit allows developers to set up simulation based and test case scenario based testing, providing powerful insights of the MAS under construction and assuring that the interation protocols and agent interaction in general are been enacted as expected. -
12
The aim of the project is to provide a testing tool that would reduce the cost associated with the regression testing process. The tool provides test case subset selection so that the user need not run the redundant test cases.
-
13
OpenAI Realtime Console
React app for inspecting, building and debugging with the Realtime API
openai-realtime-console is a developer tool created by OpenAI that provides a web-based console for experimenting with the Realtime API. The Realtime API enables low-latency, interactive communication with language models, supporting use cases such as live conversations, real-time transcription, and interactive applications. This console serves as a reference implementation, showing how to establish WebRTC or WebSocket connections, send audio or text inputs, and receive model outputs in real time. It is built as a simple frontend that developers can run locally to test and understand how Realtime API interactions work. ...
- Previous
- You're on page 1
- Next
