Search Results for "benchmark"
Sort By:
Showing 922 open source projects for "benchmark"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Benchmark
A microbenchmark support library
A library to benchmark code snippets, similar to unit tests. -
2
go-web-framework-benchmark
Go web framework benchmark
go-web-framework-benchmark is a benchmark suite for comparing the performance of Go web frameworks. It was created to measure full HTTP request processing instead of only route matching speed. The project runs small real HTTP servers for many stable frameworks and tests a simple /hello endpoint. It can add configurable handler delay to simulate business work such as database calls, cache access, disk writes, socket activity, or microservice calls. -
3
Superposition Benchmark (Unigine)
GPU benchmark testing graphics performance with realistic 3D scenes.
Superposition Benchmark by Unigine is a powerful GPU stress-testing and benchmarking tool designed to evaluate graphics performance using the Unigine 2 Engine. It features advanced visuals, real-time lighting, and physics simulations to test DirectX and OpenGL performance. Superposition provides detailed results, including frame rates, GPU temperatures, and stability data. -
4
hyperfine
A command-line benchmarking tool
A command-line benchmarking tool. Statistical analysis across multiple runs. Support for arbitrary shell commands. Constant feedback about the benchmark progress and current estimates. Warmup runs can be executed before the actual benchmark. Cache-clearing commands can be set up before each timing run. Statistical outlier detection to detect interference from other programs and caching effects. Export results to various formats: CSV, JSON, Markdown, AsciiDoc. Parameterized benchmarks (e.g. vary the number of threads). ... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
Harvey LAB
A benchmark built to evaluate and improve agent capabilities
Harvey LAB is an open-source benchmark for evaluating how effectively AI agents perform realistic legal work. It combines a dataset of legal assignments with an execution harness that runs agents against those tasks. Each benchmark task includes instructions, working documents, and rubrics that define successful completion. The environment is designed to test practical legal workflows rather than isolated question-answering ability. -
6
BenchmarkTools.jl
A benchmarking framework for the Julia language
...Under the hood, BenchmarkTrackers relied on Benchmarks for actual benchmark execution. -
7
XMRig
RandomX, KawPow, CryptoNight, AstroBWT and GhostRider unified miner
High performance, open-source, cross-platform RandomX, KawPow, CryptoNight, and AstroBWT CPU/GPU miner, RandomX benchmark, and stratum proxy. XMRig is a high-performance, open-source, cross-platform RandomX, KawPow, CryptoNight, and AstroBWT unified CPU/GPU miner and RandomX benchmark. Official binaries are available for Windows, Linux, macOS, and FreeBSD. The preferred way to configure the miner is the JSON config file as it is more flexible and human-friendly. -
8
BEIR
A Heterogeneous Benchmark for Information Retrieval
BEIR is a benchmark framework for evaluating information retrieval models across various datasets and tasks, including document ranking and question answering. -
9
AgentBench
A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
AgentBench is an open-source benchmark designed to evaluate the capabilities of large language models when used as autonomous agents. Unlike traditional language model benchmarks that focus on static text tasks, AgentBench measures how models perform in interactive environments that require planning, reasoning, and decision-making. The benchmark includes multiple environments that simulate realistic scenarios such as web interaction, database querying, and problem solving tasks. ... -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
CrystalDiskMark
A simple disk benchmark software
A simple disk benchmark software. -
11
AICGSecEval
A.S.E (AICGSecEval) is a repository-level AI-generated code security
AICGSecEval is an open-source benchmark framework designed to evaluate the security of code generated by artificial intelligence systems. The project was developed to address concerns that AI-assisted programming tools may produce insecure code containing vulnerabilities such as injection flaws or unsafe logic. The framework constructs evaluation tasks based on real-world software repositories and known vulnerability cases derived from CVE records. -
12
GLM-4.6
Agentic, Reasoning, and Coding (ARC) foundation models
...Its reasoning capabilities have been strengthened, including improved tool usage during inference and more effective integration within agent frameworks. GLM-4.6 also enhances writing quality, producing outputs that better align with human preferences and role-playing scenarios. Benchmark evaluations demonstrate that it not only outperforms GLM-4.5 but also rivals leading global models such as DeepSeek-V3.1-Terminus and Claude Sonnet 4. -
13
kube-bench
Checks whether Kubernetes is deployed
kube-bench is a tool that checks whether Kubernetes is deployed securely by running the checks documented in the CIS Kubernetes Benchmark. Trivy, the all-in-one cloud-native security scanner, can be deployed as a Kubernetes Operator inside a cluster. Both, the Trivy CLI, and the Trivy Operator support CIS Kubernetes Benchmark scanning among several other features. There are multiple ways to run kube-bench. You can run kube-bench inside a pod, but it will need access to the host's PID namespace in order to check the running processes, as well as access to some directories on the host where config files and other files are stored. -
14
SmallCode
AI coding agent optimized for small LLMs. 87% benchmark
...Its workflow is built around terminal usage, which makes it suitable for developers who prefer command-line control and local project context. smallcode emphasizes efficient agent behavior, careful tool use, and benchmark-driven improvements for constrained models. Its main value is giving developers a compact coding-agent environment that treats small local models as first-class tools. -
15
LongBench
LongBench v2 and LongBench (ACL 25'&24')
...LongBench addresses this gap by providing datasets that require models to process and reason over long sequences of text across multiple tasks. The benchmark includes multiple categories such as single-document question answering, multi-document reasoning, summarization, long dialogue understanding, and code analysis. It supports bilingual evaluation in English and Chinese to assess multilingual capabilities across extended contexts. Newer versions of the benchmark introduce extremely long context windows ranging from thousands to millions of tokens, enabling researchers to test the limits of modern long-context models. -
16
HumanEval
Code for the paper "Evaluating Large Language Models Trained on Code"
...The benchmark has become a standard for evaluating code generation models, including those in the Codex and GPT families. Researchers can use the dataset to run reproducible comparisons across models and track improvements in functional code synthesis. By focusing on correctness through execution, human-eval provides a rigorous and practical way to evaluate programming capabilities in AI systems. -
17
MTEB
MTEB: Massive Text Embedding Benchmark
...This makes progress in the field difficult to track, as various models are constantly being proposed without proper evaluation. To solve this problem, we introduce the Massive Text Embedding Benchmark (MTEB). MTEB spans 8 embedding tasks covering a total of 58 datasets and 112 languages. Through the benchmarking of 33 models on MTEB, we establish the most comprehensive benchmark of text embeddings to date. We find that no particular text embedding method dominates across all tasks. This suggests that the field has yet to converge on a universal text embedding method and scale it up sufficiently to provide state-of-the-art results on all embedding tasks. -
18
JMH Gradle Plugin
Integrates the JMH benchmarking framework with Gradle
The JMH Gradle Plugin provides integration of the Java Microbenchmark Harness (JMH) into Gradle builds, enabling developers to write and run performance benchmarks directly in their projects. JMH is the de facto standard for writing accurate and reliable Java microbenchmarks, and this plugin automates tasks like generating benchmark sources, compiling them with the required JMH support classes, and packaging runnable benchmark jars. It simplifies the workflow by handling classpath setup and wiring Gradle tasks for running benchmarks. Developers can run benchmarks via Gradle commands, produce reports, and compare performance over time. This reduces the manual effort of setting up JMH, making performance testing a natural part of the development cycle. ... -
19
Crow Framework
A Fast and Easy to use microframework for the web
...Get started by installing Crow and building you first application. Or go through the guides if you're stuck somewhere. Easy Routing (similar to flask). Type-safe Handlers. Blazingly fast (see this benchmark and this benchmark). Built-in JSON support. Mustache-based templating library (crow::mustache). Header-only library (single header file available). Middleware support for extensions. HTTP/1.1 and Websocket support. Multi-part request and response support. Uses modern C++ (11/14). -
20
CrystalMark Retro
CrystalMark Retro is a comprehensive benchmarking software.
...It supports 32-bit (x86), 64-bit (x64/ARM64), many-core, and multilingual (48+ languages) systems, and can measure CPU, Disk, 2D graphics (GDI), and 3D graphics (OpenGL) performance with a single click. Benchmark results can be registered in CrystalMarkDB for centralized management of past results (account required: free of charge) and comparison with data registered by users around the world. -
21
Meta Agents Research Environments (ARE)
Meta Agents Research Environments is a comprehensive platform
...Unlike static benchmarks, ARE supports environments where agents must adapt to changes over time and reason over sequences of actions. It interacts with applications and faces uncertainty. The included Gaia2 benchmark offers 800 scenarios across multiple “universes”. It can test reasoning, memory, tool use, and adaptability. Integration with simulated applications/agent APIs (email, file system, etc.). Support for multiple AI model backends/providers. -
22
T3MP3ST
Autonomous red teaming platform
...The project can work through a browser War Room or CLI while relying on agents such as Claude Code, Codex, Hermes, or locally hosted models. It emphasizes reproducible benchmark claims, keyless operation, and a clear status table that separates stable capabilities from experimental or roadmap work. Its stated target areas include web apps, CTF challenges, source-code review, OSS vulnerability hunting, smart contracts, and embedded or robotics research. Because it automates offensive workflows, it must only be used on systems where the user has explicit written permission. -
23
SDGym
Benchmarking synthetic data generation methods
The Synthetic Data Gym (SDGym) is a benchmarking framework for modeling and generating synthetic data. Measure performance and memory usage across different synthetic data modeling techniques – classical statistics, deep learning and more! The SDGym library integrates with the Synthetic Data Vault ecosystem. You can use any of its synthesizers, datasets or metrics for benchmarking. You also customize the process to include your own work. Select any of the publicly available datasets from the... -
24
-
25
Likwid
Performance monitoring and benchmarking suite
Likwid is a simple to install and use toolsuite of command line applications and a library for performance oriented programmers. It works for Intel, AMD, ARMv8 and POWER9 processors on the Linux operating system. There is additional support for Nvidia and AMD GPUs. There is support for ARMv7 and POWER8/9 but there is currently no test machine in our hands to test them properly.