Search Results for "benchmarking tool"
Sort By:
Showing 15 open source projects for "benchmarking tool"
View related business solutions-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Matrix
Multi-Agent daTa geneRation Infra and eXperimentation framework
...The idea is to treat data generation as a “data-to-data” transformation: each input item defines a task, and the runtime orchestrates asynchronous, peer-to-peer agent workflows, avoiding global synchronization bottlenecks. That design makes Matrix particularly well-suited for large-batch inference, model benchmarking, data curation, augmentation, or generation — whether for language, code, dialogue, or multimodal tasks. It supports both open-source LLMs and proprietary models (via integration with model backends), and works with containerized or sandboxed environments for safe tool execution or external code runs. -
2
FFmpeg Quality Metrics
Calculate quality metrics with FFmpeg (SSIM, PSNR, VMAF, VIF)
FFmpeg Quality Metrics is a Python-based tool that evaluates video quality by calculating objective metrics using FFmpeg. It supports widely used metrics such as PSNR, SSIM, VIF, MSAD, and VMAF, enabling detailed comparison between reference and distorted video files. The tool outputs both per-frame data and aggregated statistics like averages and standard deviation, making it useful for research, encoding optimization, and benchmarking. -
3
Claude Ads
Comprehensive paid advertising audit & optimization skill
Claude Ads is an AI-powered auditing and optimization tool designed to analyze paid advertising campaigns across multiple platforms using Claude Code. It processes user-provided data such as exports or screenshots and evaluates campaigns using hundreds of predefined checks. The system generates structured reports, identifies inefficiencies, and suggests optimization strategies based on industry benchmarks. It supports platforms like Google Ads, Meta Ads, TikTok, LinkedIn, and more, offering... -
4
Meta Agents Research Environments (ARE)
Meta Agents Research Environments is a comprehensive platform
...It can test reasoning, memory, tool use, and adaptability. Integration with simulated applications/agent APIs (email, file system, etc.). Support for multiple AI model backends/providers. -
Paessler: Easy to Use With Enterprise Power. Free TrialYou shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
-
5
Perf Book
The book "Performance Analysis and Tuning on Modern CPU"
This project is a practical guide to performance analysis and tuning on modern CPUs, bridging microarchitecture details with hands-on profiling. It explains how caches, TLBs, prefetchers, branch predictors, and out-of-order execution influence real program speed, then connects those concepts to concrete optimization strategies. Readers learn how to design trustworthy benchmarks, avoid measurement traps (warmup, turbo, frequency scaling), and interpret hardware performance counters. The book... -
6
Nerve
The Simple Agent Development Kit
Nerve is a developer-friendly Agent Development Kit (ADK) that utilizes YAML and a CLI to define, run, orchestrate, and evaluate LLM-driven agents. It supports declarative setups, tool integration, workflow pipelines, and both MCP client and server roles. Nerve is a simple yet powerful Agent Development Kit (ADK) to build, run, evaluate, and orchestrate LLM-based agents using just YAML and a CLI. It’s designed for technical users who want programmable, auditable, and reproducible automation... -
7
Youtu-Agent
A simple yet powerful agent framework that delivers with models
Youtu-Agent is an open-source framework developed to simplify the creation, execution, and evaluation of autonomous AI agents. The system focuses on reducing the complexity traditionally involved in configuring large language model agents by providing a modular architecture that separates execution environments, tools, and context management. This structure allows developers to rapidly assemble agent systems capable of performing tasks such as research, file processing, and data analysis.... -
8
DevOps Exercises
Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git
DevOps Exercises is a massive, community-maintained collection of questions, tasks, and mini-challenges that cover the breadth of modern DevOps and platform engineering. It spans Linux, networking, Docker, Kubernetes, CI/CD, monitoring, cloud providers, security, and even soft skills and troubleshooting. The idea is to give candidates and teams a realistic practice ground for interviews, certifications, and day-to-day operational work. Because it’s structured as Q&A and exercises, you can go... -
9
deepclaude
Use Claude Code's agent loop with DeepSeek V4 Pro, OpenRouter & more
deepclaude is a lightweight proxy tool that enables developers to run Claude Code’s autonomous coding agent loop using alternative AI backends like DeepSeek V4 Pro, OpenRouter, or other Anthropic-compatible models. It preserves the full Claude Code experience—including file editing, terminal execution, and multi-step agent workflows—while dramatically reducing operational costs. -
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
10
Crunch PNG
Insane(ly slow but wicked good) PNG image optimization
...Continuous benchmark testing is available in our GitHub Actions CI. Please see the benchmarks directory of this repository for details about the benchmarking approach and instructions on how to execute benchmarks locally on the reference images distributed in this repository or with your own image files. -
11
Pytorch Points 3D
Pytorch framework for doing deep learning on point clouds
...The framework currently integrates some of the best-published architectures and it integrates the most common public datasets for ease of reproducibility. It heavily relies on Pytorch Geometric and Facebook Hydra library thanks for the great work! We aim to build a tool that can be used for benchmarking SOTA models, while also allowing practitioners to efficiently pursue research into point cloud analysis, with the end goal of building models which can be applied to real-life applications. Task driven implementation with dynamic model and dataset resolution from arguments. Core implementation of common components for point cloud deep learning - greatly simplifying the creation of new models. 4 Base Convolution base classes to simplify the implementation of new convolutions. ... -
12
PerfKit Benchmarker
PerfKit Benchmarker (PKB) contains a set of benchmarks
PerfKitBenchmarker is an open-source benchmarking framework designed to measure and compare the performance of cloud infrastructure across multiple providers in a consistent and reproducible way. It allows users to evaluate metrics such as latency, throughput, provisioning time, and system performance using a standardized set of benchmarks. The tool supports a wide range of environments, including major cloud platforms, Kubernetes clusters, and even local hardware, making it highly versatile for performance analysis. ... -
13
cnn-benchmarks
Benchmarks for popular CNN models
...By simplifying performance evaluation, it helps developers make informed decisions about model design and hardware selection. Overall, cnn-benchmarks is a practical tool for performance analysis in deep learning workflows. -
14
This is a software tool that automates the process of benchmarking high performance computer clusters by auto analyzing the hardware of the cluster and configuring and compiling specialized benchmarks (HPC Challenge, IOzone, Netperf)
-
15
ClusterScores is a cluster benchmarking tool which automate compile, benchmark, and report benchmarking on cluster. This tool integrates other standard cluster benchmark tools such as HPL, Stream, Netpipe, Iperf, Bonnie, IOZone, etc...
- Previous
- You're on page 1
- Next
