Search Results for "benchmark testing" - Page 2
Sort By:
Showing 105 open source projects for "benchmark testing"
View related business solutions-
AI-powered service management for IT and enterprise teamsGive your IT, operations, and business teams the ability to deliver exceptional services—without the complexity. Maximize operational efficiency with refreshingly simple, AI-powered Freshservice.
-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
1
The DaCapo Benchmark Suite
Benchmarking tool
This benchmark suite is intend as a tool for the research community. It consists of a set of open source, real world applications with non-trivial memory loads. -
2
OpenDDS
OpenDDS is open source publish/subscribe middleware
OpenDDS is an open source implementation of the Object Management Group (OMG) Data Distribution Service (DDS), providing a publish/subscribe middleware solution for real-time distributed systems. OpenDDS includes development and run-time tools. Full product information, source code, documentation, build instructions, and license information are available from http://www.opendds.org. Commercial consulting, support, and training for OpenDDS are available. OpenDDS is in production use... -
3
FuzzBench
FuzzBench - Fuzzer benchmarking as a service
FuzzBench is a large-scale, open research platform developed by Google to evaluate and benchmark fuzzers — automated software testing tools that detect vulnerabilities through randomized input generation. It provides a standardized, reproducible environment for comparing the performance and effectiveness of different fuzzing algorithms on real-world software targets. FuzzBench integrates with the OSS-Fuzz infrastructure, allowing it to run experiments on authentic open source projects and collect meaningful data on crash discovery rates, code coverage, and bug-finding efficiency. ... -
4
collectl
This is now also available here github.com/sharkcz/collectl.git
Collectl is a light-weight performance monitoring tool capable of reporting interactively as well as logging to disk. It reports statistics on cpu, disk, infiniband, lustre, memory, network, nfs, process, quadrics, slabs and more in easy to read format. -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
Phoronix Test Suite
Open-Source, Automated Benchmarking
The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added. The Phoronix Test Suite is designed to effectively carry out both benchmarks in a clean, reproducible, and easy-to-use manner. -
6
UVU
UVU is an extremely fast and lightweight test runner for Node.js
UVU is a lightweight, ultra-fast JavaScript test runner for Node.js and the browser created by Luke Edwards (lukeed). Its primary goal is to minimize overhead: startup time, memory usage, and complexity are all kept very low so that developers can write and run tests with minimal friction. The tool supports modern features like async/await and native ES Modules, making it suitable for modern codebases. It also supports running in browser environments, which makes it versatile for frontend... -
7
Fashion-MNIST
A MNIST-like fashion product database
...The dataset consists of 70,000 images in total, with 60,000 examples used for training and 10,000 reserved for testing. Each image has a resolution of 28 by 28 pixels and belongs to one of ten clothing classes, making it suitable for evaluating classification models. Because the dataset represents real-world objects rather than handwritten digits, it offers a more challenging benchmark for testing machine learning algorithms. -
8
Procgen
Procedurally-Generated Game-Like Gym-Environments
...The environments are designed to run very quickly (thousands of steps per second on a single core) to facilitate large-scale experiments and make benchmarking efficient. The benchmark supports both “easy” and “hard” difficulty modes, letting researchers trade off computational cost vs challenge. The repo provides a C++ core for game logic and rendering (with support for gym/Gym3 wrappers) plus Python bindings and interactive mode for human play testing. -
9
Grade School Math
8.5K high quality grade school math problems
The grade-school-math repository (sometimes called GSM8K) is a curated dataset of 8,500 high-quality grade school math word problems intended for evaluating mathematical reasoning capabilities of language models. It is structured into 7,500 training problems and 1,000 test problems. These aren’t trivial exercises — many require multi-step reasoning, combining arithmetic operations, and handling intermediate steps (e.g. “If she sold half as many in May… how many in total?”). The problems are... -
Secure File Transfer for Windows with Cerberus by RedwoodCerberus supports unlimited users and connections on a single IP, with built-in encryption, 2FA, and a browser-based web client — all deployable in under 15 minutes with a 25-day free trial.
-
10
CRSLab
CRSLab is an open-source toolkit
CRSLab is an open-source toolkit for building Conversational Recommender System (CRS). It is developed based on Python and PyTorch. CRSLab has the following highlights. Comprehensive benchmark models and datasets: We have integrated commonly-used 6 datasets and 18 models, including graph neural network and pre-training models such as R-GCN, BERT and GPT-2. We have preprocessed these datasets to support these models, and release for downloading. Extensive and standard evaluation protocols: We support a series of widely-adopted evaluation protocols for testing and comparing different CRS. ... -
11
wrk
Modern HTTP benchmarking tool
wrk is a modern, command-line HTTP benchmarking tool engineered for high performance, capable of generating substantial load using a single multi-core CPU by leveraging multithreading and scalable event notification systems. An optional LuaJIT script can perform HTTP request generation, response processing, and custom reporting. Details are available in SCRIPTING and several examples are located in scripts. The machine running wrk must have a sufficient number of ephemeral ports available... -
12
netstress is a client/server utility designed to stress & benchmark network activity of a given ethernet device or path using simulated (random) real world data and packet sizes instead of fixed data and packet sizes.
-
13
qpxtool
Utility for testing CD/DVD quality and burning rate
Utility for testing CD/DVD quality and transfer rate written on C++ and Qt -
14
sysbench
Scriptable database and system performance benchmark
sysbench is a scriptable multi-threaded benchmark tool based on LuaJIT. It is most frequently used for database benchmarks, but can also be used to create arbitrarily complex workloads that do not involve a database server. extensive statistics about rate and latency is available, including latency percentiles and histograms. Low overhead even with thousands of concurrent threads. sysbench is capable of generating and tracking hundreds of millions of events per second. New benchmarks can be... -
15
UNMAINTAINED: Try https://github.com/pjoe/loadem instead This project aims to provide a tool for load testing web applications. The goal is a tool that is easy to use and provides near real-time performance measurements of the application under test which is very usefull during optimization.
-
16
Tiny
Tiny Face Detector, CVPR 2017
...The method is designed to detect tiny faces (i.e. very small-scale faces) by combining multi-scale context modeling, foveal descriptors, and scale enumeration strategies. It provides training/testing scripts, a demo (tiny_face_detector.m), model loading, evaluation on WIDER FACE, and supporting utilities (e.g. cnn_widerface_eval.m). The code depends on MatConvNet, which must be compiled (with GPU / CUDA / cuDNN support) for full performance. Pretrained model provided (ResNet101-based, plus alternatives). Demo and evaluation scripts for benchmark datasets. ... -
17
Yandex Tank
Load and performance benchmark tool
Yandex.Tank is an extensible open-source load testing tool for advanced Linux users which is especially good as a part of an automated load testing suite. Different load generators are supported. Evgeniy Mamchits' phantom is a very fast (100 000+ RPS) shooter written in C++ (default) JMeter is an extendable and widely known one. BFG is a Python-based generator that allows you to write your load scenarios in Python. Experimental Golang generator: pandora. Performance analytics backend... -
18
I3D models trained on Kinetics
Convolutional neural network model for video classification
Kinetics-I3D, developed by Google DeepMind, provides trained models and implementation code for the Inflated 3D ConvNet (I3D) architecture introduced in the paper “Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset” (CVPR 2017). The I3D model extends the 2D convolutional structure of Inception-v1 into 3D, allowing it to capture spatial and temporal information from videos for action recognition. This repository includes pretrained I3D models on the Kinetics dataset, with... -
19
benchm-ml
A benchmark of commonly used open source implementations
This repository is designed to provide a minimal benchmark framework comparing commonly used machine learning libraries in terms of scalability, speed, and classification accuracy. The focus is on binary classification tasks without missing data, where inputs can be numeric or categorical (after one-hot encoding). It targets large scale settings by varying the number of observations (n) up to millions and the number of features (after expansion) to about a thousand, to stress test different... -
20
RefineNet
RefineNet: Multi-Path Refinement Networks
...It implements the architecture presented in the CVPR 2017 paper RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation and its extended version published in TPAMI 2019. The framework uses multi-path refinement and improved residual pooling to achieve high-quality segmentation results across multiple benchmark datasets. It provides trained models for datasets such as PASCAL VOC 2012, Cityscapes, NYUDv2, Person_Parts, PASCAL_Context, SUNRGBD, and ADE20k, with versions based on ResNet-101 and ResNet-152 backbones. The repository supports both single-scale and multi-scale prediction, with scripts for training, testing, and evaluating segmentation performance. ... -
21
test-tlb
Stupid memory latency and TLB tester
test-tlb is a tiny C microbenchmark that explores the performance characteristics of memory access patterns with respect to the CPU’s Translation Lookaside Buffer (TLB) and caches. It walks arrays using different strides and working-set sizes so you can observe when access patterns overflow cache or TLB capacity. By timing tight loops and varying parameters, the program reveals step-changes in latency that map to cache lines, page sizes, and TLB coverage. It is intentionally minimal so you... -
22
SPARQL Query Benchmarker
A simple tool for testing SPARQL system performance and reliability
SPARQL Query Benchmarker is a simple to use tool (and API) for running any benchmark/testing you want to create against any HTTP accessible SPARQL system. -
23
OpenGLChecker
Utility application to obtain data about your OpenGL implementation.
OpenGLChecker is a fast and smooth program that retrieves relevant information about your OpenGL implementation. It can also test your computer's performance with fully scripted benchmarks. This allows you to write your own benchmark scripts for testing your OpenGL performance. -
24
The project is moved to GitHub: https://github.com/STSSoft/DatabaseBenchmark. We will continue to upload the source and binaries here, but the code repository will be innactive. Database Benchmark is one of the most powerfull open source tools designed to stress test database management systems with large data flows. The application performs two main test scenarios: - Insertion of large amount of randomly generated records with sequential or random keys; - Read of the inserted...
-
25
miRLAB
miRLAB: an R package for exploring miRNA-mRNA regulatory relationships
miRLAB is an R package for automating the procedure of inferring and validating miRNA-mRNA regulatory relationships. The package provides a complete set of pipelines for testing new methods and analysing new expression datasets. miRLAB includes a pipeline to obtain matched miRNA and mRNA expression datasets directly from The Cancer Genome Atlas (TCGA, based on TCGA Assembler), the benchmark computational methods for inferring miRNA-mRNA regulatory relationships, the functions for validating the predictions using miRNA experimentally validated target data and miRNA transfection data, and tools to compare the results from different computational methods.
