Search Results for "design experiments"
Sort By:
Showing 37 open source projects for "design experiments"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
1
AI Infra
Understanding of AI Infra: Quantitative Analysis and System Design
...It approaches inference and training through quantitative analysis of hardware limits, data movement, model architecture, and distributed systems. The book contains twelve chapters supported by formulas, diagrams, experiments, and case studies. Companion tools help readers reproduce resource calculations and inspect the assumptions behind system-design decisions. Additional material covers accelerators, networking, KV caches, inference serving, training systems, mixture-of-experts models, and performance engineering. The source is written in Markdown and automatically built into a XeLaTeX PDF and a searchable website. ... -
2
Deep Learning Models
A collection of various deep learning architectures, models, and tips
...Examples span fundamental architectures—MLPs, CNNs, RNN/Transformers—and practical tasks like image classification or text modeling. Reproducible training scripts and configuration files make it straightforward to rerun experiments or adapt them to your own datasets. The repo often pairs implementations with notes on design choices and trade-offs, turning it into both a toolbox and a learning resource. It’s suitable for students, researchers prototyping ideas, and practitioners who want clean baselines before adding complexity. -
3
SLM Lab
Modular Deep Reinforcement Learning framework in PyTorch
SLM Lab is a modular and extensible deep reinforcement learning framework designed for research and practical applications. It provides implementations of various state-of-the-art RL algorithms and emphasizes reproducibility, scalability, and detailed experiment tracking. SLM Lab is structured around a flexible experiment management system, allowing users to define, run, and analyze RL experiments efficiently. -
4
TorchDistill
A coding-free framework built on PyTorch
torchdistill (formerly kdkit) offers various state-of-the-art knowledge distillation methods and enables you to design (new) experiments simply by editing a declarative yaml config file instead of Python code. Even when you need to extract intermediate representations in teacher/student models, you will NOT need to reimplement the models, which often change the interface of the forward, but instead specify the module path(s) in the yaml file. In addition to knowledge distillation, this framework helps you design and perform general deep learning experiments (WITHOUT coding) for reproducible deep learning studies. i.e., it enables you to train models without teachers simply by excluding teacher entries from a declarative yaml config file. -
Paessler: Easy to Use With Enterprise Power. Free TrialYou shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
-
5
TNT
A lightweight library for PyTorch training tools and utilities
...The project focuses on providing a flexible yet structured environment for implementing training pipelines without the complexity of large deep learning frameworks. It introduces modular abstractions that allow developers to organize training logic into reusable components such as trainers, evaluators, and callbacks. This design helps separate concerns such as model training, evaluation, logging, and checkpointing, making machine learning experiments easier to manage. The framework is particularly useful for large-scale experiments where maintaining clear training workflows becomes increasingly important. Because it is built on top of PyTorch, the framework integrates naturally with existing deep learning models and datasets. -
6
AI Agent Book
Deep Understanding AI Agents
...The repository includes 88 companion experiments, with more than 70 designed to run independently. Readers can access the source chapters, generated figures, code, and downloadable PDF or EPUB editions. Community translations provide versions in several languages alongside the original Chinese text. -
7
SwanLab
An open-source, modern-design AI training tracking and visualization
SwanLab is an open-source experiment tracking and visualization platform designed to help machine learning engineers monitor, compare, and analyze the training of artificial intelligence models. The tool records training metrics, hyperparameters, model outputs, and experiment configurations so that developers can easily understand how different experiments perform over time. It provides a modern user interface for visualizing results, enabling teams to compare runs, track model performance... -
8
MLE-bench
AI multi-agent framework for automating data-driven R&D workflows
...It separates the process into two core phases: a research stage that proposes hypotheses and ideas, and a development stage that implements and evaluates them through code execution and experiments. By iterating through these stages, the framework continuously refines models and strategies using feedback from previous results. RD-Agent focuses heavily on automating complex tasks such as feature engineering, model design, and experimentation, which are traditionally time-consuming in machine learning and quantitative research workflows. ... -
9
NVIDIA NeMo Framework
Scalable generative AI framework built for researchers and developers
NVIDIA NeMo is a scalable, cloud-native generative AI framework aimed at researchers and PyTorch developers working on large language models, multimodal models, and speech AI (ASR and TTS), with growing support for computer vision. It provides collections of domain-specific modules and reference implementations that make it easier to pre-train, fine-tune, and deploy very large models on multi-GPU and multi-node infrastructure. NeMo 2.0 introduces a Python-based configuration system,... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
Nano-Banana Creation ZHO
My collection of creative ways to play nano-banana
...Ideas include turning images into figures, toys, illustrations, realistic photographs, architectural models, product renders, and advertisements. The collection also explores continuous editing, character consistency, material transfer, lighting references, virtual makeup, industrial design, and image restoration. Many examples demonstrate how reference images can control people, poses, expressions, products, environments, or styles. The repository also connects these experiments to open-source interfaces for window-based, canvas-based, and workflow-based creation. -
11
esp32-ai
Running a 28.9M parameter LLM on an $8 microcontroller
...The repository includes firmware, wiring and flashing instructions, training code, quantization experiments, ablations, and measured results. -
12
mlr3
mlr3: Machine Learning in R - next generation
mlr3 is a modern, object-oriented R framework for machine learning. It provides core abstractions (tasks, learners, resamplings, measures, pipelines) implemented using R6 classes, enabling extensible, composable machine learning workflows. It focuses on clean design, scalability (large datasets), and integration into the wider R ecosystem via extension packages. Users can do classification, regression, survival analysis, clustering, hyperparameter tuning, benchmarking etc., often via... -
13
RL with PyTorch
Clean, Robust, and Unified PyTorch implementation
RL with PyTorch is a research-oriented repository that provides implementations of deep reinforcement learning algorithms using the PyTorch framework. The project focuses on helping developers and researchers understand reinforcement learning methods by providing clean and reproducible implementations of well-known algorithms. It includes code for popular deep reinforcement learning techniques such as Deep Q-Networks, policy gradient methods, actor-critic architectures, and other modern RL... -
14
BigMac
An open-source toolkit for BigMac-style pipeline-parallel training
...The simulator lets researchers visualize schedules, compare pipeline strategies, and model timing imbalances caused by compute cost, input size, or uneven stage partitioning. Profiling tools also expose per-operator traces for diagnosing pipeline performance before or during experiments. -
15
MSA: Memory Sparse Attention
Trainable latent-memory framework for 100M-token contexts
...It replaces full attention over all tokens with sparse selection of compressed latent memory states. Document-wise rotary position encoding and top-k routing keep training and inference close to linear complexity. A tiered KV-cache design stores routing keys on GPU while larger content states can remain on CPU. Its Memory Parallel engine distributes scoring and transfers only selected memory back to the accelerator. Memory Interleave alternates retrieval, context expansion, and generation to improve multi-hop reasoning across distant segments. The project reports experiments extending from 16K to 100M tokens, including inference on two A800 GPUs. -
16
HRM-Text
1B text generation model based on the HRM architecture
...It is useful for researchers and engineers exploring efficient language model pretraining, reasoning-focused architectures, and reproducible foundation model experiments. -
17
AI-Researcher
AI-Researcher: Autonomous Scientific Innovation
...It lets users input high-level research goals or questions in natural language and then automatically plans, decomposes, and executes tasks such as literature surveying, summarization, synthesis, experiment design, and draft generation. The system integrates retrieval mechanisms to pull in external knowledge sources, contextually analyze documents and papers, and build structured representations of ideas and arguments that can later be turned into coherent reports or drafts. Rather than simply generating text from prompts, AI-Researcher orchestrates sequences of subtasks — such as extracting definitions, identifying key experiments, and tracking citations — and uses self-refinement loops to iteratively improve outputs. -
18
Minigrid
Simple and easily configurable grid world environments
...It provides a suite of simple 2D grid-based tasks (e.g., navigating mazes, unlocking doors, carrying keys) where an agent moves in discrete steps and interacts with objects. The design emphasizes speed (agents can run thousands of steps per second), low dependency overhead, and high customizability — making it easy to define new maps, new tasks, or wrappers. It supports the Gymnasium-style environment API so that RL researchers can plug it into their existing frameworks and algorithms with minimal adaptation. Because of its simplicity, it is often used for rapid prototyping, analytic experiments, curriculum learning, or pedagogical tutorials. ... -
19
llm.c
LLM training in simple, raw C/CUDA
...By stripping away heavy frameworks, it exposes the core math and memory flows of embeddings, attention, and feed-forward layers. The code illustrates how to wire forward passes, losses, and simple training or inference loops with direct control over arrays and buffers. Its compact design makes it easy to trace execution, profile hotspots, and understand the cost of each operation. Portability is a goal: it aims to compile with common toolchains and run on modest hardware for small experiments. Rather than delivering a production-grade stack, it serves as a reference and learning scaffold for people who want to “see the metal” behind LLMs. -
20
The Arcade Learning Environment
The Arcade Learning Environment (ALE) -- a platform for AI research
Arcade Learning Environment (ALE) is a widely used open-source framework that wraps hundreds of Atari 2600 games via an emulator and presents them as RL environments for AI agents. It decouples the game/emulation aspects from the agent interface, providing a clean API (C++, Python, Gymnasium) so researchers can focus on agent design rather than game plumbing. This environment suite has been central to many RL breakthroughs, including value-based agents, deep Q-nets, and general-agent... -
21
FlexLLMGen
Running large language models on a single GPU
...The architecture distributes computation and memory usage across the GPU, CPU, and disk in order to maximize the number of tokens processed during inference. This design allows organizations to deploy powerful language models for high-volume tasks without the infrastructure costs typically associated with large-scale AI systems. The project is particularly useful for workloads that prioritize throughput over latency, including benchmarking experiments and large corpus analysis. -
22
Made With ML
Learn how to develop, deploy and iterate on production-grade ML
...The project focuses on bridging the gap between experimental machine learning notebooks and real-world software systems that can be deployed, monitored, and maintained at scale. It provides structured lessons and practical code examples that demonstrate how to design machine learning workflows, manage datasets, train models, evaluate performance, and deploy inference services. The repository organizes these concepts into modular Python scripts that follow software engineering best practices such as testing, configuration management, logging, and version control. Through a combination of tutorials, notebooks, and production-ready scripts, the project demonstrates how machine learning applications should be developed as maintainable systems rather than isolated experiments. -
23
Skywork-R1V4
Skywork-R1V is an advanced multimodal AI model series
Skywork-R1V is an open-source multimodal reasoning model designed to extend the capabilities of large language models into vision-language tasks that require complex logical reasoning. The project introduces a model architecture that transfers the reasoning abilities of advanced text-based models into visual domains so the system can interpret images and perform multi-step reasoning about them. Instead of retraining both language and vision models from scratch, the framework uses a... -
24
WavTokenizer
SOTA discrete acoustic codec models with 40/75 tokens per second
...Extensive experiments show that WavTokenizer matches or surpasses previous neural codecs across speech, music, and general audio on both objective metrics and subjective listening tests. -
25
Agentex
Open source codebase for Scale Agentex
...It treats an “agent” as a composition of a policy (the LLM), tools, memory, and an execution runtime so you can test the whole loop, not just prompting. The repo focuses on structured experiments: standardized tasks, canonical tool interfaces, and logs that make it possible to compare models, prompts, and tool sets fairly. It also includes evaluation harnesses that capture success criteria and partial credit, plus traces you can inspect to understand where reasoning or tool use failed. The design encourages clean separation between experiment configuration and code, which makes sharing results or re-running baselines straightforward. ...
