Search Results for "gpu monitoring"
Sort By:
Showing 48 open source projects for "gpu monitoring"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
Context for your AI agentsBuild data pipelines that feed your AI models and agents without managing infrastructure. Crawl any website, transform content, and push directly to your preferred vector store. Use 10,000+ tools for RAG applications, AI assistants, and real-time knowledge bases. Monitor site changes, trigger workflows on new data, and keep your AIs fed with fresh, structured information. Cloud-native, API-first, and free to start until you need to scale.
-
1
NVIDIA GPU Exporter
Nvidia GPU exporter for prometheus using nvidia-smi binary
Nvidia GPU exporter for prometheus, using nvidia-smi binary to gather metrics. There are many Nvidia GPU exporters out there however they have problems such as not being maintained, not providing pre-built binaries, having a dependency to Linux and/or Docker, targeting enterprise setups (DCGM) and so on. -
2
TrafficMonitor
Floating window used to display current network speed, CPU & memory
...The standard version includes all the functions, while the Lite version does not include hardware monitoring functions such as temperature monitoring, GPU usage, and hard disk usage. The standard version requires administrator privilege to run, while the Lite version does not. -
3
GPU-Z
Lightweight GPU information and diagnostics tool.
...It accurately reports clock speeds, including default, overclocked, 3D, and boost clocks. Furthermore, it provides a detailed analysis of the memory subsystem, including size, type, speed, and bus width. Unique features include a GPU load test to verify PCI-Express configuration, results validation, and the ability to back up your graphics card BIOS. It is portable (requires no installation) and fully supports all modern Windows versions, including Windows 11. (GPU-Z, graphics card info, GPU specs, video card diagnostics, NVIDIA, AMD, Intel, BIOS backup, overclocking, sensor monitoring, free download, portable, TechPowerUp.) -
4
Ricks-Lab GPU Utilities
A set of utilities for monitoring and customizing GPU performance
A set of utilities for monitoring GPU performance and modifying control settings. In order to get the maximum capability of these utilities, you should be running with a kernel that provides support for the GPUs you have installed. If using AMD GPUs, installing the latest AMD GPU driver or ROCm package may provide additional capabilities. If you have Nvidia GPUs installed, you should have Nvidia-smi installed in order for the utility reading of the cards to be possible. ... -
Cloud data warehouse to power your data-driven innovationBigQuery Studio provides a single, unified interface for all data practitioners of various coding skills to simplify analytics workflows from data ingestion and preparation to data exploration and visualization to ML model creation and use. It also allows you to use simple SQL to access Vertex AI foundational models directly inside BigQuery for text processing tasks, such as sentiment analysis, entity extraction, and many more without having to deal with specialized models.
-
5
NVIDIA GPU Operator
NVIDIA GPU Operator creates/configures/manages GPUs atop Kubernetes
...However, configuring and managing nodes with these hardware resources requires the configuration of multiple software components such as drivers, container runtimes or other libraries which are difficult and prone to errors. The NVIDIA GPU Operator uses the operator framework within Kubernetes to automate the management of all NVIDIA software components needed to provision GPU. These components include the NVIDIA drivers (to enable CUDA), Kubernetes device plugin for GPUs, the NVIDIA Container Runtime, automatic node labeling, DCGM-based monitoring, and others. -
6
Nvitop
An interactive NVIDIA-GPU process viewer and beyond
nvitop is an interactive NVIDIA device and process monitoring tool. It has a colorful and informative interface that continuously updates the status of the devices and processes. As a resource monitor, it includes many features and options, such as tree-view, environment variable viewing, process filtering, process metrics monitoring, etc. Beyond that, the package also ships a CUDA device selection tool nvisel for deep learning researchers. It also provides handy APIs that allow developers... -
7
MangoHud
A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU
A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more. mangoplot is a plotting script that is shipped with MangoHud: on a given folder, it takes each log file, makes a 1D heatmap of its framerates, then stacks the heat maps vertically to form a 2D graph for easy visual comparison between benchmarks. -
8
nviwatch
A blazingly fast rust based TUI for managing and monitoring NVIDIA GPU
NviWatch is an interactive terminal user interface (TUI) application for monitoring NVIDIA GPU devices and processes. Built with Rust, it provides real-time insights into GPU performance metrics, including temperature, utilization, memory usage, and power consumption. -
9
Beta9
Run serverless GPU workloads with fast cold starts on bare-metal
beta9 is a platform that enables running serverless GPU workloads with fast cold starts on bare-metal servers globally. It allows developers to deploy and scale GPU-accelerated applications without managing underlying infrastructure, offering flexibility and efficiency for AI and high-performance computing tasks. beta9 supports various frameworks and provides tools for monitoring and managing deployments effectively. -
Pest Control Management SoftwareBuilt for the pest control industry, but also works great for Mosquito Control, Bin Cleaning, Window Washing, Solar Panel Cleaning, and other Home Service Businesses in need of an easy-to-use software that helps you simplify routing, scheduling, communications, payment processing, truck tracking, time tracking, and reporting.
-
10
LibreHardwareMonitor
Monitor temperature sensors, fan speed, voltage, load & clock speeds
...LibreHardwareMonitor supports modern Intel and AMD CPUs, major GPU vendors, storage devices, and network adapters. Built on modern .NET versions, it continues to evolve with frequent updates and broad community contributions. Licensed under MPL 2.0, it offers a transparent and extensible alternative to proprietary hardware monitoring tools. -
11
NVTOP
GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel
NVTOP stands for Neat Video card TOP, a (h) top-like task monitor for GPUs and accelerators. It can handle multiple GPUs and print information about them in a htop-familiar way. Currently supported vendors are AMD (Linux AMD GPU driver), Apple (limited M1 & M2 support), Huawei (Ascend), Intel (Linux i915 driver), NVIDIA (Linux proprietary divers), and Qualcomm Adreno (Linux MSM driver). -
12
nanominer
Nanominer is a versatile tool for mining cryptocurrencies on GPUs
A versatile cryptocurrency mining software for both GPUs and CPUs, supporting multiple algorithms and coins. -
13
ImplicitGlobalGrid.jl
Distributed parallelization of stencil-based GPU and CPU applications
ImplicitGlobalGrid is an outcome of a collaboration of the Swiss National Supercomputing Centre, ETH Zurich (Dr. Samuel Omlin) with Stanford University (Dr. Ludovic Räss) and the Swiss Geocomputing Centre (Prof. Yuri Podladchikov). It renders the distributed parallelization of stencil-based GPU and CPU applications on a regular staggered grid almost trivial and enables close to ideal weak scaling of real-world applications on thousands of GPUs [1, 2, 3]. ImplicitGlobalGrid relies on the... -
14
higgsfield
Fault-tolerant, highly scalable GPU orchestration
Higgsfield is an open-source, fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters, such as Large Language Models (LLMs). -
15
mactop
Apple Silicon Monitor Top written in pure Golang
mactop is a terminal-based monitoring tool "top" designed to display real-time metrics for Apple Silicon chips. It provides a simple and efficient way to monitor CPU and GPU usage, E-Cores and P-Cores, power consumption, and other system metrics directly from your terminal. -
16
CapFrameX
Frametime capture and analysis tool
CapFrameX is a performance capture and analysis tool designed for PC gamers and benchmarking enthusiasts, which records frametimes, frame-rates and various sensor data during game or application execution. It uses backend tools like PresentMon to log data and then exposes a comprehensive UI for analyzing the results: you can view charts of frametimes, historic graphing, stuttering analysis, L-shape graphs, input-lag overlays, and compare multiple capture runs side by side. Importantly, the... -
17
OhmGraphite
OhmGraphite is a Windows service that exposes hardware sensor data
The above dashboard captures: - Power consumption of the CPU and GPU - CPU voltages and frequencies - Load breakdown on individual GPU components - CPU, GPU, disk, and motherboard temperature readings - Disk activity, space remaining, and error monitoring - Fan speed - Network consumption -
18
FastKoko
Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model
FastKoko is a self-hosted text-to-speech server built around the Kokoro-82M model and exposed through a FastAPI backend. It is designed to be easy to deploy via Docker, with separate CPU and GPU images so that users can choose between pure CPU inference and NVIDIA GPU acceleration. The project exposes an OpenAI-compatible speech endpoint, which means existing code that talks to the OpenAI audio API can often be pointed at a Kokoro-FastAPI instance with minimal changes. It supports multiple languages and voicepacks and allows phoneme based generation for more accurate pronunciation and prosody. ... -
19
OpenLIT
OpenLIT is an open-source LLM Observability tool
OpenLIT is an OpenTelemetry-native tool designed to help developers gain insights into the performance of their LLM applications in production. It automatically collects LLM input and output metadata and monitors GPU performance for self-hosted LLMs. OpenLIT makes integrating observability into GenAI projects effortless with just a single line of code. Whether you're working with popular LLM providers such as OpenAI and HuggingFace, or leveraging vector databases like ChromaDB, OpenLIT... -
20
OpenCost
Cost monitoring for Kubernetes workloads and cloud costs
OpenCost is a vendor-neutral open-source project for measuring and allocating cloud infrastructure and container costs in real-time. Built by Kubernetes experts and supported by Kubernetes practitioners, OpenCost shines a light into the black box of Kubernetes spending. Flexible, customizable cost allocation and cloud resource monitoring for accurate showback, chargeback, and ongoing reporting. Dynamic asset pricing, through integrations with AWS, Azure, and GCP billing APIs as well as... -
21
KServe
Standardized Serverless ML Inference Platform on Kubernetes
KServe provides a Kubernetes Custom Resource Definition for serving machine learning (ML) models on arbitrary frameworks. It aims to solve production model serving use cases by providing performant, high abstraction interfaces for common ML frameworks like Tensorflow, XGBoost, ScikitLearn, PyTorch, and ONNX. It encapsulates the complexity of autoscaling, networking, health checking, and server configuration to bring cutting edge serving features like GPU Autoscaling, Scale to Zero, and... -
22
FurMark
GPU stress test OpenGL and Vulkan graphics benchmark Windows/Linux
FurMark is an intensive benchmarking tool designed to evaluate the performance of graphics cards using fur rendering algorithms. This tool is particularly effective in generating high workloads that can significantly increase the temperature of the GPU, making it a useful utility for testing the stability and stress tolerance of graphics cards. By simulating demanding rendering tasks, FurMark serves as a comprehensive test for assessing the robustness and thermal performance of GPUs under... -
23
Mosec
A high-performance ML model serving framework, offers dynamic batching
Mosec is a high-performance and flexible model-serving framework for building ML model-enabled backend and microservices. It bridges the gap between any machine learning models you just trained and the efficient online service API. -
24
The System Load Tracker is a lightweight WPF application that monitors key system performance indicators in real-time. It includes CPU, GPU, VRAM, and RAM usage, as well as temperature readings. Designed for ease of use, it lets users monitor their computer's performance easily. Visit the project on Github: https://github.com/Schuischta/SystemLoadTracker
-
25
WhisperLive
A nearly-live implementation of OpenAI's Whisper
WhisperLive is a “nearly live” implementation of OpenAI’s Whisper model focused on real-time transcription. It runs as a server–client system in which the server hosts a Whisper backend and clients stream audio to be transcribed with very low delay. The project supports multiple inference backends, including Faster-Whisper, NVIDIA TensorRT, and OpenVINO, allowing you to target GPUs and different CPU architectures efficiently. It can handle microphone input, pre-recorded audio files, and...
