Search Results for "gpu monitoring"
Sort By:
Showing 25 open source projects for "gpu monitoring"
View related business solutions-
Auth0 for AI Agents now in GAConnect your AI agents to apps and data more securely, give users control over the actions AI agents can perform and the data they can access, and enable human confirmation for critical agent actions.
-
Total Network Visibility for Network Engineers and IT ManagersThis means every device on your network, and every interface on every device is automatically analyzed for performance, errors, QoS, and configuration.
-
1
NVIDIA GPU Exporter
Nvidia GPU exporter for prometheus using nvidia-smi binary
Nvidia GPU exporter for prometheus, using nvidia-smi binary to gather metrics. There are many Nvidia GPU exporters out there however they have problems such as not being maintained, not providing pre-built binaries, having a dependency to Linux and/or Docker, targeting enterprise setups (DCGM) and so on. -
2
Ricks-Lab GPU Utilities
A set of utilities for monitoring and customizing GPU performance
A set of utilities for monitoring GPU performance and modifying control settings. In order to get the maximum capability of these utilities, you should be running with a kernel that provides support for the GPUs you have installed. If using AMD GPUs, installing the latest AMD GPU driver or ROCm package may provide additional capabilities. If you have Nvidia GPUs installed, you should have Nvidia-smi installed in order for the utility reading of the cards to be possible. ... -
3
NVIDIA GPU Operator
NVIDIA GPU Operator creates/configures/manages GPUs atop Kubernetes
...However, configuring and managing nodes with these hardware resources requires the configuration of multiple software components such as drivers, container runtimes or other libraries which are difficult and prone to errors. The NVIDIA GPU Operator uses the operator framework within Kubernetes to automate the management of all NVIDIA software components needed to provision GPU. These components include the NVIDIA drivers (to enable CUDA), Kubernetes device plugin for GPUs, the NVIDIA Container Runtime, automatic node labeling, DCGM-based monitoring, and others. -
4
Nvitop
An interactive NVIDIA-GPU process viewer and beyond
nvitop is an interactive NVIDIA device and process monitoring tool. It has a colorful and informative interface that continuously updates the status of the devices and processes. As a resource monitor, it includes many features and options, such as tree-view, environment variable viewing, process filtering, process metrics monitoring, etc. Beyond that, the package also ships a CUDA device selection tool nvisel for deep learning researchers. It also provides handy APIs that allow developers... -
Cloud-based help desk software with ServoDeskWhat if You Could Automate 90% of Your Repetitive Tasks in Under 30 Days? At ServoDesk, we help businesses like yours automate operations with AI, allowing you to cut service times in half and increase productivity by 25% - without hiring more staff.
-
5
nviwatch
A blazingly fast rust based TUI for managing and monitoring NVIDIA GPU
NviWatch is an interactive terminal user interface (TUI) application for monitoring NVIDIA GPU devices and processes. Built with Rust, it provides real-time insights into GPU performance metrics, including temperature, utilization, memory usage, and power consumption. -
6
Beta9
Run serverless GPU workloads with fast cold starts on bare-metal
beta9 is a platform that enables running serverless GPU workloads with fast cold starts on bare-metal servers globally. It allows developers to deploy and scale GPU-accelerated applications without managing underlying infrastructure, offering flexibility and efficiency for AI and high-performance computing tasks. beta9 supports various frameworks and provides tools for monitoring and managing deployments effectively. -
7
LibreHardwareMonitor
Monitor temperature sensors, fan speed, voltage, load & clock speeds
...LibreHardwareMonitor supports modern Intel and AMD CPUs, major GPU vendors, storage devices, and network adapters. Built on modern .NET versions, it continues to evolve with frequent updates and broad community contributions. Licensed under MPL 2.0, it offers a transparent and extensible alternative to proprietary hardware monitoring tools. -
8
NVTOP
GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel
NVTOP stands for Neat Video card TOP, a (h) top-like task monitor for GPUs and accelerators. It can handle multiple GPUs and print information about them in a htop-familiar way. Currently supported vendors are AMD (Linux AMD GPU driver), Apple (limited M1 & M2 support), Huawei (Ascend), Intel (Linux i915 driver), NVIDIA (Linux proprietary divers), and Qualcomm Adreno (Linux MSM driver). -
9
nanominer
Nanominer is a versatile tool for mining cryptocurrencies on GPUs
A versatile cryptocurrency mining software for both GPUs and CPUs, supporting multiple algorithms and coins. -
All-in-One Inspection SoftwareOptimize Frontline Operations: Elevate Equipment Uptime, Operational Excellence, and Safety with Connected Teams and Data, Including Issue Capture and Corrective Action.
-
10
ImplicitGlobalGrid.jl
Distributed parallelization of stencil-based GPU and CPU applications
ImplicitGlobalGrid is an outcome of a collaboration of the Swiss National Supercomputing Centre, ETH Zurich (Dr. Samuel Omlin) with Stanford University (Dr. Ludovic Räss) and the Swiss Geocomputing Centre (Prof. Yuri Podladchikov). It renders the distributed parallelization of stencil-based GPU and CPU applications on a regular staggered grid almost trivial and enables close to ideal weak scaling of real-world applications on thousands of GPUs [1, 2, 3]. ImplicitGlobalGrid relies on the... -
11
higgsfield
Fault-tolerant, highly scalable GPU orchestration
Higgsfield is an open-source, fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters, such as Large Language Models (LLMs). -
12
mactop
Apple Silicon Monitor Top written in pure Golang
mactop is a terminal-based monitoring tool "top" designed to display real-time metrics for Apple Silicon chips. It provides a simple and efficient way to monitor CPU and GPU usage, E-Cores and P-Cores, power consumption, and other system metrics directly from your terminal. -
13
FastKoko
Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model
FastKoko is a self-hosted text-to-speech server built around the Kokoro-82M model and exposed through a FastAPI backend. It is designed to be easy to deploy via Docker, with separate CPU and GPU images so that users can choose between pure CPU inference and NVIDIA GPU acceleration. The project exposes an OpenAI-compatible speech endpoint, which means existing code that talks to the OpenAI audio API can often be pointed at a Kokoro-FastAPI instance with minimal changes. It supports multiple languages and voicepacks and allows phoneme based generation for more accurate pronunciation and prosody. ... -
14
OpenLIT
OpenLIT is an open-source LLM Observability tool
OpenLIT is an OpenTelemetry-native tool designed to help developers gain insights into the performance of their LLM applications in production. It automatically collects LLM input and output metadata and monitors GPU performance for self-hosted LLMs. OpenLIT makes integrating observability into GenAI projects effortless with just a single line of code. Whether you're working with popular LLM providers such as OpenAI and HuggingFace, or leveraging vector databases like ChromaDB, OpenLIT... -
15
OpenCost
Cost monitoring for Kubernetes workloads and cloud costs
OpenCost is a vendor-neutral open-source project for measuring and allocating cloud infrastructure and container costs in real-time. Built by Kubernetes experts and supported by Kubernetes practitioners, OpenCost shines a light into the black box of Kubernetes spending. Flexible, customizable cost allocation and cloud resource monitoring for accurate showback, chargeback, and ongoing reporting. Dynamic asset pricing, through integrations with AWS, Azure, and GCP billing APIs as well as... -
16
KServe
Standardized Serverless ML Inference Platform on Kubernetes
KServe provides a Kubernetes Custom Resource Definition for serving machine learning (ML) models on arbitrary frameworks. It aims to solve production model serving use cases by providing performant, high abstraction interfaces for common ML frameworks like Tensorflow, XGBoost, ScikitLearn, PyTorch, and ONNX. It encapsulates the complexity of autoscaling, networking, health checking, and server configuration to bring cutting edge serving features like GPU Autoscaling, Scale to Zero, and... -
17
Mosec
A high-performance ML model serving framework, offers dynamic batching
Mosec is a high-performance and flexible model-serving framework for building ML model-enabled backend and microservices. It bridges the gap between any machine learning models you just trained and the efficient online service API. -
18
The System Load Tracker is a lightweight WPF application that monitors key system performance indicators in real-time. It includes CPU, GPU, VRAM, and RAM usage, as well as temperature readings. Designed for ease of use, it lets users monitor their computer's performance easily. Visit the project on Github: https://github.com/Schuischta/SystemLoadTracker
-
19
WhisperLive
A nearly-live implementation of OpenAI's Whisper
WhisperLive is a “nearly live” implementation of OpenAI’s Whisper model focused on real-time transcription. It runs as a server–client system in which the server hosts a Whisper backend and clients stream audio to be transcribed with very low delay. The project supports multiple inference backends, including Faster-Whisper, NVIDIA TensorRT, and OpenVINO, allowing you to target GPUs and different CPU architectures efficiently. It can handle microphone input, pre-recorded audio files, and... -
20
MSI Kombustor
Advanced OpenGL and Vulkan graphics card stress testing utility
MSI Kombustor is a dedicated GPU stress-testing and benchmarking tool built on top of the popular FurMark engine. It is designed to push graphics cards to their thermal and stability limits, helping users verify cooling performance and overclocking reliability. With support for advanced 3D APIs like OpenGL and Vulkan, Kombustor can generate demanding rendering workloads that simulate real-world GPU pressure. The tool provides MSI users with an exclusive, streamlined interface for testing... -
21
EvaDB
Database system for building simpler and faster AI-powered application
...Running these deep learning models on large document or video datasets is costly and time-consuming. For example, the state-of-the-art object detection model takes multiple GPU years to process just a week’s videos from a single traffic monitoring camera. Besides the money spent on hardware, these models also increase the time that you spend waiting for the model inference to finish. -
22
XMRig NVIDIA
Monero (XMR) NVIDIA miner
XMRig is high performance Monero (XMR) NVIDIA miner, with the official full Windows support. -
23
xmrMiner
A CUDA based miner for Monero
An optimized Monero miner designed to maximize GPU mining efficiency. -
24
DIGITS
Deep Learning GPU training system
The NVIDIA Deep Learning GPU Training System (DIGITS) puts the power of deep learning into the hands of engineers and data scientists. DIGITS can be used to rapidly train the highly accurate deep neural network (DNNs) for image classification, segmentation and object detection tasks. DIGITS simplifies common deep learning tasks such as managing data, designing and training neural networks on multi-GPU systems, monitoring performance in real-time with advanced visualizations, and selecting the best performing model from the results browser for deployment. ... -
25
A simple, cross platform performance monitoring application specifically designed to be used with nVidia's instrumented driver and the NVPerfSDK to give a graphical representation of internal GPU counters. Support for non-GPU counters is also available.
- Previous
- You're on page 1
- Next
