Search Results for "gpu"
Sort By:
Showing 32 open source projects for "gpu"
View related business solutions-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
1
AGI (Android GPU Inspector)
Android GPU Inspector
Android GPU Inspector (AGI) is a desktop tool for profiling, tracing, and debugging graphics workloads running on Android devices. It helps developers analyze Vulkan and OpenGL ES applications at the system, frame, and draw-call levels to uncover GPU and CPU bottlenecks. AGI captures detailed performance counters, timelines, and pipeline state to reveal stalls, overdraw, shader hotspots, and inefficient resource usage. -
2
Nvitop
An interactive NVIDIA-GPU process viewer and beyond
nvitop is an interactive NVIDIA device and process monitoring tool. It has a colorful and informative interface that continuously updates the status of the devices and processes. As a resource monitor, it includes many features and options, such as tree-view, environment variable viewing, process filtering, process metrics monitoring, etc. Beyond that, the package also ships a CUDA device selection tool nvisel for deep learning researchers. It also provides handy APIs that allow developers... -
3
Android Emulator Container Scripts
Minimal scripts to run the emulator in a container for various systems
...The project focuses on reproducibility and scale: you define which system image to boot, how to persist or reset data, and how many instances to run, then schedule them like any other workload. GPU acceleration, audio, and sensors can be enabled depending on your host and cluster capabilities, while fallbacks like SwiftShader keep things usable when no GPU is available. -
4
FlashKDA
High-performance Kimi Delta Attention kernels
...It supports recurrent state input and output, variable-length batches, internal gating, query-key normalization, and beta activation. Builds can target the detected GPU architecture or multiple supported architectures for wheels and CI pipelines. The repository also provides correctness tests, benchmark material, a direct Python kernel API, and development helpers for CUDA and C++ tooling. -
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
5
jetson-stats
Simple package for monitoring and control your NVIDIA Jetson
...It supports Jetson platforms such as Orin, Xavier, Nano, TX, and newer Jetson families. The project includes jtop, a terminal-based dashboard that gives users a live view of CPU, GPU, memory, power, temperature, engine usage, and system status. It can also be imported into Python scripts, which makes it useful for custom monitoring, robotics dashboards, automation, and diagnostics. Developers working with embedded AI systems can use it to understand performance limits and troubleshoot hardware behavior during deployment. ... -
6
OpenLIT
OpenLIT is an open-source LLM Observability tool
OpenLIT is an OpenTelemetry-native tool designed to help developers gain insights into the performance of their LLM applications in production. It automatically collects LLM input and output metadata and monitors GPU performance for self-hosted LLMs. OpenLIT makes integrating observability into GenAI projects effortless with just a single line of code. Whether you're working with popular LLM providers such as OpenAI and HuggingFace, or leveraging vector databases like ChromaDB, OpenLIT ensures your applications are monitored seamlessly, providing critical insights including GPU performance stats for self-hosted LLMs to improve performance and reliability. ... -
7
OSX-KVM
Run macOS on QEMU/KVM
...It supports Intel VT-x and AMD SVM hosts, although newer macOS releases impose additional CPU instruction requirements. Included resources cover networking, libvirt, offline installation, headless operation, diagnostics, cloud environments, and GPU passthrough experiments. The repository is useful for macOS testing, development, research, and build-farm scenarios on compatible hardware. Users must still evaluate Apple licensing requirements and the hardware-specific limitations of their chosen configuration. -
8
Throttled
Workaround for Intel throttling issues in Linux
This tool was originally developed to fix Linux CPU throttling issues affecting Lenovo T480 / T480s / X1C6. The CPU package power limit (PL1/2) is forced to a value of 44 W (29 W on battery) and the temperature trip point to 95 'C (85 'C on battery) by overriding default values in MSR and MCHBAR every 5 seconds (30 on battery) to block the Embedded Controller from resetting these values to default. On systems where the EC doesn't reset the values (ex: ASUS Zenbook UX430UNR), the power limit... -
9
Ricks-Lab GPU Utilities
A set of utilities for monitoring and customizing GPU performance
A set of utilities for monitoring GPU performance and modifying control settings. In order to get the maximum capability of these utilities, you should be running with a kernel that provides support for the GPUs you have installed. If using AMD GPUs, installing the latest AMD GPU driver or ROCm package may provide additional capabilities. If you have Nvidia GPUs installed, you should have Nvidia-smi installed in order for the utility reading of the cards to be possible. ... -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
10
Selkies-GStreamer
Open-Source Low-Latency Accelerated Linux WebRTC HTML5 Remote Desktop
...This module acts as a high-performance media pipeline that captures video, encodes it with low latency, and streams it via WebRTC to client browsers. It is optimized for GPU-accelerated encoding and integrates with Kubernetes-based deployments to enable scalable, real-time remote desktop sessions. This component plays a critical role in delivering smooth, responsive experiences for cloud-based workstations, gaming, or visualization tools. -
11
EPLB
Expert Parallelism Load Balancer
...EPLB solves this by duplicating heavily used experts (redundancy) and then placing those duplicates across GPUs to even out computational load. It uses policies like hierarchical load balancing (grouped experts placed at node and then GPU level) and global load balancing depending on configuration. The logic is implemented in eplb.py and supports predicting placements given estimated expert usage weights. EPLB aims to reduce hot-spotting and ensure more uniform usage of compute resources in large MoE deployments. -
12
PyG
Graph Neural Network Library for PyTorch
...It consists of various methods for deep learning on graphs and other irregular structures, also known as geometric deep learning, from a variety of published papers. In addition, it consists of easy-to-use mini-batch loaders for operating on many small and single giant graphs, multi GPU-support, DataPipe support, distributed graph learning via Quiver, a large number of common benchmark datasets (based on simple interfaces to create your own), the GraphGym experiment manager, and helpful transforms, both for learning on arbitrary graphs as well as on 3D meshes or point clouds. All it takes is 10-20 lines of code to get started with training a GNN model (see the next section for a quick tour). -
13
Genv
GPU environment management and cluster orchestration
Genv is an open-source environment and cluster management system for GPUs. Genv lets you easily control, configure, monitor and enforce the GPU resources that you are using in a GPU machine or cluster. It is intended to ease up the process of GPU allocation for data scientists without code changes. -
14
Arsen Clicker & Macro
The world’s smartest autoclicker & macro tool.
Arsen is a Python-based autoclicker and macro manager. Built with PySide6, it provides a fast and efficient desktop automation experience on Windows with a clean, modern interface. Arsen allows precise control of mouse and keyboard actions, making it suitable for repetitive tasks, UI testing, data entry automation, and workflow optimization. The application includes a built-in macro editor for creating and managing complex automation sequences, along with global hotkey support for... -
15
PC Workman HCK
AI-powered PC monitoring that explains. Not shows numbers/spikes.
Your PC says CPU 87%. PC Workman says why, since when, and what to do about it. Real-time system monitor with built-in offline AI. No cloud. Your data stays on your machine. What's inside: -hck_GPT: 82-intent AI assistant. -Ask it anything about your PC in Polish or English. -9-layer routing, learns your usage patterns over weeks. -TURBO mode: one click stops unnecessary services (Gaming/Work/Economy profiles), switches power plan, flushes RAM, freezes idle apps. -One click restores... -
16
NebiOS Alternative Mirror (Official)
A unique Ubuntu-based Linux OS with its own desktop and ecosystem.
...Main site: https://nebios.org 📌 This mirror page is updated less frequently than the main site. For the latest information, visit https://nebios.org ⚠️ Don't download from unknown sources. ⚠️ Virtual machines: NebiOS X requires GPU acceleration. Most hypervisors (VirtualBox, VMware, GNOME Boxes) will show degraded performance. QEMU with 3D acceleration enabled gives the best VM experience. See FAQ for details. System requirements and pre-installation info: https://nebios.org/download (select your version) Full FAQ: https://nebios.org/support/faq -
17
PulseMonitor
Free real-time PC health monitor for Windows
PulseMonitor is a free portable PC health monitor for Windows with a clean dark interface. Monitor CPU, GPU, RAM, network and storage in real time. Features include network monitoring, mini gaming overlay (Ctrl+Shift+M), performance history, process manager with End Task, startup manager, light/dark theme and CSV export. No installation needed — just extract and run. Under 5% CPU usage. -
18
BashCore
A custom Debian live ISO with security tools, no GUI, only Bash.
BashCore is a Debian-based live ISO for security, networking, and learning. CLI-only, Bash-driven, lightweight, GPU-ready, with optional PREEMPT_RT kernel. Fresh environment on every boot, ideal for safe experimentation. Also available: BashCoreX (XFCE GUI) BashCoreT (Trixie CLI, Linux 6.12) BashCoreTX (Trixie XFCE) BashCoreZ (ultra-minimal CLI) BashLabOS (XFCE, daily use & privacy tools) BashCoreGee (GNOME, installable via Calamares) BourneCore (minimal illumos/OpenIndiana CLI) Info & download: https://www.bashcore.org - https://github.com/bashcore -
19
PyMapStitcher-3---Cuda-Maps-Downloader
A low ram maps downloader to keep your ram free.
PyMapStitcher 3 is a desktop application for downloading, stitching, and exporting very large satellite map areas as GeoTIFF/BigTIFF files. The software supports GPU acceleration with NVIDIA CUDA and CuPy, direct GeoTIFF georeferencing, WebView-based map selection, and high-performance tile processing for large-scale mapping workflows. -
20
Shopne-Arcade
A frontend for GnGeo emulator written purely in Python
Shopne Arcade is a front-end application designed to easily play Neo Geo system games on PC. It's interface is compatible for screens with low resolution such as 640x480 pixels. It lets users play Neo Geo system games from one interface where users will be able pick different game play experience settings such as Neo Geo games video resolutions, audio sampling rates, etc. Shopne Arcade is written in pure Python language without any external dependencies making it portable across various... -
21
UTILHELP
Universal Windows Helper - Easy software and driver management
A modern application that simplifies finding and installing essential software and drivers for Windows systems. The program serves as a centralized hub for managing all your software needs, eliminating the hassle of searching across multiple websites for downloads. The application automatically scans your system to detect already installed programs and provides intelligent recommendations based on your hardware configuration. It features a clean, modern interface with dark theme and smooth... -
22
FreeAskInternet
FreeAskInternet is a completely free running search aggregator
...The web interface is designed for desktop and mobile use and exposes the service only on the local machine by default. Docker Compose provides a straightforward deployment path without requiring a dedicated GPU. The project is still described as early-stage, and actual privacy depends partly on whether users select a local or external model provider. -
23
CLIP-as-service
Embed images and sentences into fixed-length vectors
...Non-blocking duplex streaming on requests and responses, designed for large data and long-running tasks. Horizontally scale up and down multiple CLIP models on single GPU, with automatic load balancing. Easy-to-use. No learning curve, minimalist design on client and server. Intuitive and consistent API for image and sentence embedding. Async client support. Easily switch between gRPC, HTTP, WebSocket protocols with TLS and compression. Smooth integration with neural search ecosystem including Jina and DocArray. ... -
24
gpustat
A simple command-line utility for querying and monitoring GPU status
gpustat is a lightweight Python command-line utility designed to provide fast, human-readable monitoring of NVIDIA GPU status in real time. It serves as a simplified alternative to the more verbose nvidia-smi tool by presenting key GPU metrics in a compact, developer-friendly format. The utility retrieves data through NVIDIA’s NVML bindings and displays information such as temperature, utilization, memory usage, and running processes directly in the terminal. -
25
DeepSpeech
Open source embedded speech-to-text engine
DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers. DeepSpeech is an open-source Speech-To-Text engine, using a model trained by machine learning techniques based on Baidu's Deep Speech research paper. Project DeepSpeech uses Google's TensorFlow to make the implementation easier. A pre-trained English model is available for use and can be downloaded following the instructions in the usage docs. ...
