Search Results for "llm"
Sort By:
Showing 26 open source projects for "llm"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
1
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI
Confidently evaluate, test, and monitor LLM applications. Opik is an open-source platform for evaluating, testing, and monitoring LLM applications. Built by Comet. Record, sort, search, and understand each step your LLM app takes to generate a response. Manually annotate, view, and compare LLM responses in a user-friendly table. Log traces during development and in production. -
2
LangCheck
Simple, Pythonic building blocks to evaluate LLM applications
Simple, Pythonic building blocks to evaluate LLM applications. -
3
whisper.cpp
Port of OpenAI's Whisper model in C/C++
whisper.cpp is a lightweight, C/C++ reimplementation of OpenAI’s Whisper automatic speech recognition (ASR) model—designed for efficient, standalone transcription without external dependencies. The entire high-level implementation of the model is contained in whisper.h and whisper.cpp. The rest of the code is part of the ggml machine learning library. The command downloads the base.en model converted to custom ggml format and runs the inference on all .wav samples in the folder samples.... -
4
Lunary
The production toolkit for LLMs. Observability, prompt management
Lunary helps developers of LLM Chatbots develop and improve them. -
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
5
OpenLIT
OpenLIT is an open-source LLM Observability tool
OpenLIT is an OpenTelemetry-native tool designed to help developers gain insights into the performance of their LLM applications in production. It automatically collects LLM input and output metadata and monitors GPU performance for self-hosted LLMs. OpenLIT makes integrating observability into GenAI projects effortless with just a single line of code. Whether you're working with popular LLM providers such as OpenAI and HuggingFace, or leveraging vector databases like ChromaDB, OpenLIT ensures your applications are monitored seamlessly, providing critical insights including GPU performance stats for self-hosted LLMs to improve performance and reliability. ... -
6
OpenLLMetry
Open-source observability for your LLM application
The repo contains standard OpenTelemetry instrumentations for LLM providers and Vector DBs, as well as a Traceloop SDK that makes it easy to get started with OpenLLMetry, while still outputting standard OpenTelemetry data that can be connected to your observability stack. If you already have OpenTelemetry instrumented, you can just add any of our instrumentations directly. -
7
Arize Phoenix
Uncover insights, surface problems, monitor, and fine tune your LLM
...It allows Data Scientists to quickly visualize their model data, monitor performance, track down issues & insights, and easily export to improve. Deep Learning Models (CV, LLM, and Generative) are an amazing technology that will power many of future ML use cases. A large set of these technologies are being deployed into businesses (the real world) in what we consider a production setting. -
8
Anima
Open-source Agent OS for hardware intelligence
...The system runs as an intelligent hardware agent runtime inside the local network. It discovers devices, tracks their state, and controls real hardware through adapters. Anima uses an LLM-powered brain to interpret the environment, user intent, memory, and device-specific skills before planning actions. It currently supports Mi Home and MIoT devices while providing a dashboard, REST API, and CLI for observation, debugging, control, and extension. -
9
Helicone
Open source LLM-Observability Platform for Developers
Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
10
Kalavai
Turn everyday devices into your own AI cluster
...Do you have an old desktop or a gaming laptop gathering dust? Aggregate resources from multiple machines and say goodbye to CUDA out-of-memory errors. Deploy your favorite open-source LLM, fine-tune it with your own data, or simply run your distributed work, zero-DevOps. Simple. Private. Yours. -
11
Kong
The Cloud-Native API Gateway
Kong is a next generation cloud-native API platform for multi-cloud and hybrid organizations. When building for the web, mobile, or Internet of Things, you’ll need a common functionality to run your software, and Kong is that solution. Kong acts as a gateway, connecting microservices requests and APIs natively while also providing load balancing, logging, monitoring, authentication, rate-limiting, and so much more through plugins. Kong is highly extensible as well as platform agnostic,... -
12
OpenClaw Opik Observability Plugin
Official plugin for OpenClaw that exports agent traces to Opik
OpenClaw Opik Observability Plugin is an open-source plugin designed to add observability and monitoring capabilities to OpenClaw autonomous AI agents by exporting operational traces to the Opik observability platform. The project integrates directly with OpenClaw’s plugin architecture so that developers can capture detailed runtime information about how their agents behave while executing tasks. Each time an AI agent performs an action—such as calling a large language model, invoking a... -
13
Model Context Protocol (MCP) Servers
Model Context Protocol Servers
The Model Context Protocol (MCP) is an open protocol that enables seamless integration between LLM applications and external data sources and tools. Whether you’re building an AI-powered IDE, enhancing a chat interface, or creating custom AI workflows, MCP provides a standardized way to connect LLMs with the context they need. -
14
Files.md
Private, quiet space for thinking. A simple app for your .md files
...The project also includes optional sync approaches, including cloud folders, a self-hosted server, and hosted sync. files.md is useful for users who want a private, portable, LLM-friendly writing and thinking space built on durable plain-text files. -
15
Grafana
Leading open-source visualization and observability platform
Grafana OSS is the leading open-source platform for visualization and observability. It enables teams to query, visualize, alert on, and explore telemetry data from multiple sources in a single interface. With support for 100+ data source plugins—including Prometheus, Loki, Elasticsearch, InfluxDB, SQL/NoSQL databases, and OpenTelemetry—Grafana helps teams correlate metrics, logs, and traces across applications and infrastructure. Users can build interactive dashboards with rich... -
16
Zenclora OS
Debian-based desktop distro optimized for stability and daily use
Zenclora is a Debian-based desktop Linux distribution optimized for stability and daily use. Zenclora offers simplified package and system management commands to make Linux usage easier; it avoids unnecessary complexity while providing control to the user. Check the website for details: https://nixovena.org/zenclora -
17
skorpion_os
the whole os and work i have done documented
...The included SkAi Firefox extension brings local AI directly into your browser, while Olly — a natural language CLI file manager — lets you interact with your filesystem using plain language powered by the local LLM. -
18
Logilocky AI Linux
Offline LLM, AI Development and Desktop Focused Linux Distribution
Logilocky AI Linux is a Linux distribution built on top of Debian. The goal of the distribution is to run offline AI models, provide a suitable environment for AI developers, make AI tools easily accessible, and offer an easy-to-use experience for Linux beginners. It also provides tuned kernel settings specifically optimized for AI workloads. The distribution has its own rich ecosystem, featuring numerous desktop applications built from scratch for Logilocky. This includes tools for daily... -
19
Genv
GPU environment management and cluster orchestration
Genv is an open-source environment and cluster management system for GPUs. Genv lets you easily control, configure, monitor and enforce the GPU resources that you are using in a GPU machine or cluster. It is intended to ease up the process of GPU allocation for data scientists without code changes. -
20
AI File Sorter
Local AI file organization with categorization and rename suggestions
AI File Sorter is a cross-platform desktop application that uses AI (local LLMs run on your computer) to organize files and suggest meaningful file names based on real content, not just filenames or extensions. The app can analyze images locally and propose descriptive rename suggestions (for example, IMG_2048.jpg → clouds_over_lake.jpg). It can also analyze document text to improve categorization and renaming. Supported formats include PDF, DOCX, XLSX, PPTX, ODT, ODS, ODP, and common... -
21
CurlFlow
A graphical download manager written in Python
CurlFlow is a simple graphical download manager for Linux. It's written in Python and uses your existing installation of "cURL" to do the downloads. The "initial commit" version was written largely with the help of an LLM as an experiment to see how much work would be involved, for a hobbyist like me, in getting usable code out of free or locally hosted LLMs. Though I have made and will probably continue to make some corrections and changes on my own, most of the original work was done by LLMs such as the "Brave Leo" AI utility (it used Qwen) and my own locally hosted copy of Qwen via the Jan desktop app. ... -
22
FreeAskInternet
FreeAskInternet is a completely free running search aggregator
FreeAskInternet is a self-hosted search and answer application that combines web results with large language models. A local SearXNG instance sends queries to multiple search engines and returns a broader collection of sources. The backend crawls selected pages, supplies their content to a configured model, and streams a synthesized response to the chat interface. It supports several hosted model services as well as custom local backends such as Ollama and llama.cpp. The web interface is... -
23
OnnxStream
Lightweight inference library for ONNX files, written in C++
The challenge is to run Stable Diffusion 1.5, which includes a large transformer model with almost 1 billion parameters, on a Raspberry Pi Zero 2, which is a microcomputer with 512MB of RAM, without adding more swap space and without offloading intermediate results on disk. The recommended minimum RAM/VRAM for Stable Diffusion 1.5 is typically 8GB. Generally, major machine learning frameworks and libraries are focused on minimizing inference latency and/or maximizing throughput, all of which... -
24
Paul Graham GPT
RAG on Paul Graham's essays
...The repo stores the full text of his essays (chunked), uses embeddings (e.g. via OpenAI embeddings) to allow semantic search over that corpus, and hosts a chat interface that combines retrieval results with LLM-based answering — enabling RAG (retrieval-augmented generation) over a fixed dataset. The app uses a Postgres database (with pgvector) hosted on Supabase for its embedding store, making the backend relatively simple and accessible, and the frontend is again built with Next.js/TypeScript for a modern responsive UI. By pulling together search and chat, it creates a useful tool both for readers who want to revisit or explore Paul Graham’s ideas thematically, and for learners or researchers who want to query specific essays or concepts quickly. -
25
KonsolScript: Automate and Orchestrate
Embeddable scripting runtime for live behavior, AI, and automation.
...Key capabilities: - Embed into any C++ app with a single header - Hot-reload scripts at runtime without restarting - AI-safe: validate or reject scripts before execution - Orchestrate LLMs (OpenAI, Claude, Gemini, Ollama) in .ks scripts - Built-in: String, File, JSON, CSV, Math, Regex, and more - Plugins: HTTP, SQLite, MySQL, TCP, Redis, Crypto, JWT, Zip - Push behavior updates to remote instances over TCP Use cases: - Scriptable game engines (hot-patch rules mid-session) - AI event bridges (natural language to live app behavior) - Automation pipelines (CI, log triage, file processing) - LLM orchestration workflows Docs: https://konsolscript.sf.net/kookbook.html