Search Results for "llm"
Sort By:
Showing 22 open source projects for "llm"
View related business solutions-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
1
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI
Confidently evaluate, test, and monitor LLM applications. Opik is an open-source platform for evaluating, testing, and monitoring LLM applications. Built by Comet. Record, sort, search, and understand each step your LLM app takes to generate a response. Manually annotate, view, and compare LLM responses in a user-friendly table. Log traces during development and in production. -
2
LangCheck
Simple, Pythonic building blocks to evaluate LLM applications
Simple, Pythonic building blocks to evaluate LLM applications. -
3
Lunary
The production toolkit for LLMs. Observability, prompt management
Lunary helps developers of LLM Chatbots develop and improve them. -
4
whisper.cpp
Port of OpenAI's Whisper model in C/C++
whisper.cpp is a lightweight, C/C++ reimplementation of OpenAI’s Whisper automatic speech recognition (ASR) model—designed for efficient, standalone transcription without external dependencies. The entire high-level implementation of the model is contained in whisper.h and whisper.cpp. The rest of the code is part of the ggml machine learning library. The command downloads the base.en model converted to custom ggml format and runs the inference on all .wav samples in the folder samples.... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
5
OpenLIT
OpenLIT is an open-source LLM Observability tool
OpenLIT is an OpenTelemetry-native tool designed to help developers gain insights into the performance of their LLM applications in production. It automatically collects LLM input and output metadata and monitors GPU performance for self-hosted LLMs. OpenLIT makes integrating observability into GenAI projects effortless with just a single line of code. Whether you're working with popular LLM providers such as OpenAI and HuggingFace, or leveraging vector databases like ChromaDB, OpenLIT ensures your applications are monitored seamlessly, providing critical insights including GPU performance stats for self-hosted LLMs to improve performance and reliability. ... -
6
OpenLLMetry
Open-source observability for your LLM application
The repo contains standard OpenTelemetry instrumentations for LLM providers and Vector DBs, as well as a Traceloop SDK that makes it easy to get started with OpenLLMetry, while still outputting standard OpenTelemetry data that can be connected to your observability stack. If you already have OpenTelemetry instrumented, you can just add any of our instrumentations directly. -
7
Arize Phoenix
Uncover insights, surface problems, monitor, and fine tune your LLM
...It allows Data Scientists to quickly visualize their model data, monitor performance, track down issues & insights, and easily export to improve. Deep Learning Models (CV, LLM, and Generative) are an amazing technology that will power many of future ML use cases. A large set of these technologies are being deployed into businesses (the real world) in what we consider a production setting. -
8
Anima
Open-source Agent OS for hardware intelligence
...The system runs as an intelligent hardware agent runtime inside the local network. It discovers devices, tracks their state, and controls real hardware through adapters. Anima uses an LLM-powered brain to interpret the environment, user intent, memory, and device-specific skills before planning actions. It currently supports Mi Home and MIoT devices while providing a dashboard, REST API, and CLI for observation, debugging, control, and extension. -
9
Helicone
Open source LLM-Observability Platform for Developers
Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
10
Kalavai
Turn everyday devices into your own AI cluster
...Do you have an old desktop or a gaming laptop gathering dust? Aggregate resources from multiple machines and say goodbye to CUDA out-of-memory errors. Deploy your favorite open-source LLM, fine-tune it with your own data, or simply run your distributed work, zero-DevOps. Simple. Private. Yours. -
11
Kong
The Cloud-Native API Gateway
Kong is a next generation cloud-native API platform for multi-cloud and hybrid organizations. When building for the web, mobile, or Internet of Things, you’ll need a common functionality to run your software, and Kong is that solution. Kong acts as a gateway, connecting microservices requests and APIs natively while also providing load balancing, logging, monitoring, authentication, rate-limiting, and so much more through plugins. Kong is highly extensible as well as platform agnostic,... -
12
OpenClaw Opik Observability Plugin
Official plugin for OpenClaw that exports agent traces to Opik
OpenClaw Opik Observability Plugin is an open-source plugin designed to add observability and monitoring capabilities to OpenClaw autonomous AI agents by exporting operational traces to the Opik observability platform. The project integrates directly with OpenClaw’s plugin architecture so that developers can capture detailed runtime information about how their agents behave while executing tasks. Each time an AI agent performs an action—such as calling a large language model, invoking a... -
13
Model Context Protocol (MCP) Servers
Model Context Protocol Servers
The Model Context Protocol (MCP) is an open protocol that enables seamless integration between LLM applications and external data sources and tools. Whether you’re building an AI-powered IDE, enhancing a chat interface, or creating custom AI workflows, MCP provides a standardized way to connect LLMs with the context they need. -
14
Files.md
Private, quiet space for thinking. A simple app for your .md files
...The project also includes optional sync approaches, including cloud folders, a self-hosted server, and hosted sync. files.md is useful for users who want a private, portable, LLM-friendly writing and thinking space built on durable plain-text files. -
15
Grafana
Leading open-source visualization and observability platform
Grafana OSS is the leading open-source platform for visualization and observability. It enables teams to query, visualize, alert on, and explore telemetry data from multiple sources in a single interface. With support for 100+ data source plugins—including Prometheus, Loki, Elasticsearch, InfluxDB, SQL/NoSQL databases, and OpenTelemetry—Grafana helps teams correlate metrics, logs, and traces across applications and infrastructure. Users can build interactive dashboards with rich... -
16
skorpion_os
the whole os and work i have done documented
...The included SkAi Firefox extension brings local AI directly into your browser, while Olly — a natural language CLI file manager — lets you interact with your filesystem using plain language powered by the local LLM. -
17
Genv
GPU environment management and cluster orchestration
Genv is an open-source environment and cluster management system for GPUs. Genv lets you easily control, configure, monitor and enforce the GPU resources that you are using in a GPU machine or cluster. It is intended to ease up the process of GPU allocation for data scientists without code changes. -
18
AI File Sorter
Local AI file organization with categorization and rename suggestions
AI File Sorter is a cross-platform desktop application that uses AI (local LLMs run on your computer) to organize files and suggest meaningful file names based on real content, not just filenames or extensions. The app can analyze images locally and propose descriptive rename suggestions (for example, IMG_2048.jpg → clouds_over_lake.jpg). It can also analyze document text to improve categorization and renaming. Supported formats include PDF, DOCX, XLSX, PPTX, ODT, ODS, ODP, and common... -
19
FreeAskInternet
FreeAskInternet is a completely free running search aggregator
FreeAskInternet is a self-hosted search and answer application that combines web results with large language models. A local SearXNG instance sends queries to multiple search engines and returns a broader collection of sources. The backend crawls selected pages, supplies their content to a configured model, and streams a synthesized response to the chat interface. It supports several hosted model services as well as custom local backends such as Ollama and llama.cpp. The web interface is... -
20
OnnxStream
Lightweight inference library for ONNX files, written in C++
The challenge is to run Stable Diffusion 1.5, which includes a large transformer model with almost 1 billion parameters, on a Raspberry Pi Zero 2, which is a microcomputer with 512MB of RAM, without adding more swap space and without offloading intermediate results on disk. The recommended minimum RAM/VRAM for Stable Diffusion 1.5 is typically 8GB. Generally, major machine learning frameworks and libraries are focused on minimizing inference latency and/or maximizing throughput, all of which... -
21
Paul Graham GPT
RAG on Paul Graham's essays
...The repo stores the full text of his essays (chunked), uses embeddings (e.g. via OpenAI embeddings) to allow semantic search over that corpus, and hosts a chat interface that combines retrieval results with LLM-based answering — enabling RAG (retrieval-augmented generation) over a fixed dataset. The app uses a Postgres database (with pgvector) hosted on Supabase for its embedding store, making the backend relatively simple and accessible, and the frontend is again built with Next.js/TypeScript for a modern responsive UI. By pulling together search and chat, it creates a useful tool both for readers who want to revisit or explore Paul Graham’s ideas thematically, and for learners or researchers who want to query specific essays or concepts quickly. -
22
KonsolScript: Automate and Orchestrate
Embeddable scripting runtime for live behavior, AI, and automation.
...Key capabilities: - Embed into any C++ app with a single header - Hot-reload scripts at runtime without restarting - AI-safe: validate or reject scripts before execution - Orchestrate LLMs (OpenAI, Claude, Gemini, Ollama) in .ks scripts - Built-in: String, File, JSON, CSV, Math, Regex, and more - Plugins: HTTP, SQLite, MySQL, TCP, Redis, Crypto, JWT, Zip - Push behavior updates to remote instances over TCP Use cases: - Scriptable game engines (hot-patch rules mid-session) - AI event bridges (natural language to live app behavior) - Automation pipelines (CI, log triage, file processing) - LLM orchestration workflows Docs: https://konsolscript.sf.net/kookbook.html
- Previous
- You're on page 1
- Next