Search Results for "llm"
Sort By:
Showing 204 open source projects for "llm"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
1
Harbor LLM
Run a full local LLM stack with one command using Docker
...It is intended for local development and experimentation rather than production deployment, giving developers a flexible way to explore AI systems, test configurations, and manage complex LLM stacks without manual wiring or setup overhead. -
2
LLM Wiki
Open Source Implementation of Karpathy's LLM Wiki
LLM Wiki is a knowledge management and documentation system designed to organize, generate, and maintain structured information using large language models. It allows users to create interconnected knowledge bases that function similarly to a wiki but are enhanced with AI-driven content generation and summarization. The system emphasizes linking and context, enabling information to be connected across pages and topics for better navigation and understanding. -
3
LLM Scraper
Extract structured data from webpages using LLM-powered scraping
LLM Scraper also provides streaming output and code generation capabilities that help developers build reusable scraping workflows. -
4
Superset LLM
Run an army of Claude Code, Codex, etc. on your machine
Superset is a development environment and terminal-based platform designed to orchestrate multiple AI coding agents simultaneously within a single workspace. The tool enables developers to run many autonomous coding agents in parallel without the typical overhead of manually managing multiple terminals, repositories, or branches. Each agent task is isolated in its own Git worktree, ensuring that code changes from different agents do not interfere with each other while allowing developers to... -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
5
Reader LLM
Convert any URL to an LLM-friendly input with a simple prefix
Reader LLM is an open-source tool designed to convert web content into formats that are easier for large language models to process. The system works by transforming a webpage into a clean text or Markdown representation that removes unnecessary formatting and highlights the core information within the page. Developers can use a simple URL prefix to retrieve a version of a webpage that has been optimized for machine consumption, making it suitable for use in AI agents or retrieval-augmented generation pipelines. ... -
6
LLM Gateway
Route, manage, and analyze your LLM requests across multiple providers
...With optional UI, telemetry, and Docker deployment, it's ideal for teams aiming to centralize LLM orchestration and gain visibility into AI usage. -
7
nashsu LLM Wiki
LLM Wiki is a cross-platform desktop application
...It may include mechanisms for content generation, summarization, and contextual linking, making it useful for research and knowledge management. The project reflects the trend of combining LLM capabilities with traditional information architectures. Overall, it provides a dynamic alternative to conventional documentation systems. -
8
EASY LLM CLI
An open-source AI agent that is compatible with multiple LLM models
EASY LLM CLI is an open-source command-line AI agent compatible with multiple large language model providers. It is based on a fork of Gemini CLI and is designed to connect to local tools, understand code, and support developer workflows from the terminal. The project supports providers such as Gemini, OpenAI, and custom APIs that follow the OpenAI-compatible format. -
9
AWS GenAI LLM Chatbot
A modular and comprehensive solution to deploy a Multi-LLM
AWS GenAI LLM Chatbot is an enterprise-ready reference solution for deploying a secure, feature-rich generative AI chatbot on AWS with retrieval-augmented generation capabilities. The project is built as a modular blueprint that helps organizations stand up a production-oriented chat experience rather than a simple demo, combining model access, knowledge retrieval, storage, security, and user interface components into one deployable system. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
NextJS Ollama LLM UI
Fully-featured web interface for Ollama LLMs
NextJS Ollama LLM UI is a web-based frontend interface built with Next.js to make interacting with Ollama-hosted large language models easy and fast. Its goal is to remove the complexity of setting up and managing UI components for local or offline LLM usage by providing a straightforward chat experience with support for responsive layouts, light and dark themes, and local chat history storage in the browser. -
11
OmniRoute
OmniRoute is an AI gateway for multi-provider LLM
OmniRoute is a routing and orchestration framework designed to simplify the handling of requests, workflows, or data flows across multiple services or endpoints in a unified manner. It focuses on providing a flexible abstraction layer where developers can define routing logic that dynamically directs traffic based on conditions, context, or predefined rules. The project emphasizes modularity and extensibility, allowing users to plug in different services or handlers without tightly coupling... -
12
Langfuse
Open source LLM engineering platform: LLM Observability, metrics, etc.
Langfuse is a logging and analytics tool for large language model (LLM) applications, providing insights into usage, performance, and troubleshooting. -
13
Flowise
Drag & drop UI to build your customized LLM flow
Open source UI visual tool to build your customized LLM flow using LangchainJS, written in Node Typescript/Javascript. Conversational agent for a chat model which utilizes chat-specific prompts and buffer memory. Open source is the core of Flowise, and it will always be free for commercial and personal usage. Flowise support different environment variables to configure your instance. You can specify the following variables in the .env file inside the packages/server folder. -
14
Agentic
AI agent stdlib that works with any LLM and TypeScript AI SDK
Agentic is an open source, TypeScript, AI agent standard library that works with any LLM and TS AI SDK. Agentic’s standard library of TypeScript AI tools are optimized for both TS-usage as well as LLM-based usage, which is really important for testing and debugging. -
15
Langtrace
Open Telemetry based end-to-end observability tool for LLM apps
Langtrace is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations, and metrics for popular LLMs, LLM frameworks, vectors, and more.. Integrate using Typescript, and Python. Langtrace is an open-source observability tool that collects and analyzes traces and metrics to help you improve your LLM apps. -
16
promptfoo
Evaluate and compare LLM outputs, catch regressions, improve prompts
Ensure high-quality LLM outputs with automatic evals. Use a representative sample of user inputs to reduce subjectivity when tuning prompts. Use built-in metrics, LLM-graded evals, or define your own custom metrics. Compare prompts and model outputs side-by-side, or integrate the library into your existing test/CI workflow. Use OpenAI, Anthropic, and open-source models like Llama and Vicuna, or integrate custom API providers for any LLM API. -
17
OpenKnowledge
Beautiful, AI-native markdown editor and LLM Wiki
OpenKnowledge is an AI-native Markdown editor and LLM wiki for knowledge bases, specs, notes, and agent-friendly documentation. It is designed to make Markdown editing feel closer to a visual document editor while still preserving file-based workflows. The app supports a macOS desktop experience as well as a local web and CLI workflow for other platforms. It includes file navigation, search, tabs, wiki graph viewing, rich components, embeddable HTML, and terminal-oriented access. ... -
18
OpenClaude
Claude Code opened to any LLM
OpenClaude is an open-source alternative or extension inspired by Claude-style agent systems, designed to provide similar capabilities in a customizable and self-hosted environment. The project focuses on enabling users to run their own AI agents with full control over data, workflows, and integrations, reducing reliance on proprietary platforms. It likely includes support for executing tasks, managing context, and interacting with external tools, allowing agents to perform real-world... -
19
Lunary
The production toolkit for LLMs. Observability, prompt management
Lunary helps developers of LLM Chatbots develop and improve them. -
20
KnowNote
A local-first AI knowledge base & NotebookLM alternative
...It lets users build an intelligent, searchable knowledge base from uploaded documents such as PDFs, Word files, PowerPoints, and web pages, and then interact with that content using LLM-powered chat, summarization, and reasoning tools. Unlike many NotebookLM alternatives that rely on Docker or cloud deployments, KnowNote runs natively on desktop platforms without complex setup, meaning all data stays local unless the user opts to integrate with self-managed or private LLM APIs. Its retrieval-augmented generation (RAG) system offers semantic search and traceable source references, and it supports multiple LLM providers through a flexible plugin-style provider architecture. -
21
Lobe Icons
Brings AI/LLM brand logos to your React & React Native apps
Lobe Icons is an open-source icon library designed to provide developers with a comprehensive collection of logos and visual assets representing popular artificial intelligence platforms, language models, and related technologies. The project focuses on making it easy for developers to include recognizable AI brand icons in applications such as dashboards, AI tools, documentation sites, or developer portals. The library includes icons for a wide range of AI providers and models, allowing... -
22
RWKV Runner
A RWKV management and startup tool, full automation, only 8MB
RWKV (pronounced as RwaKuv) is an RNN with GPT-level LLM performance, which can also be directly trained like a GPT transformer (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, fast training, saves VRAM, "infinite" ctxlen, and free text embedding. Moreover it's 100% attention-free. Default configs has enabled custom CUDA kernel acceleration, which is much faster and consumes much less VRAM. -
23
WebLLM
Bringing large-language models and chat to web browsers
WebLLM is a modular, customizable javascript package that directly brings language model chats directly onto web browsers with hardware acceleration. Everything runs inside the browser with no server support and is accelerated with WebGPU. We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration. WebLLM offers a minimalist and modular interface to access the chatbot in the browser. The WebLLM package itself does not come... -
24
wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
wllama is a WebAssembly-based library that enables large language model inference directly inside a web browser. Built as a binding for the llama.cpp inference engine, the project allows developers to run LLM models locally without requiring a server backend or dedicated GPU hardware. The library leverages WebAssembly SIMD capabilities to achieve efficient execution within modern browsers while maintaining compatibility across platforms. By running models locally on the user’s device, wllama enables privacy-preserving AI applications that do not require sending data to remote servers. ... -
25
Void Editor
Open source AI IDE and Cursor alternative
...—without routing data through proprietary servers. Developed by YC-backed startup Glass Devtools, it supports traditional coding features inherited from VS Code, enhanced with in-editor LLM capabilities—autocomplete, inline quick edits, and chat agents, all while giving developers total prompt and data control.