Search Results for "llm"
Sort By:
Showing 88 open source projects for "llm"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
1
LLM Tornado
The .NET library to build AI agents with 30+ built-in connectors
LLM Tornado is a provider-agnostic .NET SDK designed to build, orchestrate, and deploy AI agents and workflows with a strong focus on flexibility and integration. It provides a unified interface that connects to more than 30 AI providers and vector databases, allowing developers to switch between models and services without rewriting application logic. -
2
LLM CLI
Access large language models from the command-line
A CLI utility and Python library for interacting with Large Language Models, both via remote APIs and models that can be installed and run on your own machine. -
3
any-llm
Communicate with an LLM provider using a single interface
any-llm is a unified SDK and platform developed by Mozilla AI that allows developers to interact with multiple large language model providers through a single, consistent interface. Instead of rewriting code for each provider, developers can switch between services like OpenAI, Anthropic, Mistral, and Ollama simply by changing configuration parameters. -
4
LLM Datasets
Curated list of datasets and tools for post-training
LLM Datasets curates and standardizes datasets commonly used to train and fine-tune large language models, reducing the overhead of hunting down sources and normalizing formats. The repository aims to make datasets easy to inspect and transform, with scripts for downloading, deduping, cleaning, and converting to formats like JSONL that slot into training pipelines. -
Veeam Data Platform v13.1 - Get Your Free TrialTry Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
5
KnowNote
A local-first AI knowledge base & NotebookLM alternative
...It lets users build an intelligent, searchable knowledge base from uploaded documents such as PDFs, Word files, PowerPoints, and web pages, and then interact with that content using LLM-powered chat, summarization, and reasoning tools. Unlike many NotebookLM alternatives that rely on Docker or cloud deployments, KnowNote runs natively on desktop platforms without complex setup, meaning all data stays local unless the user opts to integrate with self-managed or private LLM APIs. Its retrieval-augmented generation (RAG) system offers semantic search and traceable source references, and it supports multiple LLM providers through a flexible plugin-style provider architecture. -
6
Semantix
Non-Pydantic, Non-JSON Schema, efficient AutoPrompting
...By leveraging the power of large language models (LLMs) behind the scenes, Semantix transforms ordinary functions into intelligent, context-aware operations without explicit LLM calls. -
7
Void Editor
Open source AI IDE and Cursor alternative
...—without routing data through proprietary servers. Developed by YC-backed startup Glass Devtools, it supports traditional coding features inherited from VS Code, enhanced with in-editor LLM capabilities—autocomplete, inline quick edits, and chat agents, all while giving developers total prompt and data control. -
8
BricksLLM
Enterprise-grade API gateway that helps you monitor and impose cost
BricksLLM is an open-source framework for building and managing production-ready LLM (Large Language Model) applications. It provides tooling for prompt engineering, memory management, observability, and chaining, all in one unified developer experience. BricksLLM is designed to reduce boilerplate and increase the maintainability of LLM-based workflows. -
9
Beta9
Run serverless GPU workloads with fast cold starts on bare-metal
beta9 is a platform that enables running serverless GPU workloads with fast cold starts on bare-metal servers globally. It allows developers to deploy and scale GPU-accelerated applications without managing underlying infrastructure, offering flexibility and efficiency for AI and high-performance computing tasks. beta9 supports various frameworks and provides tools for monitoring and managing deployments effectively. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
LlamaIndexTS
Data framework for your LLM applications
LlamaIndexTS is a data framework designed for Large Language Model (LLM) applications, focusing on server-side solutions to manage and process data efficiently. -
11
ONNX Runtime
ONNX Runtime: cross-platform, high performance ML inferencing
ONNX Runtime is a cross-platform inference and training machine-learning accelerator. ONNX Runtime inference can enable faster customer experiences and lower costs, supporting models from deep learning frameworks such as PyTorch and TensorFlow/Keras as well as classical machine learning libraries such as scikit-learn, LightGBM, XGBoost, etc. ONNX Runtime is compatible with different hardware, drivers, and operating systems, and provides optimal performance by leveraging hardware accelerators... -
12
LangChain.dart
Build LLM-powered Dart/Flutter applications
LangChain.dart is a Dart and Flutter implementation of the LangChain framework, designed to enable developers to build LLM-powered applications for mobile, web, and cross-platform environments. It provides a structured way to integrate language models into applications by offering abstractions for chains, agents, embeddings, and vector stores. The framework supports multiple providers and includes packages for integrating with services such as OpenAI, Google AI, and Firebase, allowing developers to build both local and cloud-based AI workflows. ... -
13
Mistral Inference
Official inference library for Mistral models
Open and portable generative AI for devs and businesses. We release open-weight models for everyone to customize and deploy where they want it. Our super-efficient model Mistral Nemo is available under Apache 2.0, while Mistral Large 2 is available through both a free non-commercial license, and a commercial license. -
14
Prompt Declaration Language
Prompt Declaration Language is a declarative prompt programming lang
LLMs will continue to change the way we build software systems. They are not only useful as coding assistants, providing snipets of code, explanations, and code transformations, but they can also help replace components that could only previously be achieved with rule-based systems. Whether LLMs are used as coding assistants or software components, reliability remains an important concern. LLMs have a textual interface and the structure of useful prompts is not captured formally. Programming... -
15
Output
TypeScript framework for building AI workflows and agents
...It eliminates reliance on fragmented SaaS tools by providing all necessary components locally, ensuring better transparency and control over data and processes. Output includes built-in evaluation systems, such as LLM-as-a-judge scoring, and integrates workflow orchestration tools like Temporal to handle retries, parallel execution, and state management. It also supports multiple model providers through a unified API. -
16
Gitleaks
Protect and discover secrets using Gitleaks
Gitleaks is a fast, lightweight, portable, and open-source secret scanner for git repositories, files, and directories. With over 6.8 million docker downloads, 11.2k GitHub stars, 1.7 million GitHub Downloads, thousands of weekly clones, and over 400k homebrew installs, gitleaks is the most trusted secret scanner among security professionals, enterprises, and developers. Gitleaks-Action is our official GitHub Action. You can use it to automatically run a gitleaks scan on all your team's pull... -
17
Llama Cloud Services
Knowledge Agents and Management in the Cloud
Llama Cloud Services is a suite of tools designed to facilitate the integration of large language models (LLMs) into applications. It offers components for parsing, extracting, and reporting on complex documents, streamlining the process of preparing data for LLM consumption. -
18
NNCF
Neural Network Compression Framework for enhanced OpenVINO
NNCF (Neural Network Compression Framework) is an optimization toolkit for deep learning models, designed to apply quantization, pruning, and other techniques to improve inference efficiency. -
19
Mediary Scout
Agent-driven media library for your cloud drives
Mediary Scout is an agent-driven media library that acquires movies, television shows, and anime for supported cloud drives. An LLM agent searches connected indexers, selects a result according to quality and subtitle preferences, transfers it, and verifies what arrived. The library tracks season coverage, missing episodes, airing status, and scheduled gap-filling tasks. It supports 115, Quark, and GuangYaPan as separate workspaces without requiring local media downloads. -
20
ncnn
High-performance neural network inference framework for mobile
ncnn is a high-performance neural network inference computing framework designed specifically for mobile platforms. It brings artificial intelligence right at your fingertips with no third-party dependencies, and speeds faster than all other known open source frameworks for mobile phone cpu. ncnn allows developers to easily deploy deep learning algorithm models to the mobile platform and create intelligent APPs. It is cross-platform and supports most commonly used CNN networks, including... -
21
MagicAPI AI Gateway
Built for demanding AI workflows
The world's fastest AI Gateway proxy, written in Rust and optimized for maximum performance. This high-performance API gateway routes requests to various AI providers (OpenAI, GROQ) with streaming support, making it perfect for developers who need reliable and blazing-fast AI API access. -
22
Superduper
Superduper: Integrate AI models and machine learning workflows
Superduper is a Python-based framework for building end-2-end AI-data workflows and applications on your own data, integrating with major databases. It supports the latest technologies and techniques, including LLMs, vector-search, RAG, and multimodality as well as classical AI and ML paradigms. Developers may leverage Superduper by building compositional and declarative objects that out-source the details of deployment, orchestration versioning, and more to the Superduper engine. This... -
23
Markdown Site
An open-source publishing framework built for AI agents and developers
...By leveraging Convex for backend real-time data management and Netlify for static hosting, markdown-site enables rich publishing features like SEO optimization, full-text search, analytics dashboards, and AI-indexed content tailored to LLM workflows. -
24
Unsloth-MLX
Bringing the Unsloth experience to Mac users via Apple's MLX framework
Unsloth-MLX offers developers the power of Unsloth’s efficient large language model fine-tuning experience on Apple Silicon Macs by wrapping Apple’s native MLX framework with an API fully compatible with Unsloth workflows. This project removes traditional barriers that prevent Mac users from prototyping and experimenting with LLM training locally by allowing the same code used in cloud GPU environments to run on M-series hardware, improving workflow continuity and reducing iteration costs. It supports loading and training Hugging Face models with fine-tuning strategies like SFT, DPO, ORPO, and GRPO and even handles exporting models to formats like GGUF for downstream use, although some limitations apply with quantized models. ... -
25
KServe
Standardized Serverless ML Inference Platform on Kubernetes
KServe provides a Kubernetes Custom Resource Definition for serving machine learning (ML) models on arbitrary frameworks. It aims to solve production model serving use cases by providing performant, high abstraction interfaces for common ML frameworks like Tensorflow, XGBoost, ScikitLearn, PyTorch, and ONNX. It encapsulates the complexity of autoscaling, networking, health checking, and server configuration to bring cutting edge serving features like GPU Autoscaling, Scale to Zero, and...