Search Results for "llm software" - Page 3
Sort By:
Showing 95 open source projects for "llm software"
View related business solutions-
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
1
Seldon Core
An MLOps framework to package, deploy, monitor and manage models
The de facto standard open-source platform for rapidly deploying machine learning models on Kubernetes. Seldon Core, our open-source framework, makes it easier and faster to deploy your machine learning models and experiments at scale on Kubernetes. Seldon Core serves models built in any open-source or commercial model building framework. You can make use of powerful Kubernetes features like custom resource definitions to manage model graphs. And then connect your continuous integration and... -
2
AIMET
AIMET is a library that provides advanced quantization and compression
Qualcomm Innovation Center (QuIC) is at the forefront of enabling low-power inference at the edge through its pioneering model-efficiency research. QuIC has a mission to help migrate the ecosystem toward fixed-point inference. With this goal, QuIC presents the AI Model Efficiency Toolkit (AIMET) - a library that provides advanced quantization and compression techniques for trained neural network models. AIMET enables neural networks to run more efficiently on fixed-point AI hardware... -
3
1Backend
Build AI (or any) apps with scalable microservices & microfrontends
1Backend is an AI-native full-stack platform for building distributed applications with microservices and microfrontends. It works as a framework, proxy, and runtime that reduces early infrastructure overhead for developers. The platform includes built-in capabilities for authentication, user accounts, service routing, microfrontend routing, email, and API access. It can run and program LLMs inside containers, making it suitable for AI applications as well as general software products.... -
4
Tambo
Add generative UI components to your AI assistant, copilot, or agent
Tambo is a React-oriented AI orchestration framework that enables integration of “generative UI” components—that is, components that can be dynamically rendered or updated in response to AI decisions or prompts. It acts as the bridge between an AI assistant and the React front end, letting your AI agent not only send text responses, but also generate interactive UI elements (forms, charts, dashboards, etc.). The library includes tools to scaffold a Tambo app, manage state, and integrate with... -
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
5
Ray
A unified framework for scalable computing
Modern workloads like deep learning and hyperparameter tuning are compute-intensive and require distributed or parallel execution. Ray makes it effortless to parallelize single machine code — go from a single CPU to multi-core, multi-GPU or multi-node with minimal code changes. Accelerate your PyTorch and Tensorflow workload with a more resource-efficient and flexible distributed execution framework powered by Ray. Accelerate your hyperparameter search workloads with Ray Tune. Find the best... -
6
DocsGPT
Private AI platform for agents, enterprise search and RAG pipelines
DocsGPT is an open-source AI platform for deploying private RAG pipelines, AI agents, and enterprise search on your own infrastructure. Connect any data source (PDFs, DOCX, CSV, Excel, HTML, audio, GitHub, databases, URLs) and get accurate, hallucination-free answers with source citations. Choose your LLM: OpenAI, Anthropic, Google Gemini, or local models. Works with Qdrant, MongoDB, and Elasticsearch and more. Deploy via Docker or Kubernetes with full data sovereignty. Build... -
7
MIVisionX
Set of comprehensive computer vision & machine intelligence libraries
MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX delivers highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions along with Convolution Neural Net Model Compiler & Optimizer supporting ONNX, and Khronos NNEF™ exchange formats. The toolkit allows for rapid prototyping and deployment of optimized computer vision and machine learning... -
8
TensorZero
TensorZero is an open-source stack for industrial-grade LLM apps
tensorzero is a lightweight C++ library designed for tensor operations and numerical computing. It offers a minimal and readable implementation of core tensor functionality, making it ideal for educational purposes, lightweight applications, or those wanting to understand how tensor libraries work under the hood. With no external dependencies, tensorzero is easy to integrate into C++ projects needing basic multi-dimensional array support. -
9
Backtrack Sampler
An easy-to-understand framework for LLM samplers
Backtrack Sampler is a framework designed for experimenting with custom sampling strategies for language models (LLMs), enabling the ability to rewind and revise generated tokens. It allows developers to create and test their own token generation strategies by providing a base structure for manipulating logits and probabilities, making it a flexible tool for those interested in fine-tuning the behavior of LLMs. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
ComfyUI Workflows ZHO
My ComfyUI workflows collection
ComfyUI Workflows ZHO is a collection of reusable ComfyUI workflow files for generative image, video, 3D, and multimodal experiments. It brings together ready-made graphs for systems such as Stable Cascade, SD3, FLUX.1, Hunyuan Video, InstantID, PhotoMaker, and LivePortrait Animals. The repository also includes workflows that combine large language models with diffusion systems. Other examples cover ControlNet, image-to-image generation, inpainting, prompt visualization, upscaling, and... -
11
APIPark
APIPark is the #1 open-source AI Gateway and Developer Portal
APIPark is an open-source, all-in-one AI gateway and API developer portal, that helps developers and enterprises easily manage, integrate, and deploy AI services. No matter which AI model you use, APIPark provides a one-stop integration solution. It unifies the management of all authentication information and tracks the costs of API calls. Standardize the request data format for all AI models. When switching AI models or modifying prompts, it won’t affect your app or microservices,... -
12
QodeAssist
QodeAssist is an AI-powered coding assistant plugin for Qt Creator
QodeAssist is an AI-powered coding assistant plugin specifically designed for Qt Creator, bringing modern AI capabilities directly into a C++ and QML development environment. It provides intelligent code completion, inline refactoring, and conversational chat interfaces that can appear as popups, side panels, or embedded views within the IDE. The plugin supports both local and cloud-based language model providers, including Ollama, llama.cpp, OpenAI, Claude, and others, allowing developers... -
13
OWL
Optimized Workforce Learning for General Multi-Agent Assistance
OWL (Optimized Workforce Learning) is a sophisticated open-source framework built on the CAMEL-AI ecosystem for orchestrating teams of AI agents to collaboratively solve complex, real-world tasks with dynamic planning and automation capabilities. Unlike single-agent systems, it treats task completion as a collaborative workforce where agents take on specialized roles (planning, execution, analysis) and coordinate via a modular multi-agent architecture that supports flexible teamwork across... -
14
voice-input-src
Documents and exposes generated source for menu-bar workflows
voice-input-src documents and exposes the generated source workflow for a macOS menu-bar speech input application. Holding the Fn key starts recording, and releasing it transcribes and pastes text into the currently focused field. It uses Apple's streaming Speech Recognition framework and requires macOS 14 or newer. The application supports English, Simplified Chinese, Traditional Chinese, Japanese, and Korean, with the chosen language stored locally. A floating capsule displays a live... -
15
Elixir LangChain
Elixir implementation of a LangChain style framework
Elixir LangChain is an Elixir-native implementation of the LangChain concept, designed to help developers build applications powered by large language models using the Elixir ecosystem. The library focuses on enabling composable workflows where different processes, APIs, and services can be connected into structured pipelines driven by LLMs. It mirrors the architecture of traditional LangChain frameworks by providing abstractions for chains, tools, agents, and model integrations while... -
16
Orbiton
Snappy and configuration-free text editor/IDE for the terminal
Orbiton is a terminal-based text editor that incorporates AI-assisted capabilities directly into a lightweight and efficient command-line environment. It is designed for developers who prefer minimal interfaces but still want access to modern AI features such as code generation, editing assistance, and contextual suggestions. The editor emphasizes speed and simplicity, maintaining a small footprint while integrating with external language model providers. It allows users to interact with AI... -
17
Languine
Translate your application with Languine CLI powered by AI.
Languine is an AI-powered localization platform designed to automate and streamline the translation process for applications, ensuring seamless integration within development workflows. It offers intelligent, context-aware translations across over 100 languages, maintaining brand voice and tone consistency. It provides a command-line interface and continuous integration/continuous deployment integration, allowing developers to manage translations directly or automate them within existing... -
18
any-agent
A single interface to use and evaluate different agent frameworks
any-agent is a Python library that provides a unified interface for working with multiple agent frameworks, allowing developers to create, run, and evaluate AI agents without being locked into a single ecosystem. It abstracts the differences between frameworks such as LangChain, LlamaIndex, OpenAI Agents, and others, enabling users to switch between them with minimal configuration changes. The library is designed to simplify experimentation and benchmarking, making it easier to compare agent... -
19
ollama-hpp
Modern, Header-only C++ bindings for the Ollama API
ollama-hpp is a C++ client library that provides a lightweight and efficient interface for interacting with the Ollama API in native applications. It is designed with performance and portability in mind, making it suitable for systems where low-level control and minimal overhead are important. The library exposes core Ollama functionality such as text generation and chat through a C++-friendly API, allowing developers to integrate local LLM capabilities into desktop, embedded, or... -
20
Ellama
Ellama is a tool for interacting with large language models from Emacs
Ellama is an Emacs integration that brings large language model capabilities directly into the Emacs editor environment, focusing on extensibility and deep workflow integration. It allows users to interact with local or remote models through a unified interface embedded within their editing sessions. The tool is designed to align with Emacs’ philosophy of customization, enabling users to define prompts, commands, and behaviors tailored to their workflows. It supports conversational... -
21
FastMCP Framework
A TypeScript framework for building MCP servers
FastMCP is a TypeScript framework aimed at building servers compliant with the Model Context Protocol (MCP), enabling LLMs (large language models) or other clients to access tools, resources, and context through a defined protocol. It allows developers to define “tools” (basically operations or services) and “resources” that can be fetched or interacted with, and supports multiple transport mechanisms (HTTP streaming, SSE, etc) for client-server communication. Because it’s built in... -
22
Tunix
A JAX-native LLM Post-Training Library
Tunix is a JAX-native library for post-training large language models, bringing supervised fine-tuning, reinforcement learning–based alignment, and knowledge distillation into one coherent toolkit. It embraces JAX’s strengths—functional programming, jit compilation, and effortless multi-device execution—so experiments scale from a single GPU to pods of TPUs with minimal code changes. The library is organized around modular pipelines for data loading, rollout, optimization, and evaluation,... -
23
PydanticAI
Agent Framework / shim to use Pydantic with LLMs
When I first found FastAPI, I got it immediately. I was excited to find something so innovative and ergonomic built on Pydantic. Virtually every Agent Framework and LLM library in Python uses Pydantic, but when we began to use LLMs in Pydantic Logfire, I couldn't find anything that gave me the same feeling. PydanticAI is a Python Agent Framework designed to make it less painful to build production-grade applications with Generative AI. Built by the team behind Pydantic (the validation layer... -
24
Groq TypeScript / Node.s
The official Node.js / Typescript library for the Groq API
Groq TypeScript / Node.s (also often referred to as “groq-sdk” on npm) is the official Node.js / TypeScript client library for Groq’s REST API, enabling JavaScript/TypeScript developers to integrate LLM and AI-powered services into web backends, serverless functions, or frontend apps. It exports strongly-typed interfaces for models, chat completions, file uploads (e.g. for audio transcription), and other endpoints, allowing for better type safety and developer experience when using Groq from... -
25
OpenAI Agents JS
A lightweight, powerful framework for multi-agent workflows
openai-agents-js is the JavaScript/TypeScript version of the OpenAI Agents SDK, designed to give developers a lightweight but powerful framework for building agentic workflows, voice agents, and tool-augmented LLM systems in JS/TS environments. The SDK is provider-agnostic, meaning while it’s deeply compatible with OpenAI’s APIs, you can also adapt it to use other backends or extension layers. At its core, it introduces primitives like Agents, Tools, Guardrails, and Handoffs, letting you...
