Search Results for "llm software"
Sort By:
Showing 33 open source projects for "llm software"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
1
any-llm
Communicate with an LLM provider using a single interface
any-llm is a unified SDK and platform developed by Mozilla AI that allows developers to interact with multiple large language model providers through a single, consistent interface. Instead of rewriting code for each provider, developers can switch between services like OpenAI, Anthropic, Mistral, and Ollama simply by changing configuration parameters. The project is designed to be framework-agnostic, making it easy to integrate into scripts, applications, or production systems without being... -
2
LLM CLI
Access large language models from the command-line
A CLI utility and Python library for interacting with Large Language Models, both via remote APIs and models that can be installed and run on your own machine. -
3
LLM Tornado
The .NET library to build AI agents with 30+ built-in connectors
LLM Tornado is a provider-agnostic .NET SDK designed to build, orchestrate, and deploy AI agents and workflows with a strong focus on flexibility and integration. It provides a unified interface that connects to more than 30 AI providers and vector databases, allowing developers to switch between models and services without rewriting application logic. The framework introduces a powerful orchestration system based on graph-like structures, where agents, tasks, and transitions can be defined... -
4
LLM Datasets
Curated list of datasets and tools for post-training
LLM Datasets curates and standardizes datasets commonly used to train and fine-tune large language models, reducing the overhead of hunting down sources and normalizing formats. The repository aims to make datasets easy to inspect and transform, with scripts for downloading, deduping, cleaning, and converting to formats like JSONL that slot into training pipelines. It highlights instruction-tuning and conversation-style corpora while also pointing to code, math, or domain-specific sets for... -
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
5
KnowNote
A local-first AI knowledge base & NotebookLM alternative
KnowNote is a local-first, open-source AI knowledge base and notebook application created as an Electron-based alternative to Google NotebookLM that emphasizes privacy, control, and simplicity. It lets users build an intelligent, searchable knowledge base from uploaded documents such as PDFs, Word files, PowerPoints, and web pages, and then interact with that content using LLM-powered chat, summarization, and reasoning tools. Unlike many NotebookLM alternatives that rely on Docker or cloud... -
6
Mini Jinja
MiniJinja is a powerful but minimal dependency template engine
MiniJinja is a minimal-dependency template engine based on the syntax and behavior of Python’s Jinja2. It is implemented primarily for Rust and also has Go, JavaScript, Python, C, and CLI-related components. The project supports Jinja-style templates, inheritance, filters, expressions, dynamic objects, and serde-compatible data. It is designed to stay close to Jinja2 while keeping compile times, dependencies, and API surface manageable for Rust programs. MiniJinja can also be used as a small... -
7
Mediary Scout
Agent-driven media library for your cloud drives
Mediary Scout is an agent-driven media library that acquires movies, television shows, and anime for supported cloud drives. An LLM agent searches connected indexers, selects a result according to quality and subtitle preferences, transfers it, and verifies what arrived. The library tracks season coverage, missing episodes, airing status, and scheduled gap-filling tasks. It supports 115, Quark, and GuangYaPan as separate workspaces without requiring local media downloads. Users can run an... -
8
LangChain.dart
Build LLM-powered Dart/Flutter applications
LangChain.dart is a Dart and Flutter implementation of the LangChain framework, designed to enable developers to build LLM-powered applications for mobile, web, and cross-platform environments. It provides a structured way to integrate language models into applications by offering abstractions for chains, agents, embeddings, and vector stores. The framework supports multiple providers and includes packages for integrating with services such as OpenAI, Google AI, and Firebase, allowing... -
9
Mistral Inference
Official inference library for Mistral models
Open and portable generative AI for devs and businesses. We release open-weight models for everyone to customize and deploy where they want it. Our super-efficient model Mistral Nemo is available under Apache 2.0, while Mistral Large 2 is available through both a free non-commercial license, and a commercial license. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
Semantix
Non-Pydantic, Non-JSON Schema, efficient AutoPrompting
Semantix empowers developers to infuse meaning into their code through enhanced variable typing (semantic typing). By leveraging the power of large language models (LLMs) behind the scenes, Semantix transforms ordinary functions into intelligent, context-aware operations without explicit LLM calls. -
11
LangChainGo
LangChain for Go, the easiest way to write LLM-based programs in Go
LangChainGo is a Go-based implementation of the LangChain framework, designed to help developers build applications powered by large language models using the Go programming language. It provides a modular architecture that allows developers to combine components such as language models, chains, agents, memory systems, and vector stores into flexible workflows. The framework emphasizes composability, making it easy to create complex pipelines that integrate LLMs with external data sources,... -
12
jamesob's guide to running SOTA LLMs
Everything I know about running LLMs locally
jamesob's guide to running SOTA LLMs is a practical guide and configuration repository for running high-end language models on local hardware. It documents one developer’s local LLM setup, including hardware choices, GPU layout, storage, PCIe switches, kernel settings, and serving workflows. The repository compares budget levels ranging from dual RTX 3090 systems to high-end multi-GPU workstations with very large VRAM pools. It includes ready-to-run serving configurations for selected models... -
13
TensorRT
C++ library for high performance inference on NVIDIA GPUs
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference. It includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for deep learning inference applications. TensorRT-based applications perform up to 40X faster than CPU-only platforms during inference. With TensorRT, you can optimize neural network models trained in all major frameworks, calibrate for lower precision with high accuracy, and deploy to hyperscale data centers,... -
14
ncnn
High-performance neural network inference framework for mobile
ncnn is a high-performance neural network inference computing framework designed specifically for mobile platforms. It brings artificial intelligence right at your fingertips with no third-party dependencies, and speeds faster than all other known open source frameworks for mobile phone cpu. ncnn allows developers to easily deploy deep learning algorithm models to the mobile platform and create intelligent APPs. It is cross-platform and supports most commonly used CNN networks, including... -
15
rollama
Wrap the Ollama API, which allows you to run different LLMs
rollama is an R package that provides a convenient interface for interacting with local large language models through the Ollama API, bringing modern AI capabilities into the R ecosystem. It is designed to make LLM usage accessible to data scientists and researchers who work primarily in R, allowing them to generate text, analyze data, and create embeddings without relying on external cloud services. The package emphasizes reproducibility and privacy by enabling local execution of models,... -
16
Open LLMs
A list of open LLMs available for commercial use
Open LLMs, by the same author behind applied-ml — serves as a curated directory of open large language models (LLMs) that are available for commercial or open-source use. Rather than proprietary or closed-source LLMs, this repo focuses on freely available or permissively licensed models that practitioners can download, run, fine-tune or integrate without restrictive licensing. For teams or developers interested in experimenting with LLMs but wanting to avoid vendor lock-in or licensing... -
17
DocTR
Library for OCR-related tasks powered by Deep Learning
DocTR provides an easy and powerful way to extract valuable information from your documents. Seemlessly process documents for Natural Language Understanding tasks: we provide OCR predictors to parse textual information (localize and identify each word) from your documents. Robust 2-stage (detection + recognition) OCR predictors with pretrained parameters. User-friendly, 3 lines of code to load a document and extract text with a predictor. State-of-the-art performances on public document... -
18
Gen.jl
A general-purpose probabilistic programming system
An open-source stack for generative modeling and probabilistic inference. Gen’s inference library gives users building blocks for writing efficient probabilistic inference algorithms that are tailored to their models, while automating the tricky math and the low-level implementation details. Gen helps users write hybrid algorithms that combine neural networks, variational inference, sequential Monte Carlo samplers, and Markov chain Monte Carlo. Gen features an easy-to-use modeling language... -
19
SageMaker Hugging Face Inference Toolkit
Library for serving Transformers models on Amazon SageMaker
SageMaker Hugging Face Inference Toolkit is an open-source library for serving Transformers models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain Transformers models and tasks. It utilizes the SageMaker Inference Toolkit for starting up the model server, which is responsible for handling inference requests. For the Dockerfiles used for building SageMaker Hugging Face Containers, see AWS Deep Learning Containers. The SageMaker Hugging... -
20
Groq Python
The official Python Library for the Groq API
Groq Python is the official Python SDK for the Groq REST API, giving Python developers straightforward access to Groq’s LLM, chat, audio, and other AI services. Through this library, you can call Groq’s models from Python code — for example to request chat completions, code generation, transcription, or any supported endpoint — using idiomatic Python syntax. The SDK handles authentication (via environment variable or parameter), defines proper type-safe request/response data types, and... -
21
AIMET
AIMET is a library that provides advanced quantization and compression
Qualcomm Innovation Center (QuIC) is at the forefront of enabling low-power inference at the edge through its pioneering model-efficiency research. QuIC has a mission to help migrate the ecosystem toward fixed-point inference. With this goal, QuIC presents the AI Model Efficiency Toolkit (AIMET) - a library that provides advanced quantization and compression techniques for trained neural network models. AIMET enables neural networks to run more efficiently on fixed-point AI hardware... -
22
MIVisionX
Set of comprehensive computer vision & machine intelligence libraries
MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX delivers highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions along with Convolution Neural Net Model Compiler & Optimizer supporting ONNX, and Khronos NNEF™ exchange formats. The toolkit allows for rapid prototyping and deployment of optimized computer vision and machine learning... -
23
ComfyUI Workflows ZHO
My ComfyUI workflows collection
ComfyUI Workflows ZHO is a collection of reusable ComfyUI workflow files for generative image, video, 3D, and multimodal experiments. It brings together ready-made graphs for systems such as Stable Cascade, SD3, FLUX.1, Hunyuan Video, InstantID, PhotoMaker, and LivePortrait Animals. The repository also includes workflows that combine large language models with diffusion systems. Other examples cover ControlNet, image-to-image generation, inpainting, prompt visualization, upscaling, and... -
24
voice-input-src
Documents and exposes generated source for menu-bar workflows
voice-input-src documents and exposes the generated source workflow for a macOS menu-bar speech input application. Holding the Fn key starts recording, and releasing it transcribes and pastes text into the currently focused field. It uses Apple's streaming Speech Recognition framework and requires macOS 14 or newer. The application supports English, Simplified Chinese, Traditional Chinese, Japanese, and Korean, with the chosen language stored locally. A floating capsule displays a live... -
25
Elixir LangChain
Elixir implementation of a LangChain style framework
Elixir LangChain is an Elixir-native implementation of the LangChain concept, designed to help developers build applications powered by large language models using the Elixir ecosystem. The library focuses on enabling composable workflows where different processes, APIs, and services can be connected into structured pipelines driven by LLMs. It mirrors the architecture of traditional LangChain frameworks by providing abstractions for chains, tools, agents, and model integrations while...
