Search Results for "llm software"
Sort By:
Showing 187 open source projects for "llm software"
View related business solutions-
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
Demo Series - Small Business Backup By VeeamWatch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
-
1
any-llm
Communicate with an LLM provider using a single interface
any-llm is a unified SDK and platform developed by Mozilla AI that allows developers to interact with multiple large language model providers through a single, consistent interface. Instead of rewriting code for each provider, developers can switch between services like OpenAI, Anthropic, Mistral, and Ollama simply by changing configuration parameters. The project is designed to be framework-agnostic, making it easy to integrate into scripts, applications, or production systems without being... -
2
LLM CLI
Access large language models from the command-line
A CLI utility and Python library for interacting with Large Language Models, both via remote APIs and models that can be installed and run on your own machine. -
3
LLM Tornado
The .NET library to build AI agents with 30+ built-in connectors
LLM Tornado is a provider-agnostic .NET SDK designed to build, orchestrate, and deploy AI agents and workflows with a strong focus on flexibility and integration. It provides a unified interface that connects to more than 30 AI providers and vector databases, allowing developers to switch between models and services without rewriting application logic. The framework introduces a powerful orchestration system based on graph-like structures, where agents, tasks, and transitions can be defined... -
4
LLM Datasets
Curated list of datasets and tools for post-training
LLM Datasets curates and standardizes datasets commonly used to train and fine-tune large language models, reducing the overhead of hunting down sources and normalizing formats. The repository aims to make datasets easy to inspect and transform, with scripts for downloading, deduping, cleaning, and converting to formats like JSONL that slot into training pipelines. It highlights instruction-tuning and conversation-style corpora while also pointing to code, math, or domain-specific sets for... -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
LLM Agents Papers
Must-read Papers on LLM Agents
LLM Agent Papers is an open-source repository that curates research papers related to large language model agents and autonomous AI systems. The project organizes academic literature that explores how language models can act as agents capable of reasoning, planning, and interacting with external tools or environments. Rather than providing software code, the repository functions as a structured knowledge base that helps researchers navigate the rapidly expanding field of agent-based AI research. ... -
6
LLM.swift
LLM.swift is a simple and readable library
LLM.swift is a Swift package that enables developers to run Large Language Models (LLMs) directly on Apple devices, including iOS, macOS, and watchOS. By leveraging Apple's hardware and software optimizations, LLM.swift facilitates on-device natural language processing tasks, ensuring user privacy and reducing latency associated with cloud-based solutions. -
7
BruteForceAI
Advanced LLM-powered brute-force tool combining AI intelligence
BruteForceAI is an open-source security testing tool that applies large language models to the analysis of login forms and authentication flows in web applications. At a high level, the project uses AI to inspect HTML content, identify the relevant form elements, and automate selector discovery so that a tester does not need to hand-map every field before evaluation. It combines that analysis layer with automated credential testing workflows, framing itself as a more adaptive alternative to... -
8
GPT4All
Run Local LLMs on Any Device. Open-source
GPT4All is an open-source project that allows users to run large language models (LLMs) locally on their desktops or laptops, eliminating the need for API calls or GPUs. The software provides a simple, user-friendly application that can be downloaded and run on various platforms, including Windows, macOS, and Ubuntu, without requiring specialized hardware. It integrates with the llama.cpp implementation and supports multiple LLMs, allowing users to interact with AI models privately. This... -
9
Langtrace
Open Telemetry based end-to-end observability tool for LLM apps
Langtrace is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations, and metrics for popular LLMs, LLM frameworks, vectors, and more.. Integrate using Typescript, and Python. Langtrace is an open-source observability tool that collects and analyzes traces and metrics to help you improve your LLM apps. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
KnowNote
A local-first AI knowledge base & NotebookLM alternative
KnowNote is a local-first, open-source AI knowledge base and notebook application created as an Electron-based alternative to Google NotebookLM that emphasizes privacy, control, and simplicity. It lets users build an intelligent, searchable knowledge base from uploaded documents such as PDFs, Word files, PowerPoints, and web pages, and then interact with that content using LLM-powered chat, summarization, and reasoning tools. Unlike many NotebookLM alternatives that rely on Docker or cloud... -
11
Ollama
Run models like Kimi-K2.5, GLM-5, DeepSeek, gpt-oss, Gemma, Qwen etc.
Ollama is an open-source platform that enables developers to run large language models locally on their own machines. It simplifies working with modern AI models by providing a unified interface to download, manage, and interact with them. Users can run models like Llama, Gemma, Qwen, and others directly from the command line or through APIs. Ollama also integrates with popular developer tools and AI agents, allowing seamless workflows across coding environments and applications. It supports... -
12
Void Editor
Open source AI IDE and Cursor alternative
Void is an open-source, AI-powered code editor built as a fork of Visual Studio Code. Designed as a fully transparent and privacy-focused alternative to Cursor or GitHub Copilot, it lets you use AI models locally or via APIs (OpenAI, Claude, Gemini, Ollama, etc.)—without routing data through proprietary servers. Developed by YC-backed startup Glass Devtools, it supports traditional coding features inherited from VS Code, enhanced with in-editor LLM capabilities—autocomplete, inline quick... -
13
BricksLLM
Enterprise-grade API gateway that helps you monitor and impose cost
BricksLLM is an open-source framework for building and managing production-ready LLM (Large Language Model) applications. It provides tooling for prompt engineering, memory management, observability, and chaining, all in one unified developer experience. BricksLLM is designed to reduce boilerplate and increase the maintainability of LLM-based workflows. -
14
Beta9
Run serverless GPU workloads with fast cold starts on bare-metal
beta9 is a platform that enables running serverless GPU workloads with fast cold starts on bare-metal servers globally. It allows developers to deploy and scale GPU-accelerated applications without managing underlying infrastructure, offering flexibility and efficiency for AI and high-performance computing tasks. beta9 supports various frameworks and provides tools for monitoring and managing deployments effectively. -
15
ControlFlow
Take control of your AI agents
...ControlFlow focuses on maintaining transparency and control in AI applications by providing explicit workflow structures instead of opaque chains of prompts. The system integrates with common LLM providers and allows developers to create workflows that blend traditional software logic with AI-driven reasoning. Built on top of the Prefect ecosystem, the framework also includes observability and debugging capabilities that allow developers to monitor how tasks are executed. -
16
GLM-5
From Vibe Coding to Agentic Engineering
GLM-5 is a next-generation open-source large language model (LLM) developed by the Z .ai team under the zai-org organization that pushes the boundaries of reasoning, coding, and long-horizon agentic intelligence. Building on earlier GLM series models, GLM-5 dramatically scales the parameter count (to roughly 744 billion) and expands pre-training data to significantly improve performance on complex tasks such as multi-step reasoning, software engineering workflows, and agent orchestration compared to its predecessors like GLM-4.5. ... -
17
LlamaIndexTS
Data framework for your LLM applications
LlamaIndexTS is a data framework designed for Large Language Model (LLM) applications, focusing on server-side solutions to manage and process data efficiently. -
18
Synthetic Data Generator
SDG is a specialized framework
Synthetic Data Generator is an open-source framework designed to generate high-quality synthetic tabular datasets that replicate the statistical characteristics of real data while avoiding privacy risks. The platform enables developers and data scientists to create artificial datasets that preserve important relationships between variables without containing sensitive personal information. This makes the generated data suitable for tasks such as machine learning model training, testing... -
19
Strix
Open-source AI hackers to find and fix your app’s vulnerabilities
Strix is an open source agent-driven security platform that uses autonomous AI agents to identify, investigate, and validate vulnerabilities in software applications. The system is designed to mimic the behavior of real attackers by executing dynamic testing and verifying findings through proof-of-concept exploitation. Unlike traditional vulnerability scanners that rely heavily on static analysis, Strix agents actively run code, probe systems, and attempt exploitation to confirm whether... -
20
Prompt Declaration Language
Prompt Declaration Language is a declarative prompt programming lang
LLMs will continue to change the way we build software systems. They are not only useful as coding assistants, providing snipets of code, explanations, and code transformations, but they can also help replace components that could only previously be achieved with rule-based systems. Whether LLMs are used as coding assistants or software components, reliability remains an important concern. LLMs have a textual interface and the structure of useful prompts is not captured formally. Programming... -
21
ONNX Runtime
ONNX Runtime: cross-platform, high performance ML inferencing
ONNX Runtime is a cross-platform inference and training machine-learning accelerator. ONNX Runtime inference can enable faster customer experiences and lower costs, supporting models from deep learning frameworks such as PyTorch and TensorFlow/Keras as well as classical machine learning libraries such as scikit-learn, LightGBM, XGBoost, etc. ONNX Runtime is compatible with different hardware, drivers, and operating systems, and provides optimal performance by leveraging hardware accelerators... -
22
TypedAI
TypeScript AI platform with AI chat, Autonomous agents
...Written in TypeScript, the platform emphasizes strong typing and structured development patterns to improve reliability when building AI-driven systems. TypedAI includes tools for building chat interfaces, managing LLM interactions, and orchestrating multi-step workflows that combine AI reasoning with external tools. The platform also includes specialized software engineering agents that can assist with tasks such as code reviews or repository analysis. Developers can integrate multiple model providers and tools into the platform to create flexible agent pipelines. -
23
12-Factor Agents
What are the principles we can use to build LLM-powered software
12-Factor Agents is a conceptual engineering guide that defines a set of principles for building reliable, scalable, and maintainable LLM-powered applications. Inspired by the original Twelve-Factor App methodology, the project reframes best practices specifically for agentic systems and AI software. It outlines patterns such as treating prompts as first-class assets, owning the context window, and converting natural language into structured tool calls. The repository emphasizes operational discipline, arguing that even as models improve, strong engineering patterns remain essential for production-grade AI systems. ... -
24
tt-metal
TT-NN operator library, and TT-Metalium low level kernel programming
tt-metal, also referred to in its documentation as TT-Metalium, is Tenstorrent’s low-level software development kit for programming applications on Tenstorrent AI accelerators. The project is designed for developers who need direct access to the company’s Tensix processor architecture, exposing a programming model that is closer to hardware control than high-level inference frameworks. Instead of following a traditional GPU model centered on massive thread parallelism, the platform is built... -
25
Mini Jinja
MiniJinja is a powerful but minimal dependency template engine
MiniJinja is a minimal-dependency template engine based on the syntax and behavior of Python’s Jinja2. It is implemented primarily for Rust and also has Go, JavaScript, Python, C, and CLI-related components. The project supports Jinja-style templates, inheritance, filters, expressions, dynamic objects, and serde-compatible data. It is designed to stay close to Jinja2 while keeping compile times, dependencies, and API surface manageable for Rust programs. MiniJinja can also be used as a small...
