Search Results for "llm software" - Page 4
Sort By:
Showing 95 open source projects for "llm software"
View related business solutions-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
Paessler: Easy to Use With Enterprise Power. Free TrialYou shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
-
1
LoopTroop
Free, open-source local GUI orchestrator for AI coding.
LoopTroop is a local-first, open-source GUI app for running complex AI coding tickets from start to finish across multiple projects. Instead of one long chat that suffers context rot, an LLM Council plans the work, atomic Beads run in isolated git worktrees, and Ralph Loops retry failed steps with fresh context. The result is a transparent, auditable workflow from ticket to reviewable PR, with logs and artifacts visible in one pane. -
2
Temporal Inference Engine
A real time inference engine for temporal logical specifications
A real time inference engine for temporal logical specifications, which is able to acquire, process and generate any binary or real signal through POSIX IPC, files or UNIX sockets. Specifications of signals and dynamic systems are represented as special graphs and executed in real time, with a predictable sampling time of few milliseconds. Real time signal processing, dynamic system control, state machine modeling and logical property verification are some fields of application of this... -
3
Astro Stardrive Boilerplate
The Astro boilerplate to create super stable websites even faster
Stardrive is a batteries-included Astro boilerplate built for the AI age. It skips the first 36 steps of creating a high-class website, giving you a fast, secure, accessible, and SEO-optimized foundation without reinventing the wheel. What makes it special: it is LLM-friendly by design, with dedicated AI guidance files so coding assistants immediately understand the project. It also prepares your site for WebMCP, auto-populates an llms.txt, and generates Schema.org structured data... -
4
LangChain for .NET
C# implementation of LangChain
LangChain .NET is a C# implementation of the LangChain framework that enables developers to build LLM-powered applications using the .NET ecosystem. The project aims to replicate the core abstractions of LangChain, such as chains, agents, and vector stores, while adapting them to the conventions and strengths of C#. It emphasizes composability, allowing developers to build complex workflows by combining modular components that interact with language models and external data sources. The... -
Build Securely on Azure with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
gptstudio
GPT RStudio addins that enable GPT assisted coding, writing & analysis
gptstudio is an R package and RStudio Addins interface that enables interactive use of large language models (OpenAI, HuggingFace, etc.) from within R. It includes a Chat add-in and source editing helpers to query models, generate code, comment or refactor code, and manage conversations—all integrated into RStudio using Shiny and bslib. -
6
MegEngine
Easy-to-use deep learning framework with 3 key features
MegEngine is a fast, scalable and easy-to-use deep learning framework with 3 key features. You can represent quantization/dynamic shape/image pre-processing and even derivation in one model. After training, just put everything into your model and inference it on any platform at ease. Speed and precision problems won't bother you anymore due to the same core inside. In training, GPU memory usage could go down to one-third at the cost of only one additional line, which enables the DTR... -
7
MMDeploy
OpenMMLab Model Deployment Framework
MMDeploy is an open-source deep learning model deployment toolset. It is a part of the OpenMMLab project. Models can be exported and run in several backends, and more will be compatible. All kinds of modules in the SDK can be extended, such as Transform for image processing, Net for Neural Network inference, Module for postprocessing and so on. Install and build your target backend. ONNX Runtime is a cross-platform inference and training accelerator compatible with many popular ML/DNN... -
8
towhee
Framework that is dedicated to making neural data processing
Towhee is an open-source machine-learning pipeline that helps you encode your unstructured data into embeddings. You can use our Python API to build a prototype of your pipeline and use Towhee to automatically optimize it for production-ready environments. From images to text to 3D molecular structures, Towhee supports data transformation for nearly 20 different unstructured data modalities. We provide end-to-end pipeline optimizations, covering everything from data decoding/encoding, to... -
9
pipeless
A computer vision framework to create and deploy apps in minutes
Pipeless is an open-source computer vision framework to create and deploy applications without the complexity of building and maintaining multimedia pipelines. It ships everything you need to create and deploy efficient computer vision applications that work in real-time in just minutes. Pipeless is inspired by modern serverless technologies. It provides the development experience of serverless frameworks applied to computer vision. You provide some functions that are executed for new... -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
spaGO
Self-contained Machine Learning and Natural Language Processing lib
A Machine Learning library written in pure Go designed to support relevant neural architectures in Natural Language Processing. Spago is self-contained, in that it uses its own lightweight computational graph both for training and inference, easy to understand from start to finish. The core module of Spago relies only on testify for unit testing. In other words, it has "zero dependencies", and we are committed to keeping it that way as much as possible. Spago uses a multi-module workspace to... -
11
LangChain Apps on Production with Jina
Langchain Apps on Production with Jina & FastAPI
Jina is an open-source framework for building scalable multi-modal AI apps on Production. LangChain is another open-source framework for building applications powered by LLMs. long-chain-serve helps you deploy your LangChain apps on Jina AI Cloud in a matter of seconds. You can benefit from the scalability and serverless architecture of the cloud without sacrificing the ease and convenience of local development. And if you prefer, you can also deploy your LangChain apps on your own... -
12
LLM React App Javascript Template
The Javascript template for an LLM react node app
This template is an example project for a simple Large Language Model (LLM) application built on top of React and Node. This template was built on top of the React template app from nano-react-app and updated with a Node server that uses HuggingFace.js and LangChain.js to connect to supported large language models. Use this template to easily build and run an LLM app. -
13
KotlinDL
High-level Deep Learning Framework written in Kotlin
KotlinDL is a high-level Deep Learning API written in Kotlin and inspired by Keras. Under the hood, it uses TensorFlow Java API and ONNX Runtime API for Java. KotlinDL offers simple APIs for training deep learning models from scratch, importing existing Keras and ONNX models for inference, and leveraging transfer learning for tailoring existing pre-trained models to your tasks. This project aims to make Deep Learning easier for JVM and Android developers and simplify deploying deep learning... -
14
ReactAgent
The open-source React.js Autonomous LLM Agent
React-Agent is a framework for integrating AI-driven agents into React applications. It provides an intuitive way to build interactive UI components powered by AI models, enabling dynamic and intelligent user interfaces. -
15
Alpa
Training and serving large-scale neural networks
Alpa is a system for training and serving large-scale neural networks. Scaling neural networks to hundreds of billions of parameters has enabled dramatic breakthroughs such as GPT-3, but training and serving these large-scale neural networks require complicated distributed system techniques. Alpa aims to automate large-scale distributed training and serving with just a few lines of code. -
16
SageMaker MXNet Inference Toolkit
Toolkit for allowing inference and serving with MXNet in SageMaker
SageMaker MXNet Inference Toolkit is an open-source library for serving MXNet models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain MXNet model types and utilizes the SageMaker Inference Toolkit for starting up the model server, which is responsible for handling inference requests. AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet. Deep... -
17
MACE
Deep learning inference framework optimized for mobile platforms
Mobile AI Compute Engine (or MACE for short) is a deep learning inference framework optimized for mobile heterogeneous computing on Android, iOS, Linux and Windows devices. Runtime is optimized with NEON, OpenCL and Hexagon, and Winograd algorithm is introduced to speed up convolution operations. The initialization is also optimized to be faster. Chip-dependent power options like big.LITTLE scheduling, Adreno GPU hints are included as advanced APIs. UI responsiveness guarantee is sometimes... -
18
TNN
Uniform deep learning inference framework for mobile
TNN, a high-performance, lightweight neural network inference framework open sourced by Tencent Youtu Lab. It also has many outstanding advantages such as cross-platform, high performance, model compression, and code tailoring. The TNN framework further strengthens the support and performance optimization of mobile devices on the basis of the original Rapidnet and ncnn frameworks. At the same time, it refers to the high performance and good scalability characteristics of the industry's... -
19
BudgetML
Deploy a ML inference service on a budget in 10 lines of code
Deploy a ML inference service on a budget in less than 10 lines of code. BudgetML is perfect for practitioners who would like to quickly deploy their models to an endpoint, but not waste a lot of time, money, and effort trying to figure out how to do this end-to-end. We built BudgetML because it's hard to find a simple way to get a model in production fast and cheaply. Deploying from scratch involves learning too many different concepts like SSL certificate generation, Docker, REST,... -
20
KonsolScript: Automate and Orchestrate
Embeddable scripting runtime for live behavior, AI, and automation.
KonsolScript is an embeddable scripting runtime for games, tools, automation, and AI-driven applications. Add a live scripting layer to any C++ application. Hot-reload behavior, patch running apps, and orchestrate AI workflows - without rebuilding or redeploying the binary. Ship once. Evolve forever. Key capabilities: - Embed into any C++ app with a single header - Hot-reload scripts at runtime without restarting - AI-safe: validate or reject scripts before execution -...
