Search Results for "llama-cpp-static"
Sort By:
Showing 379 open source projects for "llama-cpp-static"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
1
Distributed Llama
Connect home devices into a powerful cluster to accelerate LLM
Distributed Llama is an open-source project that enables users to connect multiple home devices into a powerful cluster to accelerate Large Language Model (LLM) inference. By leveraging tensor parallelism and high-speed synchronization over Ethernet, it allows for faster performance as more devices are added to the cluster. The system supports various operating systems, including Linux, macOS, and Windows, and is optimized for both ARM and x86_64 AVX2 CPUs. -
2
cpp-httplib
A C++ header-only HTTP/HTTPS server and client library
...If your program needs to avoid being terminated on SIGPIPE, the only fully general way might be to set up a signal handler for SIGPIPE to handle or ignore it yourself. cpp-httplib officially supports only the latest Visual Studio. It might work with former versions of Visual Studio, but I can no longer verify it. -
3
llama.cpp
Port of Facebook's LLaMA model in C/C++
The llama.cpp project enables the inference of Meta's LLaMA model (and other models) in pure C/C++ without requiring a Python runtime. It is designed for efficient and fast model execution, offering easy integration for applications needing LLM-based capabilities. The repository focuses on providing a highly optimized and portable implementation for running large language models directly within C/C++ environments. -
4
pytorch-cpp
C++ Implementation of PyTorch Tutorials for Everyone
C++ Implementation of PyTorch Tutorials for Everyone. This repository provides tutorial code in C++ for deep learning researchers to learn PyTorch (i.e. Section 1 to 3) Interactive Tutorials are currently running on LibTorch Nightly Version. Libtorch only supports 64bit Windows and an x64 generator needs to be specified. Create all required script module files for pre-learned models/weights during the build. Requires installed python3 with PyTorch and torch-vision. You can choose to only... -
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
5
Cpp-Peglib
A single file C++ header-only PEG (Parsing Expression Grammars)
cpp-peglib is a single-file, header-only C++17 library for Parsing Expression Grammars (PEG). It enables developers to define grammars and build parsers directly within C++ code without external dependencies. -
6
tgbot-cpp
C++ library for Telegram bot API
C++ library for Telegram bot API. -
7
cpp-ipc
C++ IPC Library: A high-performance inter-process communication
C++ IPC Library: A high-performance inter-process communication using shared memory on Linux/Windows. -
8
Skiplist-CPP
A tiny KV storage based on skiplist written in C++ language
Skiplist-CPP is a lightweight key-value storage engine implemented in C++ using a skip list as its core data structure. It showcases how a log-structured, ordered index can deliver fast inserts, lookups, and deletes while remaining simple to implement and reason about. The project supplies a compact codebase with a clear separation between the skip list implementation and the storage operations that use it. -
9
restc-cpp C++ library
Modern C++ REST Client library
The magic that takes the pain out of accessing JSON API's from C++. It formulates a HTTP request to a REST API server. Then, it transforms the JSON formatted payload in the reply into a native C++ object (GET). It Serializes a native C++ object or a container of C++ objects into a JSON payload and sends it to the REST API server (POST, PUT). It formulates an HTTP request to the REST API without serializing any data in either direction (typically DELETE). It uploads a stream of data, like a... -
AI-generated apps that pass security reviewRetool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
-
10
RedPanda C++
A powerful, lighweight and cross-platform C/C++ IDE
Red Panda C++ is a lightweight yet powerful C/C++/GNU Assembly IDE. It provides users with coding experiences like vs code and CLion, but is much lightweighted than them. Highlights of its new and enhanced feature: * High DPI support * Code intellisense (Code Completion suggestion while editing). * Syntax checking while editing * Greatly improved debugger (local \ call stack \ memory view) * Theme and color scheme. * UTF-8 encoding support * Greatly improved search/replace... -
11
btop
A monitor of resources
...It supports mouse controls, filters, signal sending (SIGTERM/KILL), theme customization, GPU, battery support, and runs on Linux, macOS, BSD (with specific builds), via static binaries linked with musl. -
12
llamafile
Distribute and run LLMs with a single file
...We're doing that by combining llama.cpp with Cosmopolitan Libc into one framework that collapses all the complexity of LLMs down to a single-file executable (called a "llamafile") that runs locally on most computers, with no installation. The easiest way to try it for yourself is to download our example llamafile for the LLaVA model (license: LLaMA 2, OpenAI). LLaVA is a new LLM that can do more than just chat; you can also upload images and ask it questions about them. With llamafile, this all happens locally; no data ever leaves your computer. -
13
RTP-LLM
Alibaba's high-performance LLM inference engine for diverse apps
...The framework is designed for large-scale AI services and is already used internally across several Alibaba platforms such as Taobao, Amap, and other business systems that rely on conversational or search-related AI services. RTP-LLM supports a wide variety of modern model architectures, including Qwen, DeepSeek, and Llama-based models, making it a flexible engine for deploying many different open-source LLMs. -
14
GPT4All
Run Local LLMs on Any Device. Open-source
GPT4All is an open-source project that allows users to run large language models (LLMs) locally on their desktops or laptops, eliminating the need for API calls or GPUs. The software provides a simple, user-friendly application that can be downloaded and run on various platforms, including Windows, macOS, and Ubuntu, without requiring specialized hardware. It integrates with the llama.cpp implementation and supports multiple LLMs, allowing users to interact with AI models privately. This... -
15
cpp-mate
Helpful library for C++.
The library contains classes that can be useful in addition to STL. -
16
gradle-cpp
Intended to make Gradle C++ working more comfortable.
-
17
PuerTS
Write your game with TypeScript in UE or Unity
...Facilitates game-building processes by combining JavaScript ecosystem with the rendering power of professional game engines. In contrast to lua script, TypeScript supports static type checking, which significantly improves code robustness and maintainability. High efficiency: supports reflection binding throughout the platform (engine), no extra steps (code generation) needed for development. High performance supports static binding throughout the platform (engine), takes care of complex scenes. -
18
far2l
Linux port of FAR v2
Linux fork of FAR Manager v2. Works also on OSX/MacOS and BSD (but the latter is not tested on a regular manner). Plug-ins that are currently working: NetRocks (SFTP/SCP/FTP/FTPS/SMB/NFS/WebDAV), colorer, multiarc, tmppanel, align, autowrap, drawing, edit case, SimpleIndent, Calculator, Python (optional scripting support). -
19
VoxelCore
Voxel game engine in C++ with OpenGL
VoxelEngine-Cpp is a minimal voxel engine written in modern C++ using OpenGL, GLFW, and GLM, inspired by Minecraft-style block worlds. It offers a clean foundation for learning and experimenting with voxel-based rendering and world generation. With features like chunk loading, perlin noise terrain generation, and basic lighting, the engine is a perfect starting point for developers who want to create sandbox games or explore the technical aspects of 3D voxel environments. -
20
N64: Recompiled
Tool to statically recompile N64 games into native executables
N64: Recompiled is an open-source recompilation framework designed to translate Nintendo 64 game binaries into modern, portable C code that can be compiled and executed natively on contemporary systems. Instead of relying on traditional emulation, which interprets instructions at runtime, N64Recomp focuses on static recompilation, converting MIPS-based N64 binaries into readable and buildable source code. This approach allows developers to run classic games with improved performance, lower latency, and better integration with modern hardware and operating systems. The framework provides tools for analyzing ROMs, reconstructing program logic, and generating code that preserves the original game’s behavior while enabling modifications and enhancements. ... -
21
Soufflé
Datalog variant for tool designers crafting analyses in Horn clauses
Rapid prototyping for your analysis problems with logic; enabling deep design-space explorations; designed for large-scale static analysis; e.g., points-to analysis for Java, taint-analysis, and security checks. Futamura projections/partial evaluation for effective translation to parallel C++; optimized staged compilation; specialized data-structures for logical relations. Efficient translation to parallel C++ of Datalog programs (CAV'16, CC'16) Efficient interpretation using de-specialization techniques (PLDI'21) Specialized data structure for relations (PACT'19, PPoPP'19, PMAM'19) with optimal index selection (VLDB'18) Extended semantics of Datalog, e.g., permitting unbounded recursions with numbers and terms. ... -
22
Magic Enum C++
Static reflection for enums (to string, from string, iteration)
Static reflection for enums (to string, from string, iteration) for modern C++, work with any enum type without any macro or boilerplate code. magic_enum does not pretend to be a silver bullet for reflection for enums, it was originally designed for small enum. If you are using vcpkg on your project for external dependencies, then you can use the magic-enum package. -
23
JarkViewer
A lightweight, lightning-fast, and powerful image viewer
JarkViewer is a lightweight, lightning‑fast image viewer for Windows 10/11 (64‑bit) that supports a wide range of modern image formats, from traditional JPEG/PNG to newer types such as AVIF, HEIC, JPEG XL, and various RAW files. It is designed as a native portable application with fully static linking, distributed as a single executable with no separate installer, making it simple to run from any folder or removable drive. The viewer handles static images, animated formats (GIF, animated WebP/PNG/APNG/JXL/AVIF), and special “live” photo types such as iOS Live Photos (.livp) and Android Motion Photos/Micro Videos, although audio playback for live photos is not yet supported. ... -
24
RunAnywhere
Production ready toolkit to run AI locally
...By running models entirely on device, the platform eliminates network latency and protects user data because information does not leave the device. The SDK supports popular open-source models such as Llama, Mistral, and Qwen, enabling developers to build AI-powered features such as chat interfaces and voice assistants with minimal external dependencies. It also includes integrated pipelines that combine speech-to-text, large language models, and text-to-speech into a complete conversational system. -
25
AWS IoT Device SDK for C++ v2
Next generation AWS IoT Client SDK for C++ using AWS Common Runtime
...This SDK is built on the AWS Common Runtime, a collection of libraries (AWS-c-common, aws-c-io, aws-c-mqtt, aws-c-http, aws-c-cal, aws-c-auth, s2n...) written in C to be cross-platform, high-performance, secure, and reliable. The libraries are bound to C++ by the AWS-crt-CPP package.
