Search Results for "llama-cpp-python.whl"
Sort By:
Showing 171 open source projects for "llama-cpp-python.whl"
View related business solutions-
Cloud-based help desk software with ServoDeskWhat if You Could Automate 90% of Your Repetitive Tasks in Under 30 Days? At ServoDesk, we help businesses like yours automate operations with AI, allowing you to cut service times in half and increase productivity by 25% - without hiring more staff.
-
Keep company data safe with Chrome EnterpriseMake AI work your way with Chrome Enterprise. Block unapproved sites and set custom data controls that align with your company's policies.
-
1
llama.cpp
Port of Facebook's LLaMA model in C/C++
The llama.cpp project enables the inference of Meta's LLaMA model (and other models) in pure C/C++ without requiring a Python runtime. It is designed for efficient and fast model execution, offering easy integration for applications needing LLM-based capabilities. The repository focuses on providing a highly optimized and portable implementation for running large language models directly within C/C++ environments. -
2
cpp-httplib
A C++ header-only HTTP/HTTPS server and client library
...If your program needs to avoid being terminated on SIGPIPE, the only fully general way might be to set up a signal handler for SIGPIPE to handle or ignore it yourself. cpp-httplib officially supports only the latest Visual Studio. It might work with former versions of Visual Studio, but I can no longer verify it. -
3
Distributed Llama
Connect home devices into a powerful cluster to accelerate LLM
Distributed Llama is an open-source project that enables users to connect multiple home devices into a powerful cluster to accelerate Large Language Model (LLM) inference. By leveraging tensor parallelism and high-speed synchronization over Ethernet, it allows for faster performance as more devices are added to the cluster. The system supports various operating systems, including Linux, macOS, and Windows, and is optimized for both ARM and x86_64 AVX2 CPUs. -
4
tgbot-cpp
C++ library for Telegram bot API
C++ library for Telegram bot API. -
Grafana: The open and composable observability platformGrafana is the open source analytics & monitoring solution for every database.
-
5
Skiplist-CPP
A tiny KV storage based on skiplist written in C++ language
Skiplist-CPP is a lightweight key-value storage engine implemented in C++ using a skip list as its core data structure. It showcases how a log-structured, ordered index can deliver fast inserts, lookups, and deletes while remaining simple to implement and reason about. The project supplies a compact codebase with a clear separation between the skip list implementation and the storage operations that use it. -
6
Cpp-Peglib
A single file C++ header-only PEG (Parsing Expression Grammars)
cpp-peglib is a single-file, header-only C++17 library for Parsing Expression Grammars (PEG). It enables developers to define grammars and build parsers directly within C++ code without external dependencies. -
7
pytorch-cpp
C++ Implementation of PyTorch Tutorials for Everyone
C++ Implementation of PyTorch Tutorials for Everyone. This repository provides tutorial code in C++ for deep learning researchers to learn PyTorch (i.e. Section 1 to 3) Interactive Tutorials are currently running on LibTorch Nightly Version. Libtorch only supports 64bit Windows and an x64 generator needs to be specified. Create all required script module files for pre-learned models/weights during the build. Requires installed python3 with PyTorch and torch-vision. You can choose to only... -
8
cpp-ipc
C++ IPC Library: A high-performance inter-process communication
C++ IPC Library: A high-performance inter-process communication using shared memory on Linux/Windows. -
9
restc-cpp C++ library
Modern C++ REST Client library
The magic that takes the pain out of accessing JSON API's from C++. It formulates a HTTP request to a REST API server. Then, it transforms the JSON formatted payload in the reply into a native C++ object (GET). It Serializes a native C++ object or a container of C++ objects into a JSON payload and sends it to the REST API server (POST, PUT). It formulates an HTTP request to the REST API without serializing any data in either direction (typically DELETE). It uploads a stream of data, like a... -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
10
RedPanda C++
A powerful, lighweight and cross-platform C/C++ IDE
Red Panda C++ is a lightweight yet powerful C/C++/GNU Assembly IDE. It provides users with coding experiences like vs code and CLion, but is much lightweighted than them. Highlights of its new and enhanced feature: * High DPI support * Code intellisense (Code Completion suggestion while editing). * Syntax checking while editing * Greatly improved debugger (local \ call stack \ memory view) * Theme and color scheme. * UTF-8 encoding support * Greatly improved search/replace... -
11
GPT4All
Run Local LLMs on Any Device. Open-source
GPT4All is an open-source project that allows users to run large language models (LLMs) locally on their desktops or laptops, eliminating the need for API calls or GPUs. The software provides a simple, user-friendly application that can be downloaded and run on various platforms, including Windows, macOS, and Ubuntu, without requiring specialized hardware. It integrates with the llama.cpp implementation and supports multiple LLMs, allowing users to interact with AI models privately. This... -
12
gradle-cpp
Intended to make Gradle C++ working more comfortable.
-
13
llamafile
Distribute and run LLMs with a single file
...We're doing that by combining llama.cpp with Cosmopolitan Libc into one framework that collapses all the complexity of LLMs down to a single-file executable (called a "llamafile") that runs locally on most computers, with no installation. The easiest way to try it for yourself is to download our example llamafile for the LLaVA model (license: LLaMA 2, OpenAI). LLaVA is a new LLM that can do more than just chat; you can also upload images and ask it questions about them. With llamafile, this all happens locally; no data ever leaves your computer. -
14
VoxelCore
Voxel game engine in C++ with OpenGL
VoxelEngine-Cpp is a minimal voxel engine written in modern C++ using OpenGL, GLFW, and GLM, inspired by Minecraft-style block worlds. It offers a clean foundation for learning and experimenting with voxel-based rendering and world generation. With features like chunk loading, perlin noise terrain generation, and basic lighting, the engine is a perfect starting point for developers who want to create sandbox games or explore the technical aspects of 3D voxel environments. -
15
far2l
Linux port of FAR v2
Linux fork of FAR Manager v2. Works also on OSX/MacOS and BSD (but the latter is not tested on a regular manner). Plug-ins that are currently working: NetRocks (SFTP/SCP/FTP/FTPS/SMB/NFS/WebDAV), colorer, multiarc, tmppanel, align, autowrap, drawing, edit case, SimpleIndent, Calculator, Python (optional scripting support). -
16
AWS IoT Device SDK for C++ v2
Next generation AWS IoT Client SDK for C++ using AWS Common Runtime
...This SDK is built on the AWS Common Runtime, a collection of libraries (AWS-c-common, aws-c-io, aws-c-mqtt, aws-c-http, aws-c-cal, aws-c-auth, s2n...) written in C to be cross-platform, high-performance, secure, and reliable. The libraries are bound to C++ by the AWS-crt-CPP package. -
17
C++ lectures in russian
Open lectures in C++
Открытые лекции по C++ являются многолетним конспектом соответствующего учебного курса, с существенными расширениями (о которых можно судить по приложенному плану курса). Проект служит основой для преподавания современного C++, а также постоянно обновляется по мере обновления языка. Этот материал в перспективе должен стать лучшим бесплатным русскоязычным учебником по C++ -
18
Vigenère
A powerful tool for cracking the Vigenère cipher
Vigenère is a program for encrypting and decrypting text using the Vigenère cipher. Built-in cryptanalysis tools make it possible to crack the cipher without needing the key — or even knowing its length. -
19
Portable Cpp Sound OpenAL
cross-platform sound-playing package for C++ apps
This is a cross-platform sound-playing package for C++ apps that can asynchronously start and stop music loops, as well as initiate transient sounds. It plays WAV files, via OpenAL, on Windows, OSX, and linux platforms. It is suitable for any Cpp application that needs music, sound loops or transient sound effects; eg. games. -
20
cppEditor
Text editor created with cpp
cppEditor is a lightweight application that uses cpp language under the hood. The objective of this app is to create/edit text files, with code or normal text files. If you find this application useful please help us improve it by donating using the following link: https://paypal.me/arkneid -
21
AI File Sorter
AI File Sorter uses AI to help you organize your files and folders
...When you're ready, AI FileSorter creates the right folder structure and moves everything into place for you. You can use a remote AI model or download a local one (like Mistral 7B or LLaMa 3B) for faster, private file sorting - your choice. -
22
NetJoy
Network gamepad/joystick
...This project is available in two versions: a console-based version and a version with a Textual User Interface (tUI). Versions are cross compatible. Requires latest MSVC Redistributable https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist?view=msvc-170#visual-studio-2015-2017-2019-and-2022 Requires ViGEm Bus Driver for game pad emulation on host machine. https://github.com/ViGEm/ViGEmBus -
23
GCCE4Symbian
Provide latest GNU toolchain for Symbian developers
Provides bleeding-edge GNU toolchain for Symbian. GCC still supports Symbian therefore project active. All thanks for me and my hard-work GCC still supports Symbian. Benefits: moderm libraries require new compiler features and languange standarts. More software will be coming to small old phones! Binutils and GDB stop support Symbian and last provided versions are 2.29.1 and 10.2 -
24
Mocker++11
C++ Mock object auto generator
...What you need is to run the generator and full featured mock class is there for your unit test. ---- How to use: You need Ruby. Obtain it if you don't have it yet. Get Tools At your convenient directory: git clone https://git.code.sf.net/p/cpp-tools-in-ruby/code tools Get Mocker++11 git clone https://git.code.sf.net/p/mockerplusplus11/code mocker++ Run it Change directory to mocker++ ./Mocker++ --help (On Mac/Unix, you may need to run dos2unix) Code samples (unit test codes) are found in 'unittest/MockerppTest -
25
DocWire SDK
Award-winning modern data processing SDK in C++20
DocWire SDK, a standout C++20AI driven data processing tool, has received award from SourceForge and strong backing from Microsoft. It handles nearly 100 file types, empowering efficient text extraction, web data extraction, and document analysis. For businesses, the shift to DocWire SDK signifies a leap forward. It promises comprehensive document format support and the ability to extract valuable insights from email boxes, databases, and websites using cutting-edge AI. DocWire SDK aims to...
