llama2-webui

Running Llama 2 with gradio web UI on GPU or CPU from anywhere (Linux/Windows/Mac).

Features

Supporting all Llama 2 models (7B, 13B, 70B, GPTQ, GGML) with 8-bit, 4-bit mode
Use llama2-wrapper as your local llama2 backend for Generative Agents/Apps; colab example
Run OpenAI Compatible API on Llama2 models
Supporting models: Llama-2-7b/13b/70b, all Llama-2-GPTQ, all Llama-2-GGML
Supporting model backends: tranformers, bitsandbytes(8-bit inference), AutoGPTQ(4-bit inference), llama.cpp
Demos: Run Llama2 on MacBook Air; Run Llama2 on free Colab T4 GPU

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow llama2-webui

llama2-webui Web Site

Other Useful Business Software

Veeam Data Platform v13.1 - Get Your Free Trial

Secure by design, portable by default. Recover clean, fast, anywhere. Start a free trial.

Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.

Try it Free

Rate This Project

User Reviews

Be the first to post a review of llama2-webui!

Additional Project Details

Programming Language

Python

Related Categories

Python Large Language Models (LLM), Python LLM Inference Tool

Registered

2023-08-25

Similar Business Software

Gemini Enterprise Agent Platform

Gemini Enterprise Agent Platform is a comprehensive solution from Google Cloud designed to help organizations build, scale, govern, and optimize AI agents. It represents the evolution of Vertex AI, combining advanced model development with new capabilities for agent orchestration and...

See Software
LM-Kit.NET

LM-Kit.NET is a complete local AI runtime for .NET that lets engineering teams ship AI-powered features without cloud dependencies, per-token costs, or data leaving the network. Most .NET AI integrations stop at inference. LM-Kit.NET covers the full range of capabilities production...

See Software
Google AI Studio

Google AI Studio is a unified development platform that helps teams explore, build, and deploy applications using Google’s most advanced AI models. It brings text, image, audio, and video models together in one interactive playground. With vibe coding, developers can use natural language to...

See Software
Runpod

Runpod offers a cloud-based platform designed for running AI workloads, focusing on providing scalable, on-demand GPU resources to accelerate machine learning (ML) model training and inference. With its diverse selection of powerful GPUs like the NVIDIA A100, RTX 3090, and H100, Runpod supports...

See Software
Muse Spark 1.2

Muse Spark 1.2 is Meta’s coding-focused model update designed to power Muse Code and improve software engineering workflows. The model is built for code generation, complex debugging, codebase understanding, long-horizon development tasks, and end-to-end developer workflows. Muse Spark 1.2 was...

See Software
GLM-5.3

GLM-5.3 is Z.ai’s frontier coding model designed for complex software engineering, long-horizon agent tasks, and advanced post-training research. The model uses the same base model as GLM-5.2, with improvements coming from scaled post-training across more environments, more diverse tasks, and...

See Software

Report inappropriate content

llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere

Features

Project Samples

Project Activity

Categories

License

Follow llama2-webui

User Reviews

Additional Project Details

Programming Language

Related Categories

Registered