Download
Running Llama 2 with gradio web UI on GPU or CPU from anywhere (Linux/Windows/Mac).
Features
- Supporting all Llama 2 models (7B, 13B, 70B, GPTQ, GGML) with 8-bit, 4-bit mode
- Use llama2-wrapper as your local llama2 backend for Generative Agents/Apps; colab example
- Run OpenAI Compatible API on Llama2 models
- Supporting models: Llama-2-7b/13b/70b, all Llama-2-GPTQ, all Llama-2-GGML
- Supporting model backends: tranformers, bitsandbytes(8-bit inference), AutoGPTQ(4-bit inference), llama.cpp
- Demos: Run Llama2 on MacBook Air; Run Llama2 on free Colab T4 GPU
Project Samples
License
MIT LicenseFollow llama2-webui
Other Useful Business Software
Demo Series - Small Business Backup By Veeam
Watch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of llama2-webui!
