Download
Run a fast ChatGPT-like model locally on your device. This combines the LLaMA foundation model with an open reproduction of Stanford Alpaca a fine-tuning of the base model to obey instructions (akin to the RLHF used to train ChatGPT) and a set of modifications to llama.cpp to add a chat interface. Download the zip file corresponding to your operating system from the latest release. The weights are based on the published fine-tunes from alpaca-lora, converted back into a PyTorch checkpoint with a modified script and then quantized with llama.cpp the regular way.
Features
- Run a fast ChatGPT-like model locally on your device
- If you have more than 10GB of RAM, you can use the higher quality 13B model
- Combines the LLaMA foundation model with an open reproduction of Stanford Alpaca
- The weights are based on the published fine-tunes from alpaca-lora,
- You can add other launch options
- You can now type to the AI in the terminal and it will reply
Project Samples
License
MIT LicenseFollow Alpaca.cpp
Other Useful Business Software
$300 Free Credits for Your Google Cloud Projects
Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
Rate This Project
Login To Rate This Project
User Reviews
-
Really great for running a ChatGPT-style model on my own device.