DownloadEasy-to-use headless React Hooks to run LLMs in the browser with WebGPU. As simple as useLLM().
Features
- Supports Vicuna 7B
- Use custom system prompts and "user:"/"assistant:" role names
- Completion options like max tokens and stop sequences
- No data leaves the browser. Accelerated via WebGPU
- Hooks built to 'Bring your own UI'
- Persistent storage for conversations in browser storage. Hooks for loading and saving conversations
Project Samples
Categories
Large Language Models (LLM)License
MIT LicenseFollow react-llm
You Might Also Like
Our Free Plans just got better! | Auth0 by Okta
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your secuirty. Auth0 now, thank yourself later.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of react-llm!