Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. As simple as useLLM().

Features

  • Supports Vicuna 7B
  • Use custom system prompts and "user:"/"assistant:" role names
  • Completion options like max tokens and stop sequences
  • No data leaves the browser. Accelerated via WebGPU
  • Hooks built to 'Bring your own UI'
  • Persistent storage for conversations in browser storage. Hooks for loading and saving conversations

Project Samples

react-llm Screenshot 1

Project Activity

See All Activity >

Categories

Large Language Models (LLM), Headless Browsers

License

MIT License

Follow react-llm

react-llm Web Site

Other Useful Business Software
$300 Free Credits to Build on Google Cloud Icon
$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of react-llm!

Additional Project Details

Programming Language

TypeScript

Related Categories

TypeScript Large Language Models (LLM), TypeScript Headless Browsers

Registered

2023-08-25
Report inappropriate content