Download
A self-hardening prompt injection detector. Rebuff is designed to protect AI applications from prompt injection (PI) attacks through a multi-layered defense. Rebuff is still a prototype and cannot provide 100% protection against prompt injection attacks. Add canary tokens to prompts to detect leakages, allowing the framework to store embeddings about the incoming prompt in the vector database and prevent future attacks.
Features
- Filter out potentially malicious input before it reaches the LLM
- Use a dedicated LLM to analyze incoming prompts and identify potential attacks
- Store embeddings of previous attacks in a vector database to recognize and prevent similar attacks in the future
- Add canary tokens to prompts to detect leakages, allowing the framework to store embeddings about the incoming prompt in the vector database and prevent future attacks
- Heuristics
- LLM-based detection
- VectorDB
Project Samples
Categories
Artificial IntelligenceLicense
Apache License V2.0Follow Rebuff
Other Useful Business Software
MongoDB Atlas runs apps anywhere
MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Rebuff!
