Download
Director-AI is a real-time LLM hallucination guardrail that catches factual errors mid-stream before users see them.
Core capabilities:
- Token-level streaming halt: stops generation the moment hallucination is detected
- NLI scoring via DeBERTa/FactCG: 75.8% balanced accuracy on 29,320 LLM-AggreFact samples
- RAG knowledge grounding: vector store integration with Chroma, FAISS, Pinecone, Weaviate, Qdrant, Elasticsearch
- 14.6ms GPU latency (GTX 1060, ONNX), 0.5ms/pair on L40S FP16
- Rust-accelerated BM25 (10.2x speedup) and signal processing
Integrations: LangChain, LlamaIndex, LangGraph, CrewAI, Haystack, DSPy, Semantic Kernel, SDK Guard (OpenAI/Anthropic/Bedrock/Gemini/Cohere)
Domain presets: medical, finance, legal, customer support, summarisation, creative
Security: Sigstore-signed, SLSA provenance, OpenSSF Best Practices (100%), AGPL-3.0 with commercial licensing
pip install director-ai
https://github.com/anulum/director-ai
Features
- Real-time hallucination detection, Token-level streaming halt, NLI scoring (DeBERTa/FactCG), RAG knowledge grounding, 8 framework integrations, Domain presets, ONNX/Rust acceleration, Sigstore-signed releases