director-ai
Real-time LLM hallucination guardrail — NLI + RAG fact-checking
...Core capabilities:
- Token-level streaming halt: stops generation the moment hallucination is detected
- NLI scoring via DeBERTa/FactCG: 75.8% balanced accuracy on 29,320 LLM-AggreFact samples
- RAG knowledge grounding: vector store integration with Chroma, FAISS, Pinecone, Weaviate, Qdrant, Elasticsearch
- 14.6ms GPU latency (GTX 1060, ONNX), 0.5ms/pair on L40S FP16
- Rust-accelerated BM25 (10.2x speedup) and signal processing
Integrations: LangChain, LlamaIndex, LangGraph, CrewAI, Haystack, DSPy, Semantic Kernel, SDK Guard (OpenAI/Anthropic/Bedrock/Gemini/Cohere)
Domain presets: medical, finance, legal, customer support, summarisation, creative
Security: Sigstore-signed, SLSA provenance, OpenSSF Best Practices (100%), AGPL-3.0 with commercial licensing
pip install director-ai
https://github.com/anulum/director-ai