Director-AI is a real-time LLM hallucination guardrail that catches factual errors mid-stream before users see them.

Core capabilities:
- Token-level streaming halt: stops generation the moment hallucination is detected
- NLI scoring via DeBERTa/FactCG: 75.8% balanced accuracy on 29,320 LLM-AggreFact samples
- RAG knowledge grounding: vector store integration with Chroma, FAISS, Pinecone, Weaviate, Qdrant, Elasticsearch
- 14.6ms GPU latency (GTX 1060, ONNX), 0.5ms/pair on L40S FP16
- Rust-accelerated BM25 (10.2x speedup) and signal processing

Integrations: LangChain, LlamaIndex, LangGraph, CrewAI, Haystack, DSPy, Semantic Kernel, SDK Guard (OpenAI/Anthropic/Bedrock/Gemini/Cohere)

Domain presets: medical, finance, legal, customer support, summarisation, creative

Security: Sigstore-signed, SLSA provenance, OpenSSF Best Practices (100%), AGPL-3.0 with commercial licensing

pip install director-ai
https://github.com/anulum/director-ai

Features

  • Real-time hallucination detection, Token-level streaming halt, NLI scoring (DeBERTa/FactCG), RAG knowledge grounding, 8 framework integrations, Domain presets, ONNX/Rust acceleration, Sigstore-signed releases

Project Activity

See All Activity >

Follow director-ai

director-ai Web Site

Other Useful Business Software
Go from Code to Production URL in Seconds Icon
Go from Code to Production URL in Seconds

Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of director-ai!

Additional Project Details

Registered

2026-03-29