director-ai Files

Real-time LLM hallucination guardrail — NLI + RAG fact-checking

Brought to you by: anulum

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2026-02-27	1.9 kB	0
v1.2.0 source code.tar.gz	2026-02-27	1.3 MB	0
v1.2.0 source code.zip	2026-02-27	1.4 MB	0
Totals: 3 Items		2.8 MB	0

What's New

Score Caching

LRU cache with blake2b key hashing and configurable TTL — eliminates redundant NLI/embedding computation during streaming.

:::python
scorer = CoherenceScorer(threshold=0.6, cache_size=1024, cache_ttl=300)

Framework Integrations

LangGraph — director_ai_node() factory + director_ai_conditional_edge() for state graph routing
Haystack 2.x — DirectorAIChecker component with run(query, replies) interface
CrewAI — DirectorAITool for agent-based workflows

Quantized NLI

8-bit model loading via bitsandbytes for <80ms GPU inference:

:::bash
pip install director-ai[quantize]

:::python
scorer = CoherenceScorer(nli_quantize_8bit=True, nli_device="cuda")

Upgraded Embeddings

SentenceTransformerBackend with BAAI/bge-large-en-v1.5 (default) for higher-quality vector retrieval:

:::bash
pip install director-ai[embeddings]

MkDocs Documentation Site

Full documentation at anulum.github.io/director-ai:

User guides (scoring, streaming, evidence, config)
6 integration pages (SDK, LangChain, LlamaIndex, LangGraph, Haystack, CrewAI)
API reference (mkdocstrings)
Production deployment guides (scaling, Docker, Prometheus)
Domain cookbooks (legal, medical, finance)

Enhanced Demo

Side-by-side comparison tab with token-level HTML highlighting (green/yellow/red + strikethrough for halted tokens).

Community

GitHub issue templates (bug report, feature request)
PR template
Good first issues — 10 starter tasks for contributors

Stats

374 tests passing across Python 3.10/3.11/3.12
50 files changed, 2,464 insertions
CI: lint, format, mypy, security audit — all green

Install

:::bash
pip install director-ai==1.2.0

Full Changelog: https://github.com/anulum/director-ai/compare/v1.1.0...v1.2.0

Source: README.md, updated 2026-02-27

Other Useful Business Software

Earn up to 16% annual interest with Nexo. Icon

Earn up to 16% annual interest with Nexo.

Let your crypto work for you

Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform. Geographic restrictions, eligibility, and terms apply.

Get started with Nexo.

AI-generated apps that pass security review Icon

AI-generated apps that pass security review

Stop waiting on engineering. Build production-ready internal tools with AI—on your company data, in your cloud.

Retool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.

Try Retool free

Go From AI Idea to AI App Fast

One platform to build, fine-tune, and deploy ML models. No MLOps team required.

Access Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.

Try Free

Recommended Projects

Node Director
The Node Director is a tool for managing distributed, hetergeneous UNIX Systems. Its functionality includes System Configuration, Application Distribution, NIS & NIS+ Management, User Creation and Dynamic System Documentation.
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI
DocsGPT
Private AI platform for agents, enterprise search and RAG pipelines
DeepEval
DeepEval is a simple-to-use, open-source LLM evaluation framework, for evaluating and testing large-language model systems. It is similar to Pytest but specialized for unit testing LLM outputs. DeepEval incorporates the latest research to evaluate LLM outputs based on metrics such as G-Eval, hallucination, answer relevancy, RAGAS, etc., which uses LLMs and various other NLP models that run locally on your machine for evaluation. Whether your application is implemented via RAG or fine-tuning, LangChain, or LlamaIndex, DeepEval has you covered. With it, you can easily determine the optimal hyperparameters to improve your RAG pipeline, prevent prompt drifting, or even transition from OpenAI to hosting your own Llama2 with confidence.
Vector Admin
The universal tool suite for vector database management