Stanford NLP Python library for many human languages
A Repo For Document AI
The Classical Language Toolkit
Data processing for and with foundation models
Extract schema, statistics and entities from datasets
ReFT: Representation Finetuning for Language Models
The no-nonsense RAG chunking library
Superlinked is a Python framework for AI Engineers
A natural language interface for computers
The most accurate natural language detection library for Python
Efficient few-shot learning with Sentence Transformers
A full spaCy pipeline and models for scientific/biomedical documents
An LLM-powered knowledge curation system that researches topics
ExtractThinker is a Document Intelligence library for LLMs
A Heterogeneous Benchmark for Information Retrieval
WikiChat is an improved RAG
Large Language Model Text Generation Inference
Efficient Retrieval Augmentation and Generation Framework
An easy-to-use LLMs quantization package with user-friendly apis
Toolkit for conversational AI
Semantic search and workflows for medical/scientific papers
Neural Network Compression Framework for enhanced OpenVINO
Underthesea - Vietnamese NLP Toolkit
Han Language Processing
Data and tools for generating and inspecting OLMo pre-training data