Industrial-strength Natural Language Processing (NLP)
Public opinion analysis system
A natural language interface for computers
Han Language Processing
A Repo For Document AI
Semantic search and workflows for medical/scientific papers
The no-nonsense RAG chunking library
Training data (data labeling, annotation, workflow) for all data types
Module for automatic summarization of text documents and HTML pages
ReFT: Representation Finetuning for Language Models
The most accurate natural language detection library for Python
ExtractThinker is a Document Intelligence library for LLMs
A Heterogeneous Benchmark for Information Retrieval
Neural Network Compression Framework for enhanced OpenVINO
Efficient few-shot learning with Sentence Transformers
Extract schema, statistics and entities from datasets
Hub of ready-to-use datasets for ML models
A full spaCy pipeline and models for scientific/biomedical documents
An LLM-powered knowledge curation system that researches topics
Underthesea - Vietnamese NLP Toolkit
Data and tools for generating and inspecting OLMo pre-training data
Efficient Retrieval Augmentation and Generation Framework
Build AI-powered semantic search applications
Large Language Model Text Generation Inference
The Classical Language Toolkit