Industrial-strength Natural Language Processing (NLP)
A natural language interface for computers
Han Language Processing
Semantic search and workflows for medical/scientific papers
Large Language Model Text Generation Inference
A Heterogeneous Benchmark for Information Retrieval
Data and tools for generating and inspecting OLMo pre-training data
ExtractThinker is a Document Intelligence library for LLMs
The no-nonsense RAG chunking library
Efficient Retrieval Augmentation and Generation Framework
Efficient few-shot learning with Sentence Transformers
Neural Network Compression Framework for enhanced OpenVINO
ReFT: Representation Finetuning for Language Models
The Classical Language Toolkit
An LLM-powered knowledge curation system that researches topics
Training data (data labeling, annotation, workflow) for all data types
Build AI-powered semantic search applications
Extract schema, statistics and entities from datasets
Hub of ready-to-use datasets for ML models
Stanford NLP Python library for many human languages
The library to build & auto-optimize LLM applications
A full spaCy pipeline and models for scientific/biomedical documents
Data processing for and with foundation models
Trained models & code to predict toxic comments
Easy-to-use and powerful NLP library with Awesome model zoo