Data and tools for generating and inspecting OLMo pre-training data
Stanford NLP Python library for many human languages
Persian NLP Toolkit
Easy-to-use and high-performance NLP and LLM framework
ExtractThinker is a Document Intelligence library for LLMs
Superlinked is a Python framework for AI Engineers
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models
The no-nonsense RAG chunking library
The Classical Language Toolkit
A full spaCy pipeline and models for scientific/biomedical documents
Training data (data labeling, annotation, workflow) for all data types
A Repo For Document AI
Public opinion analysis system
A library for deep learning end-to-end dialog systems and chatbots
A natural language interface for computers
Industrial-strength Natural Language Processing (NLP)
Haystack is an open source NLP framework to interact with your data
Han Language Processing
Underthesea - Vietnamese NLP Toolkit
Toolkit for conversational AI
A Unified Library for Parameter-Efficient Learning
Chinese XLNet pre-trained model
Trained models & code to predict toxic comments
WikiChat is an improved RAG
ReFT: Representation Finetuning for Language Models