Data and tools for generating and inspecting OLMo pre-training data
Superlinked is a Python framework for AI Engineers
Stanford NLP Python library for many human languages
Easy-to-use and high-performance NLP and LLM framework
ExtractThinker is a Document Intelligence library for LLMs
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models
The no-nonsense RAG chunking library
The Classical Language Toolkit
Persian NLP Toolkit
Obsei is a low code AI powered automation tool
A full spaCy pipeline and models for scientific/biomedical documents
A Repo For Document AI
Training data (data labeling, annotation, workflow) for all data types
Haystack is an open source NLP framework to interact with your data
A library for deep learning end-to-end dialog systems and chatbots
Code repo for "WebArena to build Autonomous Agents
Resources, corpora, and tools for Chinese natural language processing
Unified embedding model
A toolkit for managing and manipulating text annotations
jiant is an nlp toolkit
PyTorch original implementation of Cross-lingual Language Model
High-accuracy NLP parser with models for 11 languages
Tools to download and cleanup Common Crawl data
fastNLP: A Modularized and Extensible NLP Framework
NLP made easy