The Classical Language Toolkit
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Sparsity-aware deep learning inference runtime for CPUs
Han Language Processing
Industrial-strength Natural Language Processing (NLP)
Efficient Retrieval Augmentation and Generation Framework
Unified embedding model
Large Language Model Text Generation Inference
Data and tools for generating and inspecting OLMo pre-training data
Training data (data labeling, annotation, workflow) for all data types
ReFT: Representation Finetuning for Language Models
ExtractThinker is a Document Intelligence library for LLMs
Evaluation code for various unsupervised automated metrics
Toolkit for conversational AI
Pretrained model hub for Keras 3
Obsei is a low code AI powered automation tool
Transformers4Rec is a flexible and efficient library
A full spaCy pipeline and models for scientific/biomedical documents
Extract schema, statistics and entities from datasets
A Repo For Document AI
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models
A tool for learning vector representations of words and entities
A Heterogeneous Benchmark for Information Retrieval
The no-nonsense RAG chunking library
Bring the notion of Model-as-a-Service to life