albert_zh
Implementation of A Lite Bert For Self-Supervised Learning Language
albert_zh is a Chinese ALBERT pretraining and model release repository. It implements ALBERT with TensorFlow and provides Chinese pretrained models designed to reduce parameter size while preserving strong language understanding performance. The project includes several model variants, such as tiny, small, base, large, and xlarge-style releases, giving users options for speed, size, and accuracy tradeoffs. It also provides guidance for fine-tuning downstream tasks such as sentence-pair...