albert_zh
Implementation of A Lite Bert For Self-Supervised Learning Language
...It implements ALBERT with TensorFlow and provides Chinese pretrained models designed to reduce parameter size while preserving strong language understanding performance. The project includes several model variants, such as tiny, small, base, large, and xlarge-style releases, giving users options for speed, size, and accuracy tradeoffs. It also provides guidance for fine-tuning downstream tasks such as sentence-pair semantic similarity and Chinese classification benchmarks. The repository includes support paths for TensorFlow, PyTorch conversion, Keras loading, TensorFlow 2.0 loading, and TensorFlow Lite deployment for mobile scenarios. ...