nlp_chinese_corpus is a large-scale Chinese corpus collection for natural language processing research and development. It was created to make high-volume Chinese text data easier to access for students, researchers, and practitioners. The repository gathers several major datasets, including Chinese Wikipedia entries, news articles, encyclopedia-style question answering data, community question answering data, and Chinese-English translation sentence pairs. Each dataset includes descriptions, download links, structure notes, and examples to help users understand how the data is formatted. The corpora can support tasks such as language model pretraining, word vector training, question answering, title generation, keyword generation, translation, and sentence representation learning. Overall, it is a practical resource hub for building or testing Chinese NLP models with larger and more varied datasets.
Features
- Large-scale Chinese NLP corpus collection
- Wikipedia, news, encyclopedia QA, community QA, and translation datasets
- JSON-formatted data structures for easier processing
- Dataset descriptions, schemas, examples, and usage notes
- Download links through Google Drive and Baidu Netdisk
- Useful for pretraining, word vectors, QA, summarization, translation, and representation learning