Indexed by TopGit from live GitHub metadata: ymcui/Chinese-BERT-wwm has 10.2k stars, written primarily in Python. Pre-Training with Whole Word Masking for Chinese BERT(中文BERT-wwm系列模型)
Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.
WHY NO REVIEW YET
TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.
在自然语言处理领域中,预训练语言模型(Pre-trained Language Models)已成为非常重要的基础技术。为了进一步促进中文信息处理的研究发展,我们发布了基于全词掩码(Whole Word Masking)技术的中文预训练模型BERT-wwm,以及与此技术密切相关的模型:BERT-wwm-ext,RoBERTa-wwm-ext,RoBERTa-wwm-ext-large, RBT3, RBTL3等。
Pre-Training with Whole Word Masking for Chinese BERT
Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, Ziqing Yang
Published in IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP)
@journal{cui-etal-2021-pretrain,
title={Pre-Training with Whole Word Masking for Chinese BERT},
author={Cui, Yiming and Che, Wanxiang and Liu, Ting and Qin, Bing and Yang, Ziqing},
journal={IEEE Transactions on Audio, Speech and Language Processing},
year={2021},
url={https://ieeexplore.ieee.org/document/9599397},
doi={10.1109/TASLP.2021.3124365},
}
@inproceedings{cui-etal-2020-revisiting,
title = "Revisiting Pre-Trained Models for {C}hinese Natural Language Processing",
author = "Cui, Yiming and
Che, Wanxiang and
Liu, Ting and
Qin, Bing and
Wang, Shijin and
Hu, Guoping",
booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings",
month = nov,
year = "2020",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://www.aclweb.org/anthology/2020.findings-emnlp.58",
pages = "657--668",
}
How active is development on ymcui/Chinese-BERT-wwm?
The most recent commit recorded on ymcui/Chinese-BERT-wwm was 7 months ago, based on the GitHub push timestamp. The repository has 1.4k forks — one of the better signals of community interest.
How many stars does ymcui/Chinese-BERT-wwm have?
ymcui/Chinese-BERT-wwm has 10.2k GitHub stars — refresh the page for the live number, or check github.com/ymcui/Chinese-BERT-wwm. TopGit mirrors GitHub's count but does not claim minute-by-minute accuracy.
What else is in the AI Tools space?
ymcui/Chinese-BERT-wwm is tracked by TopGit under the AI Tools category, alongside 10 GitHub-tagged topics. Trending and Topics pages list peer repositories of comparable stars and language.
What language is ymcui/Chinese-BERT-wwm written in?
ymcui/Chinese-BERT-wwm is written primarily in Python. GitHub's language field is based on the largest share of bytes in the default branch.
What topics is ymcui/Chinese-BERT-wwm associated with?
GitHub's repository topics for ymcui/Chinese-BERT-wwm: "bert", "bert-wwm", "bert-wwm-ext", "chinese-bert", "nlp", "pytorch", "rbt", "roberta", "roberta-wwm", "tensorflow". TopGit's editorial category is AI Tools.
Where do I read more about ymcui/Chinese-BERT-wwm?
This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/ymcui/Chinese-BERT-wwm is the definitive source.
Why is ymcui/Chinese-BERT-wwm categorized under AI Tools?
TopGit places ymcui/Chinese-BERT-wwm in the AI Tools category based on its GitHub topics and description (tagged: "bert", "bert-wwm", "bert-wwm-ext"). Categories are assigned from real repository metadata, not editorial guesswork.
Read full README in the tab above.
Want a second opinion on Chinese-BERT-wwm?
Ask an AI that can read this page — one click and you get its take on Chinese-BERT-wwm.