Commit History
-
update
Verified signature5dea5bb -
update
Verified signatureb326139
-
Adding `safetensors` variant of this model (#1)
Verified signature- Adding `safetensors` variant of this model (4cf9c5d76291f6f2168b9787e44685a18aab57e0) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>32dd8ee
-
Update README.md
e640272
-
Update README.md
370bc94 -
Upload 2 files
3228023 -
Update modeling_glycebert.py
fdd8bb9 -
Update bert_tokenizer.py
bbab6d8 -
Update README.md
f1bfdd0 -
Delete models
60f9151 -
Update README.md
60e0896 -
Update README.md
0771f63 -
Update README.md
# ChineseBERT-base 本项目是将ChineseBERT进行了加工，可供使用者直接使用HuggingFace API进行调用，无需再进行多余的代码配置。 原论文地址： **[ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information](https://arxiv.org/abs/2106.16038)** *Zijun Sun, Xiaoya Li, Xiaofei Sun, Yuxian Meng, Xiang Ao, Qing He, Fei Wu and Jiwei Li* 原项目地址： [ChineseBERT github link](https://github.com/ShannonAI/ChineseBert) 原模型地址： [ShannonAI/ChineseBERT-base](https://huggingface.co/ShannonAI/ChineseBERT-base) (该模型无法直接使用HuggingFace API调用) # 本项目使用方法 1. 安装pypinyin ``` pip install pypinyin ``` 2. 使用AutoClass加载tokenizer和model ```python from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("iioSnail/ChineseBERT-base", trust_remote_code=True) model = AutoModel.from_pretrained("iioSnail/ChineseBERT-base", trust_remote_code=True) ``` 3. 之后与普通BERT使用方法一致 ```python inputs = tokenizer(["我 喜 [MASK] 猫"], return_tensors='pt') logits = model(**inputs).logits print(tokenizer.decode(logits.argmax(-1)[0, 1:-1])…9b6e41a -
Upload bert_tokenizer.py
f76a1c9 -
Upload bert_tokenizer.py
78daf2e -
Upload bert_tokenizer.py
d292447 -
Upload bert_tokenizer.py
24dc275 -
Upload modeling_glycebert.py
8135e8c -
Upload modeling_glycebert.py
ce93088
-
Upload modeling_glycebert.py
fef7e55 -
Update bert_tokenizer.py
181e9b5 -
Update bert_tokenizer.py
e795962 -
Update bert_tokenizer.py
ffecf65
-
Upload bert_tokenizer.py
af43a53 -
Upload bert_tokenizer.py
f3a7c66 -
Upload bert_tokenizer.py
a30567c -
Upload bert_tokenizer.py
20bc2dd -
Upload bert_tokenizer.py
f72ad04 -
Upload bert_tokenizer.py
3217624 -
Upload bert_tokenizer.py
de3a7d8
-
Upload 8 files
601e637
-
Update tokenizer.py
b71d0a4 -
Update config.json
61a86e4 -
Upload 6 files
a2e10c0 -
commit
8d7c576 -
initial commit
47e9648