Mirror from hf-internal-testing/tiny-random-squeezebert

.gitattributes

@@ -1,35 +1,18 @@
-*.7z filter=lfs diff=lfs merge=lfs -text
-*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin.* filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
 *.bin filter=lfs diff=lfs merge=lfs -text
-*.bz2 filter=lfs diff=lfs merge=lfs -text
-*.ckpt filter=lfs diff=lfs merge=lfs -text
-*.ftz filter=lfs diff=lfs merge=lfs -text
-*.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tar.gz filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text
-*.lfs.* filter=lfs diff=lfs merge=lfs -text
-*.mlmodel filter=lfs diff=lfs merge=lfs -text
 *.model filter=lfs diff=lfs merge=lfs -text
 *.msgpack filter=lfs diff=lfs merge=lfs -text
-*.npy filter=lfs diff=lfs merge=lfs -text
-*.npz filter=lfs diff=lfs merge=lfs -text
-*.onnx filter=lfs diff=lfs merge=lfs -text
-*.ot filter=lfs diff=lfs merge=lfs -text
-*.parquet filter=lfs diff=lfs merge=lfs -text
 *.pb filter=lfs diff=lfs merge=lfs -text
-*.pickle filter=lfs diff=lfs merge=lfs -text
-*.pkl filter=lfs diff=lfs merge=lfs -text
 *.pt filter=lfs diff=lfs merge=lfs -text
 *.pth filter=lfs diff=lfs merge=lfs -text
-*.rar filter=lfs diff=lfs merge=lfs -text
-*.safetensors filter=lfs diff=lfs merge=lfs -text
-saved_model/**/* filter=lfs diff=lfs merge=lfs -text
-*.tar.* filter=lfs diff=lfs merge=lfs -text
-*.tar filter=lfs diff=lfs merge=lfs -text
-*.tflite filter=lfs diff=lfs merge=lfs -text
-*.tgz filter=lfs diff=lfs merge=lfs -text
-*.wasm filter=lfs diff=lfs merge=lfs -text
-*.xz filter=lfs diff=lfs merge=lfs -text
-*.zip filter=lfs diff=lfs merge=lfs -text
-*.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+model.safetensors filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,199 @@
+---
+library_name: transformers
+tags: []
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]

config.json

@@ -0,0 +1,29 @@
+{
+  "architectures": [
+    "SqueezeBertModel"
+  ],
+  "attention_dropout": 0.1,
+  "attention_probs_dropout_prob": 0.1,
+  "embedding_size": 32,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 32,
+  "initializer_range": 0.02,
+  "intermediate_groups": 4,
+  "intermediate_size": 64,
+  "k_groups": 2,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "squeezebert",
+  "num_attention_heads": 4,
+  "num_hidden_layers": 5,
+  "output_groups": 1,
+  "pad_token_id": 0,
+  "post_attention_groups": 2,
+  "q_groups": 2,
+  "torch_dtype": "float32",
+  "transformers_version": "4.52.0.dev0",
+  "type_vocab_size": 2,
+  "v_groups": 2,
+  "vocab_size": 1124
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de13912fa0d2d4a9b080567e82c0b3c48595bfee0ea62d7dcd2626c4c3ce23fe
+size 322400

pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9684d0a832a18823a3da0e477a251f8422136d0faf1c33c00f193cd91622560e
+size 846669

special_tokens_map.json

@@ -0,0 +1 @@
+{"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}

tokenizer.json

@@ -0,0 +1 @@
+{"version":"1.0","truncation":null,"padding":null,"added_tokens":[{"id":0,"special":true,"content":"[PAD]","single_word":false,"lstrip":false,"rstrip":false,"normalized":false},{"id":1,"special":true,"content":"[UNK]","single_word":false,"lstrip":false,"rstrip":false,"normalized":false},{"id":2,"special":true,"content":"[CLS]","single_word":false,"lstrip":false,"rstrip":false,"normalized":false},{"id":3,"special":true,"content":"[SEP]","single_word":false,"lstrip":false,"rstrip":false,"normalized":false},{"id":4,"special":true,"content":"[MASK]","single_word":false,"lstrip":false,"rstrip":false,"normalized":false}],"normalizer":{"type":"BertNormalizer","clean_text":true,"handle_chinese_chars":true,"strip_accents":null,"lowercase":true},"pre_tokenizer":{"type":"BertPreTokenizer"},"post_processor":{"type":"TemplateProcessing","single":[{"SpecialToken":{"id":"[CLS]","type_id":0}},{"Sequence":{"id":"A","type_id":0}},{"SpecialToken":{"id":"[SEP]","type_id":0}}],"pair":[{"SpecialToken":{"id":"[CLS]","type_id":0}},{"Sequence":{"id":"A","type_id":0}},{"SpecialToken":{"id":"[SEP]","type_id":0}},{"Sequence":{"id":"B","type_id":1}},{"SpecialToken":{"id":"[SEP]","type_id":1}}],"special_tokens":{"[CLS]":{"id":"[CLS]","ids":[2],"tokens":["[CLS]"]},"[SEP]":{"id":"[SEP]","ids":[3],"tokens":["[SEP]"]}}},"decoder":{"type":"WordPiece","prefix":"##","cleanup":true},"model":{"type":"WordPiece","unk_token":"[UNK]","continuing_subword_prefix":"##","max_input_chars_per_word":100,"vocab":{"[PAD]":0,"[UNK]":1,"[CLS]":2,"[SEP]":3,"[MASK]":4,"!":5,"\"":6,"#":7,"$":8,"%":9,"&":10,"'":11,"(":12,")":13,"*":14,"+":15,",":16,"-":17,".":18,"/":19,"0":20,"1":21,"2":22,"3":23,"4":24,"5":25,"6":26,"7":27,"8":28,"9":29,":":30,";":31,"<":32,"=":33,">":34,"?":35,"@":36,"[":37,"\\":38,"]":39,"^":40,"_":41,"`":42,"a":43,"b":44,"c":45,"d":46,"e":47,"f":48,"g":49,"h":50,"i":51,"j":52,"k":53,"l":54,"m":55,"n":56,"o":57,"p":58,"q":59,"r":60,"s":61,"t":62,"u":63,"v":64,"w":65,"x":66,"y":67,"z":68,"|":69,"}":70,"~":71,"¡":72,"¢":73,"£":74,"¥":75,"§":76,"°":77,"±":78,"²":79,"³":80,"´":81,"µ":82,"·":83,"º":84,"½":85,"¿":86,"×":87,"ß":88,"æ":89,"ð":90,"ø":91,"þ":92,"đ":93,"ħ":94,"ı":95,"ł":96,"œ":97,"ɐ":98,"ɑ":99,"ɒ":100,"ɔ":101,"ə":102,"ɛ":103,"ɜ":104,"ɡ":105,"ɢ":106,"ɪ":107,"ɫ":108,"ɳ":109,"ɽ":110,"ɾ":111,"ʁ":112,"ʃ":113,"ʊ":114,"ʋ":115,"ʒ":116,"ʔ":117,"ʕ":118,"ʲ":119,"ʻ":120,"ʼ":121,"ʾ":122,"ʿ":123,"ˈ":124,"ˌ":125,"ː":126,"α":127,"β":128,"γ":129,"δ":130,"ε":131,"η":132,"θ":133,"ι":134,"κ":135,"λ":136,"μ":137,"ν":138,"ξ":139,"ο":140,"π":141,"ρ":142,"ς":143,"σ":144,"τ":145,"υ":146,"φ":147,"χ":148,"ψ":149,"ω":150,"а":151,"б":152,"в":153,"г":154,"д":155,"е":156,"ж":157,"з":158,"и":159,"к":160,"л":161,"м":162,"н":163,"о":164,"п":165,"р":166,"с":167,"т":168,"у":169,"х":170,"ц":171,"ш":172,"ъ":173,"ы":174,"ь":175,"ю":176,"я":177,"є":178,"א":179,"ב":180,"ג":181,"ה":182,"ו":183,"ז":184,"ח":185,"י":186,"ל":187,"ם":188,"מ":189,"ן":190,"נ":191,"ס":192,"ף":193,"פ":194,"צ":195,"ר":196,"ש":197,"ת":198,"ء":199,"ا":200,"ب":201,"ة":202,"ت":203,"ث":204,"ج":205,"ح":206,"خ":207,"د":208,"ذ":209,"ر":210,"س":211,"ش":212,"ص":213,"ع":214,"ف":215,"ق":216,"ك":217,"ل":218,"م":219,"ن":220,"ه":221,"و":222,"ي":223,"ܐ":224,"ܕ":225,"ܗ":226,"ܝ":227,"ܠ":228,"ܢ":229,"ܬ":230,"अ":231,"ई":232,"क":233,"ग":234,"ण":235,"त":236,"द":237,"न":238,"प":239,"ब":240,"म":241,"य":242,"र":243,"ल":244,"व":245,"स":246,"ह":247,"ा":248,"ि":249,"আ":250,"ল":251,"হ":252,"া":253,"ਅ":254,"ਲ":255,"ਹ":256,"ਾ":257,"അ":258,"ള":259,"ഹ":260,"ാ":261,"ก":262,"ค":263,"ง":264,"ช":265,"ซ":266,"ญ":267,"ฐ":268,"ณ":269,"ด":270,"ต":271,"น":272,"บ":273,"ป":274,"พ":275,"ภ":276,"ม":277,"ย":278,"ร":279,"ล":280,"ว":281,"ศ":282,"ษ":283,"ส":284,"ห":285,"อ":286,"ฮ":287,"ะ":288,"า":289,"เ":290,"แ":291,"ไ":292,"ა":293,"ბ":294,"გ":295,"დ":296,"ე":297,"ვ":298,"ზ":299,"თ":300,"ი":301,"კ":302,"ლ":303,"მ":304,"ნ":305,"ო":306,"პ":307,"ჟ":308,"რ":309,"ს":310,"ტ":311,"უ":312,"ფ":313,"ქ":314,"ღ":315,"ყ":316,"შ":317,"ჩ":318,"ც":319,"ძ":320,"წ":321,"ჭ":322,"ხ":323,"ჯ":324,"ჰ":325,"ჱ":326,"ჲ":327,"ჳ":328,"ჴ":329,"ჵ":330,"ჶ":331,"ჷ":332,"ჸ":333,"ჹ":334,"ჺ":335,"჻":336,"ᄃ":337,"ᄅ":338,"ᄇ":339,"ᄋ":340,"ᄌ":341,"ᅡ":342,"ᅢ":343,"ᅦ":344,"ᅧ":345,"ᅩ":346,"ᅮ":347,"ᅵ":348,"ᆨ":349,"ᆫ":350,"ᆯ":351,"ᆸ":352,"ᆼ":353,"ᵻ":354,"‐":355,"‑":356,"–":357,"—":358,"―":359,"‘":360,"’":361,"“":362,"”":363,"„":364,"†":365,"‡":366,"•":367,"…":368,"′":369,"″":370,"⁄":371,"₣":372,"₤":373,"€":374,"₹":375,"⅓":376,"⅔":377,"→":378,"−":379,"≡":380,"≤":381,"①":382,"☉":383,"☫":384,"♀":385,"♭":386,"♯":387,"⚳":388,"ⴀ":389,"ⴂ":390,"ⴃ":391,"ⴈ":392,"ⴌ":393,"ⴕ":394,"ⴟ":395,"〈":396,"〉":397,"〜":398,"あ":399,"い":400,"う":401,"お":402,"か":403,"き":404,"く":405,"け":406,"こ":407,"さ":408,"し":409,"す":410,"せ":411,"た":412,"ち":413,"っ":414,"つ":415,"と":416,"な":417,"に":418,"の":419,"は":420,"ひ":421,"ふ":422,"ほ":423,"ま":424,"み":425,"め":426,"も":427,"ゃ":428,"ゆ":429,"ょ":430,"ら":431,"り":432,"る":433,"れ":434,"わ":435,"を":436,"ん":437,"ァ":438,"ア":439,"ィ":440,"イ":441,"ゥ":442,"ウ":443,"ェ":444,"エ":445,"ォ":446,"オ":447,"カ":448,"キ":449,"ク":450,"ケ":451,"コ":452,"サ":453,"シ":454,"ス":455,"セ":456,"タ":457,"チ":458,"ッ":459,"ツ":460,"テ":461,"ト":462,"ナ":463,"ニ":464,"ネ":465,"ノ":466,"ハ":467,"フ":468,"ヘ":469,"マ":470,"ミ":471,"ム":472,"モ":473,"ャ":474,"ュ":475,"ョ":476,"ラ":477,"リ":478,"ル":479,"レ":480,"ロ":481,"ン":482,"・":483,"ー":484,"一":485,"七":486,"下":487,"世":488,"丙":489,"中":490,"主":491,"乃":492,"之":493,"乙":494,"九":495,"二":496,"云":497,"人":498,"今":499,"付":500,"作":501,"侗":502,"依":503,"信":504,"傳":505,"儚":506,"充":507,"光":508,"全":509,"兵":510,"其":511,"具":512,"円":513,"再":514,"出":515,"判":516,"前":517,"剛":518,"劇":519,"劉":520,"動":521,"化":522,"北":523,"华":524,"厂":525,"去":526,"古":527,"可":528,"台":529,"史":530,"同":531,"名":532,"君":533,"吳":534,"周":535,"命":536,"和":537,"咲":538,"善":539,"四":540,"國":541,"園":542,"圣":543,"在":544,"坂":545,"堤":546,"場":547,"塘":548,"夕":549,"大":550,"天":551,"夫":552,"女":553,"妙":554,"姚":555,"子":556,"孟":557,"守":558,"安":559,"宋":560,"完":561,"宗":562,"宝":563,"宫":564,"寝":565,"寺":566,"小":567,"少":568,"尾":569,"山":570,"岳":571,"川":572,"州":573,"巳":574,"市":575,"師":576,"平":577,"广":578,"庆":579,"府":580,"座":581,"廬":582,"建":583,"式":584,"張":585,"彌":586,"彩":587,"彼":588,"後":589,"御":590,"德":591,"思":592,"愛":593,"憑":594,"憶":595,"應":596,"懷":597,"战":598,"戦":599,"扈":600,"技":601,"拉":602,"拳":603,"挑":604,"揺":605,"攻":606,"放":607,"政":608,"散":609,"斯":610,"方":611,"日":612,"旦":613,"旭":614,"昌":615,"明":616,"星":617,"春":618,"晋":619,"景":620,"曦":621,"月":622,"望":623,"未":624,"本":625,"李":626,"村":627,"杜":628,"束":629,"来":630,"林":631,"桜":632,"梶":633,"棘":634,"椎":635,"楊":636,"楚":637,"榮":638,"橘":639,"機":640,"正":641,"殻":642,"殿":643,"母":644,"水":645,"汉":646,"沂":647,"沙":648,"河":649,"泗":650,"波":651,"泣":652,"洪":653,"淹":654,"清":655,"湯":656,"漢":657,"澄":658,"澤":659,"火":660,"灯":661,"灵":662,"灼":663,"焼":664,"熱":665,"物":666,"狐":667,"狸":668,"玄":669,"王":670,"玩":671,"珂":672,"珙":673,"球":674,"理":675,"琦":676,"琪":677,"瓊":678,"生":679,"田":680,"畢":681,"番":682,"瘡":683,"白":684,"皮":685,"真":686,"砲":687,"礮":688,"祈":689,"神":690,"祠":691,"秋":692,"空":693,"立":694,"精":695,"約":696,"絵":697,"織":698,"義":699,"翠":700,"者":701,"耕":702,"肖":703,"胡":704,"膀":705,"臂":706,"興":707,"良":708,"花":709,"芳":710,"芽":711,"若":712,"英":713,"藕":714,"藥":715,"蘄":716,"蘇":717,"行":718,"裁":719,"規":720,"覺":721,"观":722,"解":723,"記":724,"誓":725,"誡":726,"誰":727,"謎":728,"许":729,"谭":730,"豪":731,"豫":732,"費":733,"贵":734,"赤":735,"趙":736,"足":737,"跡":738,"転":739,"辛":740,"逆":741,"遇":742,"運":743,"過":744,"遠":745,"選":746,"邦":747,"邱":748,"部":749,"郭":750,"都":751,"酈":752,"里":753,"野":754,"金":755,"銃":756,"鋼":757,"錄":758,"錡":759,"鍵":760,"鐵":761,"钱":762,"铁":763,"關":764,"防":765,"阿":766,"陈":767,"陳":768,"陽":769,"隊":770,"階":771,"集":772,"雪":773,"雲":774,"霖":775,"霹":776,"靂":777,"韓":778,"願":779,"顯":780,"颜":781,"马":782,"高":783,"龍":784,"ﷲ":785,"ﻋ":786,"／":787,"３":788,"～":789,"##i":790,"##r":791,"##a":792,"##m":793,"##p":794,"##t":795,"##n":796,"##c":797,"##k":798,"##e":799,"##d":800,"##h":801,"##o":802,"##q":803,"##u":804,"##s":805,"##b":806,"##l":807,"##x":808,"##y":809,"##2":810,"##g":811,"##9":812,"##3":813,"##f":814,"##w":815,"##7":816,"##5":817,"##0":818,"##v":819,"##z":820,"##ł":821,"##6":822,"##ʻ":823,"##1":824,"##4":825,"##j":826,"##8":827,"##ო":828,"##ი":829,"##ə":830,"##ニ":831,"##ø":832,"##ि":833,"##მ":834,"##ე":835,"##ლ":836,"##ɑ":837,"##ˈ":838,"##ː":839,"##đ":840,"##ภ":841,"##า":842,"##ด":843,"##ɾ":844,"##ʲ":845,"##л":846,"##а":847,"##х":848,"##ل":849,"##ش":850,"##ي":851,"##خ":852,"##フ":853,"##ъ":854,"##з":855,"##н":856,"##е":857,"##с":858,"##и":859,"##ɪ":860,"##し":861,"##の":862,"##た":863,"##ま":864,"##ε":865,"##τ":866,"##ρ":867,"##ο":868,"##ν":869,"##ル":870,"##レ":871,"##イ":872,"##ン":873,"##ð":874,"##ι":875,"##σ":876,"##υ":877,"##ッ":878,"##ク":879,"##マ":880,"##ल":881,"##พ":882,"##ร":883,"##ذ":884,"##ن":885,"##ة":886,"##ा":887,"##न":888,"##ई":889,"##ネ":890,"##シ":891,"##ョ":892,"##ه":893,"##æ":894,"##р":895,"##т":896,"##о":897,"##ا":898,"##ب":899,"##つ":900,"##う":901,"##อ":902,"##ก":903,"##ว":904,"##ξ":905,"##ß":906,"##ء":907,"##ɛ":908,"##რ":909,"##გ":910,"##ვ":911,"##ა":912,"##ნ":913,"##サ":914,"##ス":915,"##ャ":916,"##モ":917,"##ล":918,"##ฮ":919,"##か":920,"##こ":921,"##く":922,"##み":923,"##д":924,"##ー":925,"##テ":926,"##ィ":927,"##ア":928,"##ל":929,"##ה":930,"##り":931,"##ォ":932,"##ト":933,"##ゥ":934,"##ナ":935,"##α":936,"##δ":937,"##μ":938,"##ש":939,"##מ":940,"##צ":941,"##っ":942,"##γ":943,"##ს":944,"##ტ":945,"##と":946,"##ह":947,"##ხ":948,"##η":949,"##ו":950,"##פ":951,"##נ":952,"##れ":953,"##い":954,"##ɽ":955,"##ן":956,"##ы":957,"##も":958,"##י":959,"##ס":960,"##п":961,"##क":962,"##ʊ":963,"##ˌ":964,"##ʁ":965,"##к":966,"##セ":967,"##リ":968,"##オ":969,"##ك":970,"##ر":971,"##د":972,"##و":973,"##ح":974,"##დ":975,"##ت":976,"##უ":977,"##を":978,"##あ":979,"##ん":980,"##θ":981,"##ɔ":982,"##ʔ":983,"##თ":984,"##ɒ":985,"##ᵻ":986,"##я":987,"##ɫ":988,"##λ":989,"##ς":990,"##は":991,"##め":992,"##व":993,"##ı":994,"##ウ":995,"##ァ":996,"##キ":997,"##ュ":998,"##３":999,"##き":1000,"##ᄇ":1001,"##ᅮ":1002,"##ᄃ":1003,"##ᅢ":1004,"##ܕ":1005,"##ܝ":1006,"##ܢ":1007,"##ܬ":1008,"##в":1009,"##χ":1010,"##ع":1011,"##ʿ":1012,"##ण":1013,"##ग":1014,"##ラ":1015,"##ჱ":1016,"##ল":1017,"##є":1018,"##ف":1019,"##º":1020,"##ث":1021,"##م":1022,"##س":1023,"##タ":1024,"##ら":1025,"##ɐ":1026,"##ซ":1027,"##ш":1028,"##ц":1029,"##ь":1030,"##ɜ":1031,"##ω":1032,"##ਲ":1033,"##ਾ":1034,"##ਹ":1035,"##ც":1036,"##ള":1037,"##お":1038,"##β":1039,"##ʃ":1040,"##κ":1041,"##π":1042,"##ж":1043,"##ɡ":1044,"##ᅡ":1045,"##ᆯ":1046,"##ᄅ":1047,"##द":1048,"##ю":1049,"##ค":1050,"##ต":1051,"##ษ":1052,"##ฐ":1053,"##ハ":1054,"##ɳ":1055,"##ാ":1056,"##ഹ":1057,"##ロ":1058,"##र":1059,"##ψ":1060,"##な":1061,"##া":1062,"##হ":1063,"##ะ":1064,"##ช":1065,"##น":1066,"##ף":1067,"##カ":1068,"##す":1069,"##ย":1070,"##ณ":1071,"##ม":1072,"##ق":1073,"##ゆ":1074,"##ミ":1075,"##у":1076,"##ჳ":1077,"##ツ":1078,"##ב":1079,"##ת":1080,"##א":1081,"##ง":1082,"##ไ":1083,"##ム":1084,"##チ":1085,"##ェ":1086,"##œ":1087,"##せ":1088,"##ひ":1089,"##ქ":1090,"##ܠ":1091,"##ܗ":1092,"##ܐ":1093,"##ʒ":1094,"##წ":1095,"##ფ":1096,"##る":1097,"##ち":1098,"##ゃ":1099,"##เ":1100,"##ป":1101,"##ჲ":1102,"##エ":1103,"##わ":1104,"##ص":1105,"##г":1106,"##ᅦ":1107,"##ᅩ":1108,"##ᆨ":1109,"##ᅵ":1110,"##ᆸ":1111,"##ᅧ":1112,"##ᆼ":1113,"##ᄋ":1114,"##ᆫ":1115,"##ノ":1116,"##स":1117,"##แ":1118,"##ょ":1119,"##に":1120,"##ם":1121,"##ר":1122,"##м":1123}}}

tokenizer_config.json

@@ -0,0 +1 @@
+{"do_lower_case": true, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "squeezebert/squeezebert-uncased", "tokenizer_class": "SqueezeBertTokenizer"}

vocab.txt

@@ -0,0 +1,1124 @@
+[PAD]
+[UNK]
+[CLS]
+[SEP]
+[MASK]
+!
+"
+#
+$
+%
+&
+'
+(
+)
+*
++
+,
+-
+.
+/
+0
+1
+2
+3
+4
+5
+6
+7
+8
+9
+:
+;
+<
+=
+>
+?
+@
+[
+\
+]
+^
+_
+`
+a
+b
+c
+d
+e
+f
+g
+h
+i
+j
+k
+l
+m
+n
+o
+p
+q
+r
+s
+t
+u
+v
+w
+x
+y
+z
+|
+}
+~
+¡
+¢
+£
+¥
+§
+°
+±
+²
+³
+´
+µ
+·
+º
+½
+¿
+×
+ß
+æ
+ð
+ø
+þ
+đ
+ħ
+ı
+ł
+œ
+ɐ
+ɑ
+ɒ
+ɔ
+ə
+ɛ
+ɜ
+ɡ
+ɢ
+ɪ
+ɫ
+ɳ
+ɽ
+ɾ
+ʁ
+ʃ
+ʊ
+ʋ
+ʒ
+ʔ
+ʕ
+ʲ
+ʻ
+ʼ
+ʾ
+ʿ
+ˈ
+ˌ
+ː
+α
+β
+γ
+δ
+ε
+η
+θ
+ι
+κ
+λ
+μ
+ν
+ξ
+ο
+π
+ρ
+ς
+σ
+τ
+υ
+φ
+χ
+ψ
+ω
+а
+б
+в
+г
+д
+е
+ж
+з
+и
+к
+л
+м
+н
+о
+п
+р
+с
+т
+у
+х
+ц
+ш
+ъ
+ы
+ь
+ю
+я
+є
+א
+ב
+ג
+ה
+ו
+ז
+ח
+י
+ל
+ם
+מ
+ן
+נ
+ס
+ף
+פ
+צ
+ר
+ש
+ת
+ء
+ا
+ب
+ة
+ت
+ث
+ج
+ح
+خ
+د
+ذ
+ر
+س
+ش
+ص
+ع
+ف
+ق
+ك
+ل
+م
+ن
+ه
+و
+ي
+ܐ
+ܕ
+ܗ
+ܝ
+ܠ
+ܢ
+ܬ
+अ
+ई
+क
+ग
+ण
+त
+द
+न
+प
+ब
+म
+य
+र
+ल
+व
+स
+ह
+ा
+ि
+আ
+ল
+হ
+া
+ਅ
+ਲ
+ਹ
+ਾ
+അ
+ള
+ഹ
+ാ
+ก
+ค
+ง
+ช
+ซ
+ญ
+ฐ
+ณ
+ด
+ต
+น
+บ
+ป
+พ
+ภ
+ม
+ย
+ร
+ล
+ว
+ศ
+ษ
+ส
+ห
+อ
+ฮ
+ะ
+า
+เ
+แ
+ไ
+ა
+ბ
+გ
+დ
+ე
+ვ
+ზ
+თ
+ი
+კ
+ლ
+მ
+ნ
+ო
+პ
+ჟ
+რ
+ს
+ტ
+უ
+ფ
+ქ
+ღ
+ყ
+შ
+ჩ
+ც
+ძ
+წ
+ჭ
+ხ
+ჯ
+ჰ
+ჱ
+ჲ
+ჳ
+ჴ
+ჵ
+ჶ
+ჷ
+ჸ
+ჹ
+ჺ
+჻
+ᄃ
+ᄅ
+ᄇ
+ᄋ
+ᄌ
+ᅡ
+ᅢ
+ᅦ
+ᅧ
+ᅩ
+ᅮ
+ᅵ
+ᆨ
+ᆫ
+ᆯ
+ᆸ
+ᆼ
+ᵻ
+‐
+‑
+–
+—
+―
+‘
+’
+“
+”
+„
+†
+‡
+•
+…
+′
+″
+⁄
+₣
+₤
+€
+₹
+⅓
+⅔
+→
+−
+≡
+≤
+①
+☉
+☫
+♀
+♭
+♯
+⚳
+ⴀ
+ⴂ
+ⴃ
+ⴈ
+ⴌ
+ⴕ
+ⴟ
+〈
+〉
+〜
+あ
+い
+う
+お
+か
+き
+く
+け
+こ
+さ
+し
+す
+せ
+た
+ち
+っ
+つ
+と
+な
+に
+の
+は
+ひ
+ふ
+ほ
+ま
+み
+め
+も
+ゃ
+ゆ
+ょ
+ら
+り
+る
+れ
+わ
+を
+ん
+ァ
+ア
+ィ
+イ
+ゥ
+ウ
+ェ
+エ
+ォ
+オ
+カ
+キ
+ク
+ケ
+コ
+サ
+シ
+ス
+セ
+タ
+チ
+ッ
+ツ
+テ
+ト
+ナ
+ニ
+ネ
+ノ
+ハ
+フ
+ヘ
+マ
+ミ
+ム
+モ
+ャ
+ュ
+ョ
+ラ
+リ
+ル
+レ
+ロ
+ン
+・
+ー
+一
+七
+下
+世
+丙
+中
+主
+乃
+之
+乙
+九
+二
+云
+人
+今
+付
+作
+侗
+依
+信
+傳
+儚
+充
+光
+全
+兵
+其
+具
+円
+再
+出
+判
+前
+剛
+劇
+劉
+動
+化
+北
+华
+厂
+去
+古
+可
+台
+史
+同
+名
+君
+吳
+周
+命
+和
+咲
+善
+四
+國
+園
+圣
+在
+坂
+堤
+場
+塘
+夕
+大
+天
+夫
+女
+妙
+姚
+子
+孟
+守
+安
+宋
+完
+宗
+宝
+宫
+寝
+寺
+小
+少
+尾
+山
+岳
+川
+州
+巳
+市
+師
+平
+广
+庆
+府
+座
+廬
+建
+式
+張
+彌
+彩
+彼
+後
+御
+德
+思
+愛
+憑
+憶
+應
+懷
+战
+戦
+扈
+技
+拉
+拳
+挑
+揺
+攻
+放
+政
+散
+斯
+方
+日
+旦
+旭
+昌
+明
+星
+春
+晋
+景
+曦
+月
+望
+未
+本
+李
+村
+杜
+束
+来
+林
+桜
+梶
+棘
+椎
+楊
+楚
+榮
+橘
+機
+正
+殻
+殿
+母
+水
+汉
+沂
+沙
+河
+泗
+波
+泣
+洪
+淹
+清
+湯
+漢
+澄
+澤
+火
+灯
+灵
+灼
+焼
+熱
+物
+狐
+狸
+玄
+王
+玩
+珂
+珙
+球
+理
+琦
+琪
+瓊
+生
+田
+畢
+番
+瘡
+白
+皮
+真
+砲
+礮
+祈
+神
+祠
+秋
+空
+立
+精
+約
+絵
+織
+義
+翠
+者
+耕
+肖
+胡
+膀
+臂
+興
+良
+花
+芳
+芽
+若
+英
+藕
+藥
+蘄
+蘇
+行
+裁
+規
+覺
+观
+解
+記
+誓
+誡
+誰
+謎
+许
+谭
+豪
+豫
+費
+贵
+赤
+趙
+足
+跡
+転
+辛
+逆
+遇
+運
+過
+遠
+選
+邦
+邱
+部
+郭
+都
+酈
+里
+野
+金
+銃
+鋼
+錄
+錡
+鍵
+鐵
+钱
+铁
+關
+防
+阿
+陈
+陳
+陽
+隊
+階
+集
+雪
+雲
+霖
+霹
+靂
+韓
+願
+顯
+颜
+马
+高
+龍
+ﷲ
+ﻋ
+／
+３
+～
+##i
+##r
+##a
+##m
+##p
+##t
+##n
+##c
+##k
+##e
+##d
+##h
+##o
+##q
+##u
+##s
+##b
+##l
+##x
+##y
+##2
+##g
+##9
+##3
+##f
+##w
+##7
+##5
+##0
+##v
+##z
+##ł
+##6
+##ʻ
+##1
+##4
+##j
+##8
+##ო
+##ი
+##ə
+##ニ
+##ø
+##ि
+##მ
+##ე
+##ლ
+##ɑ
+##ˈ
+##ː
+##đ
+##ภ
+##า
+##ด
+##ɾ
+##ʲ
+##л
+##а
+##х
+##ل
+##ش
+##ي
+##خ
+##フ
+##ъ
+##з
+##н
+##е
+##с
+##и
+##ɪ
+##し
+##の
+##た
+##ま
+##ε
+##τ
+##ρ
+##ο
+##ν
+##ル
+##レ
+##イ
+##ン
+##ð
+##ι
+##σ
+##υ
+##ッ
+##ク
+##マ
+##ल
+##พ
+##ร
+##ذ
+##ن
+##ة
+##ा
+##न
+##ई
+##ネ
+##シ
+##ョ
+##ه
+##æ
+##р
+##т
+##о
+##ا
+##ب
+##つ
+##う
+##อ
+##ก
+##ว
+##ξ
+##ß
+##ء
+##ɛ
+##რ
+##გ
+##ვ
+##ა
+##ნ
+##サ
+##ス
+##ャ
+##モ
+##ล
+##ฮ
+##か
+##こ
+##く
+##み
+##д
+##ー
+##テ
+##ィ
+##ア
+##ל
+##ה
+##り
+##ォ
+##ト
+##ゥ
+##ナ
+##α
+##δ
+##μ
+##ש
+##מ
+##צ
+##っ
+##γ
+##ს
+##ტ
+##と
+##ह
+##ხ
+##η
+##ו
+##פ
+##נ
+##れ
+##い
+##ɽ
+##ן
+##ы
+##も
+##י
+##ס
+##п
+##क
+##ʊ
+##ˌ
+##ʁ
+##к
+##セ
+##リ
+##オ
+##ك
+##ر
+##د
+##و
+##ح
+##დ
+##ت
+##უ
+##を
+##あ
+##ん
+##θ
+##ɔ
+##ʔ
+##თ
+##ɒ
+##ᵻ
+##я
+##ɫ
+##λ
+##ς
+##は
+##め
+##व
+##ı
+##ウ
+##ァ
+##キ
+##ュ
+##３
+##き
+##ᄇ
+##ᅮ
+##ᄃ
+##ᅢ
+##ܕ
+##ܝ
+##ܢ
+##ܬ
+##в
+##χ
+##ع
+##ʿ
+##ण
+##ग
+##ラ
+##ჱ
+##ল
+##є
+##ف
+##º
+##ث
+##م
+##س
+##タ
+##ら
+##ɐ
+##ซ
+##ш
+##ц
+##ь
+##ɜ
+##ω
+##ਲ
+##ਾ
+##ਹ
+##ც
+##ള
+##お
+##β
+##ʃ
+##κ
+##π
+##ж
+##ɡ
+##ᅡ
+##ᆯ
+##ᄅ
+##द
+##ю
+##ค
+##ต
+##ษ
+##ฐ
+##ハ
+##ɳ
+##ാ
+##ഹ
+##ロ
+##र
+##ψ
+##な
+##া
+##হ
+##ะ
+##ช
+##น
+##ף
+##カ
+##す
+##ย
+##ณ
+##ม
+##ق
+##ゆ
+##ミ
+##у
+##ჳ
+##ツ
+##ב
+##ת
+##א
+##ง
+##ไ
+##ム
+##チ
+##ェ
+##œ
+##せ
+##ひ
+##ქ
+##ܠ
+##ܗ
+##ܐ
+##ʒ
+##წ
+##ფ
+##る
+##ち
+##ゃ
+##เ
+##ป
+##ჲ
+##エ
+##わ
+##ص
+##г
+##ᅦ
+##ᅩ
+##ᆨ
+##ᅵ
+##ᆸ
+##ᅧ
+##ᆼ
+##ᄋ
+##ᆫ
+##ノ
+##स
+##แ
+##ょ
+##に
+##ם
+##ר
+##м