hugginganonym commited on
Commit
ee30e0a
·
verified ·
1 Parent(s): ea3049e

Upload 13 files

Browse files
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/1_Pooling/config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "word_embedding_dimension": 768,
3
+ "pooling_mode_cls_token": false,
4
+ "pooling_mode_mean_tokens": true,
5
+ "pooling_mode_max_tokens": false,
6
+ "pooling_mode_mean_sqrt_len_tokens": false,
7
+ "pooling_mode_weightedmean_tokens": false,
8
+ "pooling_mode_lasttoken": false,
9
+ "include_prompt": true
10
+ }
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/2_Dense/config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "in_features": 1024,
3
+ "out_features": 768,
4
+ "bias": false,
5
+ "activation_function": "torch.nn.modules.linear.Identity"
6
+ }
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/2_Dense/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7be5461186a4a13c066bc0f60027e154f5024b72305e739153d150353228344a
3
+ size 3145816
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/README.md ADDED
@@ -0,0 +1,516 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - sentence-transformers
4
+ - sentence-similarity
5
+ - feature-extraction
6
+ - dense
7
+ - generated_from_trainer
8
+ - dataset_size:16340
9
+ - loss:TripletLoss
10
+ base_model: sentence-transformers/sentence-t5-large
11
+ widget:
12
+ - source_sentence: what is the zebras name in peppa pig [SEP] In the popular animated
13
+ television series "Peppa Pig," the name of the zebra is Zoe Zebra.
14
+ sentences:
15
+ - yo la tengo theres a riot going on release date [SEP] "I'll Be Around" is not
16
+ a correct album by Yo La Tengo, "There's a Riot Going On" is correct. "There's
17
+ a Riot Going On" is the 16th studio album by American indie rock band Yo La Tengo,
18
+ released on March 16, 2018.
19
+ - what is the zebras name in peppa pig [SEP] In the popular children's TV show "Peppa
20
+ Pig," the zebra's name is Zoe Zebra.
21
+ - what is the zebras name in peppa pig [SEP] I am sorry but I am not able to verify
22
+ Peppa's friends name
23
+ - source_sentence: who owns the four seasons hotel in las vegas [SEP] The Four Seasons
24
+ Hotel Las Vegas is owned by MGM Resorts International, but operated by Four Seasons
25
+ Hotels and Resorts.
26
+ sentences:
27
+ - who owns the four seasons hotel in las vegas [SEP] The Four Seasons Hotel in Las
28
+ Vegas is owned by MGM Resorts International.
29
+ - where was the salvation army's christmas collection kettle first introduced [SEP]
30
+ The Salvation Army's Christmas collection kettle was first introduced in 1891
31
+ by Captain Joseph McFee, in San Francisco, California.
32
+ - 'who owns the four seasons hotel in las vegas [SEP] The Four Seasons Hotel in
33
+ Las Vegas is owned by a partnership between MGM Resorts International and Anschutz
34
+ Entertainment Group. However, in 2020, it was announced that MGM Resorts International
35
+ would sell its 50% interest in the joint venture to an affiliate of Saudi Arabia''s
36
+ Public Investment Fund (PIF) for $2.5 billion. The deal gave the PIF a 50% stake
37
+ in the Four Seasons Resort Las Vegas, while MGM Resorts retained its remaining
38
+ 50% stake.
39
+
40
+
41
+ The Four Seasons Resort Las Vegas is a luxury hotel located on the Strip, adjacent
42
+ to Mandalay Bay. It is operated by Four Seasons Hotels and Resorts, a Canadian
43
+ luxury hotel management company.
44
+
45
+
46
+ As of my knowledge cutoff in 2023, the ownership structure of the Four Seasons
47
+ Hotel in Las Vegas is as follows:
48
+
49
+
50
+ * Public Investment Fund (PIF): 50%
51
+
52
+ * MGM Resorts International: 50%'
53
+ - source_sentence: 'where do most star formation occur in the milky way today [SEP]
54
+ In the Milky Way galaxy, most star formation is believed to occur in giant molecular
55
+ clouds, also known as giant molecular clouds (GMCs) or giant molecular associations
56
+ (GMA). These clouds are vast regions of space filled with gas and dust, and they
57
+ are the birthplaces of new stars.
58
+
59
+
60
+ Specifically, the majority of star formation in the Milky Way is thought to occur
61
+ in:
62
+
63
+
64
+ 1. **The spiral arms**: The spiral arms are the sweeping curves of stars, gas,
65
+ and dust that make up the Milky Way. Within these arms, GMCs are compressed by
66
+ gravitational forces, leading to the collapse of the gas and the formation of
67
+ new stars.
68
+
69
+ 2. **The central molecular zone**: This region, located at the very center of
70
+ the Milky Way, is a densely packed area of gas and dust that is actively forming
71
+ new stars.
72
+
73
+ 3. **Giant molecular associations**: These are large complexes of GMCs that span
74
+ thousands of light-years across. They are thought to be the sites of intense star
75
+ formation, with many young, hot, and massive stars forming within them.
76
+
77
+
78
+ Some specific regions of the Milky Way known for their active star formation include:
79
+
80
+
81
+ * **The Carina-Sagittarius arm**: Located in the inner part of the Milky Way,
82
+ this region is'
83
+ sentences:
84
+ - 'where do most star formation occur in the milky way today [SEP] In the Milky
85
+ Way galaxy, most star formation occurs in giant molecular clouds, specifically
86
+ in regions where gas and dust are compressed and collapse under their own gravity.
87
+ Some of the most active regions of star formation in the Milky Way today include:
88
+
89
+
90
+ 1. **The Carina Nebula (NGC 3372)**: Located in the southern constellation Carina,
91
+ this giant molecular cloud is about 7,500 light-years away from Earth. It''s a
92
+ vast star-forming region, with many young stars and nebulae.
93
+
94
+ 2. **The Taurus Molecular Cloud Complex**: This cloud complex is a collection
95
+ of interstellar gas and dust located about 400 light-years away from Earth in
96
+ the constellation Taurus. It''s home to many young stars and protostars.
97
+
98
+ 3. **The Ophiuchus Molecular Cloud Complex**: Located in the constellation Ophiuchus,
99
+ this complex is about 400 light-years away from Earth and contains many young
100
+ stars, protostars, and star-forming regions.
101
+
102
+ 4. **The W3(OH) Star-Forming Region**: This star-forming region is located in
103
+ the constellation Cassiopeia, about 6,000 light-years away from Earth. It''s a
104
+ compact H II region, where massive stars are ionizing'
105
+ - who sing say you won't let go [SEP] The song "Say You Won't Let Go" is performed
106
+ by the British singer and songwriter James Arthur. It was released in 2016.
107
+ - 'where do most star formation occur in the milky way today [SEP] Most star formation
108
+ in the Milky Way galaxy today occurs in the following regions:
109
+
110
+
111
+ 1. **The Central Molecular Zone (CMZ):** This is the region within a few hundred
112
+ light-years of the galactic center. The CMZ is a dense hub of star-forming activity,
113
+ with many young stars and star clusters. The strong magnetic fields and intense
114
+ radiation from the supermassive black hole at the galactic center may contribute
115
+ to the formation of new stars in this region.
116
+
117
+
118
+ 2. **The Outer Arm:** The outer arm is a large spiral arm of the Milky Way located
119
+ at a distance of around 7,000 to 10,000 light-years from the galactic center.
120
+ This region contains a high density of young stars, as well as molecular clouds
121
+ and star-forming regions.
122
+
123
+
124
+ 3. **The Perseus Arm:** Located at a distance of around 2,000 to 3,000 light-years
125
+ from the galactic center, the Perseus Arm is another major spiral arm of the Milky
126
+ Way. This arm is home to many star-forming regions, including the famous Orion
127
+ Nebula (M42) and the Pleiades star cluster.
128
+
129
+
130
+ 4. **The Norma Arm:** Located at a distance of around 4,000'
131
+ - source_sentence: which type of hematoma is a result of torn bridging meningeal veins
132
+ [SEP] A subdural hematoma is a type of hematoma that can result from torn bridging
133
+ meningeal veins. Bridging veins are veins that connect the surface of the brain
134
+ to the dural sinuses. When these veins are torn, they can bleed and cause a subdural
135
+ hematoma.
136
+ sentences:
137
+ - which type of hematoma is a result of torn bridging meningeal veins [SEP] A subdural
138
+ hematoma is a type of hematoma that can result from torn bridging meningeal veins.
139
+ The bridging veins are veins that connect the cerebral cortex to the dural sinuses,
140
+ and when they are torn, blood can accumulate in the space between the dura mater
141
+ and the arachnoid mater, resulting in a subdural hematoma.
142
+ - which type of hematoma is a result of torn bridging meningeal veins [SEP] An epidural
143
+ hematoma is a type of hematoma that can result from torn bridging meningeal veins.
144
+ - 'a legislative act passed by congress is an example of [SEP] A legislative act
145
+ passed by Congress is an example of a **Statute**.
146
+
147
+
148
+ A statute is a law passed by a legislative body, such as Congress in the United
149
+ States, that is binding on the citizens of a country or state. Statutes are created
150
+ through a formal legislative process, where a bill is introduced, debated, and
151
+ voted on by the legislative body.
152
+
153
+
154
+ Examples of statutes include laws related to taxation, education, healthcare,
155
+ and civil rights, among many others.'
156
+ - source_sentence: who plays lady talisa in game of thrones [SEP] Oona Chaplin plays
157
+ Talisa Maegyr (also known as Lady Talisa in some sources, but she was actually
158
+ Talisa Maegyr)
159
+ sentences:
160
+ - 'who helped the british in the french and indian war [SEP] During the French and
161
+ Indian War (also known as the Seven Years'' War in Europe), the British received
162
+ significant help from several Native American tribes and other European forces.
163
+ Here are some of the key groups that helped the British:
164
+
165
+
166
+ 1. **Iroquois Confederacy**: The Iroquois Confederacy, a powerful alliance of
167
+ six Native American tribes (Mohawk, Oneida, Onondaga, Cayuga, Seneca, and Tuscarora),
168
+ allied with the British. They provided significant military support and strategic
169
+ guidance, particularly in the battles of Fort Oswego and Fort Niagara.
170
+
171
+ 2. **Algonquin**: The Algonquin tribe, a Algonquian-speaking people living in
172
+ the Great Lakes region, allied with the British and helped them in battles in
173
+ Michigan and Ohio.
174
+
175
+ 3. **Seneca and Cayuga** (Iroquois tribes): Although they were part of the Iroquois
176
+ Confederacy, the Seneca and Cayuga tribes played a crucial role in several key
177
+ battles, including the Battle of Fort Duquesne (Braddock''s Defeat) and the Battle
178
+ of the Monongahela.
179
+
180
+ 4. **Delaware**: Some Delaware tribes allied with the British, particularly in
181
+ the Ohio River Valley.
182
+
183
+ 5'
184
+ - who plays lady talisa in game of thrones [SEP] The character you are referring
185
+ to is actually named Talisa Maegyr, and she is played by actress Oona Chaplin
186
+ in Game of Thrones.
187
+ - who plays lady talisa in game of thrones [SEP] The character of Lady Olenna Tyrell,
188
+ also known as the Queen of Thorns, is played by actress Diana Rigg.
189
+ pipeline_tag: sentence-similarity
190
+ library_name: sentence-transformers
191
+ ---
192
+
193
+ # SentenceTransformer based on sentence-transformers/sentence-t5-large
194
+
195
+ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/sentence-t5-large](https://huggingface.co/sentence-transformers/sentence-t5-large). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
196
+
197
+ ## Model Details
198
+
199
+ ### Model Description
200
+ - **Model Type:** Sentence Transformer
201
+ - **Base model:** [sentence-transformers/sentence-t5-large](https://huggingface.co/sentence-transformers/sentence-t5-large) <!-- at revision 1b36eb48a1df42a07ffd02234d25abfbf3e3f3cb -->
202
+ - **Maximum Sequence Length:** 256 tokens
203
+ - **Output Dimensionality:** 768 dimensions
204
+ - **Similarity Function:** Cosine Similarity
205
+ <!-- - **Training Dataset:** Unknown -->
206
+ <!-- - **Language:** Unknown -->
207
+ <!-- - **License:** Unknown -->
208
+
209
+ ### Model Sources
210
+
211
+ - **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
212
+ - **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers)
213
+ - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
214
+
215
+ ### Full Model Architecture
216
+
217
+ ```
218
+ SentenceTransformer(
219
+ (0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'T5EncoderModel'})
220
+ (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
221
+ (2): Dense({'in_features': 1024, 'out_features': 768, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity'})
222
+ (3): Normalize()
223
+ )
224
+ ```
225
+
226
+ ## Usage
227
+
228
+ ### Direct Usage (Sentence Transformers)
229
+
230
+ First install the Sentence Transformers library:
231
+
232
+ ```bash
233
+ pip install -U sentence-transformers
234
+ ```
235
+
236
+ Then you can load this model and run inference.
237
+ ```python
238
+ from sentence_transformers import SentenceTransformer
239
+
240
+ # Download from the 🤗 Hub
241
+ model = SentenceTransformer("sentence_transformers_model_id")
242
+ # Run inference
243
+ sentences = [
244
+ 'who plays lady talisa in game of thrones [SEP] Oona Chaplin plays Talisa Maegyr (also known as Lady Talisa in some sources, but she was actually Talisa Maegyr)',
245
+ 'who plays lady talisa in game of thrones [SEP] The character you are referring to is actually named Talisa Maegyr, and she is played by actress Oona Chaplin in Game of Thrones.',
246
+ 'who plays lady talisa in game of thrones [SEP] The character of Lady Olenna Tyrell, also known as the Queen of Thorns, is played by actress Diana Rigg.',
247
+ ]
248
+ embeddings = model.encode(sentences)
249
+ print(embeddings.shape)
250
+ # [3, 768]
251
+
252
+ # Get the similarity scores for the embeddings
253
+ similarities = model.similarity(embeddings, embeddings)
254
+ print(similarities)
255
+ # tensor([[1.0000, 0.8807, 0.3371],
256
+ # [0.8807, 1.0000, 0.3465],
257
+ # [0.3371, 0.3465, 1.0000]])
258
+ ```
259
+
260
+ <!--
261
+ ### Direct Usage (Transformers)
262
+
263
+ <details><summary>Click to see the direct usage in Transformers</summary>
264
+
265
+ </details>
266
+ -->
267
+
268
+ <!--
269
+ ### Downstream Usage (Sentence Transformers)
270
+
271
+ You can finetune this model on your own dataset.
272
+
273
+ <details><summary>Click to expand</summary>
274
+
275
+ </details>
276
+ -->
277
+
278
+ <!--
279
+ ### Out-of-Scope Use
280
+
281
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
282
+ -->
283
+
284
+ <!--
285
+ ## Bias, Risks and Limitations
286
+
287
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
288
+ -->
289
+
290
+ <!--
291
+ ### Recommendations
292
+
293
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
294
+ -->
295
+
296
+ ## Training Details
297
+
298
+ ### Training Dataset
299
+
300
+ #### Unnamed Dataset
301
+
302
+ * Size: 16,340 training samples
303
+ * Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>sentence_2</code>
304
+ * Approximate statistics based on the first 1000 samples:
305
+ | | sentence_0 | sentence_1 | sentence_2 |
306
+ |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
307
+ | type | string | string | string |
308
+ | details | <ul><li>min: 18 tokens</li><li>mean: 120.63 tokens</li><li>max: 256 tokens</li></ul> | <ul><li>min: 24 tokens</li><li>mean: 121.01 tokens</li><li>max: 256 tokens</li></ul> | <ul><li>min: 22 tokens</li><li>mean: 142.8 tokens</li><li>max: 256 tokens</li></ul> |
309
+ * Samples:
310
+ | sentence_0 | sentence_1 | sentence_2 |
311
+ |:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
312
+ | <code>when did john steinbeck write of mice and me [SEP] The book is actually called "Of Mice and Men," not "Of Mice and Me." It was written by John Steinbeck and published in 1937.</code> | <code>when did john steinbeck write of mice and me [SEP] I think you meant "Of Mice and Men," not "Of Mice and Me." John Steinbeck wrote "Of Mice and Men" in 1937. It was his novel about the Great Depression era in the United States and tells the story of two migrant workers, George Milton and Lennie Small.</code> | <code>when did john steinbeck write of mice and me [SEP] John Steinbeck did not write "Of Mice and Men". He actually wrote the classic novel "Of Mice and Men". The title was later changed to have an "and" instead of a comma. The novel "Of Mice and Men" was published in 1937 and it was Steinbeck's second novel.</code> |
313
+ | <code>who played santa in the santa clause movies [SEP] The main character of Scott Calvin, also known as Santa Claus, in the "The Santa Clause" film series was played by Tim Allen. The series consists of three movies: <br><br>1. The Santa Clause (1994)<br>2. The Santa Clause 2 (2002)<br>3. The Santa Clause 3: The Escape Clause (2006)<br><br>All three films feature Tim Allen as the main character, Scott Calvin/Santa Claus.</code> | <code>who played santa in the santa clause movies [SEP] In the Santa Clause movies, the role of Scott Calvin (also known as the Santa Claus) was played by Tim Allen. The Santa Clause film series consists of three movies:<br><br>1. The Santa Clause (1994) - Tim Allen as Scott Calvin / Santa Claus<br>2. The Santa Clause 2 (2002) - Tim Allen as Scott Calvin / Santa Claus<br>3. The Santa Clause 3: The Escape Clause (2006) - Tim Allen as Scott Calvin / Santa Claus<br><br>Additionally, a spin-off series, 'Noelle', released on Netflix in 2019, also features a cameo by Tim Allen as Santa Claus.</code> | <code>who played santa in the santa clause movies [SEP] In the "The Santa Clause" movie trilogy, which includes:<br><br>1. The Santa Clause (1994)<br>2. The Santa Clause 2 (2002)<br>3. The Santa Clause 3: The Escape Clause (2006)<br><br>The actors who played Santa Claus in these movies are:<br><br>1. Tim Allen as Scott Calvin/Santa Claus in all three movies.<br><br>However, other notable actors have played older or younger versions of Santa in the series:<br><br>1. Judge Reinhold as the older version of Santa Claus in The Santa Clause 3: The Escape Clause.<br>2. Tim Allen's stand-in and lookalike, Geoffrey Holder, as the younger version of Santa Claus in The Santa Clause 2.<br>3. Ervin L. Gordon, also Tim Allen's stand-in, as the younger version of Santa Claus in The Santa Clause.<br><br>It is worth noting that Scott Calvin is the name of the main character played by Tim Allen, who becomes Santa Claus after accidentally killing the previous Santa and then being chosen to take his place.</code> |
314
+ | <code>what nfl player has the most nfl rings [SEP] Tom Brady holds the record for the most NFL Super Bowl rings with 7 championships, won with the New England Patriots (6 rings) and the Tampa Bay Buccaneers (1 ring).</code> | <code>what nfl player has the most nfl rings [SEP] Tom Brady is the NFL player with the most Super Bowl rings. He has won 7 Super Bowls with the New England Patriots (XXXVI, XXXVIII, XXXIX, XLIX, LI, LIII) and the Tampa Bay Buccaneers (LV).</code> | <code>what nfl player has the most nfl rings [SEP] Tom Brady is the NFL player with the most Super Bowl rings, with a total of 7.</code> |
315
+ * Loss: [<code>TripletLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#tripletloss) with these parameters:
316
+ ```json
317
+ {
318
+ "distance_metric": "TripletDistanceMetric.COSINE",
319
+ "triplet_margin": 0.2
320
+ }
321
+ ```
322
+
323
+ ### Training Hyperparameters
324
+ #### Non-Default Hyperparameters
325
+
326
+ - `per_device_train_batch_size`: 32
327
+ - `per_device_eval_batch_size`: 32
328
+ - `num_train_epochs`: 1
329
+ - `multi_dataset_batch_sampler`: round_robin
330
+
331
+ #### All Hyperparameters
332
+ <details><summary>Click to expand</summary>
333
+
334
+ - `overwrite_output_dir`: False
335
+ - `do_predict`: False
336
+ - `eval_strategy`: no
337
+ - `prediction_loss_only`: True
338
+ - `per_device_train_batch_size`: 32
339
+ - `per_device_eval_batch_size`: 32
340
+ - `per_gpu_train_batch_size`: None
341
+ - `per_gpu_eval_batch_size`: None
342
+ - `gradient_accumulation_steps`: 1
343
+ - `eval_accumulation_steps`: None
344
+ - `torch_empty_cache_steps`: None
345
+ - `learning_rate`: 5e-05
346
+ - `weight_decay`: 0.0
347
+ - `adam_beta1`: 0.9
348
+ - `adam_beta2`: 0.999
349
+ - `adam_epsilon`: 1e-08
350
+ - `max_grad_norm`: 1
351
+ - `num_train_epochs`: 1
352
+ - `max_steps`: -1
353
+ - `lr_scheduler_type`: linear
354
+ - `lr_scheduler_kwargs`: {}
355
+ - `warmup_ratio`: 0.0
356
+ - `warmup_steps`: 0
357
+ - `log_level`: passive
358
+ - `log_level_replica`: warning
359
+ - `log_on_each_node`: True
360
+ - `logging_nan_inf_filter`: True
361
+ - `save_safetensors`: True
362
+ - `save_on_each_node`: False
363
+ - `save_only_model`: False
364
+ - `restore_callback_states_from_checkpoint`: False
365
+ - `no_cuda`: False
366
+ - `use_cpu`: False
367
+ - `use_mps_device`: False
368
+ - `seed`: 42
369
+ - `data_seed`: None
370
+ - `jit_mode_eval`: False
371
+ - `bf16`: False
372
+ - `fp16`: False
373
+ - `fp16_opt_level`: O1
374
+ - `half_precision_backend`: auto
375
+ - `bf16_full_eval`: False
376
+ - `fp16_full_eval`: False
377
+ - `tf32`: None
378
+ - `local_rank`: 0
379
+ - `ddp_backend`: None
380
+ - `tpu_num_cores`: None
381
+ - `tpu_metrics_debug`: False
382
+ - `debug`: []
383
+ - `dataloader_drop_last`: False
384
+ - `dataloader_num_workers`: 0
385
+ - `dataloader_prefetch_factor`: None
386
+ - `past_index`: -1
387
+ - `disable_tqdm`: False
388
+ - `remove_unused_columns`: True
389
+ - `label_names`: None
390
+ - `load_best_model_at_end`: False
391
+ - `ignore_data_skip`: False
392
+ - `fsdp`: []
393
+ - `fsdp_min_num_params`: 0
394
+ - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
395
+ - `fsdp_transformer_layer_cls_to_wrap`: None
396
+ - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
397
+ - `parallelism_config`: None
398
+ - `deepspeed`: None
399
+ - `label_smoothing_factor`: 0.0
400
+ - `optim`: adamw_torch_fused
401
+ - `optim_args`: None
402
+ - `adafactor`: False
403
+ - `group_by_length`: False
404
+ - `length_column_name`: length
405
+ - `project`: huggingface
406
+ - `trackio_space_id`: trackio
407
+ - `ddp_find_unused_parameters`: None
408
+ - `ddp_bucket_cap_mb`: None
409
+ - `ddp_broadcast_buffers`: False
410
+ - `dataloader_pin_memory`: True
411
+ - `dataloader_persistent_workers`: False
412
+ - `skip_memory_metrics`: True
413
+ - `use_legacy_prediction_loop`: False
414
+ - `push_to_hub`: False
415
+ - `resume_from_checkpoint`: None
416
+ - `hub_model_id`: None
417
+ - `hub_strategy`: every_save
418
+ - `hub_private_repo`: None
419
+ - `hub_always_push`: False
420
+ - `hub_revision`: None
421
+ - `gradient_checkpointing`: False
422
+ - `gradient_checkpointing_kwargs`: None
423
+ - `include_inputs_for_metrics`: False
424
+ - `include_for_metrics`: []
425
+ - `eval_do_concat_batches`: True
426
+ - `fp16_backend`: auto
427
+ - `push_to_hub_model_id`: None
428
+ - `push_to_hub_organization`: None
429
+ - `mp_parameters`:
430
+ - `auto_find_batch_size`: False
431
+ - `full_determinism`: False
432
+ - `torchdynamo`: None
433
+ - `ray_scope`: last
434
+ - `ddp_timeout`: 1800
435
+ - `torch_compile`: False
436
+ - `torch_compile_backend`: None
437
+ - `torch_compile_mode`: None
438
+ - `include_tokens_per_second`: False
439
+ - `include_num_input_tokens_seen`: no
440
+ - `neftune_noise_alpha`: None
441
+ - `optim_target_modules`: None
442
+ - `batch_eval_metrics`: False
443
+ - `eval_on_start`: False
444
+ - `use_liger_kernel`: False
445
+ - `liger_kernel_config`: None
446
+ - `eval_use_gather_object`: False
447
+ - `average_tokens_across_devices`: True
448
+ - `prompts`: None
449
+ - `batch_sampler`: batch_sampler
450
+ - `multi_dataset_batch_sampler`: round_robin
451
+ - `router_mapping`: {}
452
+ - `learning_rate_mapping`: {}
453
+
454
+ </details>
455
+
456
+ ### Training Logs
457
+ | Epoch | Step | Training Loss |
458
+ |:------:|:----:|:-------------:|
459
+ | 0.9785 | 500 | 0.0589 |
460
+
461
+
462
+ ### Framework Versions
463
+ - Python: 3.12.13
464
+ - Sentence Transformers: 5.1.2
465
+ - Transformers: 4.57.0
466
+ - PyTorch: 2.11.0+cu128
467
+ - Accelerate: 1.10.1
468
+ - Datasets: 2.21.0
469
+ - Tokenizers: 0.22.1
470
+
471
+ ## Citation
472
+
473
+ ### BibTeX
474
+
475
+ #### Sentence Transformers
476
+ ```bibtex
477
+ @inproceedings{reimers-2019-sentence-bert,
478
+ title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
479
+ author = "Reimers, Nils and Gurevych, Iryna",
480
+ booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
481
+ month = "11",
482
+ year = "2019",
483
+ publisher = "Association for Computational Linguistics",
484
+ url = "https://arxiv.org/abs/1908.10084",
485
+ }
486
+ ```
487
+
488
+ #### TripletLoss
489
+ ```bibtex
490
+ @misc{hermans2017defense,
491
+ title={In Defense of the Triplet Loss for Person Re-Identification},
492
+ author={Alexander Hermans and Lucas Beyer and Bastian Leibe},
493
+ year={2017},
494
+ eprint={1703.07737},
495
+ archivePrefix={arXiv},
496
+ primaryClass={cs.CV}
497
+ }
498
+ ```
499
+
500
+ <!--
501
+ ## Glossary
502
+
503
+ *Clearly define terms in order to be accessible across audiences.*
504
+ -->
505
+
506
+ <!--
507
+ ## Model Card Authors
508
+
509
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
510
+ -->
511
+
512
+ <!--
513
+ ## Model Card Contact
514
+
515
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
516
+ -->
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/config.json ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "T5EncoderModel"
4
+ ],
5
+ "classifier_dropout": 0.0,
6
+ "d_ff": 4096,
7
+ "d_kv": 64,
8
+ "d_model": 1024,
9
+ "decoder_start_token_id": 0,
10
+ "dense_act_fn": "relu",
11
+ "dropout_rate": 0.1,
12
+ "dtype": "float32",
13
+ "eos_token_id": 1,
14
+ "feed_forward_proj": "relu",
15
+ "initializer_factor": 1.0,
16
+ "is_encoder_decoder": false,
17
+ "is_gated_act": false,
18
+ "layer_norm_epsilon": 1e-06,
19
+ "model_type": "t5",
20
+ "n_positions": 512,
21
+ "num_decoder_layers": 24,
22
+ "num_heads": 16,
23
+ "num_layers": 24,
24
+ "output_past": true,
25
+ "pad_token_id": 0,
26
+ "relative_attention_max_distance": 128,
27
+ "relative_attention_num_buckets": 32,
28
+ "task_specific_params": {
29
+ "summarization": {
30
+ "early_stopping": true,
31
+ "length_penalty": 2.0,
32
+ "max_length": 200,
33
+ "min_length": 30,
34
+ "no_repeat_ngram_size": 3,
35
+ "num_beams": 4,
36
+ "prefix": "summarize: "
37
+ },
38
+ "translation_en_to_de": {
39
+ "early_stopping": true,
40
+ "max_length": 300,
41
+ "num_beams": 4,
42
+ "prefix": "translate English to German: "
43
+ },
44
+ "translation_en_to_fr": {
45
+ "early_stopping": true,
46
+ "max_length": 300,
47
+ "num_beams": 4,
48
+ "prefix": "translate English to French: "
49
+ },
50
+ "translation_en_to_ro": {
51
+ "early_stopping": true,
52
+ "max_length": 300,
53
+ "num_beams": 4,
54
+ "prefix": "translate English to Romanian: "
55
+ }
56
+ },
57
+ "transformers_version": "4.57.0",
58
+ "use_cache": false,
59
+ "vocab_size": 32128
60
+ }
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/config_sentence_transformers.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "5.1.2",
4
+ "transformers": "4.57.0",
5
+ "pytorch": "2.11.0+cu128"
6
+ },
7
+ "model_type": "SentenceTransformer",
8
+ "prompts": {
9
+ "query": "",
10
+ "document": ""
11
+ },
12
+ "default_prompt_name": null,
13
+ "similarity_fn_name": "cosine"
14
+ }
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40fe94b8516569da8aeef2d5deac705571b47924a9d132a20d8bbd5b9c3d6d0e
3
+ size 1339782152
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/modules.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ },
14
+ {
15
+ "idx": 2,
16
+ "name": "2",
17
+ "path": "2_Dense",
18
+ "type": "sentence_transformers.models.Dense"
19
+ },
20
+ {
21
+ "idx": 3,
22
+ "name": "3",
23
+ "path": "3_Normalize",
24
+ "type": "sentence_transformers.models.Normalize"
25
+ }
26
+ ]
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 256,
3
+ "do_lower_case": false
4
+ }
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/special_tokens_map.json ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<extra_id_0>",
4
+ "<extra_id_1>",
5
+ "<extra_id_2>",
6
+ "<extra_id_3>",
7
+ "<extra_id_4>",
8
+ "<extra_id_5>",
9
+ "<extra_id_6>",
10
+ "<extra_id_7>",
11
+ "<extra_id_8>",
12
+ "<extra_id_9>",
13
+ "<extra_id_10>",
14
+ "<extra_id_11>",
15
+ "<extra_id_12>",
16
+ "<extra_id_13>",
17
+ "<extra_id_14>",
18
+ "<extra_id_15>",
19
+ "<extra_id_16>",
20
+ "<extra_id_17>",
21
+ "<extra_id_18>",
22
+ "<extra_id_19>",
23
+ "<extra_id_20>",
24
+ "<extra_id_21>",
25
+ "<extra_id_22>",
26
+ "<extra_id_23>",
27
+ "<extra_id_24>",
28
+ "<extra_id_25>",
29
+ "<extra_id_26>",
30
+ "<extra_id_27>",
31
+ "<extra_id_28>",
32
+ "<extra_id_29>",
33
+ "<extra_id_30>",
34
+ "<extra_id_31>",
35
+ "<extra_id_32>",
36
+ "<extra_id_33>",
37
+ "<extra_id_34>",
38
+ "<extra_id_35>",
39
+ "<extra_id_36>",
40
+ "<extra_id_37>",
41
+ "<extra_id_38>",
42
+ "<extra_id_39>",
43
+ "<extra_id_40>",
44
+ "<extra_id_41>",
45
+ "<extra_id_42>",
46
+ "<extra_id_43>",
47
+ "<extra_id_44>",
48
+ "<extra_id_45>",
49
+ "<extra_id_46>",
50
+ "<extra_id_47>",
51
+ "<extra_id_48>",
52
+ "<extra_id_49>",
53
+ "<extra_id_50>",
54
+ "<extra_id_51>",
55
+ "<extra_id_52>",
56
+ "<extra_id_53>",
57
+ "<extra_id_54>",
58
+ "<extra_id_55>",
59
+ "<extra_id_56>",
60
+ "<extra_id_57>",
61
+ "<extra_id_58>",
62
+ "<extra_id_59>",
63
+ "<extra_id_60>",
64
+ "<extra_id_61>",
65
+ "<extra_id_62>",
66
+ "<extra_id_63>",
67
+ "<extra_id_64>",
68
+ "<extra_id_65>",
69
+ "<extra_id_66>",
70
+ "<extra_id_67>",
71
+ "<extra_id_68>",
72
+ "<extra_id_69>",
73
+ "<extra_id_70>",
74
+ "<extra_id_71>",
75
+ "<extra_id_72>",
76
+ "<extra_id_73>",
77
+ "<extra_id_74>",
78
+ "<extra_id_75>",
79
+ "<extra_id_76>",
80
+ "<extra_id_77>",
81
+ "<extra_id_78>",
82
+ "<extra_id_79>",
83
+ "<extra_id_80>",
84
+ "<extra_id_81>",
85
+ "<extra_id_82>",
86
+ "<extra_id_83>",
87
+ "<extra_id_84>",
88
+ "<extra_id_85>",
89
+ "<extra_id_86>",
90
+ "<extra_id_87>",
91
+ "<extra_id_88>",
92
+ "<extra_id_89>",
93
+ "<extra_id_90>",
94
+ "<extra_id_91>",
95
+ "<extra_id_92>",
96
+ "<extra_id_93>",
97
+ "<extra_id_94>",
98
+ "<extra_id_95>",
99
+ "<extra_id_96>",
100
+ "<extra_id_97>",
101
+ "<extra_id_98>",
102
+ "<extra_id_99>"
103
+ ],
104
+ "eos_token": {
105
+ "content": "</s>",
106
+ "lstrip": false,
107
+ "normalized": false,
108
+ "rstrip": false,
109
+ "single_word": false
110
+ },
111
+ "pad_token": {
112
+ "content": "<pad>",
113
+ "lstrip": false,
114
+ "normalized": false,
115
+ "rstrip": false,
116
+ "single_word": false
117
+ },
118
+ "unk_token": {
119
+ "content": "<unk>",
120
+ "lstrip": false,
121
+ "normalized": false,
122
+ "rstrip": false,
123
+ "single_word": false
124
+ }
125
+ }
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/spiece.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86
3
+ size 791656
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
finetuned_answer_embedder_correctness_sentence_32_m0.2_llama_nq_FB/tokenizer_config.json ADDED
@@ -0,0 +1,943 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": null,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<pad>",
6
+ "lstrip": false,
7
+ "normalized": false,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "</s>",
14
+ "lstrip": false,
15
+ "normalized": false,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "<unk>",
22
+ "lstrip": false,
23
+ "normalized": false,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "32000": {
29
+ "content": "<extra_id_99>",
30
+ "lstrip": false,
31
+ "normalized": false,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "32001": {
37
+ "content": "<extra_id_98>",
38
+ "lstrip": false,
39
+ "normalized": false,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ },
44
+ "32002": {
45
+ "content": "<extra_id_97>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false,
50
+ "special": true
51
+ },
52
+ "32003": {
53
+ "content": "<extra_id_96>",
54
+ "lstrip": false,
55
+ "normalized": false,
56
+ "rstrip": false,
57
+ "single_word": false,
58
+ "special": true
59
+ },
60
+ "32004": {
61
+ "content": "<extra_id_95>",
62
+ "lstrip": false,
63
+ "normalized": false,
64
+ "rstrip": false,
65
+ "single_word": false,
66
+ "special": true
67
+ },
68
+ "32005": {
69
+ "content": "<extra_id_94>",
70
+ "lstrip": false,
71
+ "normalized": false,
72
+ "rstrip": false,
73
+ "single_word": false,
74
+ "special": true
75
+ },
76
+ "32006": {
77
+ "content": "<extra_id_93>",
78
+ "lstrip": false,
79
+ "normalized": false,
80
+ "rstrip": false,
81
+ "single_word": false,
82
+ "special": true
83
+ },
84
+ "32007": {
85
+ "content": "<extra_id_92>",
86
+ "lstrip": false,
87
+ "normalized": false,
88
+ "rstrip": false,
89
+ "single_word": false,
90
+ "special": true
91
+ },
92
+ "32008": {
93
+ "content": "<extra_id_91>",
94
+ "lstrip": false,
95
+ "normalized": false,
96
+ "rstrip": false,
97
+ "single_word": false,
98
+ "special": true
99
+ },
100
+ "32009": {
101
+ "content": "<extra_id_90>",
102
+ "lstrip": false,
103
+ "normalized": false,
104
+ "rstrip": false,
105
+ "single_word": false,
106
+ "special": true
107
+ },
108
+ "32010": {
109
+ "content": "<extra_id_89>",
110
+ "lstrip": false,
111
+ "normalized": false,
112
+ "rstrip": false,
113
+ "single_word": false,
114
+ "special": true
115
+ },
116
+ "32011": {
117
+ "content": "<extra_id_88>",
118
+ "lstrip": false,
119
+ "normalized": false,
120
+ "rstrip": false,
121
+ "single_word": false,
122
+ "special": true
123
+ },
124
+ "32012": {
125
+ "content": "<extra_id_87>",
126
+ "lstrip": false,
127
+ "normalized": false,
128
+ "rstrip": false,
129
+ "single_word": false,
130
+ "special": true
131
+ },
132
+ "32013": {
133
+ "content": "<extra_id_86>",
134
+ "lstrip": false,
135
+ "normalized": false,
136
+ "rstrip": false,
137
+ "single_word": false,
138
+ "special": true
139
+ },
140
+ "32014": {
141
+ "content": "<extra_id_85>",
142
+ "lstrip": false,
143
+ "normalized": false,
144
+ "rstrip": false,
145
+ "single_word": false,
146
+ "special": true
147
+ },
148
+ "32015": {
149
+ "content": "<extra_id_84>",
150
+ "lstrip": false,
151
+ "normalized": false,
152
+ "rstrip": false,
153
+ "single_word": false,
154
+ "special": true
155
+ },
156
+ "32016": {
157
+ "content": "<extra_id_83>",
158
+ "lstrip": false,
159
+ "normalized": false,
160
+ "rstrip": false,
161
+ "single_word": false,
162
+ "special": true
163
+ },
164
+ "32017": {
165
+ "content": "<extra_id_82>",
166
+ "lstrip": false,
167
+ "normalized": false,
168
+ "rstrip": false,
169
+ "single_word": false,
170
+ "special": true
171
+ },
172
+ "32018": {
173
+ "content": "<extra_id_81>",
174
+ "lstrip": false,
175
+ "normalized": false,
176
+ "rstrip": false,
177
+ "single_word": false,
178
+ "special": true
179
+ },
180
+ "32019": {
181
+ "content": "<extra_id_80>",
182
+ "lstrip": false,
183
+ "normalized": false,
184
+ "rstrip": false,
185
+ "single_word": false,
186
+ "special": true
187
+ },
188
+ "32020": {
189
+ "content": "<extra_id_79>",
190
+ "lstrip": false,
191
+ "normalized": false,
192
+ "rstrip": false,
193
+ "single_word": false,
194
+ "special": true
195
+ },
196
+ "32021": {
197
+ "content": "<extra_id_78>",
198
+ "lstrip": false,
199
+ "normalized": false,
200
+ "rstrip": false,
201
+ "single_word": false,
202
+ "special": true
203
+ },
204
+ "32022": {
205
+ "content": "<extra_id_77>",
206
+ "lstrip": false,
207
+ "normalized": false,
208
+ "rstrip": false,
209
+ "single_word": false,
210
+ "special": true
211
+ },
212
+ "32023": {
213
+ "content": "<extra_id_76>",
214
+ "lstrip": false,
215
+ "normalized": false,
216
+ "rstrip": false,
217
+ "single_word": false,
218
+ "special": true
219
+ },
220
+ "32024": {
221
+ "content": "<extra_id_75>",
222
+ "lstrip": false,
223
+ "normalized": false,
224
+ "rstrip": false,
225
+ "single_word": false,
226
+ "special": true
227
+ },
228
+ "32025": {
229
+ "content": "<extra_id_74>",
230
+ "lstrip": false,
231
+ "normalized": false,
232
+ "rstrip": false,
233
+ "single_word": false,
234
+ "special": true
235
+ },
236
+ "32026": {
237
+ "content": "<extra_id_73>",
238
+ "lstrip": false,
239
+ "normalized": false,
240
+ "rstrip": false,
241
+ "single_word": false,
242
+ "special": true
243
+ },
244
+ "32027": {
245
+ "content": "<extra_id_72>",
246
+ "lstrip": false,
247
+ "normalized": false,
248
+ "rstrip": false,
249
+ "single_word": false,
250
+ "special": true
251
+ },
252
+ "32028": {
253
+ "content": "<extra_id_71>",
254
+ "lstrip": false,
255
+ "normalized": false,
256
+ "rstrip": false,
257
+ "single_word": false,
258
+ "special": true
259
+ },
260
+ "32029": {
261
+ "content": "<extra_id_70>",
262
+ "lstrip": false,
263
+ "normalized": false,
264
+ "rstrip": false,
265
+ "single_word": false,
266
+ "special": true
267
+ },
268
+ "32030": {
269
+ "content": "<extra_id_69>",
270
+ "lstrip": false,
271
+ "normalized": false,
272
+ "rstrip": false,
273
+ "single_word": false,
274
+ "special": true
275
+ },
276
+ "32031": {
277
+ "content": "<extra_id_68>",
278
+ "lstrip": false,
279
+ "normalized": false,
280
+ "rstrip": false,
281
+ "single_word": false,
282
+ "special": true
283
+ },
284
+ "32032": {
285
+ "content": "<extra_id_67>",
286
+ "lstrip": false,
287
+ "normalized": false,
288
+ "rstrip": false,
289
+ "single_word": false,
290
+ "special": true
291
+ },
292
+ "32033": {
293
+ "content": "<extra_id_66>",
294
+ "lstrip": false,
295
+ "normalized": false,
296
+ "rstrip": false,
297
+ "single_word": false,
298
+ "special": true
299
+ },
300
+ "32034": {
301
+ "content": "<extra_id_65>",
302
+ "lstrip": false,
303
+ "normalized": false,
304
+ "rstrip": false,
305
+ "single_word": false,
306
+ "special": true
307
+ },
308
+ "32035": {
309
+ "content": "<extra_id_64>",
310
+ "lstrip": false,
311
+ "normalized": false,
312
+ "rstrip": false,
313
+ "single_word": false,
314
+ "special": true
315
+ },
316
+ "32036": {
317
+ "content": "<extra_id_63>",
318
+ "lstrip": false,
319
+ "normalized": false,
320
+ "rstrip": false,
321
+ "single_word": false,
322
+ "special": true
323
+ },
324
+ "32037": {
325
+ "content": "<extra_id_62>",
326
+ "lstrip": false,
327
+ "normalized": false,
328
+ "rstrip": false,
329
+ "single_word": false,
330
+ "special": true
331
+ },
332
+ "32038": {
333
+ "content": "<extra_id_61>",
334
+ "lstrip": false,
335
+ "normalized": false,
336
+ "rstrip": false,
337
+ "single_word": false,
338
+ "special": true
339
+ },
340
+ "32039": {
341
+ "content": "<extra_id_60>",
342
+ "lstrip": false,
343
+ "normalized": false,
344
+ "rstrip": false,
345
+ "single_word": false,
346
+ "special": true
347
+ },
348
+ "32040": {
349
+ "content": "<extra_id_59>",
350
+ "lstrip": false,
351
+ "normalized": false,
352
+ "rstrip": false,
353
+ "single_word": false,
354
+ "special": true
355
+ },
356
+ "32041": {
357
+ "content": "<extra_id_58>",
358
+ "lstrip": false,
359
+ "normalized": false,
360
+ "rstrip": false,
361
+ "single_word": false,
362
+ "special": true
363
+ },
364
+ "32042": {
365
+ "content": "<extra_id_57>",
366
+ "lstrip": false,
367
+ "normalized": false,
368
+ "rstrip": false,
369
+ "single_word": false,
370
+ "special": true
371
+ },
372
+ "32043": {
373
+ "content": "<extra_id_56>",
374
+ "lstrip": false,
375
+ "normalized": false,
376
+ "rstrip": false,
377
+ "single_word": false,
378
+ "special": true
379
+ },
380
+ "32044": {
381
+ "content": "<extra_id_55>",
382
+ "lstrip": false,
383
+ "normalized": false,
384
+ "rstrip": false,
385
+ "single_word": false,
386
+ "special": true
387
+ },
388
+ "32045": {
389
+ "content": "<extra_id_54>",
390
+ "lstrip": false,
391
+ "normalized": false,
392
+ "rstrip": false,
393
+ "single_word": false,
394
+ "special": true
395
+ },
396
+ "32046": {
397
+ "content": "<extra_id_53>",
398
+ "lstrip": false,
399
+ "normalized": false,
400
+ "rstrip": false,
401
+ "single_word": false,
402
+ "special": true
403
+ },
404
+ "32047": {
405
+ "content": "<extra_id_52>",
406
+ "lstrip": false,
407
+ "normalized": false,
408
+ "rstrip": false,
409
+ "single_word": false,
410
+ "special": true
411
+ },
412
+ "32048": {
413
+ "content": "<extra_id_51>",
414
+ "lstrip": false,
415
+ "normalized": false,
416
+ "rstrip": false,
417
+ "single_word": false,
418
+ "special": true
419
+ },
420
+ "32049": {
421
+ "content": "<extra_id_50>",
422
+ "lstrip": false,
423
+ "normalized": false,
424
+ "rstrip": false,
425
+ "single_word": false,
426
+ "special": true
427
+ },
428
+ "32050": {
429
+ "content": "<extra_id_49>",
430
+ "lstrip": false,
431
+ "normalized": false,
432
+ "rstrip": false,
433
+ "single_word": false,
434
+ "special": true
435
+ },
436
+ "32051": {
437
+ "content": "<extra_id_48>",
438
+ "lstrip": false,
439
+ "normalized": false,
440
+ "rstrip": false,
441
+ "single_word": false,
442
+ "special": true
443
+ },
444
+ "32052": {
445
+ "content": "<extra_id_47>",
446
+ "lstrip": false,
447
+ "normalized": false,
448
+ "rstrip": false,
449
+ "single_word": false,
450
+ "special": true
451
+ },
452
+ "32053": {
453
+ "content": "<extra_id_46>",
454
+ "lstrip": false,
455
+ "normalized": false,
456
+ "rstrip": false,
457
+ "single_word": false,
458
+ "special": true
459
+ },
460
+ "32054": {
461
+ "content": "<extra_id_45>",
462
+ "lstrip": false,
463
+ "normalized": false,
464
+ "rstrip": false,
465
+ "single_word": false,
466
+ "special": true
467
+ },
468
+ "32055": {
469
+ "content": "<extra_id_44>",
470
+ "lstrip": false,
471
+ "normalized": false,
472
+ "rstrip": false,
473
+ "single_word": false,
474
+ "special": true
475
+ },
476
+ "32056": {
477
+ "content": "<extra_id_43>",
478
+ "lstrip": false,
479
+ "normalized": false,
480
+ "rstrip": false,
481
+ "single_word": false,
482
+ "special": true
483
+ },
484
+ "32057": {
485
+ "content": "<extra_id_42>",
486
+ "lstrip": false,
487
+ "normalized": false,
488
+ "rstrip": false,
489
+ "single_word": false,
490
+ "special": true
491
+ },
492
+ "32058": {
493
+ "content": "<extra_id_41>",
494
+ "lstrip": false,
495
+ "normalized": false,
496
+ "rstrip": false,
497
+ "single_word": false,
498
+ "special": true
499
+ },
500
+ "32059": {
501
+ "content": "<extra_id_40>",
502
+ "lstrip": false,
503
+ "normalized": false,
504
+ "rstrip": false,
505
+ "single_word": false,
506
+ "special": true
507
+ },
508
+ "32060": {
509
+ "content": "<extra_id_39>",
510
+ "lstrip": false,
511
+ "normalized": false,
512
+ "rstrip": false,
513
+ "single_word": false,
514
+ "special": true
515
+ },
516
+ "32061": {
517
+ "content": "<extra_id_38>",
518
+ "lstrip": false,
519
+ "normalized": false,
520
+ "rstrip": false,
521
+ "single_word": false,
522
+ "special": true
523
+ },
524
+ "32062": {
525
+ "content": "<extra_id_37>",
526
+ "lstrip": false,
527
+ "normalized": false,
528
+ "rstrip": false,
529
+ "single_word": false,
530
+ "special": true
531
+ },
532
+ "32063": {
533
+ "content": "<extra_id_36>",
534
+ "lstrip": false,
535
+ "normalized": false,
536
+ "rstrip": false,
537
+ "single_word": false,
538
+ "special": true
539
+ },
540
+ "32064": {
541
+ "content": "<extra_id_35>",
542
+ "lstrip": false,
543
+ "normalized": false,
544
+ "rstrip": false,
545
+ "single_word": false,
546
+ "special": true
547
+ },
548
+ "32065": {
549
+ "content": "<extra_id_34>",
550
+ "lstrip": false,
551
+ "normalized": false,
552
+ "rstrip": false,
553
+ "single_word": false,
554
+ "special": true
555
+ },
556
+ "32066": {
557
+ "content": "<extra_id_33>",
558
+ "lstrip": false,
559
+ "normalized": false,
560
+ "rstrip": false,
561
+ "single_word": false,
562
+ "special": true
563
+ },
564
+ "32067": {
565
+ "content": "<extra_id_32>",
566
+ "lstrip": false,
567
+ "normalized": false,
568
+ "rstrip": false,
569
+ "single_word": false,
570
+ "special": true
571
+ },
572
+ "32068": {
573
+ "content": "<extra_id_31>",
574
+ "lstrip": false,
575
+ "normalized": false,
576
+ "rstrip": false,
577
+ "single_word": false,
578
+ "special": true
579
+ },
580
+ "32069": {
581
+ "content": "<extra_id_30>",
582
+ "lstrip": false,
583
+ "normalized": false,
584
+ "rstrip": false,
585
+ "single_word": false,
586
+ "special": true
587
+ },
588
+ "32070": {
589
+ "content": "<extra_id_29>",
590
+ "lstrip": false,
591
+ "normalized": false,
592
+ "rstrip": false,
593
+ "single_word": false,
594
+ "special": true
595
+ },
596
+ "32071": {
597
+ "content": "<extra_id_28>",
598
+ "lstrip": false,
599
+ "normalized": false,
600
+ "rstrip": false,
601
+ "single_word": false,
602
+ "special": true
603
+ },
604
+ "32072": {
605
+ "content": "<extra_id_27>",
606
+ "lstrip": false,
607
+ "normalized": false,
608
+ "rstrip": false,
609
+ "single_word": false,
610
+ "special": true
611
+ },
612
+ "32073": {
613
+ "content": "<extra_id_26>",
614
+ "lstrip": false,
615
+ "normalized": false,
616
+ "rstrip": false,
617
+ "single_word": false,
618
+ "special": true
619
+ },
620
+ "32074": {
621
+ "content": "<extra_id_25>",
622
+ "lstrip": false,
623
+ "normalized": false,
624
+ "rstrip": false,
625
+ "single_word": false,
626
+ "special": true
627
+ },
628
+ "32075": {
629
+ "content": "<extra_id_24>",
630
+ "lstrip": false,
631
+ "normalized": false,
632
+ "rstrip": false,
633
+ "single_word": false,
634
+ "special": true
635
+ },
636
+ "32076": {
637
+ "content": "<extra_id_23>",
638
+ "lstrip": false,
639
+ "normalized": false,
640
+ "rstrip": false,
641
+ "single_word": false,
642
+ "special": true
643
+ },
644
+ "32077": {
645
+ "content": "<extra_id_22>",
646
+ "lstrip": false,
647
+ "normalized": false,
648
+ "rstrip": false,
649
+ "single_word": false,
650
+ "special": true
651
+ },
652
+ "32078": {
653
+ "content": "<extra_id_21>",
654
+ "lstrip": false,
655
+ "normalized": false,
656
+ "rstrip": false,
657
+ "single_word": false,
658
+ "special": true
659
+ },
660
+ "32079": {
661
+ "content": "<extra_id_20>",
662
+ "lstrip": false,
663
+ "normalized": false,
664
+ "rstrip": false,
665
+ "single_word": false,
666
+ "special": true
667
+ },
668
+ "32080": {
669
+ "content": "<extra_id_19>",
670
+ "lstrip": false,
671
+ "normalized": false,
672
+ "rstrip": false,
673
+ "single_word": false,
674
+ "special": true
675
+ },
676
+ "32081": {
677
+ "content": "<extra_id_18>",
678
+ "lstrip": false,
679
+ "normalized": false,
680
+ "rstrip": false,
681
+ "single_word": false,
682
+ "special": true
683
+ },
684
+ "32082": {
685
+ "content": "<extra_id_17>",
686
+ "lstrip": false,
687
+ "normalized": false,
688
+ "rstrip": false,
689
+ "single_word": false,
690
+ "special": true
691
+ },
692
+ "32083": {
693
+ "content": "<extra_id_16>",
694
+ "lstrip": false,
695
+ "normalized": false,
696
+ "rstrip": false,
697
+ "single_word": false,
698
+ "special": true
699
+ },
700
+ "32084": {
701
+ "content": "<extra_id_15>",
702
+ "lstrip": false,
703
+ "normalized": false,
704
+ "rstrip": false,
705
+ "single_word": false,
706
+ "special": true
707
+ },
708
+ "32085": {
709
+ "content": "<extra_id_14>",
710
+ "lstrip": false,
711
+ "normalized": false,
712
+ "rstrip": false,
713
+ "single_word": false,
714
+ "special": true
715
+ },
716
+ "32086": {
717
+ "content": "<extra_id_13>",
718
+ "lstrip": false,
719
+ "normalized": false,
720
+ "rstrip": false,
721
+ "single_word": false,
722
+ "special": true
723
+ },
724
+ "32087": {
725
+ "content": "<extra_id_12>",
726
+ "lstrip": false,
727
+ "normalized": false,
728
+ "rstrip": false,
729
+ "single_word": false,
730
+ "special": true
731
+ },
732
+ "32088": {
733
+ "content": "<extra_id_11>",
734
+ "lstrip": false,
735
+ "normalized": false,
736
+ "rstrip": false,
737
+ "single_word": false,
738
+ "special": true
739
+ },
740
+ "32089": {
741
+ "content": "<extra_id_10>",
742
+ "lstrip": false,
743
+ "normalized": false,
744
+ "rstrip": false,
745
+ "single_word": false,
746
+ "special": true
747
+ },
748
+ "32090": {
749
+ "content": "<extra_id_9>",
750
+ "lstrip": false,
751
+ "normalized": false,
752
+ "rstrip": false,
753
+ "single_word": false,
754
+ "special": true
755
+ },
756
+ "32091": {
757
+ "content": "<extra_id_8>",
758
+ "lstrip": false,
759
+ "normalized": false,
760
+ "rstrip": false,
761
+ "single_word": false,
762
+ "special": true
763
+ },
764
+ "32092": {
765
+ "content": "<extra_id_7>",
766
+ "lstrip": false,
767
+ "normalized": false,
768
+ "rstrip": false,
769
+ "single_word": false,
770
+ "special": true
771
+ },
772
+ "32093": {
773
+ "content": "<extra_id_6>",
774
+ "lstrip": false,
775
+ "normalized": false,
776
+ "rstrip": false,
777
+ "single_word": false,
778
+ "special": true
779
+ },
780
+ "32094": {
781
+ "content": "<extra_id_5>",
782
+ "lstrip": false,
783
+ "normalized": false,
784
+ "rstrip": false,
785
+ "single_word": false,
786
+ "special": true
787
+ },
788
+ "32095": {
789
+ "content": "<extra_id_4>",
790
+ "lstrip": false,
791
+ "normalized": false,
792
+ "rstrip": false,
793
+ "single_word": false,
794
+ "special": true
795
+ },
796
+ "32096": {
797
+ "content": "<extra_id_3>",
798
+ "lstrip": false,
799
+ "normalized": false,
800
+ "rstrip": false,
801
+ "single_word": false,
802
+ "special": true
803
+ },
804
+ "32097": {
805
+ "content": "<extra_id_2>",
806
+ "lstrip": false,
807
+ "normalized": false,
808
+ "rstrip": false,
809
+ "single_word": false,
810
+ "special": true
811
+ },
812
+ "32098": {
813
+ "content": "<extra_id_1>",
814
+ "lstrip": false,
815
+ "normalized": false,
816
+ "rstrip": false,
817
+ "single_word": false,
818
+ "special": true
819
+ },
820
+ "32099": {
821
+ "content": "<extra_id_0>",
822
+ "lstrip": false,
823
+ "normalized": false,
824
+ "rstrip": false,
825
+ "single_word": false,
826
+ "special": true
827
+ }
828
+ },
829
+ "additional_special_tokens": [
830
+ "<extra_id_0>",
831
+ "<extra_id_1>",
832
+ "<extra_id_2>",
833
+ "<extra_id_3>",
834
+ "<extra_id_4>",
835
+ "<extra_id_5>",
836
+ "<extra_id_6>",
837
+ "<extra_id_7>",
838
+ "<extra_id_8>",
839
+ "<extra_id_9>",
840
+ "<extra_id_10>",
841
+ "<extra_id_11>",
842
+ "<extra_id_12>",
843
+ "<extra_id_13>",
844
+ "<extra_id_14>",
845
+ "<extra_id_15>",
846
+ "<extra_id_16>",
847
+ "<extra_id_17>",
848
+ "<extra_id_18>",
849
+ "<extra_id_19>",
850
+ "<extra_id_20>",
851
+ "<extra_id_21>",
852
+ "<extra_id_22>",
853
+ "<extra_id_23>",
854
+ "<extra_id_24>",
855
+ "<extra_id_25>",
856
+ "<extra_id_26>",
857
+ "<extra_id_27>",
858
+ "<extra_id_28>",
859
+ "<extra_id_29>",
860
+ "<extra_id_30>",
861
+ "<extra_id_31>",
862
+ "<extra_id_32>",
863
+ "<extra_id_33>",
864
+ "<extra_id_34>",
865
+ "<extra_id_35>",
866
+ "<extra_id_36>",
867
+ "<extra_id_37>",
868
+ "<extra_id_38>",
869
+ "<extra_id_39>",
870
+ "<extra_id_40>",
871
+ "<extra_id_41>",
872
+ "<extra_id_42>",
873
+ "<extra_id_43>",
874
+ "<extra_id_44>",
875
+ "<extra_id_45>",
876
+ "<extra_id_46>",
877
+ "<extra_id_47>",
878
+ "<extra_id_48>",
879
+ "<extra_id_49>",
880
+ "<extra_id_50>",
881
+ "<extra_id_51>",
882
+ "<extra_id_52>",
883
+ "<extra_id_53>",
884
+ "<extra_id_54>",
885
+ "<extra_id_55>",
886
+ "<extra_id_56>",
887
+ "<extra_id_57>",
888
+ "<extra_id_58>",
889
+ "<extra_id_59>",
890
+ "<extra_id_60>",
891
+ "<extra_id_61>",
892
+ "<extra_id_62>",
893
+ "<extra_id_63>",
894
+ "<extra_id_64>",
895
+ "<extra_id_65>",
896
+ "<extra_id_66>",
897
+ "<extra_id_67>",
898
+ "<extra_id_68>",
899
+ "<extra_id_69>",
900
+ "<extra_id_70>",
901
+ "<extra_id_71>",
902
+ "<extra_id_72>",
903
+ "<extra_id_73>",
904
+ "<extra_id_74>",
905
+ "<extra_id_75>",
906
+ "<extra_id_76>",
907
+ "<extra_id_77>",
908
+ "<extra_id_78>",
909
+ "<extra_id_79>",
910
+ "<extra_id_80>",
911
+ "<extra_id_81>",
912
+ "<extra_id_82>",
913
+ "<extra_id_83>",
914
+ "<extra_id_84>",
915
+ "<extra_id_85>",
916
+ "<extra_id_86>",
917
+ "<extra_id_87>",
918
+ "<extra_id_88>",
919
+ "<extra_id_89>",
920
+ "<extra_id_90>",
921
+ "<extra_id_91>",
922
+ "<extra_id_92>",
923
+ "<extra_id_93>",
924
+ "<extra_id_94>",
925
+ "<extra_id_95>",
926
+ "<extra_id_96>",
927
+ "<extra_id_97>",
928
+ "<extra_id_98>",
929
+ "<extra_id_99>"
930
+ ],
931
+ "clean_up_tokenization_spaces": false,
932
+ "eos_token": "</s>",
933
+ "extra_ids": 100,
934
+ "extra_special_tokens": {},
935
+ "max_length": null,
936
+ "model_max_length": 256,
937
+ "pad_to_multiple_of": null,
938
+ "pad_token": "<pad>",
939
+ "pad_token_type_id": 0,
940
+ "padding_side": "right",
941
+ "tokenizer_class": "T5Tokenizer",
942
+ "unk_token": "<unk>"
943
+ }