Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
JuloEco
/
opsiom-fr-tokenizer
Like
3
Text Generation
French
IA
Token
dataset
License:
unknown
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
opsiom-fr-tokenizer
11.4 GB
Ctrl+K
Ctrl+K
1 contributor
History:
121 commits
JuloEco
Update README.md
1a627ea
verified
3 days ago
.gitattributes
Safe
1.52 kB
initial commit
2 months ago
Opsiom-Detector.py
Safe
70.5 kB
Update Opsiom-Detector.py
7 days ago
README.md
Safe
17.2 kB
Update README.md
3 days ago
_shard_tinystories_fr.bin
Safe
14 MB
xet
Upload _shard_tinystories_fr.bin
about 1 month ago
_shard_wikipedia_fr.bin
Safe
3.5 GB
xet
Upload _shard_wikipedia_fr.bin
about 1 month ago
change_main.py
Safe
75.7 kB
Update change_main.py
13 days ago
dialogues_fr.jsonl
Safe
626 kB
Upload dialogues_fr.jsonl
about 2 months ago
eval_prompts.py
Safe
10.2 kB
Create eval_prompts.py
about 2 months ago
kaggle_train_chat.py
Safe
67.5 kB
Update kaggle_train_chat.py
2 months ago
main-GPU-TPU-CPU.py
Safe
231 kB
Update main-GPU-TPU-CPU.py
12 days ago
main.py
Safe
83.8 kB
Update main.py
about 2 months ago
main_GPU-optimum.py
Safe
146 kB
Update main_GPU-optimum.py
30 days ago
main_GPU.py
Safe
85 kB
Create main_GPU.py
about 1 month ago
main_medium.py
Safe
91.7 kB
Update main_medium.py
19 days ago
pretrain_corpus.bin
7.87 GB
xet
Upload pretrain_corpus.bin
about 2 months ago
pretrain_corpus_meta.json
306 Bytes
Upload pretrain_corpus_meta.json
about 2 months ago
summary_model.py
Safe
84.8 kB
Update summary_model.py
15 days ago
test_ia.py
Safe
30.6 kB
Create test_ia.py
about 2 months ago
tokenizer.json
Safe
1.11 MB
Rename fr_bpe_tokenizer.json to tokenizer.json
2 months ago
tokenizer_32k.json
Safe
2.29 MB
Upload tokenizer_32k.json with huggingface_hub
about 1 month ago
train_chat.py
Safe
67.1 kB
Update train_chat.py
2 months ago
