461 MB

Ctrl+K

1 contributor

History: 38 commits

barunsaha

Upload s06_export.py with huggingface_hub

f926b84 verified 7 months ago

.gitattributes

1.57 kB
Upload train.txt with huggingface_hub 7 months ago
README.md

682 Bytes
Upload README.md with huggingface_hub 7 months ago
author_tokens.txt

2.84 kB
Upload author_tokens.txt with huggingface_hub 7 months ago
bengali_bpe.model

117 kB
xet

Upload bengali_bpe.model with huggingface_hub 7 months ago
bengali_bpe.vocab

101 kB
Upload bengali_bpe.vocab with huggingface_hub 7 months ago
ckpt_best.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.ComplexFloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
334 MB
xet

Upload ckpt_best.pt with huggingface_hub 7 months ago
s01_prepare_data.py

12.3 kB
Upload s01_prepare_data.py with huggingface_hub 7 months ago
s02_train_tokenizer.py

17.2 kB
Upload s02_train_tokenizer.py with huggingface_hub 7 months ago
s03_encode_data.py

3.16 kB
Upload s03_encode_data.py with huggingface_hub 7 months ago
s04_train_model.py

29.9 kB
Upload s04_train_model.py with huggingface_hub 7 months ago
s05_generate.py

15.5 kB
Upload s05_generate.py with huggingface_hub 7 months ago
s06_export.py

10.9 kB
Upload s06_export.py with huggingface_hub 7 months ago
tokenizer_config.json

7 kB
Upload tokenizer_config.json with huggingface_hub 7 months ago
train.txt

86.8 MB
xet

Upload train.txt with huggingface_hub 7 months ago
train_tokens.npy

19.8 MB
xet

Upload train_tokens.npy with huggingface_hub 7 months ago
val.txt

9.06 MB
Upload val.txt with huggingface_hub 7 months ago
val_tokens.npy

2.05 MB
xet

Upload val_tokens.npy with huggingface_hub 7 months ago
val_works.json

9.12 MB
Upload val_works.json with huggingface_hub 7 months ago

Detected Pickle imports (4)