Hugging Face
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
chuuhtetnaing
/
myanmar-text-segmentation-model
Like
4
Token Classification
Safetensors
chuuhtetnaing/myanmar-text-segmentation-dataset
Burmese
English
xlm-roberta
myanmar
text-segmentation
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
main
myanmar-text-segmentation-model
/
checkpoint-2000
3.35 GB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
chuuhtetnaing
Training in progress, step 2000, checkpoint
d73fe49
verified
11 months ago
config.json
Safe
765 Bytes
Training in progress, step 2000, checkpoint
11 months ago
model.safetensors
Safe
1.11 GB
xet
Training in progress, step 2000, checkpoint
11 months ago
optimizer.pt
Safe
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.22 GB
xet
Training in progress, step 2000, checkpoint
11 months ago
rng_state.pth
pickle
Detected Pickle imports (7)
"numpy._core.multiarray._reconstruct"
,
"collections.OrderedDict"
,
"_codecs.encode"
,
"torch._utils._rebuild_tensor_v2"
,
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
How to fix it?
14.6 kB
xet
Training in progress, step 2000, checkpoint
11 months ago
scheduler.pt
pickle
Pickle imports
No problematic imports detected
What is a pickle import?
1.47 kB
xet
Training in progress, step 2000, checkpoint
11 months ago
sentencepiece.bpe.model
Safe
5.07 MB
xet
Training in progress, step 2000, checkpoint
11 months ago
special_tokens_map.json
Safe
964 Bytes
Training in progress, step 2000, checkpoint
11 months ago
tokenizer.json
Safe
17.1 MB
xet
Training in progress, step 2000, checkpoint
11 months ago
tokenizer_config.json
Safe
1.29 kB
Training in progress, step 2000, checkpoint
11 months ago
trainer_state.json
Safe
2.32 kB
Training in progress, step 2000, checkpoint
11 months ago
training_args.bin
pickle
Detected Pickle imports (10)
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.training_args.OptimizerNames"
,
"torch.device"
,
"transformers.training_args.TrainingArguments"
,
"transformers.trainer_utils.SaveStrategy"
,
"accelerate.state.PartialState"
,
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.trainer_utils.SchedulerType"
,
"transformers.trainer_utils.HubStrategy"
How to fix it?
5.84 kB
xet
Training in progress, step 2000, checkpoint
11 months ago
