Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Mohamedd123321
/
Tokenization-large-last

Fill-Mask
Transformers
Safetensors
xlm-roberta
Generated from Trainer
Model card Files Files and versions
xet
Community

Instructions to use Mohamedd123321/Tokenization-large-last with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use Mohamedd123321/Tokenization-large-last with Transformers:

    # Use a pipeline as a high-level helper
    from transformers import pipeline
    
    pipe = pipeline("fill-mask", model="Mohamedd123321/Tokenization-large-last")
    # pip install -U transformers accelerate
    # Load model directly
    from transformers import AutoTokenizer, AutoModelForMaskedLM
    
    tokenizer = AutoTokenizer.from_pretrained("Mohamedd123321/Tokenization-large-last")
    model = AutoModelForMaskedLM.from_pretrained("Mohamedd123321/Tokenization-large-last", device_map="auto")
  • Notebooks
  • Google Colab
  • Kaggle

You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Gated model
You can list files but not access them

Preview of files found in this repository
  • config.json
    664 Bytes
    Training in progress, step 6000, checkpoint 3 months ago
  • model.safetensors
    2.24 GB
    xet
    Training in progress, step 42000, checkpoint 3 months ago
  • optimizer.pt
    4.48 GB
    xet
    Training in progress, step 42000, checkpoint 3 months ago
  • rng_state.pth
    14.6 kB
    xet
    Training in progress, step 42000, checkpoint 3 months ago
  • scheduler.pt

    Pickle imports

    • No problematic imports detected

    What is a pickle import?

    1.47 kB
    xet
    Training in progress, step 42000, checkpoint 3 months ago
  • sentencepiece.bpe.model
    5.07 MB
    xet
    Training in progress, step 6000, checkpoint 3 months ago
  • special_tokens_map.json
    280 Bytes
    Training in progress, step 6000, checkpoint 3 months ago
  • tokenizer.json
    17.1 MB
    xet
    Training in progress, step 6000, checkpoint 3 months ago
  • tokenizer_config.json
    1.18 kB
    Training in progress, step 6000, checkpoint 3 months ago
  • trainer_state.json
    2.44 kB
    Training in progress, step 42000, checkpoint 3 months ago
  • training_args.bin
    5.78 kB
    xet
    Training in progress, step 42000, checkpoint 3 months ago