Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

ahmedsamirtarjama
/
dialectnorm

Token Classification
Transformers
Safetensors
Arabic
bert
fill-mask
arabic
arabic-dialects
spelling-correction
grammatical-error-correction
text-normalization
CODA
Model card Files Files and versions
xet
Community

Instructions to use ahmedsamirtarjama/dialectnorm with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use ahmedsamirtarjama/dialectnorm with Transformers:

    # Use a pipeline as a high-level helper
    from transformers import pipeline
    
    pipe = pipeline("token-classification", model="ahmedsamirtarjama/dialectnorm")
    # pip install -U transformers accelerate
    # Load model directly
    from transformers import AutoTokenizer, AutoModelForMaskedLM
    
    tokenizer = AutoTokenizer.from_pretrained("ahmedsamirtarjama/dialectnorm")
    model = AutoModelForMaskedLM.from_pretrained("ahmedsamirtarjama/dialectnorm", device_map="auto")
  • Notebooks
  • Google Colab
  • Kaggle

Request access to DialectNorm

DialectNorm is released for non-commercial research only. Requests are approved automatically.

By requesting access you agree to use DialectNorm only for non-commercial research and to the terms in the LICENSE file.

Log in or Sign Up to review the conditions and access this model content.

Gated model
You can list files but not access them

Preview of files found in this repository
  • .gitattributes
    1.52 kB
    initial commit 8 days ago
  • LICENSE
    1.23 kB
    Rename DialectFix to DialectNorm; new examples and 'why not rules' section 6 days ago
  • README.md
    11.6 kB
    Rename DialectFix to DialectNorm; new examples and 'why not rules' section 6 days ago
  • config.json
    654 Bytes
    DialectFix: 12-dialect CODA spelling normalizer 8 days ago
  • dialectnorm.py
    7.26 kB
    Rename DialectFix to DialectNorm; new examples and 'why not rules' section 6 days ago
  • dialectnorm_config.json
    7.12 kB
    Rename DialectFix to DialectNorm; new examples and 'why not rules' section 6 days ago
  • model.safetensors
    573 MB
    xet
    DialectFix: 12-dialect CODA spelling normalizer 8 days ago
  • tokenizer.json
    1.78 MB
    DialectFix: 12-dialect CODA spelling normalizer 8 days ago
  • tokenizer_config.json
    480 Bytes
    DialectFix: 12-dialect CODA spelling normalizer 8 days ago