Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

prithivMLmods
/
ZONOS3-Mini-GGUF

Text-to-Speech
Transformers
GGUF
Zonos
llama-cpp
llama-tts
tts
speech-synthesis
voice-cloning
multilingual
zonos3
zyphra
wav
Model card Files Files and versions
xet
Community

Instructions to use prithivMLmods/ZONOS3-Mini-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use prithivMLmods/ZONOS3-Mini-GGUF with Transformers:

    # Use a pipeline as a high-level helper
    from transformers import pipeline
    
    pipe = pipeline("text-to-speech", model="prithivMLmods/ZONOS3-Mini-GGUF")
    # pip install -U transformers accelerate
    # Load model directly
    from transformers import AutoModel
    model = AutoModel.from_pretrained("prithivMLmods/ZONOS3-Mini-GGUF", device_map="auto")
  • Zonos

    How to use prithivMLmods/ZONOS3-Mini-GGUF with Zonos:

    # pip install git+https://github.com/Zyphra/Zonos.git
    import torchaudio
    from zonos.model import Zonos
    from zonos.conditioning import make_cond_dict
    
    model = Zonos.from_pretrained("prithivMLmods/ZONOS3-Mini-GGUF", device="cuda")
    
    wav, sr = torchaudio.load("speaker.wav")           # 5-10s reference clip
    speaker = model.make_speaker_embedding(wav, sr)
    
    cond  = make_cond_dict(text="Hello, world!", speaker=speaker, language="en-us")
    codes = model.generate(model.prepare_conditioning(cond))
    
    audio = model.autoencoder.decode(codes)[0].cpu()
    torchaudio.save("sample.wav", audio, model.autoencoder.sampling_rate)
    
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • llama.cpp

    How to use prithivMLmods/ZONOS3-Mini-GGUF with llama.cpp:

    Install (macOS, Linux)
    curl -LsSf https://llama.app/install.sh | sh
    # Start a local OpenAI-compatible server with a web UI:
    llama serve -hf prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
    # Run inference directly in the terminal:
    llama cli -hf prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
    Install from WinGet (Windows)
    winget install llama.cpp
    # Start a local OpenAI-compatible server with a web UI:
    llama serve -hf prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
    # Run inference directly in the terminal:
    llama cli -hf prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
    Build from source code
    git clone https://github.com/ggml-org/llama.cpp.git
    cd llama.cpp
    cmake -B build
    cmake --build build -j --target llama-app
    # Start a local OpenAI-compatible server with a web UI:
    ./build/bin/llama serve -hf prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
    # Run inference directly in the terminal:
    ./build/bin/llama cli -hf prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
    Use Docker
    docker model run hf.co/prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
  • Llama new
  • LM Studio
  • Jan
  • Ollama

    How to use prithivMLmods/ZONOS3-Mini-GGUF with Ollama:

    ollama run hf.co/prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
  • Unsloth Desktop
  • Docker Model Runner

    How to use prithivMLmods/ZONOS3-Mini-GGUF with Docker Model Runner:

    docker model run hf.co/prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
  • Lemonade

    How to use prithivMLmods/ZONOS3-Mini-GGUF with Lemonade:

    Pull the model
    # Download Lemonade from https://lemonade-server.ai/
    lemonade pull prithivMLmods/ZONOS3-Mini-GGUF:Q4_K_M
    Run and chat with the model
    lemonade run user.ZONOS3-Mini-GGUF-Q4_K_M
    List all available models
    lemonade list
  • Atomic Chat
ZONOS3-Mini-GGUF
8 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
prithivMLmods's picture
prithivMLmods
Update README.md
9524c6b verified 1 day ago
  • .gitattributes
    2.29 kB
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • README.md
    6.53 kB
    Update README.md 1 day ago
  • ZONOS3-Mini.BF16.gguf
    1.61 GB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q2_K.gguf
    300 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q3_K_L.gguf
    420 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q3_K_M.gguf
    387 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q4_0.gguf
    456 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q4_K_M.gguf
    484 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q4_K_S.gguf
    457 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q5_0.gguf
    555 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q5_K_M.gguf
    570 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q5_K_S.gguf
    555 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q6_K.gguf
    661 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.Q8_0.gguf
    855 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago
  • ZONOS3-Mini.mmproj-bf16.gguf
    689 MB
    xet
    Upload GGUF quants β€” Zyphra/ZONOS3-Mini 1 day ago