Audio-to-Audio
ONNX
GGUF
speech-translation
streaming-speech-translation
speech
audio
speech-recognition
automatic-speech-recognition
streaming-asr
ASR
NeMo
ONNX
cache-aware ASR
FastConformer
RNNT
Parakeet
neural-machine-translation
NMT
Translation
gemma3
llama-cpp
GGUF
conversational
text-to-speech
TTS
xtts
xttsv2
voice-clone
gpt2
hifigan
multilingual
vq
perceiver-encoder
qwen3
qwen3-tts
rvq
ecapa-tdnn
websocket
Instructions to use pltobing/streaming-speech-translation with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use pltobing/streaming-speech-translation with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf pltobing/streaming-speech-translation:Q4_K_M # Run inference directly in the terminal: llama cli -hf pltobing/streaming-speech-translation:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf pltobing/streaming-speech-translation:Q4_K_M # Run inference directly in the terminal: llama cli -hf pltobing/streaming-speech-translation:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf pltobing/streaming-speech-translation:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf pltobing/streaming-speech-translation:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf pltobing/streaming-speech-translation:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf pltobing/streaming-speech-translation:Q4_K_M
Use Docker
docker model run hf.co/pltobing/streaming-speech-translation:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use pltobing/streaming-speech-translation with Ollama:
ollama run hf.co/pltobing/streaming-speech-translation:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use pltobing/streaming-speech-translation with Docker Model Runner:
docker model run hf.co/pltobing/streaming-speech-translation:Q4_K_M
- Lemonade
How to use pltobing/streaming-speech-translation with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull pltobing/streaming-speech-translation:Q4_K_M
Run and chat with the model
lemonade run user.streaming-speech-translation-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Access Streaming Speech Translation — Vertox-AI
This repository is publicly accessible, but you have to accept the conditions to access its files and content.
To access Streaming Speech Translation — Vertox-AI, you must review and agree to the CC BY-NC 4.0 license. By submitting this form, you confirm that you have read the license and will only use the model under its terms. Requests are processed immediately.
Log in or Sign Up to review the conditions and access this model content.
Gated model You can list files but not access them
Preview of files found in this repository