Instructions to use Qwen/Qwen3Guard-Stream-4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Qwen/Qwen3Guard-Stream-4B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="Qwen/Qwen3Guard-Stream-4B", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3Guard-Stream-4B", trust_remote_code=True) model = AutoModel.from_pretrained("Qwen/Qwen3Guard-Stream-4B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Fix KV cache reuse in streaming moderation (#4)
- Fix KV cache reuse in streaming moderation (2070199fccd868775e78ccbf7008413a245c2483) Co-authored-by: YxinMiracle <YxinMiracle@users.noreply.huggingface.co>0e28178
-
Update README.md
Verified signature27a8f4e
-
Update README.md
Verified signature1dde50d
-
Update model.safetensors.index.json
Verified signature2601f25 -
Update README.md
Verified signature50b62bd
-
Update modeling_qwen3_guard.py
Verified signature6cb5f07 -
Update README.md
Verified signature230dc7d -
Update README.md
Verified signaturea7cd273 -
Upload folder using huggingface_hub
Verified signaturec5e79d3 -
initial commit
Verified signature7db3bac