Image-to-Text
Transformers
Safetensors
deepseek_vl_v2
feature-extraction
vision
ocr
quantized
qvlm
4-bit precision
deepseek
custom_code
8-bit precision
Instructions to use SamMikaelson/deepseek-ocr-qvlm-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SamMikaelson/deepseek-ocr-qvlm-4bit with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("image-to-text", model="SamMikaelson/deepseek-ocr-qvlm-4bit", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SamMikaelson/deepseek-ocr-qvlm-4bit", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload QVLM 4-bit quantized DeepSeek-OCR model (SafeTensors format) - 2.89x compression
cad72e6 verified Download quantization_config.json from SamMikaelson/deepseek-ocr-qvlm-4bit: direct link, hf CLI and curl.
- Browser
- Download file 127 Bytes
-
https://huggingface.co/SamMikaelson/deepseek-ocr-qvlm-4bit/resolve/main/quantization_config.json
- Command line
-
hf download hf://SamMikaelson/deepseek-ocr-qvlm-4bit/quantization_config.json
-
curl -L -o quantization_config.json https://huggingface.co/SamMikaelson/deepseek-ocr-qvlm-4bit/resolve/main/quantization_config.json
127 Bytes
| { | |
| "quantization_bits": 4, | |
| "group_size": 128, | |
| "vision_quantize": true, | |
| "language_quantize": true, | |
| "symmetric": false | |
| } |