Image-Text-to-Text
Transformers
minicpmv4_7
minicpm-v
multimodal
On-Device Model
lightweight
conversational
Instructions to use FastFlowLM/MiniCPM-V-4.7-1B-NPU2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FastFlowLM/MiniCPM-V-4.7-1B-NPU2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="FastFlowLM/MiniCPM-V-4.7-1B-NPU2") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("FastFlowLM/MiniCPM-V-4.7-1B-NPU2") model = AutoModelForMultimodalLM.from_pretrained("FastFlowLM/MiniCPM-V-4.7-1B-NPU2", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use FastFlowLM/MiniCPM-V-4.7-1B-NPU2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FastFlowLM/MiniCPM-V-4.7-1B-NPU2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FastFlowLM/MiniCPM-V-4.7-1B-NPU2", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/FastFlowLM/MiniCPM-V-4.7-1B-NPU2
- SGLang
How to use FastFlowLM/MiniCPM-V-4.7-1B-NPU2 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "FastFlowLM/MiniCPM-V-4.7-1B-NPU2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FastFlowLM/MiniCPM-V-4.7-1B-NPU2", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "FastFlowLM/MiniCPM-V-4.7-1B-NPU2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FastFlowLM/MiniCPM-V-4.7-1B-NPU2", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use FastFlowLM/MiniCPM-V-4.7-1B-NPU2 with Docker Model Runner:
docker model run hf.co/FastFlowLM/MiniCPM-V-4.7-1B-NPU2
|
Download README.md from FastFlowLM/MiniCPM-V-4.7-1B-NPU2: direct link, hf CLI and curl.
- Browser
- Download file 17.5 kB
-
https://huggingface.co/FastFlowLM/MiniCPM-V-4.7-1B-NPU2/resolve/main/README.md
- Command line
-
hf download hf://FastFlowLM/MiniCPM-V-4.7-1B-NPU2/README.md
-
curl -L -o README.md https://huggingface.co/FastFlowLM/MiniCPM-V-4.7-1B-NPU2/resolve/main/README.md
17.5 kB
| license: apache-2.0 | |
| pipeline_tag: image-text-to-text | |
| tags: | |
| - minicpm-v | |
| - multimodal | |
| - On-Device Model | |
| - lightweight | |
| library_name: transformers | |
| # MiniCPM-V 4.7 | |
| [Evaluation](#evaluation) · [Examples](#examples) · [Usage](#usages) · [Model weights](#model-weights) | |
| **MiniCPM-V 4.7** is the latest model in the MiniCPM-V series, available in a **1B** variant. It builds on the family's single-image, multi-image, and video understanding capabilities, combining stronger foundation capabilities with efficient visual encoding and on-device inference. Notable features of MiniCPM-V 4.7 include: | |
| - 🔥 **A New Pareto Frontier in Performance and Efficiency.** | |
| As model capabilities continue to advance, inference efficiency has become an important measure of a model's value. On resource-constrained devices, delivering the strongest possible capabilities within a limited resource budget calls for higher capability density. The **1B** variant of MiniCPM-V 4.7 advances the performance–efficiency Pareto frontier for MLLMs. In Instruct mode, the 1B variant continues to improve foundation capabilities over MiniCPM-V 4.6 and **substantially outperforms Qwen3.5 0.8B in both overall score and inference efficiency**. | |
| - 🚀 **Efficient Architecture.** | |
| Based on the intra-ViT early compression technique from [LLaVA-UHD v4](https://github.com/THUMAI-Lab/LLaVA-UHD-v4), MiniCPM-V 4.7 compresses visual tokens early within the vision encoder, reducing computation in subsequent encoder layers. It also supports **mixed 4x/16x visual token compression**, allowing developers to balance visual detail and inference cost across tasks. | |
| - 💻 **Broad Platform and Chip Support.** | |
| MiniCPM-V 4.7 supports **iOS, Android, and HarmonyOS**, together with open-source on-device deployment support. It also provides **day-0 support for chip platforms from Rockchip, Houmo, Intel, AMD, and Arm**, extending deployment options across mobile and local computing devices. | |
| - 🛠️ **Developer Friendly.** | |
| MiniCPM-V 4.7 supports [inference frameworks](https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/deployment_en.md#supported-inference-and-training-frameworks-and-api) including SGLang, vLLM, llama.cpp, and Ollama, along with [fine-tuning frameworks](https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/deployment_en.md#supported-inference-and-training-frameworks-and-api) including SWIFT and LLaMA-Factory. It provides GGUF, BNB, AWQ, and GPTQ quantized variants and adds **FP8 quantization support**. We also release **Self-Replay Fine-Tuning**, a fine-tuning approach that helps developers extend model capabilities at low cost while reducing forgetting of existing capabilities, making further customization easier. | |
| ## Get started | |
| <p align="center"> | |
| <a href="https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/minicpm_v4dot7_en.md#model-weights">Model weights</a> · | |
| <a href="https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/minicpm_v4dot7_en.md#inference-with-transformers">Inference</a> · | |
| <a href="https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/deployment_en.md#training-llama-factory-swift">Fine-tuning</a> · | |
| <a href="https://huggingface.co/spaces/openbmb/MiniCPM-V-4.7-Demo">Live demo</a> · | |
| <a href="https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/minicpm_v4dot7_en.md#on-device-deployment">Local deployment</a> · | |
| <a href="https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/api.md">API</a> · | |
| <a href="https://github.com/OpenSQZ/MiniCPM-V-CookBook">Cookbook</a> | |
| </p> | |
| ### Evaluation | |
| **Significantly Advancing the Performance–Efficiency Pareto Frontier** | |
| The 1B variant of MiniCPM-V 4.7 advances the performance–efficiency Pareto frontier. In Instruct mode, 1B substantially outperforms Qwen3.5 0.8B in both overall score and inference efficiency. | |
| <p align="center"> | |
| <a href="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/minicpmv4.7/performance_efficiency_frontier.png"><img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/minicpmv4.7/performance_efficiency_frontier.png" alt="Performance versus inference time for MiniCPM-V 4.7 1B" width="95%"></a> | |
| </p> | |
| **Overall Performance (1B, Instruct)** | |
| <p align="center"> | |
| <a href="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/minicpmv4.7/overall_performance_1b_instruct.png"><img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/minicpmv4.7/overall_performance_1b_instruct.png" alt="Full performance comparison for MiniCPM-V 4.7 1B in Instruct mode" width="90%"></a> | |
| </p> | |
| ### Examples | |
| MiniCPM-V 4.7 can run on phones and tablets. The clips below are unedited screen recordings captured directly on the devices. | |
| <table align="center"> | |
| <tr> | |
| <td align="center"><b>1B</b><br><sub>iPhone 17 Pro Max</sub></td> | |
| </tr> | |
| <tr> | |
| <td align="center"><img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/minicpmv4.7/v47_1b_iphone_en.gif" height="520"/></td> | |
| </tr> | |
| </table> | |
| ### Usages | |
| #### Inference with Transformers <!-- omit in toc --> | |
| <details> | |
| <summary>Click to expand the Transformers inference examples.</summary> | |
| ##### Installation <!-- omit in toc --> | |
| ```bash | |
| pip install "transformers[torch]>=5.18.0" torchvision torchcodec | |
| ``` | |
| > **Note on CUDA compatibility:** `torchcodec` (used for video decoding) may have compatibility issues with certain CUDA versions. For example, `torch>=2.11` bundles CUDA 13.1 by default, while environments with CUDA 12.x may encounter errors such as `RuntimeError: Could not load libtorchcodec`. Two workarounds: | |
| > | |
| > 1. **Replace `torchcodec` with `PyAV`** — supports both image and video inference without CUDA version constraints: | |
| > ```bash | |
| > pip install "transformers[torch]>=5.18.0" torchvision av | |
| > ``` | |
| > 2. **Pin the CUDA version** when installing torch to match your environment (e.g. CUDA 12.8): | |
| > ```bash | |
| > pip install "transformers>=5.18.0" torchvision torchcodec --index-url https://download.pytorch.org/whl/cu128 | |
| > ``` | |
| ##### Load the Model <!-- omit in toc --> | |
| ```python | |
| import torch | |
| from transformers import AutoModelForImageTextToText, AutoProcessor | |
| model_id = "openbmb/MiniCPM-V-4.7-1B" | |
| processor = AutoProcessor.from_pretrained(model_id) | |
| model = AutoModelForImageTextToText.from_pretrained( | |
| model_id, torch_dtype="auto", device_map="auto" | |
| ) | |
| # Flash Attention 2 is recommended for faster inference and lower GPU memory usage, | |
| # especially in multi-image and video scenarios. | |
| # model = AutoModelForImageTextToText.from_pretrained( | |
| # model_id, | |
| # torch_dtype=torch.bfloat16, | |
| # attn_implementation="flash_attention_2", | |
| # device_map="auto", | |
| # ) | |
| ``` | |
| ##### Image Inference <!-- omit in toc --> | |
| ```python | |
| messages = [ | |
| { | |
| "role": "user", | |
| "content": [ | |
| {"type": "image", "url": "https://huggingface.co/datasets/openbmb/DemoCase/resolve/main/refract.png"}, | |
| {"type": "text", "text": "What causes this phenomenon?"}, | |
| ], | |
| } | |
| ] | |
| downsample_mode = "16x" # Using `downsample_mode="4x"` for Finer Detail | |
| inputs = processor.apply_chat_template( | |
| messages, tokenize=True, add_generation_prompt=True, | |
| return_dict=True, return_tensors="pt", | |
| downsample_mode=downsample_mode, | |
| max_slice_nums=36, | |
| enable_thinking=False, | |
| ).to(model.device) | |
| generated_ids = model.generate(**inputs, downsample_mode=downsample_mode, max_new_tokens=512) | |
| generated_ids_trimmed = [ | |
| out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids) | |
| ] | |
| output_text = processor.batch_decode( | |
| generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False | |
| ) | |
| print(output_text[0]) | |
| ``` | |
| ##### Video Inference <!-- omit in toc --> | |
| ```python | |
| messages = [ | |
| { | |
| "role": "user", | |
| "content": [ | |
| {"type": "video", "url": "https://huggingface.co/datasets/openbmb/DemoCase/resolve/main/football.mp4"}, | |
| {"type": "text", "text": "Describe this video in detail. Follow the timeline and focus on on-screen text, interface changes, main actions, and scene changes."}, | |
| ], | |
| } | |
| ] | |
| downsample_mode = "16x" # Using `downsample_mode="4x"` for Finer Detail | |
| inputs = processor.apply_chat_template( | |
| messages, tokenize=True, add_generation_prompt=True, | |
| return_dict=True, return_tensors="pt", | |
| downsample_mode=downsample_mode, | |
| max_num_frames=128, | |
| stack_frames=1, | |
| max_slice_nums=1, | |
| use_image_id=False, | |
| enable_thinking=False, | |
| ).to(model.device) | |
| generated_ids = model.generate(**inputs, downsample_mode=downsample_mode, max_new_tokens=2048) | |
| generated_ids_trimmed = [ | |
| out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids) | |
| ] | |
| output_text = processor.batch_decode( | |
| generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False | |
| ) | |
| print(output_text[0]) | |
| ``` | |
| ##### Advanced Parameters <!-- omit in toc --> | |
| You can customize image/video processing by passing additional parameters to `apply_chat_template`: | |
| | Parameter | Default | Applies to | Description | | |
| |-----------|---------|------------|-------------| | |
| | `downsample_mode` | `"16x"` | Image & Video | Visual token downsampling. `"16x"` merges tokens for efficiency; `"4x"` keeps four times as many tokens for finer detail. **Must also be passed to `generate()`**. | | |
| | `max_slice_nums` | `9` | Image & Video | Maximum number of slices when splitting a high-resolution image. Higher values preserve more detail for large images. Recommended: `36` for image, `1` for video. | | |
| | `max_num_frames` | `128` | Video only | Maximum number of main frames sampled from the video. | | |
| | `stack_frames` | `1` | Video only | Total sample points per second. `1` = main frame only (no stacking). `N` (N>1) = 1 main frame + N−1 sub-frames per second; the sub-frames are composited into a grid image and interleaved with main frames. Recommended: `3` or `5`. | | |
| | `use_image_id` | `True` | Image & Video | Whether to prepend `<image_id>N</image_id>` tags before each image/frame placeholder. Recommended: `True` for image, `False` for video. | | |
| > **Note:** `downsample_mode` must be passed to **both** `apply_chat_template` (for correct placeholder count) and `generate` (for the vision encoder). All other parameters only need to be passed to `apply_chat_template`. | |
| ##### Serving with `transformers serve` <!-- omit in toc --> | |
| Hugging Face Transformers includes a lightweight OpenAI-compatible server for quick testing and moderate-load deployment. | |
| ```bash | |
| pip install "transformers[serving]>=5.18.0" | |
| ``` | |
| Start the server: | |
| ```bash | |
| transformers serve openbmb/MiniCPM-V-4.7-1B --port 8000 --host 0.0.0.0 | |
| ``` | |
| Send a request: | |
| ```bash | |
| curl -s http://localhost:8000/v1/chat/completions \ | |
| -H 'Content-Type: application/json' \ | |
| -d '{ | |
| "model": "openbmb/MiniCPM-V-4.7-1B", | |
| "messages": [{ | |
| "role": "user", | |
| "content": [ | |
| {"type": "image_url", "image_url": {"url": "https://huggingface.co/datasets/openbmb/DemoCase/resolve/main/refract.png"}}, | |
| {"type": "text", "text": "What causes this phenomenon?"} | |
| ] | |
| }] | |
| }' | |
| ``` | |
| Tool calling example: | |
| ```bash | |
| curl -s http://localhost:8000/v1/chat/completions -H 'Content-Type: application/json' -d '{ | |
| "model": "openbmb/MiniCPM-V-4.7-1B", | |
| "messages": [{"role": "user", "content": [ | |
| {"type": "text", "text": "the weather of Beijing"} | |
| ]}], | |
| "tools": [{ | |
| "type": "function", | |
| "function": { | |
| "name": "get_weather", | |
| "description": "Get the current weather for a given location", | |
| "parameters": { | |
| "type": "object", | |
| "properties": { | |
| "location": {"type": "string", "description": "City name"} | |
| }, | |
| "required": ["location"] | |
| } | |
| } | |
| }] | |
| }' | |
| ``` | |
| </details> | |
| #### Speculative decoding (DSpark) <!-- omit in toc --> | |
| <details> | |
| <summary>Click to show speculative decoding. </summary> | |
| Speculative decoding (DSpark): we also release [MiniCPM-V-4.7-1B-DSpark](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B-DSpark), a DSpark draft model trained for [MiniCPM-V-4.7-1B](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B). | |
| </details> | |
| #### Inference with OpenVINO™ | |
| [OpenVINO™](https://docs.openvino.ai) is an open-source toolkit for optimizing and deploying AI inference on Intel CPU/GPU/NPU platforms. OpenVINO provides day-0 support for MiniCPM-V-4.7 on Intel platforms with high-performance inference. See the [OpenVINO™ Toolkit](https://github.com/openvinotoolkit) to get started. You can install and run the example with this notebook (link TBD). | |
| #### On-Device Deployment | |
| MiniCPM-V 4.7 supports deployment on iOS, Android, and HarmonyOS, with day-0 support for Rockchip, Houmo, Intel, AMD, and Arm chip platforms. See the [edge deployment repository](https://github.com/OpenBMB/MiniCPM-V-Apps) for the apps and source code. | |
| #### Inference and Fine-Tuning | |
| For supported inference and training frameworks, see [Supported Inference and Training Frameworks and API](https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/deployment_en.md#supported-inference-and-training-frameworks-and-api). The [MiniCPM-V 4.7 Cookbook](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/docs/pages/v4.7/overview.md) covers deployment, fine-tuning, and quantization workflows. | |
| **Task guides** | |
| - [Single-image chat](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/inference/minicpm-v4_7_single_image.md) | |
| - [Multi-image chat](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/inference/minicpm-v4_7_multi_images.md) | |
| - [Video understanding](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/inference/minicpm-v4_7_video_understanding.md) | |
| - [OCR](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/inference/minicpm-v4_7_ocr.md) | |
| - [PDF parsing](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/inference/minicpm-v4_7_pdf_parse.md) | |
| - [Visual grounding](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/inference/minicpm-v4_7_grounding.md) | |
| **Quantization** | |
| | Method | Guide | | |
| |:---|:---| | |
| | GGUF | [Quantization guide](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/gguf/minicpm-v4_7_gguf_quantize.md) | | |
| | BNB | [Quantization guide](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/bnb/minicpm-v4_7_bnb_quantize.md) | | |
| | AWQ | [Quantization guide](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/awq/minicpm-v4_7_awq_quantize.md) | | |
| | GPTQ | [Quantization guide](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/gptq/minicpm-v4_7_gptq_quantize.md) | | |
| | FP8 / INT4 | [Quantization guide](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/llmcompressor/minicpm-v4_7_llmcompressor_quantize.md) | | |
| ### Acknowledgements | |
| <details> | |
| <summary>Click to view acknowledgements.</summary> | |
| We would like to thank the following projects: | |
| * [Qwen3.6](https://huggingface.co/collections/Qwen/qwen36) for providing the language backbone | |
| * [SigLIP2](https://github.com/google-research/big_vision/blob/main/big_vision/configs/proj/image_text/README_siglip2.md) for providing the vision understanding module | |
| * [Transformers](https://github.com/huggingface/transformers) | |
| </details> | |
| ## Model Weights | |
| MiniCPM-V 4.7 is available in the following variants: | |
| | Model | Description | Download | | |
| |:---|:---|:---:| | |
| | MiniCPM-V 4.7 1B | Combines stronger capabilities with extremely high efficiency, advancing the performance–efficiency Pareto frontier for multimodal large language models. | [🤗](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B) [<img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/modelscope_logo.png" width="20px"></img>](https://modelscope.cn/models/OpenBMB/MiniCPM-V-4.7-1B) | | |
| | MiniCPM-V 4.7 1B int4 | bitsandbytes int4 quantized version with lower GPU memory usage. | [🤗](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B-int4) [<img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/modelscope_logo.png" width="20px"></img>](https://modelscope.cn/models/OpenBMB/MiniCPM-V-4.7-1B-int4) | | |
| | MiniCPM-V 4.7 1B AWQ | AWQ (W4A16) quantized version with lower GPU memory usage. | [🤗](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B-AWQ) [<img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/modelscope_logo.png" width="20px"></img>](https://modelscope.cn/models/OpenBMB/MiniCPM-V-4.7-1B-AWQ) | | |
| | MiniCPM-V 4.7 1B GPTQ | GPTQ (W4A16) quantized version with lower GPU memory usage. | [🤗](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B-GPTQ) [<img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/modelscope_logo.png" width="20px"></img>](https://modelscope.cn/models/OpenBMB/MiniCPM-V-4.7-1B-GPTQ) | | |
| | MiniCPM-V 4.7 1B GGUF | GGUF version with lower memory usage for CPU inference. | [🤗](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B-gguf) [<img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/modelscope_logo.png" width="20px"></img>](https://modelscope.cn/models/OpenBMB/MiniCPM-V-4.7-1B-gguf) | | |
| | MiniCPM-V 4.7 1B DSpark | DSpark draft model for speculative decoding. | [🤗](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B-DSpark) [<img src="https://raw.githubusercontent.com/OpenBMB/MiniCPM-o/main/assets/modelscope_logo.png" width="20px"></img>](https://modelscope.cn/models/OpenBMB/MiniCPM-V-4.7-1B-DSpark) | | |
| Also available on [Ollama](https://ollama.com/openbmb/minicpm-v4.7). | |