Video-Text-to-Text
Transformers
Safetensors
qwen3_5
image-text-to-text
SAVER
video
video-question-answering
temporal-grounding
reinforcement-learning
Instructions to use lmsdss/SAVER-2B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lmsdss/SAVER-2B with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("lmsdss/SAVER-2B") model = AutoModelForMultimodalLM.from_pretrained("lmsdss/SAVER-2B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from lmsdss/SAVER-2B: direct link, hf CLI and curl.
- Browser
- Download file 2.86 kB
-
https://huggingface.co/lmsdss/SAVER-2B/resolve/main/README.md
- Command line
-
hf download hf://lmsdss/SAVER-2B/README.md
-
curl -L -o README.md https://huggingface.co/lmsdss/SAVER-2B/resolve/main/README.md
2.86 kB
| base_model: Qwen/Qwen3.5-2B | |
| library_name: transformers | |
| pipeline_tag: video-text-to-text | |
| license: apache-2.0 | |
| tags: | |
| - SAVER | |
| - video | |
| - video-question-answering | |
| - temporal-grounding | |
| - reinforcement-learning | |
| - qwen3_5 | |
| base_model_relation: finetune | |
| # SAVER 2B | |
| **Less from More: Reinforcing Sparse Video Reasoning from Dense References** | |
| SAVER 2B is a reinforcement-learning post-trained model based on | |
| [Qwen3.5-2B](https://huggingface.co/Qwen/Qwen3.5-2B), for sparse video | |
| question answering and temporal grounding. | |
| This release contains the full BF16 model weights, tokenizer, processor, | |
| chat template, and generation configuration in Hugging Face Transformers format. | |
| ## Abstract | |
| Video-language models commonly assume that more temporal observations lead to more reliable reasoning. We question this assumption and argue that the key challenge is not merely processing more video frames efficiently, but learning to reason reliably under limited temporal evidence. | |
| We propose SAVER, a dense-to-sparse post-training framework that uses dense video views as training-time references for sparse-frame inference. During reinforcement post-training, paired dense and sparse views are optimized with grounding rewards and a reliability-gated reference reward, encouraging sparse view predictions to preserve task-relevant temporal evidence. Notably, SAVER is trained only on 1,250 randomly sampled temporal grounding examples, without using any video question answering annotations. | |
| Across three temporal grounding benchmarks and six video question-answering benchmarks, SAVER consistently improves performance across frame budgets. In particular, SAVER can match or surpass dense-frame Qwen3.5 baselines while using substantially fewer frames. These results show that temporal grounding can serve as an effective evidence-localization proxy for learning sparse video reasoning that transfers to broader video understanding tasks. | |
| ## Loading | |
| Use a Transformers version with `Qwen3_5ForConditionalGeneration` support. | |
| The checkpoint records Transformers 5.4.0. | |
| ```python | |
| import torch | |
| from transformers import AutoProcessor, Qwen3_5ForConditionalGeneration | |
| model_id = "lmsdss/SAVER-2B" | |
| processor = AutoProcessor.from_pretrained(model_id) | |
| model = Qwen3_5ForConditionalGeneration.from_pretrained( | |
| model_id, | |
| torch_dtype=torch.bfloat16, | |
| device_map="auto", | |
| ) | |
| ``` | |
| ## Base-model attribution | |
| This model derives from Qwen3.5-2B. The upstream base model is distributed | |
| under Apache 2.0; its license and attribution requirements continue to apply. | |
| ## Links | |
| - **Paper:** [Less from More: Reinforcing Sparse Video Reasoning from Dense References](https://huggingface.co/papers/2610.10893) | |
| - **Project page:** [https://wenfangsun.cn/SAVER/](https://wenfangsun.cn/SAVER/) | |
| - **Code:** [https://github.com/lmsdss/SAVER](https://github.com/lmsdss/SAVER) |