Commit History
-
Add scope section: full Video-MME mini 2700Q result (+0.22 pp)
Verified signatureFollowing the 300Q release, the eval was extended to the full 2700Q split. Overall Δ +0.22 pp. README adds: (1) Scope note callout under TL;DR, (2) updated Caveat in Reproducibility section pointing to (3) new 'Scope on the full Video-MME mini (2700Q)' section. The original 300Q numbers are unchanged and remain reproducible by recipe; this addition characterizes the design envelope (short-clip, low-frame-budget) on the full balanced split.d0f5738
-
Wording hotfix: scope clarity + MCQ-mode terminology
Verified signatureFollowing audit, retire 'wild mode' / 'in-the-wild deployment' wording in favor of: - 'MCQ mode (no task_type)' for the default 64.3% setting - 'Task-aware MCQ mode' for the 66.3% setting (uses dataset task taxonomy) Add explicit Scope section: this release evaluates query-aware frame selection for video MCQ / decision-style QA. The selector may use the question + answer options as its CLIP query. This is appropriate for Video-MME-style benchmarks and operational triage workflows where the system chooses among predefined actions/alert categories. Not an open-ended video understanding claim. Add Motivation note: started from CCTV/video-security R&D under tight frame-budget constraints. The artifact is general-purpose, not a product-specific CCTV model. Method, numbers (64.3% / 66.3%), and Qwen3-VL attribution unchanged.c04d819 -
Polish: distinguish wild-mode (~44%) vs benchmark-mode (~56%) gap recovery
Verified signaturePer auditor feedback: the previous '56% of the gap' line was the benchmark-mode number; spell out both modes' recovery fractions to avoid ambiguity for readers who skim the lede.7cb17d8 -
Add Acknowledgements / Related Work section
Verified signatureAcknowledge that query-aware and adaptive frame selection for Video-LLMs is an active research direction; clarify that this release is an independent engineering implementation focused on small-model, low-frame-budget video QA and CCTV-style deployment.97b9bd0 -
Initial release: DW-KhotTaeVL-2B-QueryFrames v1.0
Verified signatureQuery-aware frame selection wrapper for Qwen3-VL-2B-Instruct. Wild mode: 64.3% on Video-MME mini 300Q (+7.3pp vs stock 57.0%). Benchmark mode: 66.3% (+9.3pp), 12/12 task buckets non-negative. Zero trainable parameters, no model weights modified. Built on Qwen/Qwen3-VL-2B-Instruct (Apache 2.0). Frame scorer: openai/clip-vit-large-patch14 (MIT). Author: Deaw (HF: @commandeaw).84c8a9d