diff --git a/.gitattributes b/.gitattributes index a030ab55d5be8b6382c7a6569e917a1dcdfb28f3..1f728b7231fb6fad0acff5f7a316f07ccb1a7260 100644 --- a/.gitattributes +++ b/.gitattributes @@ -158,3 +158,18 @@ qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf filter=lfs diff=lfs merge qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text +bpw/native-bpw.json filter=lfs diff=lfs merge=lfs -text +gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +gemma-4-31b-it/unsloth/mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text +glm-4.6v-flash/unsloth/mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text +internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf filter=lfs diff=lfs merge=lfs -text +internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-bf16.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/mmproj-Kimi-VL-A3B-Instruct-bf16.gguf filter=lfs diff=lfs merge=lfs -text +kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/DECODING_PARAMS.md b/DECODING_PARAMS.md new file mode 100644 index 0000000000000000000000000000000000000000..e2e31012cba023157f765570133db05bbc321c23 --- /dev/null +++ b/DECODING_PARAMS.md @@ -0,0 +1,81 @@ +# 本機模型的 model-card decoding 參數 + +查核日期: 2026-09-06 (UTC)。本次盤點 ~/models 的 GGUF 清單,核對八個選定 reference 入口的 header、reference profiles 及官方 model-card / generation_config;不代表全部量化版本完成 decoding 或完整性驗證。Reference 操作與待補流程見 [RunPod handover](/home/ubuntu/llamacpp_reference_runpod_handover.md)。舊 smoke 與移除模型的紀錄仍保留,不能當作目前完整工作清單。 + +本次目標為 9 個 checkpoint。Kimi Instruct 與 Thinking-2506 分開,使用本機 llama.cpp 轉換的 BF16 LLM / BF16 mmproj;其餘使用 Bartowski BF16 pair。Muse 已重新下載並完成 21 列容量與 thinking/high 生成驗收。Gemma 26B 與 Qwen3-VL 不在本次目標清單。使用各交接包的外部 profiles,不使用仍含 Gemma 26B 的歷史內建 profile。 + +本次固定 n_threads=8、threads_batch=8、metric_threads=8、FA on、all GPU layers、swa_full=false。100 / 500 題的 generated-token caps 由本輪 native 調查提出,不沿用舊 profile。初始探測提案為 pilot instruct=2048 / thinking=8192,較少預選題目的長度敏感度為 4096 / 16384;兩個小模型的 100 / 500 已凍結為 [可執行起始協定](/home/ubuntu/llamacpp_reference_runpod_handover_qwen_gemma_4b.md);其 500 cap 為 1024 / 4096,其餘 SNR 與最終評估組也已完成起始協定交付;最後三模型見 [專用交接](/home/ubuntu/llamacpp_reference_runpod_handover_internvl_glm_muse.md)。各模型採自己的 mmproj 預設,不傳 image-min-tokens / image-max-tokens,包括不顯式傳 -1。 + +下表列出官方推薦,含明確標記的歷史模型。`—` 表示引用段落沒有指定,不能解讀成 0 或停用。模型名稱連到官方來源;舊 server smoke 實際傳送的 overrides 由 [llamacpp_smoke_models.json](/home/ubuntu/projects/llm_reference_generator/scripts/llamacpp_smoke_models.json) 決定。 + +| 模型與模式 | temperature | top_p | top_k | min_p | presence_penalty | repetition_penalty | +|---|---:|---:|---:|---:|---:|---:| +| [Qwen3.5-4B](https://huggingface.co/Qwen/Qwen3.5-4B#best-practices):non-thinking / general | 0.7 | 0.8 | 20 | 0.0 | 1.5 | 1.0 | +| [Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B#best-practices):non-thinking | 0.7 | 0.8 | 20 | 0.0 | 1.5 | 1.0 | +| 歷史: [Qwen3-VL-4B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct#generation-hyperparameters):VL | 0.7 | 0.8 | 20 | — | 1.5 | 1.0 | +| 歷史: [Qwen3-VL-4B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-4B-Thinking#generation-hyperparameters):VL | 1.0 | 0.95 | 20 | — | 0.0 | 1.0 | +| [Gemma-4-E4B-it](https://huggingface.co/google/gemma-4-E4B-it#1-sampling-parameters):所有情境 | 1.0 | 0.95 | 64 | — | — | — | +| 歷史: [Gemma-4-26B-A4B-it](https://huggingface.co/google/gemma-4-26B-A4B-it#1-sampling-parameters):所有情境 | 1.0 | 0.95 | 64 | — | — | — | +| [Gemma-4-31B-it](https://huggingface.co/google/gemma-4-31B-it#1-sampling-parameters):所有情境 | 1.0 | 0.95 | 64 | — | — | — | +| [Muse-Glimmer-30B](https://huggingface.co/meta-models/Muse-Glimmer-30B#best-practices):官方 sampling 建議 | 1.0 | 0.95 | 64 | — | — | — | +| [GLM-4.6V-Flash](https://huggingface.co/zai-org/GLM-4.6V-Flash#evaluation-settings):官方評測設定 | 0.8 | 0.6 | 2 | — | — | 1.1 | +| [Kimi-VL-A3B-Instruct](https://huggingface.co/moonshotai/Kimi-VL-A3B-Instruct#model-variants):Instruct | 0.2 | — | — | — | — | — | +| [Kimi-VL-A3B-Thinking-2506](https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506#31-inference-with-vllm):Thinking | 0.8 | — | — | — | — | — | +| [InternVL3.5-30B-A3B](https://huggingface.co/OpenGVLab/InternVL3_5-30B-A3B/blob/ba1762d830e2aeddb3272b66ba9e0abf7e69f626/README.md#L410): thinking | 0.6 | U | U | U | U | U | + +InternVL 列的 U 同樣表示未指定。一般模式沒有統一 sampling 推薦;官方 Thinking Mode 需要 R1 system prompt,並建議 do_sample=True、temperature=0.6。本機與官方 template 都沒有 enable_thinking 分支。Reference 需保存 system prompt 本文與 hash,不能只保存一個 thinking boolean。 + +Kimi 是兩個專用 checkpoint,template 都沒有 enable_thinking 分支。Instruct card 與 generation_config 的 temperature 是 0.2;Thinking-2506 [card](https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506/blob/aa1730989e7558695b44ee493623e03bd325a994/README.md#L113) 是 0.8,[generation_config](https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506/blob/aa1730989e7558695b44ee493623e03bd325a994/generation_config.json) 與本機 GGUF 是 0.6。[本機 Thinking README](/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/README.md:30),記錄驗模採 greedy / top-k0 / top-p1 / min-p0。這些是不同 recipe,正式 reference 尚待選定,不能把驗模設定當成官方推薦。 + +本機 header 實測: Gemma 的 GGUF 指定 temp=1、top_k=64、top_p=0.95;GLM 指定 temp=0.8、top_k=2、top_p=0.6;Kimi Instruct / Thinking 分別指定 temp=0.2 / 0.6。InternVL 與 Qwen3.5 沒有 sampling metadata。原始檢查存於 [NVMe inventory](/opt/dlami/nvme/skymizer-decoding-audit-20260906/local-reference-headers.json)。這是 header 檢查,不取代完整性或品質驗收。 + +Native sampling 優先順序為 explicit CLI flags、GGUF sampling metadata、編譯時 defaults。目前 defaults 包括 top_k=40、top_p=0.95、min_p=0.05、temperature=0.8、repeat_last_n=64。現有 Gemma / GLM profiles 的 effective min_p 確實是 0.05,不能將主表未指定解讀成關閉。Qwen profiles 有明確 --min-p 0。完整 sampler 順序與 penalty 範圍也需固定並記錄。 + +八個正式來源都已由本機紀錄及官方 Hub 核對。兩個 Kimi 固定 revisions 為 Instruct 398eede0903cd983a2bfa0cc634e9ac1d843f375、Thinking-2506 aa1730989e7558695b44ee493623e03bd325a994。InternVL 官方來源為 OpenGVLab/InternVL3_5-30B-A3B,revision ba1762d830e2aeddb3272b66ba9e0abf7e69f626;GGUF 的 general.base_model 可能指前一階段 MPO / Base / Instruct 祖先,不能直接當作這次 reference 的精確來源。其他五個 checkpoint 的固定 card_source 仍見 [profiles](/home/ubuntu/projects/llama.cpp/tools/skymizer/scripts/reference_model_profiles.json)。 + +Kimi 的 temperature 建議見 Instruct card 的「Recommended parameter settings」;Thinking-2506 自己的推論範例也使用 0.8。舊 server smoke matrix 額外設定 `top_p=1.0`、`top_k=-1`(關閉 top-k),這是既有實驗沿用的設定,官方推薦段落未指定這兩項。Instruct card 也允許 greedy,本表沿用 0.2 的 sampling 建議。 + +## 模式與輸出長度 + +Seed=1234 是本次實驗設定,所查官方推薦沒有共同指定 seed。新 generation caps 須結合分 checkpoint / mode / dataset 的實測長度、容量與成本,不能用下列官方最大輸出建議直接填入。舊 vLLM 的 instruct=512 / thinking=2048 SNR 平台只作候選起點,不視為 native 已驗證;本輪原始單卡校準兩小時,後經使用者延長同一起點的截止至2026-09-06 17:00 UTC,接受 budget 截斷與 repetition 排除。完整協定見 [reference handover](/home/ubuntu/llamacpp_reference_runpod_handover.md)。 + +[Qwen3.5](https://huggingface.co/Qwen/Qwen3.5-4B/blob/851bf6e806efd8d0a36b00ddf55e13ccb7b8cd0a/README.md) 與 [Qwen3.6](https://huggingface.co/Qwen/Qwen3.6-35B-A3B/blob/995ad96eacd98c81ed38be0c5b274b04031597b0/README.md) 官方一般建議 max-output=32768,高難數理 / 競賽程式題為 81920。[Kimi Thinking 官方推論 recipe](https://huggingface.co/blog/moonshotai/kimi-vl-a3b-thinking-2506#get-started) 使用 32768。Qwen3.5 的上述固定 revision 沒有 generation_config.json;不從 Qwen3.6 或其他模型借用設定。 + +- Qwen3.5 / 3.6 的主表值是關閉 thinking 時使用的設定。兩張 card 的 thinking / general 都列 `temperature=1.0, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0`;thinking / precise coding 則將 temperature 改為 0.6、presence_penalty 改為 0.0。[Qwen3.5](https://huggingface.co/Qwen/Qwen3.5-4B#best-practices)、[Qwen3.6](https://huggingface.co/Qwen/Qwen3.6-35B-A3B#best-practices)。 +- Qwen3.5 card 的 non-thinking / reasoning 在兩處不一致:API 前的建議區塊列 `1.0 / 0.95 / 20 / presence 1.5`,Best Practices 列 `1.0 / 1.0 / 40 / presence 2.0`(依序為 temperature / top_p / top_k / presence)。兩處的 min_p 都是 0、repetition_penalty 都是 1。本次移轉的 non-thinking / general 值不受影響;若改跑 reasoning,protocol 要明確記下選用哪個段落。[官方 card](https://huggingface.co/Qwen/Qwen3.5-4B#best-practices)。 +- Qwen3-VL 主表引用 VL 區塊。Instruct 的 VL `out_seq_length=16384`,Thinking 的 VL 為 40960,兩者都列 `greedy=false`。Text 區塊另有設定:Instruct 使用 `temperature=1.0, top_p=1.0, top_k=40, presence_penalty=2.0`;Thinking 使用 `1.0 / 0.95 / 20 / presence 1.5`,兩者 repetition_penalty 都是 1.0。[Instruct card](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct#generation-hyperparameters)、[Thinking card](https://huggingface.co/Qwen/Qwen3-VL-4B-Thinking#generation-hyperparameters)。 +- GLM 的值是重現排行榜評測所用的設定,card 另列 `max_generate_tokens=16K`。[官方來源](https://huggingface.co/zai-org/GLM-4.6V-Flash#evaluation-settings)。 +- Gemma 的 sampling 建議不按 thinking 模式分組,也沒有在該段指定通用的生成長度、min_p、penalties 或 seed;範例的 `max_new_tokens` 不當成通用建議。[官方來源](https://huggingface.co/google/gemma-4-26B-A4B-it#1-sampling-parameters)。 + +## Gemma thinking 與先前驗證紀錄 + +歷史原生 `llama-reference` 驗證(2026-09-06,當時模型清單):8 個目錄、10 個權重版本的 instruct/thinking 共 48 筆,均完成生成與 KLD replay;另有 3 筆純文字 lane 測試。Gemma E4B、26B、31B 都已實際測過兩種模式。部分 thinking 回答到達 token cap;GLM thinking 雙圖題有一筆顏色誤答,流程通過不代表答案品質全對。當時結果與 review 紀錄見 [原生測試報告](/home/ubuntu/projects/llm_reference_generator/logs/native-reference/REPORT.md)。下表保留先前 server 路徑的驗證歷史。 + + +官方以 system prompt 開頭的 `<|think|>` 啟用 thinking。舊 server 路徑把 `--enable_thinking` / `--no_enable_thinking` 轉成 `/apply-template` 的 `chat_template_kwargs.enable_thinking`,由 llama-server template 加入或移除控制內容,無需手動拼 system prompt。[官方 thinking 說明](https://huggingface.co/google/gemma-4-26B-A4B-it#2-thinking-mode-configuration)。 + +| 模型 | 本機確認範圍 | +|---|---| +| Gemma-4-E4B-it | llama-server 的 default / false / true template 已驗證;生成、GT prefix 與 KLD replay 位置檢查通過。[紀錄](/home/ubuntu/projects/llm_reference_generator/logs/native-template-refactor/results.json) | +| Gemma-4-26B-A4B-it | BF16、MXFP4_MOE、UD-Q3_K_M、UD-Q4_K_M、UD-Q4_K_S 均通過非 thinking 的文字、單圖、雙圖、OCR;thinking=true 能生成思考內容,logprobs 為有限值。thinking probe 上限 32 tokens,未驗證完整思考答案。[報告](/home/ubuntu/projects/llm_reference_generator/logs/gemma-4-26b-a4b-smoke/REPORT.md) | +| [Gemma-4-31B-it](https://huggingface.co/google/gemma-4-31B-it#2-thinking-mode-configuration) | 官方說明支援 thinking;已讀取本機 bartowski BF16 GGUF:template 有 `enable_thinking` 分支,true 會加入 `<|think|>`。這次是 template 靜態確認,未新增 31B thinking 生成測試。 | + +舊 server 路徑省略 thinking 旗標時沿用 server 設定;GGUF template 本身的 default 不一定等於 server 最終採用值,要看 `/apply-template` 的實際結果。26B 個別紀錄見 [gemma-4-26b-a4b-it/DECODING_PARAMS.md](gemma-4-26b-a4b-it/DECODING_PARAMS.md)。 + +## 套用方式與紀錄 + +現在的原生入口位於 `~/projects/llama.cpp/tools/skymizer/cli/generate_reference.py`,在 `--` 後傳 llama.cpp sampling flags;有效值存在 metadata 與 row,無 HF tokenizer 對齊步驟。以下 `sampling_policy` 與 server echo 說明保留給舊 server 流程。 + +`sampling_policy=native` 預設沿用 llama-server 的 sampler 順序與未覆寫數值;這份 Markdown 不會自動載入。要使用主表數值,須明確給 generator 的 sampling flags,或設定 server 預設。model-card 數值也可搭配 native policy 使用,不必為此切換到 `vllm-like`。 + +`vllm-like` 是另一種 sampler / penalty 語意。使用哪個 policy、實際有哪些 overrides,都應記在 study protocol;生成 row 的 `generation_sampling_params` 保存 server echo 的實際值,`generation_server_args.sampling_sources` 記錄來源。[操作指南](/home/ubuntu/llamacpp_reference_dataset_guide.md)。 + +本文件新增 Gemma 26B 的參數紀錄,不會自動把它加入標準 smoke matrix。前次 26B smoke 使用 server-native sampling,因此只證明當時設定下流程可運作,不能當成已驗證官方建議參數下的品質結果。 + +## 本輪 native warning 查核 + +Gemma 的 `` / `<|tool_response>` 型別 warning 與 GLM 的 EOT warning 伴隨 native 相容處理;Qwen 的 unused blk.32 / blk.40 tensors 是 autoregressive 模式略過的 embedded MTP 層,不能據此判定權重損壞。InternVL 的 NORMAL `` token 128247 會被 native 加成 CONTROL / EOG,若生成它可能提前停止;短測未觀察到此情況,仍記為停止語義差異。Vocabulary fingerprint 不包含完整 EOG 集合,因此 binary / source identity 與實際 stop token 必須一併保存。 + +[逐模型 header / runtime / stop 證據](/opt/dlami/nvme/skymizer-length-audit-20260906/warning-triage/header-runtime-evidence.json)、[原始碼與 binary commit 查核](/opt/dlami/nvme/skymizer-length-audit-20260906/warning-triage/source-verification.json)。這些結論是 loader 行為查核,不是對全部 candidate 的完整性核准。 + +本輪最終評估組已通過獨立 gpt-6-astra max review,commit b2ced7edde884c3a72218974687fdceb4acb5bd4。InternVL R1 system prompt 由 profile 明確傳入;GLM 保留原生 thinking branch;Muse 只收 thinking/high,固定 current_date=2026-09-06,完整 native sampler config78 已實測相等。3 模型均使用 c32768/b2048/ub512/np1/t8/tb8、FA on、all GPU layers、f16 K/V、fit off、省略 image flags、swa_full=false。Upstream 支援基底固定6a1a922d269908a29cbd4b49c27e6a8e7fd10fae,不新增模型實作。候選數值品質另行檢測,不由短 reference 驗收推論。 diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..c0697d583f226312a1166b64c073aeaed5666d93 --- /dev/null +++ b/README.md @@ -0,0 +1,36 @@ +--- +tags: +- gguf +- multimodal +- quantization +--- + +# GAP model archive + +This repository backs up the retained local models used for GAP reference generation and quantization evaluation. It contains multiple model families and checkpoints. Select an individual checkpoint and its projector when loading a model. + +The directory layout preserves the original model-family/provider paths. The two Kimi checkpoints keep their separate directories, conversion records, and original Hugging Face source files. Split GGUF files, projectors, and draft heads are retained with their model files. + +## Files and provenance + +[The manifest](backup_metadata/manifest.json) records file sizes, SHA256 values, checksum evidence, and pinned source identities. [SHA256SUMS](backup_metadata/SHA256SUMS) covers the backed-up source files. Files produced by local conversion retain their conversion records; a pinned base checkpoint does not imply that the converted GGUF was downloaded from that source repository. + +Some source identities are established by exact full-file SHA256 agreement with a pinned upstream file. This establishes byte identity without reconstructing the original download history. Verified identical Hub files may be copied server-side into this repository; other files are uploaded from local storage. Both transfer paths are checked against the same final file manifest. + +## Qualification scope + +[Candidate disposition](backup_metadata/candidate-disposition.json) is the current qualification record. It supersedes older smoke-test summaries retained in conversion directories. + +Candidate usability is evaluated with the current llama.cpp CUDA 13.2.51 build on an NVIDIA RTX PRO 6000. The upstream model-support boundary is commit `6a1a922d269908a29cbd4b49c27e6a8e7fd10fae`. The sparse numerical screen uses three fixed text windows and 765 next-token targets per candidate; flagged numerical results receive additional fixed-window confirmation. Reference NLL columns and runtime settings are checked against same-checkpoint controls. + +A passing sparse screen means that the tested files did not show the screened severe failures. It does not certify full-corpus quality, all image/context combinations, or a statistical SNR claim. Projectors, draft heads, and original source tensors are auxiliary artifacts, not separately qualified standalone candidates. + +Confirmed candidates unusable in this CUDA environment are excluded from this archive. When their full-file SHA matches upstream, the recorded reason is a runtime-specific numerical failure, not a corrupt download. + +Gemma metadata compatibility is scoped to the current no-tool benchmark: token IDs, decoded pieces, full-corpus tokenization, and rendered benchmark prompts must agree. EOS metadata differences do not by themselves establish numerical failure. The applicable compatibility setting and numerical outcome are recorded with the candidate disposition. + +## Licenses and attribution + +The files retain the licenses and terms of their respective model authors and providers. This archive does not assign one replacement license to all included models. Consult the pinned source repositories in the manifest and the original model/conversion records for attribution and applicable model terms. + +Rebuildable virtual environments, caches, Git internals, and agent working directories are excluded from the backup. diff --git a/backup_metadata/SHA256SUMS b/backup_metadata/SHA256SUMS new file mode 100644 index 0000000000000000000000000000000000000000..f9acbae62ddd3b3ee656c1d340e1921a3f2b1537 --- /dev/null +++ b/backup_metadata/SHA256SUMS @@ -0,0 +1,473 @@ +aee47727c2d3049491c1bf049cd2f6e1963badd3a8947ab3f9b711a0ad56d3ba DECODING_PARAMS.md +442d560a29da5e7a001c431decba3eb1560641c179df00d4b4f63e63fb90d771 bpw/BPW.csv +f8c9f0c783ec3602c3eaa9eced3112c8947c5e28649daf39f92066339e6f72d1 bpw/BPW.json +d9a33df7b3a2ba695d76b4ad7af1d88e91f00948c0da99c57628f19fbac9942a bpw/REPORT.md +8fd785fa418595252201c14864610fc0a637450b97f63e3785efdffee9b5426d bpw/REVIEW.md +3041c5285ebc9780047fecdcbd0c42058343d985c0c5223def206b849e2b145c bpw/build_report.py +1077851bce21123b81e51b32f29c0bd87dfe68969d7f87a32288341ad4d3f4f4 bpw/hf/README.md +26d912662d89bbf455a20a0768a8a3d4a75647f00c3dfa36e67b171c281157d6 bpw/hf/check_scan.py +90c542af66fd62fc0256a1fbf28a804b87ba862fc416a0663fd99b835e435643 bpw/hf/checks.log +59b9c7eed8c4e8bf1eb6f9a213c0842dfb3266427bb43751b0bff7fea3fe12ad bpw/hf/excluded.json +115d3901137c47c45be45b7ef3d0d32a2612ad0612cd722e547f92a25ac8c71f bpw/hf/file-matches.json +94b22dd3275ed0419813e4ee2a0175810e52ef9d23c925bd2aecb89b7c94065f bpw/hf/hf-bpw-estimates.csv +a61c38b1f34d45e08092599c4b01f2d4cb0028c278820acca2872e6c13cb8a9c bpw/hf/hf-bpw-estimates.json +8bb0baf3a3a77e530267ba9d2cfc1a407ee25cd4f4e6dd2cecd51e9e9d504467 bpw/hf/inventory.json +ae60863468409f106b304ceb2d589f6b44de7edbb7246f421e562481ca303e0a bpw/hf/repo-metadata/bartowski__Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF.json +2ca179ac064f55f5515d3fb31b04494f6c40963bf4c72bb0781eef2fec83349e bpw/hf/repo-metadata/bartowski__Jackrong_Qwen3.5-4B-Neo-GGUF.json +a5481c82b52b86820a7232f693870f7d4d0b3113a64ce966cd283c7539000903 bpw/hf/repo-metadata/bartowski__Muse-Glimmer-30B-GGUF.json +abfa609b0e6c5eb72ccace1e1abdd2f0bc93eff8c36bc2cd123a255b053b41ab bpw/hf/repo-metadata/bartowski__OpenGVLab_InternVL3_5-30B-A3B-GGUF.json +0e9a473a6fcdf7cbb0622bc3bba1f4b145f7920490ca8304faefd96b8e83b679 bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.5-4B-GGUF.json +691d71c633f61e1d91255aea040f9daf76b3d5f21ec2a5842fc1583f55c08348 bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.6-35B-A3B-GGUF.json +92042d305ec2e16c8eea1cbd85cb1083fecfa68bb6715436a6e079b294da97ee bpw/hf/repo-metadata/bartowski__ReadyArt_gemma-4-31B-it-scotoma-2-GGUF.json +65704a6c2cdf929e846773aab2a8363b509e2004e367bb9cfc1db9519a8676d4 bpw/hf/repo-metadata/bartowski__ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF.json +297066582c0d5723809fbb3d4b084fd914ea0589728e31a8d77d9f37e620822d bpw/hf/repo-metadata/bartowski__allura-org_Qwen3.6-35B-A3B-Anko-GGUF.json +e2347d20305c8309d46f558b0761a7b2d09e14e4868f1cce02f85e9353d69ef2 bpw/hf/repo-metadata/bartowski__darkc0de_Muse-Glimmer-30B-heretic-GGUF.json +ab42eff98a2ed33d98826fc056b158e33ba5921ba83db89c48c6f86c15653022 bpw/hf/repo-metadata/bartowski__google_gemma-3n-E4B-it-GGUF.json +bbdc3f8de36e6b5fe7b78f02ca6756f77bb8e78062f7f6448340be6aa62cbc7b bpw/hf/repo-metadata/bartowski__google_gemma-4-31B-it-GGUF.json +6835928c30b5c3155a4daa99fb9a4ce9f5fed325becf79f6903a47ca89cfdbba bpw/hf/repo-metadata/bartowski__google_gemma-4-E4B-it-GGUF.json +4887670f9022da02654f3f76eec99ebfcf516bb84529d215c12b09df02613343 bpw/hf/repo-metadata/bartowski__huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF.json +c5c917494d5ce8e1049c51f246ac08da30bbba231db2e6b22842b24509a82e86 bpw/hf/repo-metadata/bartowski__zai-org_GLM-4.6V-Flash-GGUF.json +cb6f7f4f49ea02351bdd5cd15a5e1704a873673bc93e20fd10407a36b160bcaf bpw/hf/repo-metadata/ggml-org__Kimi-VL-A3B-Thinking-2506-GGUF.json +3500efd7576084b5d2980569976157b96263e186e5c15558a6711b4e31a425a6 bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF.json +dd1223aaecd16cf1b18a81040ecd4c638dff27242ea675de3734f8ae34616f8b bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF.json +4f8a61f81deba1d1c013b1eb88a0c4e4f25bd4f28ee4caeacc9d970b26684086 bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-GGUF.json +87eb08d054963fe5d2e36997538d8f43379a5b72f493a57af48f34b09ab6e0ec bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-i1-GGUF.json +804c2446f87f81dcadf83dbf81d4ac16ab2141794f97e094cb5c8539f9ce7803 bpw/hf/repo-metadata/unsloth__GLM-4.6V-Flash-GGUF.json +2a48c5d3807e2c08aa172b38aedb85338a1652126bc12029b0214301915c4846 bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-GGUF.json +5c402e96a7ee07c79ca857047648fc4e8b23494261c4c3b370c87e1f1b9263b4 bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-MTP-GGUF.json +ffc0a7858244d6d7ea3369823d1cbf48adaf0dc7d4f43051bc854b5032699388 bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-GGUF.json +f3dd9452e1b758c89b29ac19a9efcd538ddd3e6c2ab332ef47e30c5f37cf28a7 bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-MTP-GGUF.json +57980ddf4afe2a3c4ae343f9fd469913d001727aa9eb9e1c45dbdae35439d051 bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-GGUF.json +0e627f70f3f4583e68a5a0a45ba14247a90676c57dc5ec1d0bb947ffc1133448 bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-litert-preview-GGUF.json +07ea1b10bf0a98f6232ccc1d10732049c32b2487fa44256d399ae686e6de697a bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-GGUF.json +d9db6b1164b0eff3ee5e616dea87894092e2ad5f944ad880300e11dd40580b37 bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-qat-GGUF.json +7f2184cf0a9620e6355a2b4fe1b3a1c977d888746822cb2872fba986b4b6fecd bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-GGUF.json +d1070ee62a98848127e13bc54e96759fd71e55db186946bc36784d68f69a21be bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-qat-GGUF.json +89d010b467b4d3ea0e99011b39cd0fc8fecb6f20283267695ae3baf70588a147 bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-qat-mobile-GGUF.json +c4e3d1e0677150d35722bc1c086ef5600debe0e578395201c2fb596e0e9498c1 bpw/hf/repository-discovery.json +55ab641973192bc9ad92268e6134878246a350c6ade9a9b9c8dd8d614e36592b bpw/hf/scan.log +d1a71c525e9cd169f6f7ddf862881cc6c003dc572124eb4808e51a9968ec1e4f bpw/hf/scan_hf.py +0797ac9440cae2cb03cf19bf1dd34e90c84c229a5870c0c694d815ed21e36d4a bpw/hf/summary.json +8760508d3cee162ec48e21128afe94bf0359619b690e1651f40b31fde22ea090 bpw/main-tensor-shape-validation.json +553cf7d5d9e9d3ea565e3c747ca8daf34861e8472e79a38ec08f9da8400be0d4 bpw/model-removals-20260906.json +3ac40c5526e9ac6c71072f11d9dc3e0c16a9d23b22ce270b64c2837c2cb987e7 bpw/model-removals-q3-k-s-20260906.json +8e74ddeebf450c4c351bc172d9c8bf31b0b1adbd4ca9a7c5e1fc3f2a99bcd402 bpw/native-bpw.csv +0c2ee9efd2cf21c9d890b7ac47017c7d0f6128112f7356c173de20e68afc0be2 bpw/native-bpw.json +51625e55bff23efa01a107a88b4d953af61ef370865618e2f4f1a44a5da74421 bpw/native-scan.log +65ca0470ca28854caa47c2c479dbf06fbe90538bfddda391d7f1a7a6534b4530 bpw/refresh-validation.json +f85544114bb26a20b8242eee51c3a33ccb41263a749deff2f3e1472ffb9eceb4 bpw/refresh-validation.log +582b4cecece7458c4d9566eba8d19e184f06b8f736cc7cc6fc09dcc9e05716bb bpw/report-validation.json +935b10b1bed14e5e60a00c09009637fa73b1a7d66fb5a5bf8f5d6aba24675218 bpw/scan_native_bpw.py +84b8cc5fc87fd0d71eadaaf5ee8f05b2d3a109a7508c228025adb6c14bd32ee8 bpw/validate_native_bpw.py +d7ca1cf55a2dc5fbbe3386a4467984e1f30ef15a2fc0a9b14533c314a9a74788 bpw/validate_refresh.py +279e6b73fa5ff7c02169649bcc4863cf2ccdd668979a417902c99bbe1ff31802 bpw/validation.json +298ad89cbb3f2b877e19c6088a392bdf5b04386adfe8d449bf2c1d4e4762bf4b bpw/validation.log +00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf +ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29 gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf +05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7 gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf +0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf +4591e5ee10527739514d6db436b51169c882949e3858d30285aa997b0b253554 gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_0.gguf +567d744757d575d84c0a42278091223aa2351cdae8f375d4962eec44272659be gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_1.gguf +2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75 gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf +a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52 gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf +21487ff26d08f7ddd1d654d3bbfc1ae1020aab3119f5bf654742ce4697732e4e gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf +743b2b719e448f9a06e774b4f33dd7a391a73e94d32297c7590256484562eb52 gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf +75afa3b3ce99d8b85c27f85cf29f9e1171814211435c7eac4a387c5b36a68629 gemma-4-31b-it/integrity-check-20260906.json +3ad569528558f3915d907ead645aff66193c5a255d38a948ac313ca3654411e4 gemma-4-31b-it/integrity-check-20260906.md +811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92 gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf +e3d40b6e363954c993a6e28b160d881dfe5a243b62746bd4092b393d4f1d54e5 gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_XS.gguf +5c558b9b009e3ee69bde43e2b98a45d1f5afd316b9fbf447edd2ad4945a187bc gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_0.gguf +4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6 gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf +38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84 gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf +41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf +73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716 gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf +9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575 gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf +7a4601b12ec680f706a7e0c7e1f78f579b1db64d485a9e352ee87d4b9daa45e4 gemma-4-31b-it/unsloth/mmproj-BF16.gguf +b56f70624694ca5f2362cdafe6acffe35c5e0f44693c568f3f09fa83b968fb74 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_NL.gguf +a24429604e6f680e7bdf087b863a6cecc90f80b3d908f95d888f4f05003fdee3 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_XS.gguf +00c50656f4b16b98ff9e07199e3c9fb5e776c159a62aaae9f56628b375f689f7 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q3_K_XL.gguf +604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf +be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf +d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf +81508a92a401ccd81292b0da59f43af7360b7b2215a67bc7901830d58bfdf260 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_S.gguf +af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf +ffa64aebf7144bbadd5a1e143b77794d88e76a81cc0168d91de0770eb49e88e0 gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf +fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf +0847f7300471e9a61abaeb46b45b3d61e393af8fa6d6aa70c563623773670dd9 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_XS.gguf +4a403d2e4d80281063e4f517b1c061ded8476b4011a4fc2ba7dbff707075547e gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_0.gguf +430685a687edf70c4fdb1158aa92c34dbb38e1230f674849f198a954cc748405 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_1.gguf +85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf +0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf +7558880ee42b79ab732481bd7250e85c41d9ef044b22634b8a912eb184224009 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q3_K_XL.gguf +3cf61de12daa015ee0f7b68e7b7c541405bf220e1e942bad8b47cab827d7df80 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q4_K_XL.gguf +ee01cba03fd9c71ea2ea722225d24a84f72e7197714367e550ef705ef8851bc6 gemma-4-e4b-it/unsloth/mmproj-BF16.gguf +219b0fcf326d8d023004ce9fc27fa643bd73ebfb73684e8e0af742c1fd755b63 glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf +107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455 glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf +4342477286625c4cfcd70d0023bdb3ac30613fcce729123e0277097c7dc42e2d glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_XS.gguf +e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf +6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf +bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612 glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf +1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85 glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf +66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3 glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf +d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf +d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf +23ea7196ed6f595c44591266a1b4b90d56db5a66c5223d49a41a587b81ace35d glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_XS.gguf +c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf +66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf +4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf +258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf +b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf +74c30227dc957ed360a29b6002622472ec6fcc6a5105a1ba9a5b2a331e3a7833 glm-4.6v-flash/unsloth/mmproj-BF16.gguf +bf516e4962edd42afebb1f2dd1cbe9f5223863adec745bc4d81a0b1211ca5111 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_NL.gguf +c686a3a767fb94ef19499815036fdfb63213664cf0d5867c63848c7ec532d69c internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_XS.gguf +c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf +b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf +f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf +c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf +a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf +37ab465cd0c2b47b6b68e17f6e1f3ffd48701a27518c71ad7ac21b7f5a8d9f24 internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf +469c362f36f7ad24dec0da0c75b2ebc681f60b160cee303421388b8375fc2161 internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf +d7b31eac832bb0d9adac61b3d5c81071df31ce1ad710d0e5758564e377bb14ea internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf +be28be57166c9903fe701c99596aa3c7df9f8c834f3109e6e9b4668d72cc646f internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.IQ4_XS.gguf +497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2 internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf +adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf +d768d7983f8bb8e7804812679b0626a2fc8a87383461b0285ee5e23370143f2b internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-IQ4_XS.gguf +6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9 internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf +cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27 internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf +97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80 internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf +30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf +06f4f7fa1e43a8ef3a1bca3ccb3411392506e4ca5b090fb15d1dbf4f4e1cd84a internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.mmproj-f16.gguf +7df3cc4aea067c496f012ab019e6cd68d023260d09edda1a874d849407ddd5e8 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/README.md +03b7838aaaf18a925facbcecf4d55a4f1569c313ae15a0718290a6284557e2db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/IQ4_NL-gguf-metadata.json +0133d2ae30d2d53e50cc30b41b734a150f022dbafb92b9fe5f6fd16ca0b1ed9e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/IQ4_XS-gguf-metadata.json +0c3d4df0d16b728146c7d56f2cb45558ec6542affb7853f0e9647289976c62c7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_0-gguf-metadata.json +a50b96ef2eca372eb668d866ad87d6ea6323eaefc6e411c82d7734c921a4d850 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_1-gguf-metadata.json +41b1f719042e2e027e22db41709708c1afb3b0839a306ae9f97913895cceda9f kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_K_M-gguf-metadata.json +fc6221a6305e49fdfd448efab5f719fede66846ae55363ea661cfb367985c3c1 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_K_S-gguf-metadata.json +24506cee5d9fb04f5b9601eab6fa0deb81497f18a9a600f3ef115ae7481b9409 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/SHA256SUMS +0a2f1d4ef6d0f1560c2346c2f03a491c8d5860f83165dae901ea285172beee17 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/bf16-structural-validation.json +a5387611ba8fbb7cae8583c5033a783276f13dc46b5039eee7fb38de6abf30c0 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/convert.py +6cc733d1d78ee81e43db3ad6048bb8ca20362577076cc811334e2dee1b6d9fb3 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/converter-help.txt +84a30db1c77a9c7c25f07dc350943e6ea6609ed92911dad149e2a36088053039 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/download.log +402972df91139cccce5c4e78d58c71f2fc280c247c15c8a21e51a36e8d77e7a2 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/environment-install.log +430991a44703de334edfcd291a50fbff9f560c5da97033a37a422e0f2462a080 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/finalize.py +7ddcbb5f0983ce3e83b6c9bb77d29c70863092c487f8433491fbfdeabbe24ed7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/hash_outputs.py +d507e19b297b81b9dcbd035ead7747e6d41a8612d35dd61a252c3075462ee932 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/independent-review.json +0a344bd4d189120753d40805fafc4f3977cfe43f5f99a4421a176a07fcd503e7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/independent_review.py +d0b80fd9af9fe9f24b825aaf2adc040f23b5f520339191fcd19372358f3e7468 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/manifest.json +19bbdeced9a9cda3c3ac719b2245778bb5a723f56863b9c4f073b35a434c897a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/manual-answer-review.json +86b0f251385c87edd983690acebb5311d9f7d934d91f80dfc0aab8912d13d0ac kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-conversion.log +62e0f8c914512923d2328b20cd173125a3d688417436ca4b4babc706ebd4717e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-gguf-metadata.json +ea3e770cc512da8b04940d6787e99c64efce5b0eedc6b74fb5f4a795ceedafd7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-launch.log +ea3e770cc512da8b04940d6787e99c64efce5b0eedc6b74fb5f4a795ceedafd7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-status.json +0715622d1b8d24b833d31e4af2c0de704365d877922fbe99a72e0883c3df9e1d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/output-checksums.json +03b3a45a5d39b0c9b466343b538350f110317117a2f97412de0594a05574e54d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/output-checksums.log +bbeb84c5b9e416c248c102dfeaaaf4aea99cf3d774cb08e73c2650a2b28af03d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantization-summary.json +fa467bb97c03b75982343d0c54bc180dd2ce96997cb0bbf606cc3a92b27b7a8e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_NL.json +54437ca05eb10f0c5c75c31efb69ef2165295bcf873657ad32c2f6c32dd67415 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_NL.log +8c2dd36a9aed7361eab919393212d5ed0ed1ad03dd06ca886742f2e8d052cce5 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_XS.json +16cbb78feacfd244be26d80d8ddb2b2a5f6317e3ce1ed2f96d0e2f870b00be7e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_XS.log +01f26b719e635cc4d07bb727ff5260bc012249bea56e7c76e729fb4e0da998fe kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_0.json +4289bee35b743ee4b1b1132914baf4ec65cd3e56ce4767c9c83f20a86d669615 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_0.log +c39ca9d15f9ae9f4db2c940f90d9ec7aab51bf2129ce6bac72c4f0ebfe2d4e78 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_1.json +06de5a296c1d5578ec20b783bc73f83713c1d1333a89b2bf031189dcbc57a142 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_1.log +849d625003784e62b3cd840d10325ba37b611dfbd2f7dac00bef9ee66b881662 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_M.json +8f214e491d4fff21b7340b42259a13cea3e1dc101b002dcb4e73d124ad5bd917 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_M.log +8a9d2e5299a9590218f65434653be46ba926981259e237dfef63eb2906e8fc0d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_S.json +9868bb3d3c8757c774048e1ffd76191be00dc780933cc42e1b01b634f9dce1ef kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_S.log +66c39b8bada2ffd705f70fdfc9b09deaca32d8ff9e071d81be4e19bf7e4902c7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-all.log +1ba23d0fb43512ca1396280a8fd271bdc734888855dcc745fef13919001a83dc kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-build.log +1ca2a80f507910d60625ebb25a918eb517cb20ca581ab9507f7ea09f37a96fac kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize_all.py +a52a07f17ace264c4b932fa396fae80ecb0d2849faf3ea65d94c8a16ab9986b0 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/requirements.lock.txt +2ea3dbd7c83e77a5dd827c94e58cc01fc75c8339c43626f4ef3966aa0bfb7f81 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/run_smoke.py +4cb51193a96f44cb1c4dfbb40e17a4eb1891ad8fcd7e4d1fdb9fd3f4760d0b1d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL-launch.log +4cb51193a96f44cb1c4dfbb40e17a4eb1891ad8fcd7e4d1fdb9fd3f4760d0b1d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL-status.json +5b8428db0a3a50373e331706a38cee5b1668963325084adbd92cc2be9e9c3ce2 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/events.jsonl +618f2ad33a69305d60fe2b62efed62c869d18cfd98bb1bd56ef9baa86f09d657 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/generations.jsonl +09994322e103f2f5e42fc7437d4bb7ef0247541b6bb637657b77d9742c04281a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/metadata.json +5d91e2fb0fa073e35874d78f66316e8780ec6aadead22663601070c706402374 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS-launch.log +5d91e2fb0fa073e35874d78f66316e8780ec6aadead22663601070c706402374 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS-status.json +57b02e1985f4cbfb8f5cf53f42fddd26b2c05c06e12797d2cd4ec0615a36046c kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/events.jsonl +ed5d7429d1d96a03a37a8b5f147aaa758000410c2b23316631378c6e24633c18 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/generations.jsonl +0ca30f160b1016c3e420af1d6442ff632ef4106e5b8af2a08e44cf5f6be005ad kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/metadata.json +a34cbf7863de4f68ba8dfb1526e362217939645205bc24b89132e9ba1a2d272a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0-launch.log +a34cbf7863de4f68ba8dfb1526e362217939645205bc24b89132e9ba1a2d272a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0-status.json +ccc8ccf7de92bf40727a101f8db236dd048440d251ea32904d23555aaa53f5ba kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/events.jsonl +e776ce4447912f4a24d38c508c9d23857ba86d3363b1bf7754e33b747df33c38 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/generations.jsonl +df16019b9dbe81ccc58f52e8e33212cdf188b3a7774aee8e60ac1df3f16658bf kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/metadata.json +452aa440c36b981157a7c7f0f965e2fab429cf62994aef4a4facc5264b0ff641 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1-launch.log +452aa440c36b981157a7c7f0f965e2fab429cf62994aef4a4facc5264b0ff641 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1-status.json +f3ec1f2ad96bb5a986bdeb1291ce01cff4fa23f0b045be3572fdb871f21a2385 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/events.jsonl +b191db11ab0a472ed3c28b534120d9cc6d600f5a7f62c5a6a26817f83dabfd83 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/generations.jsonl +03c0388e81d0d2732b800c794bbb2d93bbb74b31341f7a4834e3f4e8dc7f5e3e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/metadata.json +3ab5721761df874ebefb36d4ff009f8322670861483ce2325a455c79acc93fcb kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M-launch.log +3ab5721761df874ebefb36d4ff009f8322670861483ce2325a455c79acc93fcb kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M-status.json +1320cadc9b97567c5d8c0263157c499cabe3e6287e24ad52489422ca01443f23 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/events.jsonl +0e1e2fcad8562975a088c737a277d303d3997662ef8896ca193c6e958d1d48e8 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/generations.jsonl +1b804e56f9c97af09b5d7cb506700056912791114c4fdff179317e96ee9c8204 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/metadata.json +3a54e50628f77f1a8f553a115461904be33d3cbcae707ca13744b20ce8926057 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S-launch.log +3a54e50628f77f1a8f553a115461904be33d3cbcae707ca13744b20ce8926057 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S-status.json +eefda7cd128eba25b87072440d1ee6f505efd140ba3895a6f1b0056c16aba546 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/events.jsonl +77c9e1e2b3664bff2c463309aedba57bff08c35bcaabe91c9db3ab92929236de kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/generations.jsonl +fb5c40b7727d85a850ec4e56f796e5ca235586e3e85e0e518576155133a06877 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/metadata.json +a13a019caf4e22863464ff962fe4614ab2f9aca153e53e7fcd10f68de73b5f11 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16-launch.log +a13a019caf4e22863464ff962fe4614ab2f9aca153e53e7fcd10f68de73b5f11 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16-status.json +0d20d4887178ff0e90d47911cd591601e74668841fc3f2cc351947d41de349cf kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/events.jsonl +09a4655e77511e2f19cadc4b25bb2c52c67e547be28fd6871802069654ee5be9 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/generations.jsonl +f80ca18420103598765cbc2da4c096f6f1eca62456eeeefabbf50e66a4c40d10 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/metadata.json +9cbd771461ca413a0271d77d8595bfb2df9e764136279352a6901990016eceec kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/inputs/blue.png +06196589d548330cd7dd06a644a1502e0bf21590f4031a14e4caffad5a152189 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/inputs/red.png +4e71c9809735a0ae13d3114c0fe3c56db34a8ca9aa78cc389de41c25d41e53fe kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/quantized-launch.log +73e18201baeebd547d87161a9445f7737529e42d7a3e7030c75ff76dfca2d246 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/quantized-summary.json +f53eac1e2a83cc0efc20c6fe94febeffba3d479b50f8aaeef4037aec815d7f1d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/requests.jsonl +cea924500c0721b6eafc6f2935b55f26a86d3255443fd633b9e255d6bee90422 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke_quantized.py +aa18595a55b5c1db2aafc5bcdb3b87111b3db5e94383f323c5a36fb2f370d15b kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-tensor-summary.json +953c0884b5988a16370a8464acbe7ce43553c2bff2b324b6192c839dd404598b kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-verification.json +23bdab2500c452c166158c15091f124b07bc2d9339da865ab4b10cdc5c4c1223 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-verification.log +7b93144429130e36e915c33a8f00a3e53c5200fb9070ca49c4b9d9a813d15c7a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source.json +0c0807344c32ab1ec080e0960129d70bd8731dc348ae39482b002791f473dac2 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-conversion.log +6afe9cab2faf00ad9a68374facf9baf4bde178c6098809c9b7816ff01054c118 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-gguf-metadata.json +1c7e67e1d8abc6e6d0a62d31dc32f57ceb3725bda7374ae9205b79b0b3ecddbf kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-launch.log +1c7e67e1d8abc6e6d0a62d31dc32f57ceb3725bda7374ae9205b79b0b3ecddbf kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-status.json +3c900930fe9badb5874b5a2da2cac5e24ceaa6cb665fb9b706dfb6ac06730e77 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/verify_source.py +c58cb09727b7fea047dc29f253c6aa3632fc93b538d055cb8db9831db024d73f kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/.gitattributes +7fa4d4e39537a43a7d6cc6f62873eb014b2f8bc3da2142111ba2ad29d4984794 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/README.md +172c7450a66b9b3644538888ffa24d02047e535e9d1f911564460203fbf7e8e8 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/chat_template.jinja +af3810295de6b08232776b74110ed482fa0183f4aeaec586ff4f7593910951cb kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/config.json +d30462b89993b9fef138db983d3884bbc39750effadf2efe67f404d28ee40e5b kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/configuration_kimi_vl.py +da26dd1916774784790db2b83336bad62d0917356743478ba6eb0c425c53eac5 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/generation_config.json +bb58551e088f3bb0027b1886ca5ff42776c485acec1a9aafe91553ff76926870 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/image_processing_kimi_vl.py +a5ef3ebd9727f82e34417a778317d2cc9c08762fe0bc4a2ee333b8a52cf7c1a5 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00001-of-00007.safetensors +45ecd00decdad65e7d3f494028ed0c79d0cd56f145adae077ffa78b5b8ff95c0 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00002-of-00007.safetensors +b9ba98f01e22eea43da8cfbf6f09ff0857616cd9e1df4603a735c111755109ef kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00003-of-00007.safetensors +8f7eb3fc5c12481fd1a81d2708fa4a299ff4c207a5dbafb5b8bef25ab9fd8b23 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00004-of-00007.safetensors +db83e896b3d75f4bc51f621ae90ad61e8f6f7901f49a06b5c40348b839057206 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00005-of-00007.safetensors +abed41982a3f9c7d05f69bb560dad7bcb93cfa764c77a2b59127f35dc787983c kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00006-of-00007.safetensors +2e2ddd33f2b4f472898482860585bd6d73d4397c8c833ed9d00a2024443f7a77 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00007-of-00007.safetensors +178ba3a15cb12f6ceac42aecfe665a8f041d47e948220d75b073088957efedd8 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model.safetensors.index.json +74e8f18afa5bf8f580ef5be5f15b51506f1e4f604df5a84f508a7796b8947c0b kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/modeling_kimi_vl.py +d968a7d7f83f82c3b0e1061079dcdbefd6f2c75b7ee4240cce995afaeae1f622 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/preprocessor_config.json +f8e64816baed0a92d85d0a987b587028ad55a0779f3ace8c5b68db705dc61561 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/processing_kimi_vl.py +b6c497a7469b33ced9c38afb1ad6e47f03f5e5dc05f15930799210ec050c5103 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tiktoken.model +0ae85e29c37689fefe41b8bfdb7aebd9a0152defedbf37fae0f8413000512029 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tokenization_moonshot.py +d7861718cab22c7962e14b4693b4009dd526115cd392dc779069a8173be95703 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tokenizer_config.json +294596d8c89ec237e50341a73d8122b1527db4e6eb0ed0243f86785fc772bfcd kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_NL.gguf +6e5bdf00c77ef6f4c0a871cbf2f997cb11806b7423b50decd5e4ed3989f3b973 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_XS.gguf +e3ffa932cd1318ce1231d97d832f92b90093900b2185d50d54e39c8d9d421080 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_0.gguf +0050110bc63babd859a849d160818e5ce46518c9dd92e38e50d072ee71a353ca kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_1.gguf +43a34db4974f67ad13ff3e1f8347ef1b25dbc15b077146d1c74627e3294ec49d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_M.gguf +bb2f63e9b13a0d561e19890a6c5611cd8b27c0a406b596ebd33fab9cf88187f1 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_S.gguf +6a7457a032488a1ac96b3b42cd69ad48406222d7abcd1af6042c13f5e3f33005 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-bf16.gguf +7b21d8dd54ebbd6a873a0a625bb0a1a7e002b975d43ba542681f5cca7d834ba3 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/mmproj-Kimi-VL-A3B-Instruct-bf16.gguf +c59481e1bdb3a284198ca16e523fefa1ce8a24b7dad8ad2275dccfd58807ee39 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.IQ4_XS.gguf +74e9aa21a6a6e90d6ff56b7ec311f830a0b6cf88ff7dababacc8f34c867bde1e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_M.gguf +3363ac782c25fe60d0d27061285d9eddfff1af087650756cfde183296343f22f kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_S.gguf +d1364554ff094ee66dfd2fb3787cc87cf3ebc5c944eb965f354e3c6eaf60aed2 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_NL.gguf +5d6aad466030edeb73f44b4a32c0c98d081d0e03a300366d6b63fbf469bff073 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_XS.gguf +0ea3afdd920792fd4583d8c84a979e4e0af52a2e7456ae6bb75731da999b3b1e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_0.gguf +81aaa3efc0a129abeae7149b8195d09ce5467b4436c1c412fd5cd89161d04f40 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_1.gguf +7710f9aa5bf56a38a03f26738cdbf10563a72938a41025307b57768dad40f306 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_K_M.gguf +794ffead89866df5b3c698c74ca16bd7d31b48575123edee24f476c9a15c4ad5 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.mmproj-f16.gguf +ce788856c8f0224d3e4b00e81836f8d859c7918ccac3920c96c2c3eeabd7bbca kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/README.md +e487a0d4544c3fb05b6f3665a9acab0ac02ceb098c10a4363b2505e2533fe187 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/IQ4_NL-gguf-metadata.json +f9379cbaa918d9cedd95d23fc35b236fd6514c7a95c7a99498dbe157654ffd1c kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/IQ4_XS-gguf-metadata.json +8d9f7d8f9cac6d487f32f1b32a487d4f2731337aa3c432a818062de95a6ff65f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_0-gguf-metadata.json +b558901e4e47bff1486c56d7a79b991849b13b29ed9890e1c996063707485c63 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_1-gguf-metadata.json +db935d2d82fe616f011a39bed75808827d992570b6c89a473f79001396f37e5d kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_K_M-gguf-metadata.json +03c46e6afd5e50ff9072ff487cafda2e1cd79983ca430e2ca58174103a0c7ef3 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_K_S-gguf-metadata.json +7bdbaae627cf7208b14a4b8b7c46101195340a31e4269bf1a15c35e62cd9edee kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/SHA256SUMS +2645320f3c591cc5255c5b39a73bb0ead833f7ef20fb47a2d9aa5c2fc6587cd2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/all-converted-output-checksums.json +7e40e10a8a262f49b1119297599244dd17774291d3d62a5fbe4a0ca41d322811 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-smoke-independent-review.json +b89250de61b1a47f4fb7cf7f55ab89d7435f2253ceb2485c097d91dc4e5b959c kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-structural-validation.json +5ba5b31852b5066130efda64a9ca54e199ae9817a3f2def703655c00e6e45338 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-temp08-review.json +60d86bda5476b0bfcaecf75527969091cdc74d018e63cebb7f16dba9cfe7ed6e kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert-mmproj-launch.log +03c66430b6be73f91b1aadae21f2b42a5a80ffa2fc56cc65a58d7f569140e0d8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert-text-launch.log +673b91c96b0b78ac9aea7d10b009b9603ea08d069be176a1ac1de29f5cae3647 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert.py +2ba993d87a8656d882f49daa2bb2fb1f4e09085810a836b54f2fb4adb0ea2467 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/download-command.json +1d6959baa01df79aac4cf31df3f02b8a7bb4c5650d6a7f9c48adb31fbab795dd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/download.log +0c7dd6510b64cd2310c18f1b3abf6eda80cd7ebd044240ce6087f0d3d5ee3e8e kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/finalize.py +eee9e5bcdf58ae2b285c59902d4f61788248fc9d6692fa9e740595eb7e71ee7a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/hash_outputs.py +c0b1490ad85772421e1b0e4ca05f2046fdab771841ec85d61bc8ad7cc2265545 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/independent-review.json +36929d630b6448503f5fc9135f8eab52ebb67dfa3ba379952a182eefe7224b2a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/independent_review.py +1ea5b24c2e02ab0facd7035538518600728597edece898632100de6a110227e2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/manifest.json +03a571e01631ab9384d49512e5ec2f6ba40f83ca7f5d8715d14d6e5b598eebd4 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/manual-answer-review.json +ec0ee65549d988fdb22505b9baba8905350cf4d1dd768fb3510ac83c8ba76d47 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-conversion.log +187e63eed34cbdcb825188321777f385559ba39a4853fdf04b892d3213fd9b75 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-gguf-metadata.json +60d86bda5476b0bfcaecf75527969091cdc74d018e63cebb7f16dba9cfe7ed6e kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-status.json +c4b045f3fb30d5ffa047255fe5cb030fb6f0f4e5147c3012c577950c1b321d42 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/output-checksums.json +34501423e961dff5e96ed2f352a96a01bb3f85237910b60d2ef5d2b72304c975 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/output-checksums.log +41ee38db7fe5b2177bd67256153e778094ab6659398207d3b06aabb396caf100 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/prepare-status.json +5a2684dd31d1c5bdbbc564703e4579ca39d14c1de6e4ba30d2854742eae33214 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/prepare_bf16.py +8e1f2b8e6ee0b6b163192926066d10208c570763cdb3a52c14ff60087fd65529 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantization-summary.json +8b1cb85ffb1d590b3b06ffa0791831215833d328bedb8a52c4fc3274594ad798 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_NL.json +f5075e55e59246e60e84a8b557258960de2c661074524f7391e9ba4724c9d5e0 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_NL.log +297854fd42d4ba7291bec7e13bc9442be53d01128e5f5493d10fc54b4a1a0115 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_XS.json +6104f3a049af319ebde2ace188c43556c7ef5b0771863c2fe4e89c05fc41c7f9 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_XS.log +f54ebc96645a0282b0e1e960ebbfe347115ff0406764112716c22834cc02a661 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_0.json +307b032e7a49691d6768b7bac5065e8d888fc8f97ca308246fbcbdc2dd53c734 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_0.log +ffbe73a98ede18090c142c1fd9ab77b47d7beba1fa44636369d1b539b33cffb8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_1.json +6570f92cde8773c4154f6103c049fb1d4d6236edfb4282e5c4ad6da376b692cd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_1.log +5c4b5e3be935ec045b0e9efe231292b522e308218bd057fce7cc40a4c46cbf13 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_M.json +c0d36715c6c4e2257f0aa73ddae4b19bba94dedb739b381741fd215d824ed9b5 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_M.log +ad3923c9c6e9b6094c9b5617b9167cb9c0c2281f419b4cda95bf34f2467ab1df kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_S.json +b0b468ea42239e99a3fda373d8ff23d6658266b575ac05f2e1519c1749edb005 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_S.log +7b820a3869efe92900a0ac4c4b43ca6f152b372cc500eb73b1048d5261cab841 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-all.log +180222a9664dd2dbc226dd1a9902acc483bbdcc24168d9db201aceeaca8f0894 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize_all.py +6e99230bdf3d965e045251fb8645efae89d1662a0835037f9c0c6786dfb5cabe kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/rejected-models-review.json +c84863a324d73a38045954d0f70a9458c820b928e6834adcbcb17abbc1a572fd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/rejected-models.json +a52a07f17ace264c4b932fa396fae80ecb0d2849faf3ea65d94c8a16ab9986b0 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/requirements.lock.txt +3ca593a4d0def61c9f9db5ca4f7026f1420f88a965dce7a21aa6bccf49165e58 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/retain_passed_models.py +7604505a30606645b3e5b2c73ddcfb24ccc702ea810740be06b35998f4f1d73a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/run_smoke.py +c8949c6ccd2436bf3709fffa4ab17b7607603505f4f5e7894b4f6a2e32c1707f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL-launch.log +c8949c6ccd2436bf3709fffa4ab17b7607603505f4f5e7894b4f6a2e32c1707f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL-status.json +cbd829d93a3b7f06aab097ae80f2973efd31544dc802d9cd6f02e85fcc5c1441 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/events.jsonl +a1b5b920fffcdb6cd007adbb29d18bd4d6da03dfc433de6fe65f77606ef3206d kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/generations.jsonl +7552abe068decc358d46ffebf484b1ad6b74d65d3f16ca6cdd7379af62294bad kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/metadata.json +342193699b52a16abff1a2f95a93cd56bf3ce214b265b16c162aaae8ae13e841 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS-launch.log +342193699b52a16abff1a2f95a93cd56bf3ce214b265b16c162aaae8ae13e841 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS-status.json +84d646a3ce8b586312abce2e4e7b82442c0867b7b71ce2ce7eb4031c8c2c3114 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/events.jsonl +6f37eca888a01c6e1a40870aed3502b229c48f15d848f72dba7004e639372025 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/generations.jsonl +76dce01ca2bbb06c698c1ae4800a582591f33177dc4fd0bc894e732b7d576b57 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/metadata.json +065da35af654520cca46c670a504b916cbb286988c6b5ccb9ec39f6f91fbfd17 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0-launch.log +065da35af654520cca46c670a504b916cbb286988c6b5ccb9ec39f6f91fbfd17 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0-status.json +e6027a2dcfc3b117779f9c25f264633b9f6ae1bfedecfde1ef0eab06500dd3cd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/events.jsonl +f4f6615465697e8c867a39b1e44e593e62dbc3d94fad6263d3c49fff4290ca66 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/generations.jsonl +0026a55a8c0f9ab40f57894163d7605fbc1ca3adc0e1e5369e9c4be7fa5cbe99 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/metadata.json +68b321f24e469b735788c699c4341321bc379074af131df0047fb800a3d0f869 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1-launch.log +68b321f24e469b735788c699c4341321bc379074af131df0047fb800a3d0f869 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1-status.json +2d2d7b8bb8cb4f6175fdad07dddeac6feaff1dbb593d1d26d9b78980165d5fd7 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/events.jsonl +b09d332279a74bbe6a06d4fa1adaa519a3f90febf03a118b5f4ab31d24656d18 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/generations.jsonl +1de3cfd752d1d39272ae6743e1a45783f0a710265e49af3006b79969222a405e kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/metadata.json +4ee5cd758f2f94dfad8613d71da2e4498ce3f05c8c2d642a4fb3715ee0c810d2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M-launch.log +4ee5cd758f2f94dfad8613d71da2e4498ce3f05c8c2d642a4fb3715ee0c810d2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M-status.json +7ec27b7bb0019df505b0a034e37363fd385ab0445889c3a65b720ff094699756 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/events.jsonl +fd117d46693e2909211d65880f38a3b811a6d822c724030dd53a3fa8caaf9087 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/generations.jsonl +0d71355d48e23724c7c3171536a51ea534829785374b175c163c0b15f1535363 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/metadata.json +129a92d94be9958fb6fc40104299895f78171c60252c9578ce83dfe80dc20493 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S-launch.log +129a92d94be9958fb6fc40104299895f78171c60252c9578ce83dfe80dc20493 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S-status.json +f84c50ae83e355d0507b97e5497b77b80c54d84157975a7107c1700f81d838ea kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/events.jsonl +603cd3059e7fbbb63a4861256cc3995a87576fca04a243015052192b3a9135d4 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/generations.jsonl +402d3606ef939947e4b7c7ef89091b6ea438c519357fbfe0b197c21d318fb69f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/metadata.json +35c6b21a16f3f665f2662a33c415adfe255cb1636f0736fc14bacfc663d8611d kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy-launch.log +35c6b21a16f3f665f2662a33c415adfe255cb1636f0736fc14bacfc663d8611d kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy-status.json +5697d7fe5db1a94bbe59ebe3eb3dca474a80146e873f305f3b457cb6d5ed05f5 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/events.jsonl +207f688b2d68a53daa53b28263b465d827b398ad535a17ec6c3a4eaf61f47f32 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/generations.jsonl +51608aca8533d1b2c40468343a9b05f29f01f5421f6587ce3ce53a3cdd2a12af kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/metadata.json +a396b2b76dd9d9578c069626924c60e8056103bfd345dd48ca2211b424a686d8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-launch.log +4ea9d03b5774f381a629308b6a5e719d24585e53d37fa509ea61b9d6b0cac547 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-status.json +a396b2b76dd9d9578c069626924c60e8056103bfd345dd48ca2211b424a686d8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-temp08-status.json +f61952e280bbe12b1237b26f318fc7a3c2ad2fbf05dcfaedd82f6a24754230aa kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16.log +d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/events.jsonl +7f967db40e35aa3d5303ee6b4e93abd14e6e88540c2d4e688385ae2856d981fd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/generations.jsonl +952732c12dbdd392fe70087a6ded83c23274d6f409164c75a264558642019042 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/metadata.json +9cbd771461ca413a0271d77d8595bfb2df9e764136279352a6901990016eceec kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/inputs/blue.png +06196589d548330cd7dd06a644a1502e0bf21590f4031a14e4caffad5a152189 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/inputs/red.png +5655b3abb947ef5a35dc1fd0d90cbe3280edb4c10ce8c51a636ee27f41b13deb kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/quantized-launch.log +fd4a837edccb3e3873af8060249c6931579d9326aefb5b0870120b46698940ff kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/quantized-summary.json +68d4d8d6b0bda9837b6727089bfcec7aa29603e67ea6df9756ef0154eac4468a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/requests.jsonl +e91983dd10fc46da904aa71a51e7c5e15ad098e7ae78a297b74d51b85ea5f810 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke_quantized.py +fe1a865235c50a2a5f3cde80fdc6a10417ac3ca85e1193077ea62d4e5dceb4e1 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source-tensor-summary.json +21b831d70cd0e69ba62c5d9e0faf46e762eb5c244bc471411ca41a41453fbe38 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source-verification.json +2d5860af87de9fec555d3da986a6bf73968ac0d275d86ec2028e4abecf556546 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source.json +aec8c260be2cc2fdcecc9999b68471c254aa0f22fb76e1abbd6902577b95f0b6 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-conversion.log +b3aa4a4e7f2e86c75c2e566bb343cedd904fecb7e2eb5a083b396da450d31b46 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-gguf-metadata.json +03c66430b6be73f91b1aadae21f2b42a5a80ffa2fc56cc65a58d7f569140e0d8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-status.json +13338e4ef72eacb7705a439730efaa7e8c80b2951487d69a1d01211b5e89c77f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify-bf16-launch.log +ef885264b3d71f4ba2dc0126f6a9f851ef5c05c58a8d7ff0e32ccfd762bae4c6 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify-source-launch.log +981845bf5a7765e88109f5b64f1efbc684dc4f5fbbddd44a1477a4fd14515a9a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify_bf16.py +3c900930fe9badb5874b5a2da2cac5e24ceaa6cb665fb9b706dfb6ac06730e77 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify_source.py +12db7934bb09e5bfa3026498ff609bf6bb8c03894487c6ed7f680224f1e3a219 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/.gitattributes +840d2b966176f9e1742bd3143dcf8cde33e444734f799e1502cba9d0c85643bf kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/README.md +172c7450a66b9b3644538888ffa24d02047e535e9d1f911564460203fbf7e8e8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/chat_template.jinja +af3810295de6b08232776b74110ed482fa0183f4aeaec586ff4f7593910951cb kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/config.json +d30462b89993b9fef138db983d3884bbc39750effadf2efe67f404d28ee40e5b kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/configuration_kimi_vl.py +35ad1985a08535077a2c1dbe678ff7c41d84f3e671864a310403a2967c663d85 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/generation_config.json +bb58551e088f3bb0027b1886ca5ff42776c485acec1a9aafe91553ff76926870 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/image_processing_kimi_vl.py +ad54ac1d25ae137fb4e89fcf39361c7e42f0951fff840a4d0caf06a23b0cb76f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00001-of-00007.safetensors +40a15784c7369dea09c3d82c27e57854f14ebd0866ec68c8fa472082e8fcf597 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00002-of-00007.safetensors +b99f6b16bac0a911051719b61eb39c5ada045c1f24e5a56bb435e8d08a603eb7 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00003-of-00007.safetensors +3adb7ef982fde34b13216e9f615a8f697e9d354c53b8727ac2bc775f2971f745 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00004-of-00007.safetensors +a8fc6e1c9fbc43e4ef6f065a87d0f636524ff8374555e8f9e2cef756ac456677 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00005-of-00007.safetensors +80c5bb5a0a5017cf3baa95ada6723151df9d94a7d01024bd4b8510be2d6c6084 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00006-of-00007.safetensors +76e788219ca8b1716490932db3c3bf16b57f0a64d4af499b2237af3366049a79 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00007-of-00007.safetensors +178ba3a15cb12f6ceac42aecfe665a8f041d47e948220d75b073088957efedd8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model.safetensors.index.json +a3a7caeecdeec75bc56e6c857c16fb049c5d107957ae97765d75fd8038cf9c43 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/modeling_kimi_vl.py +48c72c768c5dfeb731c7a9ec1a144cdc0ec058b18d808767c29ba0d502934377 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/preprocessor_config.json +594aa42c97e0bc8ab8d10fa514764246fa0bd74921c51a1f9bb8ea9755d21df7 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/processing_kimi_vl.py +b6c497a7469b33ced9c38afb1ad6e47f03f5e5dc05f15930799210ec050c5103 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tiktoken.model +0ae85e29c37689fefe41b8bfdb7aebd9a0152defedbf37fae0f8413000512029 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tokenization_moonshot.py +d7861718cab22c7962e14b4693b4009dd526115cd392dc779069a8173be95703 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tokenizer_config.json +9083e9ac29082a023d4f3ebd9610d89962fa205eb5da7034777b0bdf5ae0e348 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_0.gguf +780924706c8a9df254c30b33e6384de8b01db2d81a6332f0c7f8b0c44162db76 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_1.gguf +33b0598c3700e15456e4789608cd7396445201a881d97e14df17b48beda29492 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_M.gguf +a709f9add5d63f4dfd5f9dbc418a1a862331c2247363417c3a56549672bd7540 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_S.gguf +714bdf24880a7c71d4cd2a34121e39c2cbf31cbfcf1860b13e8f99ddcac0d8c8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-bf16.gguf +238c5eb49a350e381d946d35d289c781334a01a88b6c0c31d6bfeef8ef45daaf kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf +597373061abb3d5e125c6d8b976eedb1059bb2c4e91a5509d5cc8d8d66767ca2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_M.gguf +562745f30cd79c89dc247ad41ccdcd40e78e6d549493e9609ff5bf19aa0fa885 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_S.gguf +9d03ed1f97009ae541f2b29ced6b564dcd947ecf430689a395be6c91a3e0b660 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_NL.gguf +8dcfc5da55f85016482ac849615ca743a4e0085f8be5052726cd7dfed04e0678 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_XS.gguf +3b3bf0ced352c03af1380107323e65d26048b3fcfb442684c449229a93cd767c kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_0.gguf +61fa02dadce8e5caf65e4660db204b18024135ea8db88f35c8925eac82de73bc kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_1.gguf +8bfff5f8d6b391e3ed3c6d548760d6917cd3e17f246af8ada800b6d485d569bc kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_M.gguf +3d4efede5cbe05496dc71648a230529c03ab8ae7b68b5bd5006f4551e3b84785 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_S.gguf +50d5a7af02a92c68c797b0d5637f75492682beca325c48bf2a09961f422a651c kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.mmproj-f16.gguf +8ccfdf140472a18928bb867e05f69c215fb7eb6e9c16a212b0ffa76f2eb023e0 muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_NL.gguf +b3c03d94c007ae487fd5259b340ad23286190b62b0d4d452f06bc1cf8840a7da muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_XS.gguf +95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999 muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf +91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4 muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf +0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384 muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf +1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf +bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860 muse-glimmer-30b/bartowski/bf16/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf +e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16 muse-glimmer-30b/bartowski/bf16/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf +787e0708e439f0caa8e6caaafa5f0fec38e112766c150f313ac074e5cab087fc muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf +3727a47650ae65be12e91aae49f9b9f4bef09dc6c401a54ca1bd3d1a6160f35a muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf +820d18e00c59376331eba62dd716a6bcdcaa305c2316f5da3a2fab36c7c37e15 muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q3_K_XL.gguf +82bece304887a313ece08400bc030f6066c7bff5b906b0cd40308ec8a409fd38 muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q4_K_XL.gguf +27d9a805fa29b943cfb6ad4843367cd4eaaaf06bd452d8cc3e00a2cd18a677bc muse-glimmer-30b/unsloth/dflash-kquant.gguf +d08cdcfa0b41d8e20554b52df404ba4f7b440d0bc502a90038508b6407df8ee1 muse-glimmer-30b/unsloth/mmproj-Muse-Glimmer-30B-BF16.gguf +f007c3dbf67df668354d37ae13d87fd5789059704977959187e8342aec03b66f qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_NL.gguf +628124c61a806897d3f28dcd416be6daff94f62f731eb900d4381875eac9e412 qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_XS.gguf +3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf +3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf +13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983 qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf +3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf +714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5 qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf +463f39bd1c291c1186c319a8c90ff8640aafa678b14cbee2232d695113dfbb66 qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf +9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf +ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9 qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf +658a9e7e406deb06d0179755e3c14f6a82915a4be4962a2f92a64d948d2e572f qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_XS.gguf +298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf +af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf +00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4 qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf +27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77 qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf +b252c5610a42ca82d20fe2a12813e9d069eed89292907e26c783eeb0bc961bc7 qwen3.5-4b/unsloth/Qwen3.5-4B-UD-Q4_K_XL.gguf +302b92d565080b9cc0281186979ae75a7429ec23d14f6f7607a035539b21f3a6 qwen3.5-4b/unsloth/mmproj-BF16.gguf +dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf +c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9 qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf +41e9f836690bde9619928538cb4dd170472d2e851243637f7092937a151297ad qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_NL.gguf +afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf +52312daa5b2190c1f5723d33c3315c01c55af4206f6c6e6eb63f3d8dd52bb85e qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_0.gguf +8babe2c6f46b43815cae7ec2b970be8508d6867234ebf16c376bd9cc79477354 qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_1.gguf +49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf +b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772 qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf +20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf +1c625f05cd52e90abc76a5f756226c3a5fe279593379c22f6c6846c970a0cd18 qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf +ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61 qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf +a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf +707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450 qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf +356dfaa3111376a4f7165e32e8749713378d1700b37cf52e0c50d9f23322334d qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf diff --git a/backup_metadata/candidate-disposition.json b/backup_metadata/candidate-disposition.json new file mode 100644 index 0000000000000000000000000000000000000000..15870280c0bf573465903438dee904ad6f6a80a5 --- /dev/null +++ b/backup_metadata/candidate-disposition.json @@ -0,0 +1,6831 @@ +{ + "created_utc": "2026-09-07T01:55:35.237827+00:00", + "total_main_checkpoints_screened": 119, + "counts": { + "retained_sparse_screen_pass": 115, + "retained_with_distribution_drift": 1, + "removed_confirmed_current_CUDA_numerical_failure": 3 + }, + "candidate_records": [ + { + "candidate_id": "candidate-001", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 17155893600, + "sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.8709941985465819, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 4612.831190107988, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.9794560185793101, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3170.1851925820665, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "14868f3cb71e61e7d383b941c8d7cc5e9bf13575619013527eedbc84ae3e4903" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.7288807563078277, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 9013.253235895914, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d437ed493bbd1ab83d0795c092a933017d0943056a3a080e3d1e2f088ffb2918" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.9046458207526079, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3435.077015006144, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ee552e15f8c74a539673af115239d1eeed10720f7207f32aa224fcdac8ee79fc" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-002", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "IQ4_NL", + "bytes": 17287670720, + "sha256": "811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.8839090124849022, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 5181.839191286958, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.9540475432012663, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3233.500330007127, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2e042a095d31ec2c92f8353da202d5e1ab76908f92ba5020c8c4318a74b7c226" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.796145253049212, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 11057.46285143907, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "bc9767c3855575241310debabca88365d1eddef362c3b4062fbe166880913cae" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.901534241204228, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3891.5569949593655, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "07a9bc988fcf1d0908171724377a982e439030e137d8cd09f3b7800b087c13b1" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-003", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_XS.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "IQ4_XS", + "bytes": 16372460480, + "sha256": "e3d40b6e363954c993a6e28b160d881dfe5a243b62746bd4092b393d4f1d54e5", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.9677256053809701, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 4972.631015222648, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.1058016521502978, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3870.322818988431, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "89cc3917e419181fa4820e1267d7254ddc82286c6c36e4c1d283452015d5317f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.7895150696344453, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 8315.469211340336, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1eb6eace4ae708e1ad261aae9ee03e96fb91924a1bbbbdf2e4fd2bc387229ba7" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.0078600943581673, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3820.5400164530142, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2782a3a023b27621f167aa58caccbdaac56376f88557d4ad63e97e8421968956" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-004", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "UD-Q3_K_XL", + "bytes": 15380222912, + "sha256": "73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716", + "disposition": "retained_with_distribution_drift", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 3.5566490669986384, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 4950.663642119001, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 3.710583906597111, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 12799.591348594313, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "558fe41a3041adf1fd2027a2122a19acf2e0dc36697a94dfad8d0421fff81ab7" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 3.364230578607934, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 4804.093129000606, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "58fde496b8b53726e58c13db7735d6d31b5015b338ef8f682f51b1bbb0d1f7d4" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 3.5951327157908715, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 1973.2528538066429, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f76ca1dbfdf077f81245174fb5d70d1c8f50e6f509cc47085f7caa519c144fd0" + } + ] + }, + "notes": [ + "Substantial distribution drift reproduced on six fixed windows, but finite metrics, source SHA, and completed coherent arithmetic operation are valid. The lower-bit UD-Q3 uses 4.0041 tensor bits/parameter versus 4.4658 for the nominal Bartowski Q3 control. Retained as an operational candidate with larger quantization loss; no general quality or isolated CUDA-cause claim.", + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 2.892545025313801, + "PPL_reference": 12964.851857612222, + "PPL_candidate": 29628.27435877505, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 3.562193272679282, + "PPL_reference": 41368.00589307904, + "PPL_candidate": 123830.27655502838, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f4bf868d0470d63c5d285bbbf3b09ddf2461bdb2b98d6760966f75bf5a3387e6" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 2.2842431543015147, + "PPL_reference": 11468.295417470643, + "PPL_candidate": 31402.622747564466, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "61893a93d73b2b20f973ff2e9a2dc26e0271ec920c2733c80c32423805c97a27" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 2.8311986489606062, + "PPL_reference": 4593.452373266919, + "PPL_candidate": 6688.462677856313, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "112bf7238aa8e2a31e5e93a7a11900843a90fe82200d3c7e26474b1022699dbc" + } + ] + }, + "additional_windows_vocabulary_policy": "allow-vocab-attr-mismatch" + }, + { + "candidate_id": "candidate-005", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 18822970304, + "sha256": "9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.57175019649433, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 5737.559393366973, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.6673691962663566, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 4020.3627168160206, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b26b254dfedcd281802d722a5d297f295fbf7d2b6e7359adcc7b517681472db7" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.5179413344548801, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 10741.009582532744, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ed80230c37971e39a2774b90cdaa0a2ee4f3c630d8ecf89d233ab74985acbf94" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.5299400587617531, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 4373.924093015307, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e8c8a7f92cf0861dffeec916ee496164142db5f817569c5537c4e2948c29696a" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-006", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_NL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 5232226784, + "sha256": "b56f70624694ca5f2362cdafe6acffe35c5e0f44693c568f3f09fa83b968fb74", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10219618652687955, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 48.45867786299725, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.10231915311877456, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 30.565795480984484, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "077cde1ebe932fd52016be49a8353575ace504e9791c661789f401399f7f2dd3" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.1031304390361306, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 86.73973201336828, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f408841129ea1e8f54af0c9dc181bac948c9330d9228681728faf2a4810dcc04" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1011389674257335, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 42.920117610717256, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0a53d416a017e507727a3081c039fd2a65e84ee1cef4552d060b492a33d4ebcb" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-007", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_XS.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 5112828384, + "sha256": "a24429604e6f680e7bdf087b863a6cecc90f80b3d908f95d888f4f05003fdee3", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10246010047470523, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 48.14783114618879, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.09755343352319916, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 29.912741558348113, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c27a6bae81b1f34bb280c2f84cc8959b2df6fa46f2d2e5a00de8683d9ec81614" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.11415407854789236, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 89.43810715431859, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "73ffba544f324dbeeb6451fa6bdd48b78e22006fdc9adbd2ea1315046b81471c" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09567278935302417, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 41.720679035907274, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1a6f37068b2e7e94eb4c89fc89b026b5278b96d3d28f502b4cbe2ceb841e359d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-008", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "IQ4_NL", + "bytes": 4835839104, + "sha256": "fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.0992462983045245, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 47.55837056144447, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.08173399371927537, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 29.515076549800362, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "38d1c43402b95b1b2920d04f620696337edd0b1a5bec01267b66deb1e3215388" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.10839668714078088, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 83.69393989535517, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2737cc820d9460c20b9391722954bd17eb2fc72985cf2749a0bb0ba42e0f724a" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.10760821405351724, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 43.54546902634053, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6e28fa91aa5a0120abbf3c3f01949807de5567b6ab493d5e19922d393b3bcc1f" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-009", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_XS.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "IQ4_XS", + "bytes": 4715416704, + "sha256": "0847f7300471e9a61abaeb46b45b3d61e393af8fa6d6aa70c563623773670dd9", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10254910436629212, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 47.01307956009178, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.08271484012158643, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 29.03780994712443, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b4ad49d770db610ebb999621b82a47417ddb2b04b04fb48d343834bec63c5819" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.11365997813516104, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 84.81749396066122, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b53fc9d024663841e69bd044b079eaff2b1d7473526b6640b1e8f073fafe84bc" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.11127249484212888, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 42.18973581085117, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cd3c7f1fab5e1b50531f85fe437ec4a5dd4b432ca7ab5540cb189a2ee8b5fb96" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-010", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q3_K_XL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "UD-Q3_K_XL", + "bytes": 4588440704, + "sha256": "7558880ee42b79ab732481bd7250e85c41d9ef044b22634b8a912eb184224009", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.576536169259216, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 141.58918199909223, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.497150870386366, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 119.74079362211874, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e838468669ec9d2e76b1f6819060c0f4519ca0c249542324beced8ca3afc33e9" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 1.5423446660580606, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 207.5218225859721, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e1645afb27bbd4c4be85cc29cc626ebe4ee68060987a74a06237ed2d83b4f1cf" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.6901129713332208, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 114.23108790426484, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2cbd8b7655143d3ec79b44d8a2a9e239f2ff681e18cc4bb9371e1d197308acf9" + } + ] + }, + "notes": [ + "Elevated distribution loss is reported; the fixed severe-failure screen did not trigger. The Bartowski nominal Q3 uses a different average bit rate.", + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-011", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q4_K_XL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 5126306944, + "sha256": "3cf61de12daa015ee0f7b68e7b7c541405bf220e1e942bad8b47cab827d7df80", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.0727525557799666, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 47.869607150910724, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.06407102536466532, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 29.60300346081908, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c01f42103b72036e1a4df73f41b6ccc56d8e79401b66ce5f7648ad84be6ce660" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.07652880535820482, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 81.48270225008788, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fcab08f5a5b8e924f979a614a1af08896380a4d957d1185570d9c971fff74521" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.07765783661702966, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 45.47559509511411, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fe6298cfa46b8b5c57f46c2990a696e48e4d8d6e7dc75c2928efe8deb4a20508" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-012", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_NL.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "IQ4_NL", + "bytes": 9156693120, + "sha256": "294596d8c89ec237e50341a73d8122b1527db4e6eb0ed0243f86785fc772bfcd", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.053061740024844574, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.450688912190714, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.046113225623184026, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.885318149808423, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4e309f68e164bdaa50ed1d13a1452cff922688ac1d58fa08282c7aa59bf5f298" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.07072297862207907, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.234775023818754, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d17a77f954a76fa676039bc6c4f136c905bc015867f9f1a1595585b826cb1ba1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.04234901582927063, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.1679053436708, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dd33e40722e13c8712717c7f00e324944ac75179399dc67e67ebd9e27415987f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-013", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_XS.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "IQ4_XS", + "bytes": 8820448384, + "sha256": "6e5bdf00c77ef6f4c0a871cbf2f997cb11806b7423b50decd5e4ed3989f3b973", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.055164947157440934, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.521949047391484, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.06823252345490675, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.993792494245979, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "596acc0a36cf92b11af3b201011a9c04ddf5f065cc8aeface01f6ae76e9e994b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.05223403468690402, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.028953912500057, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f186c5e94d7a1afc6527054102fb854f3626015831bac9b71b008fe4477bd02e" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.045028283330512016, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.438940170051554, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9b1b16b58d960db715d196bf96ceb34f7485d08d6ec20881330d32c1e48ebd1b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-014", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_NL.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "IQ4_NL", + "bytes": 9083162400, + "sha256": "d1364554ff094ee66dfd2fb3787cc87cf3ebc5c944eb965f354e3c6eaf60aed2", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04322016801491973, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.309582333375257, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04659631008054181, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.872510172382784, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4a91a15601dba04cf1115526e61bcc860f4383e1242ba7b8a137b145a60ca2d3" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04675539811852265, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.799526498078222, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1079d3b59d8e6770ae9ed0beba6cf2ec1d733d321651850a0e49a01ab7188fb9" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03630879584569473, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.108893593867595, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "345f4d547894b94b3c341f4529001f2a7f85b2274658c0f359b84dcdaac00a5b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-015", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.IQ4_XS.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 8820448800, + "sha256": "c59481e1bdb3a284198ca16e523fefa1ce8a24b7dad8ad2275dccfd58807ee39", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.055164947157440934, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.521949047391484, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.06823252345490675, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.993792494245979, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "596acc0a36cf92b11af3b201011a9c04ddf5f065cc8aeface01f6ae76e9e994b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.05223403468690402, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.028953912500057, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f186c5e94d7a1afc6527054102fb854f3626015831bac9b71b008fe4477bd02e" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.045028283330512016, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.438940170051554, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9b1b16b58d960db715d196bf96ceb34f7485d08d6ec20881330d32c1e48ebd1b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-016", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_XS.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 8745836320, + "sha256": "5d6aad466030edeb73f44b4a32c0c98d081d0e03a300366d6b63fbf469bff073", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04508017089618174, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.386365141771177, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.05122243249106938, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.995698179879965, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c0872468237bbf0b1e8f79fa06894a370925ca4f7cad27457069fbf069392770" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04728352120561313, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.785178290338033, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dd5fcf9b8cb510af150db9b236b821d7d09b7421d6224f42e31e9d164d20ae88" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03673455899186272, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.18217461077336, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7fb185c0b27f0976564ec87bcaa55a5fbfa31e43ca1e6365eff076b5faa51f5b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-017", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_NL.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "IQ4_NL", + "bytes": 9083162400, + "sha256": "9d03ed1f97009ae541f2b29ced6b564dcd947ecf430689a395be6c91a3e0b660", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1390624147742974, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.542854850786844, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.1665027725789211, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.784116117791223, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5afeed81d63379edb6af3934f8f1be9efc4617e31be808957b3b055faeb61451" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.13374242727837626, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 15.979944854627822, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5547515fa46334d38a50e868b98fec92806682fbafa3d75e54d40ca0678d32af" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.11694204446559489, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.620957812932634, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f4052d12313c6e08c8eff65bcbb23b46a0534d8d419162fdefdad3f54eb5d98d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-018", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_XS.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 8745836320, + "sha256": "8dcfc5da55f85016482ac849615ca743a4e0085f8be5052726cd7dfed04e0678", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.13003631525522066, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.379559269193802, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.13686256781337244, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.327034208209456, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f31b54ed195ec30be32fa6c67b4d015ace82f4146a127afeb75535c957648f40" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.14273063264109248, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 16.583031754051092, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a41078b2ad38ac6cadfcb76a349a59c10a6454e5dae936a3de464eebe9d8ace9" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1105157453111971, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.266143703245714, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "86dfd62966299b6abe3b182e949af4bfc41d6df6865bdd349d12ab712c23693f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-019", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_NL.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 2775541728, + "sha256": "f007c3dbf67df668354d37ae13d87fd5789059704977959187e8342aec03b66f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.023784478446108835, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.293977066123706, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02133222501558396, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.219588614725853, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c81f6480edb6a3bafbcdcb34394a226f786daccffba6392450d47d13a0ed6ff6" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.022984530057787125, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.758647554542978, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "794c10080cba033cf4ea074469b0743513287a11d30ce84f542493479137ffa3" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.027036680264955423, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.4002022412149, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "171a4b350159fa49f95c053a43836b6fda4ff709a2be7bf77741da8f6c7f7ea9" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-020", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_XS.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 2671339488, + "sha256": "628124c61a806897d3f28dcd416be6daff94f62f731eb900d4381875eac9e412", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.023796562876705615, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.182109930421692, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.022309077272513925, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.10582664829915, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f22717db60318158022b276aeec86badfe5506d810da35bce8fd3ac6af3b5d0b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.023562276031289537, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.645229010361728, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6e7f6ae0f95fe959e21d40a72316497f17a5ec716ffb4aa0d66e3498e876ba61" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02551833532631338, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.301198581920504, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5b2c4256b1f516631392ac7c36e16b9cb076b69c647b08837dbb11bfbc47223e" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-021", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "IQ4_NL", + "bytes": 2579944608, + "sha256": "ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.025707897045922554, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.234146392663085, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02512212833348267, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.245684490362607, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "47fde5db0ddecf464b8f44caebe5069ad4670fb1467efb4c879001b9ced4f22b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.025460166536704135, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.775815576974509, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "db0c3dd41d87cdba88973fc64aa0bef29507d8cdfeaa5113c07d0bd250b9aa29" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.026541396267580862, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.143715618013912, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "85d214485051b0042c871f94264e5a1cd6c889e7dc852ec5e384985accc4a5c1" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-022", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_XS.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "IQ4_XS", + "bytes": 2477053088, + "sha256": "658a9e7e406deb06d0179755e3c14f6a82915a4be4962a2f92a64d948d2e572f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.025324262998957934, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.132462127770346, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.022721007938319007, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.1172861201782815, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b20158419e24bed19c46764671df207eee94ee28782894f285abe4f1fcb5c504" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.026402621468849818, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.632898810280043, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c7a80cb885f7eba1ceef25ecbc0565a44e7e9bb3be6f8ece7056f017d81649b2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.026849159589704977, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.127468782428295, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "285d6c19c187d9dc5f5c6b47dac50c01fceb52dc9270decf67e9c948e107663c" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-023", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-UD-Q4_K_XL.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 2912109728, + "sha256": "b252c5610a42ca82d20fe2a12813e9d069eed89292907e26c783eeb0bc961bc7", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.013083331956401701, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.23897559041603, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.012917053909545667, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.034411324304445, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f93f87041e44b6232e16f24bfd3868a433399991a4f2f2fcf6d340e52690399b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01415649142780275, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.997962514987398, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "53b53b1d987e96166618386e0c5ea8ff20518d4cda9078c2222feff98f98baae" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.012176450531856687, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.269861270230182, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "47e0647ce1e0549085bda5c5acb77d377162c1c2a9e58823b8a6cebdc725fa30" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-024", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_NL.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 20754978432, + "sha256": "41e9f836690bde9619928538cb4dd170472d2e851243637f7092937a151297ad", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.021615180135507655, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.381589625434311, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019587033485099842, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.097641394049093, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "08cb5097eba3b66b8e2a36ac0a475d79a7012544a6bf1e262829d1cb07e9f567" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.021085068775161798, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.544728200194741, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3cad4978180f00a389991c9790327a789a43d14b5ce5c86ab9b7eb2ae2348c29" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02417343814626132, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.811739889992398, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fc7a1b85207b4f3a8836afab18d38a3a0a68974f46795e0cc60fa15ff3f26b0b" + } + ] + }, + "notes": [], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.026807996728183264, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 6.786749809628335, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 0.02599571733356635, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 7.856617922309115, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1fbc5a4d310278af9620850231901d341dbc06336e2c630e7bad23c9261e36bf" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 0.01975093297667484, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 5.090639071488506, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f96684041dbb40bf164124cd2d9d4008ba72ffb39d3c680c4f26aad1385cb967" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 0.034677339874308606, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 7.815874521389845, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "aeecb71fb2b98fee4624b73ff0c72309c370205276281f737694bcb830981cbc" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-025", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 19699553920, + "sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02322642581254325, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.364823325700074, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.023378685870851228, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.073767536634147, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e08cbd7c13dd9966c85f2bb3ae8f616c876695cedcbafc6a22af92f28975f880" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.023366612274456237, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.558059711914828, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "60006cdea3efda70249b8e76369e83dd7786350534155984cd70673f3921c2cd" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.022933979292322285, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.779558492446657, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2bd1a07405343b250b9cf4bbd3ce0e39de5993461a6737dded294534a36bcd89" + } + ] + }, + "notes": [], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02822878254251945, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 6.773700388422697, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 0.029002635209423592, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 7.8902791356032145, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8f2358bec16715751322dbda235c2c7cc84ca6a1f1cbf9058bc3f7b97ad3f047" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 0.018821788390952558, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 5.031125488574295, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8057ff64002e333fee7c2b218311a9ed7440b73b2835a7e3aafc5d347204d563" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 0.036861924027182205, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 7.829254889041672, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9e2f106dd63071225392b4a885fc48e567ad1ca12f94e64fbf27611d1c36f472" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-026", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-IQ4_NL.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-IQ4_NL", + "bytes": 18040888288, + "sha256": "0d17e255dc257a11f398ed4bc8d62412d8ce9ca24b3fce2947d962e4bfed5758", + "disposition": "removed_confirmed_current_CUDA_numerical_failure", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 9.364983969342475, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 64322.66605566028, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 9.054144917749891, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 43284.40659822908, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "098acef7be1465d4842ee5f39213b56e3db0ad578304746d47be4b611edda550" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 9.612933812421911, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 93918.15966843275, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "f2b9483835256cec232aa60e0ee9f91753163bf73520aba4c7ac48a780bb12a7" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 9.427873177855622, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 65465.28584402369, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "a687776d63c3b373fe10037416fb8b42e7cba1d198b2bbc252864b9d655ea1b0" + } + ] + }, + "notes": [ + "Full-file SHA matches pinned upstream; not a demonstrated corrupt download. Root cause is not isolated." + ], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 9.424356026402096, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 83250.79344678973, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 8.930305086865145, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 63011.76010139055, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "e9bf2517a2f0ba755c7b8c9295f1b39433d38fe73a69f4383bb80751c03065df" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 9.495158492817598, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 70139.05922046494, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "9ec61acc780c8019c2bbd91922d414238972802b089228950467936f6fa0a691" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 9.847604499523547, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 130552.02027557036, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "b566882a7e44a0a2039369fcd47fba47d1745d8600707a109f1c27ac09e38c30" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-027", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-IQ4_NL_XL.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-IQ4_NL_XL", + "bytes": 19500506080, + "sha256": "071ee2a008ec51372f990d8efbea92ec9dd0137974110ef68fbfde429c8c6dd4", + "disposition": "removed_confirmed_current_CUDA_numerical_failure", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 6.847529968643695, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5745.514477094899, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 6.489482927220124, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 3248.1886149799893, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "d297d1648593a58d9251dcd6f7dc1aa90c28c707fdbf15ea5eef414e1026682e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 7.11991349493756, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 8288.726741053822, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "3909f49cdcc8431eebffa7856e71eca276ecd293118344c6758d4f2bf9064f89" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 6.9331934837734, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 7044.622212356466, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "b8232a2d0e9a8216f7cb246c2b4511f3f33d225a275923f487e2c3b9906fad74" + } + ] + }, + "notes": [ + "Full-file SHA matches pinned upstream; not a demonstrated corrupt download. Root cause is not isolated." + ], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 7.132222225210246, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 7992.022468400995, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 6.772524439353569, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 7095.364540972447, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "9c4248f6eb62b6f2b3ea8ccccff2377c364b5e2ea0e995bb3c39b1345532db65" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 6.811026959208881, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 4170.659223892634, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "d69a2981d183ac9625c423446cf1fedc3819062d97ec45ed9b20c3bdbb8d5592" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 7.813115277068288, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 17250.06235505412, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "25b7ac02cf07bc5bbb5396d58f7149cdc50689934626c58f2493dd50ad234998" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-028", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-IQ4_XS.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-IQ4_XS", + "bytes": 17730509792, + "sha256": "649d7508507b84638732c4f52c24c8b15843c6dca2f3ff793ae07c14a67ebbb3", + "disposition": "removed_confirmed_current_CUDA_numerical_failure", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 9.409277993966551, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 66694.98389551807, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 9.300592603461416, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 53360.679189798706, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "7eab6cb36473fca381df9897a910aa896a4818aa98fdd62a8fef0ad074defc0f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 9.610950671925265, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 95004.14986520872, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "4c3527554c32e2a54901f8f44caf3f9754b65dec8fe11505d02b9804108743c5" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 9.316290706512975, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 58521.51913010842, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "2e36f9dcb972716d41860c1c4aeee9cac03eba9493c0c4e32c57db53be3b3b93" + } + ] + }, + "notes": [ + "Full-file SHA matches pinned upstream; not a demonstrated corrupt download. Root cause is not isolated." + ], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 9.430330372947493, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 85471.63390627233, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 9.18556794792998, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 85853.40731086858, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "080465a2ac1cd7fb36066b90c3338d1f6a81ac0e65d30ec9b13b24722c1e53e3" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 9.426500731356004, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 72002.35123621192, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "67238ec4ce4dad7e3aca56dee74de3ac143d4608459ba7ecb7ab946b1a4fb84a" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 9.678922439556496, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 101009.40294132648, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "92f023f0959efdbcc86e7ed48e7e8ad8aa4755d431af6e4e00c527fcb5c00937" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-029", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-Q4_K_M", + "bytes": 22134528992, + "sha256": "ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.010502134859054497, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.274689959531069, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.0067445308745274195, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.0498515131071064, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3f0eedfbd923ede9a37ed1229b746cd7eed90d36ac99a2aa199bde0e4148b631" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01399282212093264, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.318622621400951, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1e6027be43618061715e4471500c63fcf1c01e896fd58f783297e0dd3c73813b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.010769051581703435, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.734945484606669, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9cf2528f5d84ff266ab660cee4b5ebe4cddf0760015822f3f95091909db342e3" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-030", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-Q4_K_S", + "bytes": 20893015008, + "sha256": "a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.012073461131714253, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.345842621276376, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.011005600989449919, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.030768025410018, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "db392759267e9c53db1f6d40db06c65cf883555e841656fb80d39c6aa10e42db" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.013593851150490617, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.488109784212366, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d5509ff13b499ea2623450c1c48d0a3ec40eabecf46c7d2fa1d10b4b1fd8175f" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.011620931255202223, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.841743889348354, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "71793050f6c8fd0618ad061d264f72ef2bfba37db967c5f7b05a124b50519bd4" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-031", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 22360456160, + "sha256": "707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.009052617464377709, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.3061014522905285, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.0057613479800360055, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.0787937985438125, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8a908aa15de9c2fcab5d15a6795c2aacb148e6c2d736e3b082a970bb9b9d254c" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.011856894658170431, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.285987967397231, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4307edfb85711aad3cbee296d1b091102142c8dc7f89e03cb319cec80f4a4b7c" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.009539609754926692, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.8266824840446105, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2903c7135923436d21685399a7ef0eaaaaf8dc151d764cce5d045a89c38b5dfd" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-079", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 5465179264, + "sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018448039016069406, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.32325974014943, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02083471774880853, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.486668961113858, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "54e0907e815c3d5a64f6ccbd768cf6e7f6f0db2cafcc076c85d30a661ae71ae1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019840731938568876, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.615122134711212, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f1e80a1614968ebf035872829b5d0d8a65176f87a741684deabca77c4209b08f" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01466866736083081, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.104046793026008, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "379bceb770dfc3ce17dc4b49be68e914a1439e4b3ec7be8a3d0fadb5c6dcda22" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-080", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_XS.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 5262279808, + "sha256": "4342477286625c4cfcd70d0023bdb3ac30613fcce729123e0277097c7dc42e2d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018103651283492287, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.302404842348925, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019398662975544313, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.474711777174666, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "aad74aedd8f22a3a98da6d812c3551bf12a070183f3f79d6316534f4f64823b0" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.020454225256645597, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.567677174039947, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5dbb92b0173a6635eda61a4b852198cd67d753183899f71717bb297545651596" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.014458065618286949, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.095490800664185, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "13b04002de16bed40316f85b4d10ccdd43841d35ec017a5e09e63d28502dd3b0" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-081", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "IQ4_NL", + "bytes": 5465179744, + "sha256": "d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.017217786023406133, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.302934265661214, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.018647831173717298, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.496960139781056, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b21ed7c330b17f62e29cd38750ef826d6b9461ad30c45d539a4f58c7b379b65e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.0185309380601122, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.544921499298708, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fd32aa07fa54a3792df44e3565e62fe82a4003a8a3088008323923ce79492a5f" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.014474588836388897, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.074041800865176, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "95ca2a168ce8eb9fe2f9b54e53c63c0ccbf3bc15ac0831bb74a7df887a7b0d6d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-082", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_XS.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "IQ4_XS", + "bytes": 5281678944, + "sha256": "23ea7196ed6f595c44591266a1b4b90d56db5a66c5223d49a41a587b81ace35d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01739768527121302, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.289581206478566, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.017796977804151844, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.485264812947823, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b2bf33136ce488724391e5b52d620fe0a5e50f7574565af63ed85da2023a60e1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019476292103721718, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.470141778275535, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "40e4ab91bb223503fe6ddf7654ee1157e0fe62290ad5fa8ead03fa1d4a88769c" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.0149197859057655, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.119334900063208, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "547520359f2acd97c45b4138f1f07cab301b3451c346a21917baf04f1fac1ac9" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-083", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 6187353696, + "sha256": "b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.012324135070447308, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.351119664117333, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.015371009660986165, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.5193186669468055, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f2856e6edec630cce310272f2c09bbc58d23425db3e950d17ab2e3d5dc851e45" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.011930681453580238, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.719382603416888, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8f32d7fed8735d0d34fc25997424d45bbb8654dfe10283480ddbae5813478e71" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.009670714096775519, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.043755931474548, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9e38e55b160f636f507f425d5db5227f5797c2ca6ed0d4c89bb0e1d4dda7ca3f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-084", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_NL.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 17386275744, + "sha256": "bf516e4962edd42afebb1f2dd1cbe9f5223863adec745bc4d81a0b1211ca5111", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.017695043762586942, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.551290840378892, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.016515456099935086, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.977278592874585, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "bd3edfed23d9f772b3614c6fd4133ffec3fbf15a0d64cce108ef7b5dc4e1a856" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01952281949013245, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.037550485277322, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d47f11aefa06aecb9d4e52bbf5875690c657eac1f7a2e35dbdc711b2d5bd0ab2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.017046855697693295, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.422305328610149, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "15760f927d4db1692ba58201f772ed39dd42cdcdd7b95360d3ab6d0f5bc6c45a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-085", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_XS.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 16457999264, + "sha256": "c686a3a767fb94ef19499815036fdfb63213664cf0d5867c63848c7ec532d69c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01881347961884568, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.531049059873261, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.016211519030960644, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.9611390981629135, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "85d299ef241b32d6a30fb30cdd2f27e530c3d005663eee1a9b79f11ddc3e51a4" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.02221207246450956, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.044608994636679, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e40513362cf9fbb744cd43aa37faad34698132a5567ad5569d51864b2f34028d" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.018016847361066842, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.369194645352614, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c7734ce804fcb37483864c64c2eac0bd96992655112d53ec5cb81d576856e35e" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-086", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.IQ4_XS.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 16557090080, + "sha256": "be28be57166c9903fe701c99596aa3c7df9f8c834f3109e6e9b4668d72cc646f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02344195739298896, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.502900693429886, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.020383110703249867, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.006122228643898, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3bf37a2bdbfd89bf08d91f455d877666855dcbd1594bdb1c61ceb9951a34c6c0" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.02587992312389949, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.87727986811867, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "11028561331ce93deabee8ba1ba5f7cb063b752e433e6b6556611c54489502ef" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.024062838351817523, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.362625306476414, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "98aef1eda771443cb7f09e2a629cdfca99e789dee45b564e33db953d9a57737f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-087", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-IQ4_XS.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 16368346656, + "sha256": "d768d7983f8bb8e7804812679b0626a2fc8a87383461b0285ee5e23370143f2b", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.021297824351990284, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.533055149392332, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019931147622854216, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.953826889989638, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3cc27d1f8e374b9075fbabd62c4a865c49bd37319906eab7096bcfc1ff5e0e48" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.02388909393568218, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.07596287133927, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "755907d10e93b42f2ccf4a859a88e1cbfddc383812de5a79c0ee7b389fbbfaac" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02007323149743445, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.356926537952631, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "791d31960c5f67aedaba0894b476546c001158635023724c3060e94baff56eec" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-106", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_NL.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 16238568480, + "sha256": "8ccfdf140472a18928bb867e05f69c215fb7eb6e9c16a212b0ffa76f2eb023e0", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.013822652021215043, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.920863583726871, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01169428321605357, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.8307494932689226, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9308605f0b38c2597fb31a3a38dba540ba880007a4bbdb5826c57ebf69c32d4d" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014031706187030495, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.367067575196865, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a2f3f98e3fabc857adb7c9c54b22f0c39a3ec41ab1f2a342f445f079381ac393" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.015741966660561064, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.342459708936508, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cba04a8492b1ed54f837a25373f3b8d605fc6cc18ed1203d4b6b9e225ea3209d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-107", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_XS.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 15435096096, + "sha256": "b3c03d94c007ae487fd5259b340ad23286190b62b0d4d452f06bc1cf8840a7da", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.015149432078010585, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.970935094253601, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.013342324615335794, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.8498284281065422, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "80e842cb92d041df4c99107cf6170077b2c1243dc8e9949e95fab9ce46efbc45" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01682354845038345, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.453132880961084, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2ec0b53ea3bebbaa136035c1cd1d4b76e93e6a22925621f9eacafecaed6b3c48" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.015282423168312508, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.409120738881072, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ef2cd557749def6c169e97d2c3a754508b16611c992e868318e620ce344a7029" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-108", + "relative_path": "muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q3_K_XL.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "unsloth", + "quant": "UD-Q3_K_XL", + "bytes": 13360983072, + "sha256": "820d18e00c59376331eba62dd716a6bcdcaa305c2316f5da3a2fab36c7c37e15", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04720273515353749, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 7.369544647263129, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04322504435096972, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 4.036181144264958, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "760890fd4919ad2bf023bd787d3b6f13dd4d5982ecdebf553ef3cf99fe31eb10" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.0468631735456595, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 9.065446781268601, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1f8c8f4c5f4b9098206177b8969b9995bfc399199caf8f52d997543d08b5148d" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.05151998756398326, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.938609056258588, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2bb796236b65567ddb8261e76daef26fb9551bc4d03aae6950c346fb8982d161" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-109", + "relative_path": "muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q4_K_XL.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 15878222368, + "sha256": "82bece304887a313ece08400bc030f6066c7bff5b906b0cd40308ec8a409fd38", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01279883417495957, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.890440257711031, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.012870441435681227, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.8453096597430654, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c8db561e721af6cb7af8534a0975d4074bb84669278d09b23f0dce5bd1bff08f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01267533593461617, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.152842410591068, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7c807e66bd00943a1e6053fe4d070637e6be407e0a7aa57356fdeab0e58a0856" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.012850725154581312, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.435194497099166, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "137699c84945b816d052f80dbb560ddbc3665f8be86b988ba9a37125eae68842" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-032", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_1.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 19765274976, + "sha256": "567d744757d575d84c0a42278091223aa2351cdae8f375d4962eec44272659be", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.6528547646572396, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 5532.618748666471, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.7705567402420124, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3689.04214687371, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6a5395d90fd176ca1b8c99cebf8b9290e4dd47e0713b53a526fe2193f364573e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.5196419237001277, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 12092.262661056915, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8cb27a3ab51fdcf0b05c361e602d507c6326c277dbd2850bfea27979fe25c051" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.6683656300295785, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3796.3919449508844, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "064aac3cabbe153775ec205b61815fdd79f6e56343f07b34f60468005bb40d16" + } + ] + }, + "notes": [], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.6224143727870406, + "PPL_reference": 12964.851857612222, + "PPL_candidate": 15518.455668029836, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 0.6883657327750027, + "PPL_reference": 41368.00589307904, + "PPL_candidate": 61547.77679512446, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "aa74620fd52ac530a99e17d14e7ea52b012f70c1e34a0e437912baa1280d2ae3" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 0.5317285359571035, + "PPL_reference": 11468.295417470643, + "PPL_candidate": 10112.449831469949, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "befbd757c71c866972ba10a128c3ffae142c2df359c2416c0491ce08943575db" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 0.6471488496290155, + "PPL_reference": 4593.452373266919, + "PPL_candidate": 6004.498622047255, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f799c6dc58189f899f4a7df99ab47f4e0bbf8146641a3cd7815871bfb0d1c2e6" + } + ] + }, + "additional_windows_vocabulary_policy": "allow-vocab-attr-mismatch" + }, + { + "candidate_id": "candidate-033", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "Q4_1", + "bytes": 19118091200, + "sha256": "4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.8149144278771223, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 7402.897871001241, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.8423449535125839, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 5924.719251065625, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "403fde4fd60f51475dd2f3b13e9ae1eac01b099649661aafe8bb59231e69a601" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.5815311898933425, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 16229.478025315737, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ba163b0a07db182e7e6dcf93235ccfb14023d86f9cc93a374a1e82b110e6e5d2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.0208671402254406, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 4219.227528645361, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4d0d7db40ac72214d0b201712cf7bf7b5d97bc3dbf877e8eb99d87d23708b0e2" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-034", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 5458479584, + "sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.13131703716239415, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 48.86211380982973, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.1141460199393832, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 31.63860212710171, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "aab77ac625d24359e6eaa0abfaf35f037a08c92929dfd6d244b6f8fcdc2506bc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.12661677503345034, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 75.11419637025064, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "03fad74873075a73d05b06a233c175d7dfbb97a4209b1e18caffdce8a8436c06" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1531883165143489, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 49.08823766133249, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1c49c326165f07c2fdc00943a0743252618b0a005bd508d2b9133e2d69d9b9c3" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-035", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_1.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "Q4_1", + "bytes": 5074390144, + "sha256": "430685a687edf70c4fdb1158aa92c34dbb38e1230f674849f198a954cc748405", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1184458912119893, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 51.533624339525346, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.10838170822427366, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 32.64592252508017, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b99cd45a6647e474fe978818f7f3fcd530b4be2e32a3ed85e87dc3fdc90b19e5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.11611990461738896, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 85.1975977261115, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1426aa7f700b60668a360e0e05845395275b6e8aafb2b204619731511ae0b7dd" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.13083606079430532, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 49.205739932032344, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "90640d218de0313380f8315c2730d7a76b4f941fa92ae5dcf12b28950cf3e46f" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-036", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_1.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "Q4_1", + "bytes": 10059476096, + "sha256": "0050110bc63babd859a849d160818e5ce46518c9dd92e38e50d072ee71a353ca", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.052384034123455644, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.244260337635893, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.05894236604133267, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.6232886969458376, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "221ffe324d8fb99df19af4148679f08640e5b9544f5baf942392a4329cd8701b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.05506409567523424, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.182057616954745, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0017cd5b3f05a2ee9832c4985233d27a7531beea8f97c464fa30cfec5bc9151d" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.043145640653800034, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 8.9555264435582, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "91539343b67be9402a03dcfad37abd6380aa2019801087de89f27c43de9d74d5" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-037", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_1.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_1", + "bytes": 10059476768, + "sha256": "81aaa3efc0a129abeae7149b8195d09ce5467b4436c1c412fd5cd89161d04f40", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.049663856853532196, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.369355692122718, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.07267542058015904, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.868135437964154, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f569ebe0f374548ce1fe51a4a8ff8266d6c201b025c84596c9a2afeda31a21de" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03751249598654777, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.96581583694961, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "942d3cc8a594592adf20561219225aa820a334bb367f20d0b2b8aff968c3b429" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.038803653993889776, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.169298058980294, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "96a021ec9b0cf78f744fdeda13b91bdecc58dc1564d5ae2c59a37f88beb6d720" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-038", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_1.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "llamacpp", + "quant": "Q4_1", + "bytes": 10059476032, + "sha256": "780924706c8a9df254c30b33e6384de8b01db2d81a6332f0c7f8b0c44162db76", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1811040221525973, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 13.079243036549581, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.24818223444277002, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.966284930393742, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ffc68626c94bab539d8ee7406587e2adc679ae75cc99d1d14c39787bf90de8f5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.14884040800581502, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 18.128574917585485, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4cce5de6d2d6ab10e8048bdf6f43ab148bbe24981803f7c8311b102bacbf3192" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.14628942400920683, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.383712606911127, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a259ef710cd665f3fe6fe4270e3c661d8867ed4b8a82217760086f49bee23e0e" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-039", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_1.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_1", + "bytes": 10059476768, + "sha256": "61fa02dadce8e5caf65e4660db204b18024135ea8db88f35c8925eac82de73bc", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.14711698559392947, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.509232252773417, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.20607207037130282, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 8.822156765113235, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "21c03ddee52b6fea98818c4be2327fd49ab39422d8d44327b9eb5ba64a598823" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.13763170110453526, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.908684817208048, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9cb06299ef580898972b6b2313f99df191e03b27e6a5cac1249a61c3b080ac37" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09764718530595036, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.389492123021427, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2d227aae487e7e34d3fd7c55bd6e3c489b74416d7c8a3c1f079197874ddce7f2" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-040", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 2979850208, + "sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02117895370244393, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.230062466611084, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.021053443715071826, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.025851833857755, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f5f9660bbf6c3ce46bfc0cb4536e396e73f245c63eb8faec5d288732be7e87dc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.021369748697653967, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 10.048422117516576, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d0483a780a88363d9099a03260d3fddd278d8b0c894db5460ee91ef1059a7709" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.021113668694605996, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.206468573158855, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b5edc2df83e51b6f2cb47e467fecf7f7f5a58146937ac0ee6faa94e826aa1872" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-041", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "Q4_1", + "bytes": 2784416928, + "sha256": "af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.024893953028052185, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.246619034087734, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02786410991315921, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.1607528104208695, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8541fe8d624cbdf38709a77d39c31849bd1d993462f1844fc30c29650a27ebec" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.022364911958021705, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.887434226331717, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ec95d15d0b28c2c00db6c11ebae90411825ad7513d2437e6f335d455d64dfef9" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02445283721297564, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.206835952646149, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "27e69ba6051c61a2fb222eb3de8307d75bbbfb9d24a7a1aa84271bab36062a79" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-042", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_1.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 22868448896, + "sha256": "8babe2c6f46b43815cae7ec2b970be8508d6867234ebf16c376bd9cc79477354", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01873216845401442, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.383768516850679, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01520064373932508, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.129105171523135, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7ee2a0bd6c3c41152df2555a01715f5a4f06fdd4f160eb5731cffff0c474e111" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.020238842584883825, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.3757008551701135, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "58234e05001d4c891272146217cf38a0cd4474fd36309756d77ad395b1db11db" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02075701903783435, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.927550445007792, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "688bd4cc6b813af902ad487b911fb8e75f0344ab8521ec2278dc4ee12f493898" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-088", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 6008603776, + "sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01801804254925986, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.46782674114322, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.021102599602206916, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.609829764398968, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cd5434807fe5cb59ce589fce6130ff49081124e8a046b24e03206bc9dcf671e1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019234970818191262, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.865308332762563, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9eec9e6c2fee175104bfe7975f7052043fe3d018b83374d8f65c4f435affa085" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.013716557227381403, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.157715542458357, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f1eea94cbb59e9f4a607ccb4dc61c03032aede21f591fc31076e6ea9f61f68c5" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-089", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "Q4_1", + "bytes": 6008604256, + "sha256": "66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018926200252666326, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.437579538023023, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02357248464735471, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.606249496777617, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e9385c0c991a6d3d9247af0b510e8baebd67a7dc93536e0f3241e77da7404378" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019460857212292397, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.736274355046906, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1ae5aa29ca09ae63c9e4c631e7822c8d42e28ad75111e274112e77dafcca1fd3" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.013745258898351868, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.173912814339321, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cd5e7f064095ab568e0a2286ac281461680e205ddfd4ade68625fabcd95555d6" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-090", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 19214517152, + "sha256": "f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.022594635411194518, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.495227405574473, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.020852574478899412, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.982115315161948, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9f6b1b69e2f389e4515782aacef435c78be5ed289e50a24a94576238409e978c" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.023158123755734672, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.894530342969823, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fa846465ddcece7af5752b897fefd650bde48363976a5d092df24f7aa8baa28d" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02377320799894947, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.357979837418227, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9ecf29d755a2d955480f523eb0359d02f9aac45913a752d0b24c0c7cc565065b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-091", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_1", + "bytes": 19192497696, + "sha256": "cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02157982843125029, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.527111650123857, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019501507319167125, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.0966445078471025, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6ae4970b81cba0728875c6f146005f8322195cbe2459c40856075aa0b0e42e7c" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.023305567408392652, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.051290437655311, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b9535fbce3d4a178407366f2e1a8355d6a1903269b0d9a072a2b48073b4763e1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.021932410566191097, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.117964558082738, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a8c38de6dd9f57c27b043c93a67e92412584050dce98b17354c09d7cb5a59927" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-110", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 17828207648, + "sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.012278850396166663, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.841468964292593, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.009964265695232682, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.819588476116318, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "80180d4445ea56b31ead983059a45228a846e6ef9287353bff87b4c1c166a894" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014107960268611528, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.103195799110969, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "54f7eafc9adc2c664999020e4fbd074884bb3e17e1ef142d59b9c7228e5e78e4" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.012764325224655777, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.34606437007683, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "06ac76952b52c0a0cd6c4d9cee9e073bec58cb5c028e30fcc0a6555ec157d062" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-043", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_0.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 18076264800, + "sha256": "4591e5ee10527739514d6db436b51169c882949e3858d30285aa997b0b253554", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.2050026099251978, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 2290.0114885013973, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.050905966150568, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3467.3528966044214, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5c9163f8b980fad1df22b124d11371ebc9ee65f56b3a86222630c9cfcf69fb8d" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 1.514681828419438, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 2581.5152533781834, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9b85739651ddf6c1ea421db88e3cdc157f69300feaa2ac451c492d5098554fc2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.0494200352055878, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 1341.6531132409946, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b358c0dcfc4c0c668d71d19d80dbba1e8d7231a7dcce20c5f7dd48eb369c31dc" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-044", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_0.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "Q4_0", + "bytes": 17338248128, + "sha256": "5c558b9b009e3ee69bde43e2b98a45d1f5afd316b9fbf447edd2ad4945a187bc", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.1275477041460908, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 2660.5518982665335, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.3103712348272818, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 2822.3925493798642, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3f38defc26270900617c466037b3acf07e75c3acd8ab06433e1024b9f07d8fcc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 1.1588903678153193, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 4269.2800423118115, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "eacac36b0b4f63396ad9b01268ed963a3459e2bd08f10265e2a7dd4a1200aafd" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.9133815097956717, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 1562.9430177409117, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ba6483eb36f00d1fb8fd0536b3d974f6cb58cd4a95aa101571e2b0e6f8d240ea" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-045", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 5223860704, + "sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.3250852422634452, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 66.05719105004967, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.3184440132452044, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 38.21031736005719, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "272baf0cb38b8730faea2e390d7db80bc53b7ee9f775d592649672bf50df3614" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.34072330973500337, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 116.97504537102407, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e7a879b9e48d1d7181f187ef5e123a63d13f299203338651aeeaa504fcd82bd8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.31608840381012776, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 64.48911835360262, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "633c2553473448dd91beaecd125176ee8a198ae17b1eec011ca013b9081575ed" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-046", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_0.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "Q4_0", + "bytes": 4836002944, + "sha256": "4a403d2e4d80281063e4f517b1c061ded8476b4011a4fc2ba7dbff707075547e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.17466558498399098, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 56.82823541655337, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.14466138562388947, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 35.721235612253, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "10025a2174c41d9a370791a6b128858ecd5041e3625b38c34cedb54190ca6128" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.19830938183967645, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 92.39797279817746, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dd757fe0f82d8935a4e4d7e314d45393710fc5944fe15c589329ddc9d555c416" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.18102598748840706, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 55.60368788025716, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0c5c13dd5e8c20d57a372d63f839520ed19fd28b0fb5b77e87edce4f8f41e2b3" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-047", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_0.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "Q4_0", + "bytes": 9083161728, + "sha256": "e3ffa932cd1318ce1231d97d832f92b90093900b2185d50d54e39c8d9d421080", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.06045780804814926, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.464154517673812, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.07010162521386092, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.8707128491822, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fc658a81a3f5208c2af7b985c22e07203704a282935acae72804419a7413429c" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.05964614782428458, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.284696233396653, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3c7014e83d71497772e4e8ae7fcc37771e972df589587ef7427a6b91e9560433" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.05162565110630228, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.195633159148125, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "13bcb563fd821ea921dd11af36f839efdda8bd9159c8efc5c5405c07ff55577a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-048", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_0.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_0", + "bytes": 9108393760, + "sha256": "0ea3afdd920792fd4583d8c84a979e4e0af52a2e7456ae6bb75731da999b3b1e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.05337949044904211, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.389658961961943, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.06295669490897197, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.758866103937971, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "474a470283637e4df5950d0c1e20649d27727bf24b9e2b6f0c49186749f3a1bc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.054226805023284336, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.988661034969297, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "52157bfcfc0dc63f4ebaf7e83c56943cbbedf5461612f1518502448bd24208e5" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.04295497141487003, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.433540072132685, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "73c92148d6c620ce50c4a00345c4bc5865802dc22b2b85766a0f583b6dfec3e5" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-049", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_0.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "llamacpp", + "quant": "Q4_0", + "bytes": 9083161664, + "sha256": "9083e9ac29082a023d4f3ebd9610d89962fa205eb5da7034777b0bdf5ae0e348", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1805879139745622, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.690078252210245, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.206644243619631, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.070377475634153, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "73fb28a1434340e5bd48e25b300bccc88cd75bd65998d0ba4b8202b6f63735bc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.19867505282924028, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.957049798274838, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f1141815ea6f829128ec663c979c697a73c00aa029cbd8d30ef34637b18a0408" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1364444454748153, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.546787778460216, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "bdced2e112f572576692b84f7bb16482b068ce5d101a5921a1cef728db017971" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-050", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_0.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_0", + "bytes": 9108393760, + "sha256": "3b3bf0ced352c03af1380107323e65d26048b3fcfb442684c449229a93cd767c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1598954956395912, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 13.066403552638132, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.16511290833511214, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.416806168419123, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "89d5f77b5f2c334d2646127cba2c9b37411632605c6b0e75c8d75920de30a211" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.17523175805416066, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 18.16025273650983, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "24b2a788b33ab6dce6e3fd5cdc1be2b354a84b5b3e4eae7806d00d060c055757" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.13934182052950086, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 13.044957902678066, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "06bc2090ade54963d9112c9c571f4cd9906a639cdd0e5c789b168543941b47f5" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-051", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 2776033248, + "sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.030247619453139658, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.269669308139676, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02691979006930898, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.179042119584652, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ca354a8ed7ca7c42b161f22478fd89e4ece0cd321508e6b2bc02fcbc1b5ec21f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03233457144273345, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 10.02778704944862, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "14e490772699d9d6bb534962d11c25689a164d20a9f057df353157e024e886b7" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03148849684737655, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.127212691710987, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8c2b2d41450600cb1fe470ddd93d68ba636d3cecefb9be108a74aebcd51678f8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-052", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "Q4_0", + "bytes": 2583221408, + "sha256": "298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.03243738571656495, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.228466270592412, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.028085233044140633, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.1934418266852385, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "92844b245e4244734188cab769e8d62b5a8b2844e1ca0fd55d80206f16f99a3b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.032620629749555305, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.904145110793616, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d96537f280e88f1ef58dc22f5f738882ca57f3ec9fbde647356f4e2c78668f0f" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03660629435599891, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.082546337541565, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4d49364ad8171a2848564c92560525898c766d7ff3778563bf4ea04499a1c75a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-053", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_0.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 20836243072, + "sha256": "52312daa5b2190c1f5723d33c3315c01c55af4206f6c6e6eb63f3d8dd52bb85e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.028529380982948785, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.395303722271188, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.026113350046726318, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.212260790919911, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "94c8ee53dcabcdc88ade7720f000b3bc41e769a6c9a3a3af0e7021bfe3c3fecd" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.026137283355616072, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.3293393706800645, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d7896350e1faac2260fc3c7896b7b79e12a0a961c43eff209c65016f73c419af" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03333750954650396, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.89079703142734, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9494e5de7b91c45393c7a7fb1234bb55f9db3a451d388bbf6039645fe8e40d87" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-092", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 5477467264, + "sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02804298717779733, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.416868563120732, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.031164711224320463, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.377231350979559, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c7438bcfa1fdcf2fb6d9f77ceb9485d0533421ec3894530010a2b07beceac542" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.027918232325721284, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.970308597292751, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "730bfaef96b473e70965924ed934c0293449e309eeee6f09c56a68bd8e6b1d18" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.025046017983350242, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.348752161653259, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "08d2016b87dec4d9858f61b9ae4d0e4f732e7c4d2a32fcdb7696f083d497a895" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-093", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "Q4_0", + "bytes": 5477467744, + "sha256": "c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.027953883222480252, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.400938926458278, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.03094981047140173, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.363255996741527, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6735622dbe59f867e17a3e6bba6fe7e1f967e392079dd5e9aafbc1142638eb29" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.02764712083360292, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.964240607071385, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0440d750ad2e2a47f08bc4440435f72d2a63817be795f4238825598c34a69b37" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.0252647183624361, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.32407076502743, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "de09f59601630e30e1026c0575322204b52d0342a5baadd10b81c9c1621a6d53" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-094", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 17631642528, + "sha256": "b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02936553050985139, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.365596839351788, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.027544030604518682, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.912029897827201, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2f08b2db437e2bcb47c4c267dd4a71d2198d1cc6230c9b801eda125ac6dae32a" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03076412636824791, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.822367127765576, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0855236251d3f1324854ef81238b6888b93b89e131a35f49c6df3b1998a641f8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.029788434556787573, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.081798392264881, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6c979f5d1d9acebae1f436b0ed01d69e222af5617c1299fc2dd92050b82a678b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-095", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_0", + "bytes": 17379984928, + "sha256": "6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.033819478748590294, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.398199780901626, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.028026350820768747, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.973922319907754, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "87782950963b343ae294984d719ce1da9ae8b8c987ad40ddcc426b144fa34fba" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03437313342848189, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.82919208226707, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b9e01128f3e228220a07d92f1644c9a3a76040d6def52e43f2032fe666334701" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03905895199652025, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.087445741290056, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7d4546231d39ce7ba49a4f3c09a17dec5c22af3c804c2fdf4b9457398a8872f8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-111", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 16265565216, + "sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018935528782238184, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.99840604836308, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.017326034894343888, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.871735916610402, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9c3c6bc7fd92c45abb98b4dc3368fe96bfbeb24747d89f6524d01d4841ea3657" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019771851714879222, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.4183024116301, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "310b48cb0937fe1d3ff0688dda5d306cb8f7d338cb3fc5c63f325c4d242f447e" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01970869973749145, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.516401535256465, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "28d35cf4c0f837c8d0508f4f14df21654084814569635f9e482a3c8d516f3963" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-054", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 19598489952, + "sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.4570696355057695, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 6318.7442797201575, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.5646540567436985, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 4607.161732909864, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "74e8b46b10534ede0e5fb646c60a6a2596c96fcec0afa33cbf33dec6fb99ca1a" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.3763286524649558, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 16193.583197113392, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fb0d8ae93125ea332fb7aa38300936d5facbd75432efb8996024c9e511112955" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.4302261973086542, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3381.55086286102, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e9c20d31c5404044ea6876f943f077b546e74a924eb21a205f35dc3db74ec9f8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-055", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "Q4_K_M", + "bytes": 18323733440, + "sha256": "38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.877349805047552, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 9691.867815554595, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.0610442601033117, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 8886.206077154957, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d2668f1da8fefc49dafd42f336c24822825ec826682752fb0b0fcdf2157be5b1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.6399580626081816, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 14050.82213583785, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5e4f0d9c8a2f55fee33addbd36828e168116facc4ccbb220445da79ed50a4c0b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.9310470924311627, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 7291.289295788462, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "68e5a736e9c0a030bf1c8f6db83933b51e82fd378433743dc44aafd221dc9470" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-056", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 5405170144, + "sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.08662593214080397, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 51.563036336994415, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.07222797923510113, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 33.260995642334606, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ea60040d5c927385f9681035659fd08035c7a677532f96e2ca5521777bc25a83" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.08873048958161937, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 80.88237897825915, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "26df3be340416e7dc42e67edc011bca3a164a2687e2f8331fb1716408620b2b1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09891932760569142, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 50.9596325551882, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7ef8724a13c504d9096ba5cb11492c096c4a2da58e1a7fadc256646ca847b936" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-057", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "Q4_K_M", + "bytes": 4977171584, + "sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10543335651853876, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 50.05581951414737, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.0993351988371831, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 31.91986711717284, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "295125b172fe4b1bcfb06df4b2445f6d33341080ec0e7dd5ecb6787a8338c083" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.10871055292203598, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 84.64947474230517, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7571a294d70b674c1f44e945a629acf8f8ce88c3a1b5ca37757930f8d30094d9" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.10825431779639717, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 46.41714085288227, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5631f07108b06506308e7f317195abec5b5dc19b829d40593ed629cfac18d601" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-058", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "Q4_K_M", + "bytes": 10540747904, + "sha256": "43a34db4974f67ad13ff3e1f8347ef1b25dbc15b077146d1c74627e3294ec49d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.03988522014494913, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.364656300809736, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04997667807590772, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.7734199408302675, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c88f6b8f24876df2f66625f0af6b2159033633d9c3a994882e19e2127a055e93" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.037565777534687456, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.154352440677426, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8a1d429f473d40c505bcbab2413219d12b8e5b00ee15ed5edf599f2ba7a202e1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.032113204824252214, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.141136189489542, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fb15120fc1efdbaa83e3c00378a0d8ec2894383ba1fa83beb9512d13d863f205" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-059", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 10540748320, + "sha256": "74e9aa21a6a6e90d6ff56b7ec311f830a0b6cf88ff7dababacc8f34c867bde1e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.03988522014494913, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.364656300809736, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04997667807590772, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.7734199408302675, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c88f6b8f24876df2f66625f0af6b2159033633d9c3a994882e19e2127a055e93" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.037565777534687456, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.154352440677426, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8a1d429f473d40c505bcbab2413219d12b8e5b00ee15ed5edf599f2ba7a202e1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.032113204824252214, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.141136189489542, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fb15120fc1efdbaa83e3c00378a0d8ec2894383ba1fa83beb9512d13d863f205" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-060", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 10540748576, + "sha256": "7710f9aa5bf56a38a03f26738cdbf10563a72938a41025307b57768dad40f306", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04031790718154595, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.252361572438242, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.05467538353807992, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.780975892849137, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2c191831b6364d1e767cc5d09eea977c8660f6ea5a92d67f444a166238531040" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03176626498735619, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.904982953746734, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e24a8ec7a04674ee0946347d4ea92f9df397710bc4289bfcfd60da005cc01043" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.034512073019201735, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 8.959601584776959, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0eff9855feec166e2e2eb6d234cdbb12397a32c943faf52a7b60ba947490d408" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-061", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "llamacpp", + "quant": "Q4_K_M", + "bytes": 10540747840, + "sha256": "33b0598c3700e15456e4789608cd7396445201a881d97e14df17b48beda29492", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.12046880669483287, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.858271291194107, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.1541783067738174, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 10.05940360966547, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9994156331e9f89533c985a7b26ac32e65654cd6afda0c64f40020bee7efe4e5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.10930876374905518, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 16.94323934570245, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6b4f4eaf2e936b4cd582ceaf7ef5d7de5b72d44bf987b860ded75cadafbefde0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09791934956162603, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.473234123208863, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "08eb9c51392bfcee5d489cfc79adfe71fae53220da28fbcba9fd4d58573d8fe8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-062", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 10540748320, + "sha256": "597373061abb3d5e125c6d8b976eedb1059bb2c4e91a5509d5cc8d8d66767ca2", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.12046880669483287, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.858271291194107, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.1541783067738174, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 10.05940360966547, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9994156331e9f89533c985a7b26ac32e65654cd6afda0c64f40020bee7efe4e5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.10930876374905518, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 16.94323934570245, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6b4f4eaf2e936b4cd582ceaf7ef5d7de5b72d44bf987b860ded75cadafbefde0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09791934956162603, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.473234123208863, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "08eb9c51392bfcee5d489cfc79adfe71fae53220da28fbcba9fd4d58573d8fe8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-063", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 10540748576, + "sha256": "8bfff5f8d6b391e3ed3c6d548760d6917cd3e17f246af8ada800b6d485d569bc", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10719487744779078, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.360339181372288, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.13706825205236764, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 8.782103471879436, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6a109e70f47b5df01606912bdffb6073dc1f61d59aac7e6de237be75dae68957" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.0988141334705884, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.253152410601295, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2ceb04a39a4214f56f6d0ecafe70fc3a3720e7d366bf7f24aff7df36e34dc7b1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.08570224682041633, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.463044818658016, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "11de826b17a732774ee7b42210e369ee7fb1e5e7d4ee15e62aef4d6a207350d8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-064", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 3013027808, + "sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.015831967668737276, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.14830958896456, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01629709280218687, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.087289251834771, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "326646da7b3c90fbbc907dfe94dcde8fece6a375daac47a90824f73d5f21df41" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014534614315447935, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.844151471833001, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5e93960c1afc7c318908c0c1e3bd58ea122ad5895335354a3b0ab24281dba4cb" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.016664195888577024, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.028182669445815, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fd90b408ad0a97576b188e435ebbc90620461c8b40111b2a191ce62d6c291534" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-065", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "Q4_K_M", + "bytes": 2740937888, + "sha256": "00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01833788689902362, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.142159220492545, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.020179507653283864, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.096758699650941, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ef5ed2c67d2a191352f5d57fb412e5ad51b3729b70ffe6d72254790a5d8ded32" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.018415715016924558, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.740546759510513, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "14c1ef50afd9357bb0ea020f8c45785d594fead54de46a6d4d0e74d4b447ab26" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.016418438026862443, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.089425412352565, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9db8cdfaf622ce9a766b48e1b5492cb051816d39ce5f62dde2e76f07f5642548" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-066", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 22285080192, + "sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.014812772117661247, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.269394184937695, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.011213701742287176, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.01809997122231, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6a9ff7f8c760d64e7a4eb9987c20d15c5a7935b501eda8ba8f02b52cfacb3dd4" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.016574646702295415, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.334132257025886, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "71d8d178313c29a83790afd8431fb2e330462229c476005288cf1ebdc423f5a2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.016649967908401155, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.748760269524338, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c7bbcc459b5f12f36cc4cf1e34bb6a808eb69141c4b87341c2949e04bf98772e" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-096", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 6166578304, + "sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.013864166723531413, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.3657652244774665, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.0149957760161005, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.511439504946498, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "50e210d22ec6e0b02c05603f3e0d679a1bc6936dceb3ea7bdedbc45c9fb123b1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014658740021952646, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.79336204649421, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6e9b41d9c1a6396288c49535f7bd7cb0d89ce9d5aa50f58cb6c785588ba23e5c" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01193798413254109, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.044960363411752, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ce49240579f0f086edbe027b60a3788692428a6b3193c89d4669bcac742b8768" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-097", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "Q4_K_M", + "bytes": 6166578784, + "sha256": "4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.0147697689796967, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.433224558075201, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01942318991680067, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.608244420279362, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cb9f73aa54d89189f8380323ea87e479a429d82f3238c1fa51d1bce67a2d21fb" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.013709148441148946, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.762621811113018, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5113d9c27283cb66d5978e1701def0e0828b93e1b3a3daca53815f459124fbfd" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.011176968581140482, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.1291383240247, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4c59ca6127dd06a5f255f0a5c37bd888b5edd8f0aa0bfa380a863083a2b158c7" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-098", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 18632180640, + "sha256": "c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.014023801192911987, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.421016784728394, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.011564675226359074, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.058971408511723, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6828a51c33af6fa444a3d62bfe773854a7e0e5a0fef4dbcbf273d326c66574fd" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01692558388352368, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.862245917692091, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "64f381802b6c7ca7ee5fa2a45188cd4c69947fa26e7bc5cb2cb6a31077acc323" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.013581144468853203, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 9.993528797320044, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2c0cae872289a675c10f48bebb282d0e150cba2b886f1eadad9084ce6e3072fc" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-099", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 18556683552, + "sha256": "497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.022191786791121187, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.431689833167503, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01809823146539647, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.053181463072436, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8364ee2af1605cd82a1f200df281d96f07d899400d6af5d5afa90f6504b05d0a" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.025189708871510126, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.911448583449362, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f0d59603a0d11456752a403d5a392643376911f4b913dec5897d22860cb13df5" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.023287420036456966, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 9.991323964240499, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0578a78a1404390675538d4d2c2fa6be69426c9d1e6db75eeac0a5b6eebbffe7" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-100", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 18556683808, + "sha256": "97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01858996156262543, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.610812256916446, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.016023484152871144, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.1144196414458465, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "002f48a7bb71dbc48155abe86f2e7c06a501238ad3d4d59dd41066a51fa3cbf4" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.020056610534258796, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.2105169953052, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0ce1a50e655e2f8da7b64cc6b979202854572f35d651c506a6819ee2f0f31da1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.019689790000746357, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.226555668598044, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cf35a3aa3941caae37ea0b6b617ba712db11cd30d4fcd6a00c033da7259f2900" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-112", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 17306324000, + "sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.008849923204210578, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.860374745196291, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.007822461206338479, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.817830941426459, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d840b50c0646136eed298c9d0467dfd0579b2a26d256b86e3359fab32f237f70" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.009928459800939177, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.157253690400037, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "84685d9178e74f7a5aa9ffb1261cc56e0cbf17b0f35312a8e657c376058ec169" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.008798848605354079, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.36771036482382, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ff2094efafefe48da41d1a3eb4a9e5d38d371b2f283251faa7c1bb982d06e71f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-067", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 18195655008, + "sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.6756041727003326, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 4489.873239674906, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.637118064890597, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3153.518994005527, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "312ce455171be90606c3f163c2de3d85e7de782d36789bf835bf8f6ec8ae8f3e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.572453897975727, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 9127.011906130489, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7825dbfcced393e504d19451813bf050dad7caeed906567b303fb8a60a006dec" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.8172405552346735, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3144.6924042799283, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2ab9e1f331593d019956840fccf645bd3b669ae466d7e1b070ba4e668d50e18d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-068", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "Q4_K_S", + "bytes": 17399835584, + "sha256": "41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.7689629351548548, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 7004.109622454445, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.7568346102687087, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 5300.3132809151575, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ab0541c1965d3227bdc1d6c3ed7d401c25d8657ac4e098d3ba3d5b9e0c3c09fe" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.6979454491944839, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 12321.585391366641, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "21f02170d79e7ef76a0a38cfec569863b6c74105489d576572e15578f16b3823" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.8521087460013717, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 5261.271010388279, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0803a6c469f585c6738a4eebd67589c5a7b3375ed92477846987d0f79906458d" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-069", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_S.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 5235657184, + "sha256": "81508a92a401ccd81292b0da59f43af7360b7b2215a67bc7901830d58bfdf260", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.12331414187791713, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 50.230273483794136, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.09353422899947295, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 32.48553681541135, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2bec25633245b470c0abdb7404cfc7dc70c979a660d102cbcaf60663bd9720de" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.13331240370895028, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 78.52484472503465, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "19a9e4366016a89afce99f171981be1ad138c44524a2200f2466bef1b105e0d6" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.14309579292532817, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 49.68204846092225, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f1c955f45610874c8085d0a32a0bad1ba9881b109aa15ba9b1f1c5a86bd5c861" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-070", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "Q4_K_S", + "bytes": 4844850304, + "sha256": "0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.11758471833069156, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 50.905917230232056, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.10933830564132449, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 33.8384879984229, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "38fbaa7ab7c01c5bdc9484807887f34bea4b39cba544c5a1e15c7d90455d5a5f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.11571654231911675, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 88.16383138688452, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f353046123628732f4116b1461be952dce89f489f1e7106e80f6b1a1a7f7e8a0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.12769930703163346, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 44.218437929543676, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "95fc67345d30594178ec15b18be6b0cb6f07d4f1fdcd66b3ae21078e6e7af18a" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-071", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "Q4_K_S", + "bytes": 9713880192, + "sha256": "bb2f63e9b13a0d561e19890a6c5611cd8b27c0a406b596ebd33fab9cf88187f1", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04110306793067305, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.429872616859555, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04507611357715659, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.834302764067871, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "958c5bc0445ba29536e0746c9d7af9311e40b5d4d9ac64b4c0d49aa48d6edde8" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04146214554637874, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.171417784106705, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1477d3a25c948d135e25ed5f960ceca074fb7791b9d6022238689340f95182a8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03677094466848383, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.250682609960176, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cf8f01aa151a21b0071558abcb708a5b42cc288da4383438dfb13766a8a4765a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-072", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 9713880608, + "sha256": "3363ac782c25fe60d0d27061285d9eddfff1af087650756cfde183296343f22f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04110306793067305, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.429872616859555, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04507611357715659, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.834302764067871, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "958c5bc0445ba29536e0746c9d7af9311e40b5d4d9ac64b4c0d49aa48d6edde8" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04146214554637874, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.171417784106705, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1477d3a25c948d135e25ed5f960ceca074fb7791b9d6022238689340f95182a8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03677094466848383, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.250682609960176, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cf8f01aa151a21b0071558abcb708a5b42cc288da4383438dfb13766a8a4765a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-073", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "llamacpp", + "quant": "Q4_K_S", + "bytes": 9713880128, + "sha256": "a709f9add5d63f4dfd5f9dbc418a1a862331c2247363417c3a56549672bd7540", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.14867650673862526, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 13.1900782500094, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.21536631866996792, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 10.766118630505284, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5a48d308f6259486c03b6993377fc20aa54cc14ceccf3220ab81227e29b8fb17" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.12046729067195544, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.047350387164236, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "94c94d3c1e48ad195a2760474a5361c949c492cdabc9436dc1b59f2c442e584b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1101959108739524, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.503340761200455, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "29a26ee6baec44fa320debf765666e0a89994c70b39733a5891cdab946393bc2" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-074", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 9713880608, + "sha256": "562745f30cd79c89dc247ad41ccdcd40e78e6d549493e9609ff5bf19aa0fa885", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.14867650673862526, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 13.1900782500094, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.21536631866996792, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 10.766118630505284, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5a48d308f6259486c03b6993377fc20aa54cc14ceccf3220ab81227e29b8fb17" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.12046729067195544, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.047350387164236, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "94c94d3c1e48ad195a2760474a5361c949c492cdabc9436dc1b59f2c442e584b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1101959108739524, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.503340761200455, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "29a26ee6baec44fa320debf765666e0a89994c70b39733a5891cdab946393bc2" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-075", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 9713880864, + "sha256": "3d4efede5cbe05496dc71648a230529c03ab8ae7b68b5bd5006f4551e3b84785", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10698238505105989, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.36973048432152, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.13128554689736155, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 8.789190176888694, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ec701680c8a8b454cfda488e61e92e916c481b7cea4b2334263e92779979617e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.1027536091933072, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.099107653243728, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0b31d19abbac6518c8b2011164cf04ad8e7ef5e62d15ecae7aa34fb19f23f5a1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.08690799906251093, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.593846723875805, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "bc814f0e17462b8c415d1abff401200a9533854affe7cc6ff5431664e0825ef8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-076", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 2846156768, + "sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.019304276224305368, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.278649044706267, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019864193024445472, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.108591452726072, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9327d1817fd55fea1286d82f78d09a82df5f7d711e797718b9ccd6006e86d7fd" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.018546304460598514, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 10.002353570476535, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e80a06743dbebba6d0d37bea9cff4c5827b2761ec36eeaacd4ec5ec5243ed0be" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.019502331187872115, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.286138005978925, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "578aaea5054be016a8eba3985a014439ac9838f576fe44e223f5854c1afbcaad" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-077", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "Q4_K_S", + "bytes": 2590430368, + "sha256": "27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.021411568882693577, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.162794399790577, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.021480590065224462, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.073702731465697, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "abeffb05feaf1784f0c9025b0a6104970fb118e89cf0714f39185b0044ba3bcf" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.020948189767224512, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.790801428217659, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "39c3b0ece46b8da37d301c4d96b6fba627c47194c7a5c1d75e12dc4ea22b2344" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.021805926815631763, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.146286450765157, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7ef0ed840bd53fc4b92ef817296b233444afce4ba796b761df1b10dc65226440" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-078", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 21486360192, + "sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01656458031940529, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.311338564047296, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.014083104957789966, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.078280338184241, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "90091bd0d2fdbd4b8f9c7cf3056c0459e61134d37e3fa492e1732208396de96a" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.018483469562554592, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.378692798261548, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "545752a321efdbc43ef3b0a8c11e6bd5a5e26237288729246c31f4f0e7a69ade" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01712716643787131, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.75974418673584, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "189280212003a5ab0654141229b741f2e994c90c9d6f79bb7e3b25895328b3b4" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-101", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 5758485632, + "sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.015079471697119035, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.394570006089792, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.016860166597138786, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.541665636568304, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e168ccaa140ec81c7d66d48204b61dfe30f1a6d7c74412b25e918b76bed97312" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014672235710758305, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.781065408292344, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c5ae52f4152438db7bb52c835607d3ef95b8d968b7ea07316a0bf94fb4f48fa4" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.013706012783460014, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.102013047405416, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "52d7908a1ec6f31ec5c0740cc383c79b6498304692ed4458a1354ff57757bc43" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-102", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "Q4_K_S", + "bytes": 5758486112, + "sha256": "258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.016620197272167615, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.449245025048584, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02124540006162025, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.605778663716155, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1e726ed4a8ed69d2192eda8b29eab2eaa318a32201c78f5f5e8388e174544cb3" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01562373113073965, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.806335574766381, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5790cbd6cbe7fa42bc2159ecc66a35dc2baffa3d750a2575709f6be6920509b0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.012991460624142942, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.152230816519202, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ecf2b3604da44c954e7887b4b7f8ebf5aad64df8ee36ff260141635b8075fcf4" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-103", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 17984488352, + "sha256": "a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018414136229848915, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.514265631895391, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.017550281527837615, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.097095523242564, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "91bbfdb6b7780548b9217e201caaf5ebedd6699a7875569abea275caf88d2db6" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01875196904878548, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.012690271775817, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0920681ec96ff4f95af62a65f68ca3e08ad53ef3c0f67b4a96c38d4876adbb5b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.018940158112923645, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.110387587461721, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "282fa068ccaf6a9c212fa5230bbdf7bfed1c60111857dde5950b0005b4c166c8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-104", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 17456006432, + "sha256": "adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.029707883974638697, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.491423178521313, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.024968826200358764, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.944948937666706, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1cb5561985fac512a6c8465ded624f742b4572da3f5a92b5498d0ea3306f40ff" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.033949248667574344, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.038813737270969, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e2d509c0e060b1bf0ea79f84dc6de06d8846209b05cd80d8a2ec163dd97c9d24" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03020557705598299, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.259139369954868, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0e9af67613bbb8d49a0e5988c7bcd1735b0ca8a03fc635128db74087b67ac35a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-105", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 17456006688, + "sha256": "30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.022032634280481918, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.619069578972605, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.018576335158255592, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.0761259360995705, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "efe0c715385cbfa808181c270ba6c5013e5125b387de6d3c64734838927de526" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.024546924276760633, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.139911147541968, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ae018d7b0607becab9ffbe56dbf995a551e165ed2f7413f00f636314595d11c8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.022974643406429525, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.392505041389839, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d30cf5f7d3e61f9d4f27ad0a04da668ca17786376310dbbb6304610466325355" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-113", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 16320943136, + "sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.012613234486114861, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.8356960737813806, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.011791560856768763, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.8318364617695204, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a912b24555635193978c0fe5bc3f196fb22f8a432eadf0dff3ae91edc6256bf5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.013597322522982009, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.145975021348615, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f88c6d8f6bd63b77586246c322a3d532e68d64dc4e45cd963c23a9b745da2d61" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01245082007859381, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.23288740343954, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e80eb6321787d56c92e7d6d0877cf2cd1bba0b64b444ad5ac5d0dc93f70c66e1" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-01", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q3_K_XL", + "bytes": 17151936864, + "sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.556931254935717, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 1956.9190003015756, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.3294554131799732, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 2235.8443120766424, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dc80f7496250bd7e689325086fd1b0739bd9f8ab3942b29d0437ab2b3a0529fa" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 1.386536583706327, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 4493.028353143813, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "32601cbedad48198607d7ef927cc9b665964e228881b459d36af638efe2c6af0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.9548017679208514, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 745.998289189889, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e961f7b12ed7f5711ec1e2e24a3c65beb6912482ae6ef94430224a1b00c6d938" + } + ] + }, + "notes": [], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.2380262589156958, + "PPL_reference": 12964.851857612222, + "PPL_candidate": 5500.726893369814, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 1.0680028441942875, + "PPL_reference": 41368.00589307904, + "PPL_candidate": 14167.418890093528, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c6f61ccc0b0d1b3269b1398bc38cb85b9ed87b4c45216ffb4cf0ee623053e29c" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 1.581600938922496, + "PPL_reference": 11468.295417470643, + "PPL_candidate": 4368.196932205284, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "385fc8ca9c0b7c555a87cbd8c0141c3a967bdf59adb76854a022c2e9f494046a" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 1.0644749936303044, + "PPL_reference": 4593.452373266919, + "PPL_candidate": 2689.4737195815364, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c1d6be58fd18272de5e834f3acd5107cf5c1b171a02c056ddb1eadf5fb7d2350" + } + ] + }, + "additional_windows_vocabulary_policy": "allow-vocab-attr-mismatch" + }, + { + "candidate_id": "supplemental-six-02", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q3_K_XL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q3_K_XL", + "bytes": 5879378400, + "sha256": "00c50656f4b16b98ff9e07199e3c9fb5e776c159a62aaae9f56628b375f689f7", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.6462462495902597, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 63.492111943057054, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.6920195699779488, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 38.39764727181369, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "eaa37961184243836509ea85cd5c8938777e111b1954e9eecb9fda8e419c4bb7" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.6866417619076802, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 122.46719335957047, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "869d7aa3453d7766e3b4dae43a6ff74e1aec5bec95ac154cd11e88e8d5e8480a" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.56007741688515, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 54.429574600330696, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9fd52b10f79f9aeacdf0204ee13e667304754bf40d82d516b986304313ed69ad" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-03", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "BF16", + "bytes": 8424393632, + "sha256": "9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 3.4151522153303226e-05, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.061376191627067, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 2.1333844481679207e-05, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 5.982542639370995, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4036b1180f293cb7dd0b34fe207fc1beef88f78f71c4543a805d3dbe83b65ca4" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 3.905387228962049e-05, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.641591050645125, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "afe24243e40dec81d3e337ea042e4568c9adef093ae0a8dc5351522821f260d1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 4.2066849688609965e-05, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.082241706232573, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b83ebeac735084602d6be36f022cf77c87d514c71c202d0a2aad7937c3b08011" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-04", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_K_L", + "bytes": 22662526592, + "sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.013140147194950992, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.322122377600644, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.00828490790666367, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.038973741526068, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "81fefb34605db9cd4e318d680d9c93f68e298c696639cc676eeadae5cdbad523" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014749622123870758, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.376088010361812, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5d70fa89889358d8cc3354ade28a6dacb66ebdd4c95fcbaf5d6280447f08170b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01638591155431855, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.853683497364457, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f42eea5bafa5d27b9b9f88f764b24af4740cb22a97005ef9ce432f6858124b5c" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-05", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q3_K_XL", + "bytes": 14855269280, + "sha256": "c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.043466665554567525, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.545446257163075, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.03463611797283678, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.153643225428043, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d6dcc0e6750f5378609508f471dae8c63c8eb0225f58c38a3e266e792d30ac93" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.049050982141546, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.25965131659381, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c8db3e0ec1b14f3f4246b83973994e5116496836a20600a3c220d0dad6c67a38" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.0467128965493198, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 9.884149994192821, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dbea51a09dca1019c8bacf8368c2fe19bc6a4262d8fa4d9c15a9b54f85485b0a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-06", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q3_K_XL", + "bytes": 5739775104, + "sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04094394224654512, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.4858822204197635, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04655583102681775, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.5345676946859665, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "df0ff1b6e33f730c69401eb1430f523494bdb1f33d5537421fc954ea4f7454d3" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04715221007519693, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 10.082264129881423, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ac49a3668c59053ad17b72dfcce955b44fcd4253f19b7c7e0e346218dcbc6093" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.029123785637620685, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.175611333295652, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "939cc2bb6947db14e2c4bc9f20a20a9a2aab487359b6f0a36e52a15b906888b3" + } + ] + }, + "notes": [] + } + ], + "runtime": { + "CUDA": "13.2.51", + "GPU": "NVIDIA RTX PRO 6000", + "upstream_base": "6a1a922d269908a29cbd4b49c27e6a8e7fd10fae", + "ctx": 512, + "batch": 512, + "ubatch": 512, + "tf_chunk": 512, + "n_seq": 1, + "threads": 8, + "metric_threads": 8, + "flash_attention": true, + "all_layers_on_GPU": true, + "KV": "f16", + "MTP": false, + "decode_shape": "prefill257 + TF254, 255 target metrics per window; not the matched full512 PPL bridge" + }, + "limitations": [ + "Sparse operational/numerical qualification, not full-corpus or all-image quality certification.", + "A fixed KLD threshold is a screening flag, not automatic proof of unusability.", + "The original 113 had two capped short text/image operations; the supplemental six have structural, full-file SHA, full-corpus tokenizer and sparse numerical checks.", + "Projectors, draft heads, split reference shards and original source tensors are auxiliary artifacts, not standalone candidate entries.", + "Gemma vocabulary/template compatibility is limited to the audited no-tool benchmark prompts." + ], + "removed_files": 3, + "removed_bytes": 55271904160 +} diff --git a/backup_metadata/manifest.json b/backup_metadata/manifest.json new file mode 100644 index 0000000000000000000000000000000000000000..6f90c5ee2918421830ef95cf46e76eb8b1f54d61 --- /dev/null +++ b/backup_metadata/manifest.json @@ -0,0 +1,11116 @@ +{ + "repository": "elichen-skymizer/GAP-models", + "private": false, + "created_utc": "2026-09-07T01:59:38.527315+00:00", + "files": [ + { + "relative_path": "DECODING_PARAMS.md", + "size": 14732, + "sha256": "aee47727c2d3049491c1bf049cd2f6e1963badd3a8947ab3f9b711a0ad56d3ba", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/BPW.csv", + "size": 20550, + "sha256": "442d560a29da5e7a001c431decba3eb1560641c179df00d4b4f63e63fb90d771", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/BPW.json", + "size": 78688, + "sha256": "f8c9f0c783ec3602c3eaa9eced3112c8947c5e28649daf39f92066339e6f72d1", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/REPORT.md", + "size": 16021, + "sha256": "d9a33df7b3a2ba695d76b4ad7af1d88e91f00948c0da99c57628f19fbac9942a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/REVIEW.md", + "size": 905, + "sha256": "8fd785fa418595252201c14864610fc0a637450b97f63e3785efdffee9b5426d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/build_report.py", + "size": 7628, + "sha256": "3041c5285ebc9780047fecdcbd0c42058343d985c0c5223def206b849e2b145c", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/README.md", + "size": 2303, + "sha256": "1077851bce21123b81e51b32f29c0bd87dfe68969d7f87a32288341ad4d3f4f4", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/check_scan.py", + "size": 2649, + "sha256": "26d912662d89bbf455a20a0768a8a3d4a75647f00c3dfa36e67b171c281157d6", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/checks.log", + "size": 184, + "sha256": "90c542af66fd62fc0256a1fbf28a804b87ba862fc416a0663fd99b835e435643", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/excluded.json", + "size": 5464, + "sha256": "59b9c7eed8c4e8bf1eb6f9a213c0842dfb3266427bb43751b0bff7fea3fe12ad", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/file-matches.json", + "size": 107840, + "sha256": "115d3901137c47c45be45b7ef3d0d32a2612ad0612cd722e547f92a25ac8c71f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/hf-bpw-estimates.csv", + "size": 25748, + "sha256": "94b22dd3275ed0419813e4ee2a0175810e52ef9d23c925bd2aecb89b7c94065f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/hf-bpw-estimates.json", + "size": 174445, + "sha256": "a61c38b1f34d45e08092599c4b01f2d4cb0028c278820acca2872e6c13cb8a9c", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/inventory.json", + "size": 29678, + "sha256": "8bb0baf3a3a77e530267ba9d2cfc1a407ee25cd4f4e6dd2cecd51e9e9d504467", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF.json", + "size": 20652, + "sha256": "ae60863468409f106b304ceb2d589f6b44de7edbb7246f421e562481ca303e0a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__Jackrong_Qwen3.5-4B-Neo-GGUF.json", + "size": 11265, + "sha256": "2ca179ac064f55f5515d3fb31b04494f6c40963bf4c72bb0781eef2fec83349e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__Muse-Glimmer-30B-GGUF.json", + "size": 15796, + "sha256": "a5481c82b52b86820a7232f693870f7d4d0b3113a64ce966cd283c7539000903", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__OpenGVLab_InternVL3_5-30B-A3B-GGUF.json", + "size": 8953, + "sha256": "abfa609b0e6c5eb72ccace1e1abdd2f0bc93eff8c36bc2cd123a255b053b41ab", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.5-4B-GGUF.json", + "size": 14825, + "sha256": "0e9a473a6fcdf7cbb0622bc3bba1f4b145f7920490ca8304faefd96b8e83b679", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.6-35B-A3B-GGUF.json", + "size": 16922, + "sha256": "691d71c633f61e1d91255aea040f9daf76b3d5f21ec2a5842fc1583f55c08348", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__ReadyArt_gemma-4-31B-it-scotoma-2-GGUF.json", + "size": 27759, + "sha256": "92042d305ec2e16c8eea1cbd85cb1083fecfa68bb6715436a6e079b294da97ee", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF.json", + "size": 19041, + "sha256": "65704a6c2cdf929e846773aab2a8363b509e2004e367bb9cfc1db9519a8676d4", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__allura-org_Qwen3.6-35B-A3B-Anko-GGUF.json", + "size": 16594, + "sha256": "297066582c0d5723809fbb3d4b084fd914ea0589728e31a8d77d9f37e620822d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__darkc0de_Muse-Glimmer-30B-heretic-GGUF.json", + "size": 15930, + "sha256": "e2347d20305c8309d46f558b0761a7b2d09e14e4868f1cce02f85e9353d69ef2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__google_gemma-3n-E4B-it-GGUF.json", + "size": 7363, + "sha256": "ab42eff98a2ed33d98826fc056b158e33ba5921ba83db89c48c6f86c15653022", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__google_gemma-4-31B-it-GGUF.json", + "size": 28048, + "sha256": "bbdc3f8de36e6b5fe7b78f02ca6756f77bb8e78062f7f6448340be6aa62cbc7b", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__google_gemma-4-E4B-it-GGUF.json", + "size": 25770, + "sha256": "6835928c30b5c3155a4daa99fb9a4ce9f5fed325becf79f6903a47ca89cfdbba", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF.json", + "size": 8039, + "sha256": "4887670f9022da02654f3f76eec99ebfcf516bb84529d215c12b09df02613343", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/bartowski__zai-org_GLM-4.6V-Flash-GGUF.json", + "size": 12074, + "sha256": "c5c917494d5ce8e1049c51f246ac08da30bbba231db2e6b22842b24509a82e86", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/ggml-org__Kimi-VL-A3B-Thinking-2506-GGUF.json", + "size": 3121, + "sha256": "cb6f7f4f49ea02351bdd5cd15a5e1704a873673bc93e20fd10407a36b160bcaf", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF.json", + "size": 7805, + "sha256": "3500efd7576084b5d2980569976157b96263e186e5c15558a6711b4e31a425a6", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF.json", + "size": 11526, + "sha256": "dd1223aaecd16cf1b18a81040ecd4c638dff27242ea675de3734f8ae34616f8b", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-GGUF.json", + "size": 4075, + "sha256": "4f8a61f81deba1d1c013b1eb88a0c4e4f25bd4f28ee4caeacc9d970b26684086", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-i1-GGUF.json", + "size": 6887, + "sha256": "87eb08d054963fe5d2e36997538d8f43379a5b72f493a57af48f34b09ab6e0ec", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__GLM-4.6V-Flash-GGUF.json", + "size": 12191, + "sha256": "804c2446f87f81dcadf83dbf81d4ac16ab2141794f97e094cb5c8539f9ce7803", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-GGUF.json", + "size": 14282, + "sha256": "2a48c5d3807e2c08aa172b38aedb85338a1652126bc12029b0214301915c4846", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-MTP-GGUF.json", + "size": 14237, + "sha256": "5c402e96a7ee07c79ca857047648fc4e8b23494261c4c3b370c87e1f1b9263b4", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-GGUF.json", + "size": 15580, + "sha256": "ffc0a7858244d6d7ea3369823d1cbf48adaf0dc7d4f43051bc854b5032699388", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-MTP-GGUF.json", + "size": 15103, + "sha256": "f3dd9452e1b758c89b29ac19a9efcd538ddd3e6c2ab332ef47e30c5f37cf28a7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-GGUF.json", + "size": 7855, + "sha256": "57980ddf4afe2a3c4ae343f9fd469913d001727aa9eb9e1c45dbdae35439d051", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-litert-preview-GGUF.json", + "size": 8245, + "sha256": "0e627f70f3f4583e68a5a0a45ba14247a90676c57dc5ec1d0bb947ffc1133448", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-GGUF.json", + "size": 27012, + "sha256": "07ea1b10bf0a98f6232ccc1d10732049c32b2487fa44256d399ae686e6de697a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-qat-GGUF.json", + "size": 21919, + "sha256": "d9db6b1164b0eff3ee5e616dea87894092e2ad5f944ad880300e11dd40580b37", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-GGUF.json", + "size": 26280, + "sha256": "7f2184cf0a9620e6355a2b4fe1b3a1c977d888746822cb2872fba986b4b6fecd", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-qat-GGUF.json", + "size": 22036, + "sha256": "d1070ee62a98848127e13bc54e96759fd71e55db186946bc36784d68f69a21be", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-qat-mobile-GGUF.json", + "size": 21806, + "sha256": "89d010b467b4d3ea0e99011b39cd0fc8fecb6f20283267695ae3baf70588a147", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/repository-discovery.json", + "size": 3291, + "sha256": "c4e3d1e0677150d35722bc1c086ef5600debe0e578395201c2fb596e0e9498c1", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/scan.log", + "size": 8728, + "sha256": "55ab641973192bc9ad92268e6134878246a350c6ade9a9b9c8dd8d614e36592b", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/scan_hf.py", + "size": 11477, + "sha256": "d1a71c525e9cd169f6f7ddf862881cc6c003dc572124eb4808e51a9968ec1e4f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/hf/summary.json", + "size": 3058, + "sha256": "0797ac9440cae2cb03cf19bf1dd34e90c84c229a5870c0c694d815ed21e36d4a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/main-tensor-shape-validation.json", + "size": 4653, + "sha256": "8760508d3cee162ec48e21128afe94bf0359619b690e1651f40b31fde22ea090", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/model-removals-20260906.json", + "size": 3702, + "sha256": "553cf7d5d9e9d3ea565e3c747ca8daf34861e8472e79a38ec08f9da8400be0d4", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/model-removals-q3-k-s-20260906.json", + "size": 455, + "sha256": "3ac40c5526e9ac6c71072f11d9dc3e0c16a9d23b22ce270b64c2837c2cb987e7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/native-bpw.csv", + "size": 15351, + "sha256": "8e74ddeebf450c4c351bc172d9c8bf31b0b1adbd4ca9a7c5e1fc3f2a99bcd402", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/native-bpw.json", + "size": 10933710, + "sha256": "0c2ee9efd2cf21c9d890b7ac47017c7d0f6128112f7356c173de20e68afc0be2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/native-scan.log", + "size": 5079, + "sha256": "51625e55bff23efa01a107a88b4d953af61ef370865618e2f4f1a44a5da74421", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/refresh-validation.json", + "size": 780, + "sha256": "65ca0470ca28854caa47c2c479dbf06fbe90538bfddda391d7f1a7a6534b4530", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/refresh-validation.log", + "size": 628, + "sha256": "f85544114bb26a20b8242eee51c3a33ccb41263a749deff2f3e1472ffb9eceb4", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/report-validation.json", + "size": 426, + "sha256": "582b4cecece7458c4d9566eba8d19e184f06b8f736cc7cc6fc09dcc9e05716bb", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/scan_native_bpw.py", + "size": 11991, + "sha256": "935b10b1bed14e5e60a00c09009637fa73b1a7d66fb5a5bf8f5d6aba24675218", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/validate_native_bpw.py", + "size": 4754, + "sha256": "84b8cc5fc87fd0d71eadaaf5ee8f05b2d3a109a7508c228025adb6c14bd32ee8", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/validate_refresh.py", + "size": 4403, + "sha256": "d7ca1cf55a2dc5fbbe3386a4467984e1f30ef15a2fc0a9b14533c314a9a74788", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/validation.json", + "size": 2911, + "sha256": "279e6b73fa5ff7c02169649bcc4863cf2ccdd668979a417902c99bbe1ff31802", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "bpw/validation.log", + "size": 962, + "sha256": "298ad89cbb3f2b877e19c6088a392bdf5b04386adfe8d449bf2c1d4e4762bf4b", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "size": 39996137216, + "sha256": "00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "size": 21417052704, + "sha256": "ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "size": 17155893600, + "sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "google_gemma-4-31B-it-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "size": 17151936864, + "sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_0.gguf", + "size": 18076264800, + "sha256": "4591e5ee10527739514d6db436b51169c882949e3858d30285aa997b0b253554", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "google_gemma-4-31B-it-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_1.gguf", + "size": 19765274976, + "sha256": "567d744757d575d84c0a42278091223aa2351cdae8f375d4962eec44272659be", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "google_gemma-4-31B-it-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "size": 19598489952, + "sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "google_gemma-4-31B-it-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "size": 18195655008, + "sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "google_gemma-4-31B-it-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf", + "size": 1200726208, + "sha256": "21487ff26d08f7ddd1d654d3bbfc1ae1020aab3119f5bf654742ce4697732e4e", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "mmproj-google_gemma-4-31B-it-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf", + "size": 514705920, + "sha256": "743b2b719e448f9a06e774b4f33dd7a391a73e94d32297c7590256484562eb52", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "revision": "619aca7589c72be65dd968de8602ad23d68b5c14", + "filename": "mtp-google_gemma-4-31B-it-Q8_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/integrity-check-20260906.json", + "size": 219913, + "sha256": "75afa3b3ce99d8b85c27f85cf29f9e1171814211435c7eac4a387c5b36a68629", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "gemma-4-31b-it/integrity-check-20260906.md", + "size": 8613, + "sha256": "3ad569528558f3915d907ead645aff66193c5a255d38a948ac313ca3654411e4", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "size": 17287670720, + "sha256": "811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "gemma-4-31B-it-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_XS.gguf", + "size": 16372460480, + "sha256": "e3d40b6e363954c993a6e28b160d881dfe5a243b62746bd4092b393d4f1d54e5", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "gemma-4-31B-it-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_0.gguf", + "size": 17338248128, + "sha256": "5c558b9b009e3ee69bde43e2b98a45d1f5afd316b9fbf447edd2ad4945a187bc", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "gemma-4-31B-it-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "size": 19118091200, + "sha256": "4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "gemma-4-31B-it-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "size": 18323733440, + "sha256": "38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "gemma-4-31B-it-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "size": 17399835584, + "sha256": "41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "gemma-4-31B-it-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "size": 15380222912, + "sha256": "73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "size": 18822970304, + "sha256": "9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-31b-it/unsloth/mmproj-BF16.gguf", + "size": 1200726496, + "sha256": "7a4601b12ec680f706a7e0c7e1f78f579b1db64d485a9e352ee87d4b9daa45e4", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "revision": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "filename": "mmproj-BF16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_NL.gguf", + "size": 5232226784, + "sha256": "b56f70624694ca5f2362cdafe6acffe35c5e0f44693c568f3f09fa83b968fb74", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "google_gemma-4-E4B-it-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_XS.gguf", + "size": 5112828384, + "sha256": "a24429604e6f680e7bdf087b863a6cecc90f80b3d908f95d888f4f05003fdee3", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "google_gemma-4-E4B-it-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q3_K_XL.gguf", + "size": 5879378400, + "sha256": "00c50656f4b16b98ff9e07199e3c9fb5e776c159a62aaae9f56628b375f689f7", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "google_gemma-4-E4B-it-Q3_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "size": 5223860704, + "sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "google_gemma-4-E4B-it-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "size": 5458479584, + "sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "google_gemma-4-E4B-it-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "size": 5405170144, + "sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_S.gguf", + "size": 5235657184, + "sha256": "81508a92a401ccd81292b0da59f43af7360b7b2215a67bc7901830d58bfdf260", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "google_gemma-4-E4B-it-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf", + "size": 15053097184, + "sha256": "af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "google_gemma-4-E4B-it-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf", + "size": 991552000, + "sha256": "ffa64aebf7144bbadd5a1e143b77794d88e76a81cc0168d91de0770eb49e88e0", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "revision": "029e94146666900b08caf49a3b47b413dfa8ec66", + "filename": "mmproj-google_gemma-4-E4B-it-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "size": 4835839104, + "sha256": "fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "gemma-4-E4B-it-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_XS.gguf", + "size": 4715416704, + "sha256": "0847f7300471e9a61abaeb46b45b3d61e393af8fa6d6aa70c563623773670dd9", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "gemma-4-E4B-it-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_0.gguf", + "size": 4836002944, + "sha256": "4a403d2e4d80281063e4f517b1c061ded8476b4011a4fc2ba7dbff707075547e", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "gemma-4-E4B-it-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_1.gguf", + "size": 5074390144, + "sha256": "430685a687edf70c4fdb1158aa92c34dbb38e1230f674849f198a954cc748405", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "gemma-4-E4B-it-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "size": 4977171584, + "sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "gemma-4-E4B-it-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "size": 4844850304, + "sha256": "0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "gemma-4-E4B-it-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q3_K_XL.gguf", + "size": 4588440704, + "sha256": "7558880ee42b79ab732481bd7250e85c41d9ef044b22634b8a912eb184224009", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "gemma-4-E4B-it-UD-Q3_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q4_K_XL.gguf", + "size": 5126306944, + "sha256": "3cf61de12daa015ee0f7b68e7b7c541405bf220e1e942bad8b47cab827d7df80", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "gemma-4-E4B-it-UD-Q4_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "gemma-4-e4b-it/unsloth/mmproj-BF16.gguf", + "size": 991552320, + "sha256": "ee01cba03fd9c71ea2ea722225d24a84f72e7197714367e550ef705ef8851bc6", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "revision": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "filename": "mmproj-BF16.gguf", + "relationship": "byte_identical_to_pinned_huggingface_file_original_download_history_unconfirmed" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf", + "size": 1840903936, + "sha256": "219b0fcf326d8d023004ce9fc27fa643bd73ebfb73684e8e0af742c1fd755b63", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179264, + "sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_XS.gguf", + "size": 5262279808, + "sha256": "4342477286625c4cfcd70d0023bdb3ac30613fcce729123e0277097c7dc42e2d", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "zai-org_GLM-4.6V-Flash-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "size": 5739775104, + "sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467264, + "sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008603776, + "sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578304, + "sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758485632, + "sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf", + "size": 18811585376, + "sha256": "d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "revision": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "filename": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179744, + "sha256": "d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "revision": "c78a0727cb5ee489db2f218a212f613943023ee8", + "filename": "GLM-4.6V-Flash-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_XS.gguf", + "size": 5281678944, + "sha256": "23ea7196ed6f595c44591266a1b4b90d56db5a66c5223d49a41a587b81ace35d", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "revision": "c78a0727cb5ee489db2f218a212f613943023ee8", + "filename": "GLM-4.6V-Flash-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467744, + "sha256": "c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "revision": "c78a0727cb5ee489db2f218a212f613943023ee8", + "filename": "GLM-4.6V-Flash-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008604256, + "sha256": "66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "revision": "c78a0727cb5ee489db2f218a212f613943023ee8", + "filename": "GLM-4.6V-Flash-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578784, + "sha256": "4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "revision": "c78a0727cb5ee489db2f218a212f613943023ee8", + "filename": "GLM-4.6V-Flash-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758486112, + "sha256": "258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "revision": "c78a0727cb5ee489db2f218a212f613943023ee8", + "filename": "GLM-4.6V-Flash-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "size": 6187353696, + "sha256": "b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "revision": "c78a0727cb5ee489db2f218a212f613943023ee8", + "filename": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "glm-4.6v-flash/unsloth/mmproj-BF16.gguf", + "size": 1840904320, + "sha256": "74c30227dc957ed360a29b6002622472ec6fcc6a5105a1ba9a5b2a331e3a7833", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "revision": "c78a0727cb5ee489db2f218a212f613943023ee8", + "filename": "mmproj-BF16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_NL.gguf", + "size": 17386275744, + "sha256": "bf516e4962edd42afebb1f2dd1cbe9f5223863adec745bc4d81a0b1211ca5111", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_XS.gguf", + "size": 16457999264, + "sha256": "c686a3a767fb94ef19499815036fdfb63213664cf0d5867c63848c7ec532d69c", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "size": 14855269280, + "sha256": "c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "size": 17631642528, + "sha256": "b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "size": 19214517152, + "sha256": "f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "size": 18632180640, + "sha256": "c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "size": 17984488352, + "sha256": "a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "size": 39717427296, + "sha256": "37ab465cd0c2b47b6b68e17f6e1f3ffd48701a27518c71ad7ac21b7f5a8d9f24", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "size": 21378372352, + "sha256": "469c362f36f7ad24dec0da0c75b2ebc681f60b160cee303421388b8375fc2161", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf", + "size": 637310368, + "sha256": "d7b31eac832bb0d9adac61b3d5c81071df31ce1ad710d0e5758564e377bb14ea", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "revision": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "filename": "mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.IQ4_XS.gguf", + "size": 16557090080, + "sha256": "be28be57166c9903fe701c99596aa3c7df9f8c834f3109e6e9b4668d72cc646f", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "revision": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "filename": "InternVL3_5-30B-A3B.IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "size": 18556683552, + "sha256": "497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "revision": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "filename": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "size": 17456006432, + "sha256": "adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "revision": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "filename": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-IQ4_XS.gguf", + "size": 16368346656, + "sha256": "d768d7983f8bb8e7804812679b0626a2fc8a87383461b0285ee5e23370143f2b", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "revision": "120d600e464788a15e2140e1c9650c543d575d95", + "filename": "InternVL3_5-30B-A3B.i1-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "size": 17379984928, + "sha256": "6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "revision": "120d600e464788a15e2140e1c9650c543d575d95", + "filename": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "size": 19192497696, + "sha256": "cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "revision": "120d600e464788a15e2140e1c9650c543d575d95", + "filename": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "size": 18556683808, + "sha256": "97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "revision": "120d600e464788a15e2140e1c9650c543d575d95", + "filename": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "size": 17456006688, + "sha256": "30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "revision": "120d600e464788a15e2140e1c9650c543d575d95", + "filename": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.mmproj-f16.gguf", + "size": 636106336, + "sha256": "06f4f7fa1e43a8ef3a1bca3ccb3411392506e4ca5b090fb15d1dbf4f4e1cd84a", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "revision": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "filename": "InternVL3_5-30B-A3B.mmproj-f16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/README.md", + "size": 3825, + "sha256": "7df3cc4aea067c496f012ab019e6cd68d023260d09edda1a874d849407ddd5e8", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/IQ4_NL-gguf-metadata.json", + "size": 86874, + "sha256": "03b7838aaaf18a925facbcecf4d55a4f1569c313ae15a0718290a6284557e2db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/IQ4_XS-gguf-metadata.json", + "size": 86822, + "sha256": "0133d2ae30d2d53e50cc30b41b734a150f022dbafb92b9fe5f6fd16ca0b1ed9e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_0-gguf-metadata.json", + "size": 86292, + "sha256": "0c3d4df0d16b728146c7d56f2cb45558ec6542affb7853f0e9647289976c62c7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_1-gguf-metadata.json", + "size": 86293, + "sha256": "a50b96ef2eca372eb668d866ad87d6ea6323eaefc6e411c82d7734c921a4d850", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_K_M-gguf-metadata.json", + "size": 86295, + "sha256": "41b1f719042e2e027e22db41709708c1afb3b0839a306ae9f97913895cceda9f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_K_S-gguf-metadata.json", + "size": 86294, + "sha256": "fc6221a6305e49fdfd448efab5f719fede66846ae55363ea661cfb367985c3c1", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/SHA256SUMS", + "size": 863, + "sha256": "24506cee5d9fb04f5b9601eab6fa0deb81497f18a9a600f3ef115ae7481b9409", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/bf16-structural-validation.json", + "size": 544, + "sha256": "0a2f1d4ef6d0f1560c2346c2f03a491c8d5860f83165dae901ea285172beee17", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/convert.py", + "size": 1590, + "sha256": "a5387611ba8fbb7cae8583c5033a783276f13dc46b5039eee7fb38de6abf30c0", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/converter-help.txt", + "size": 5861, + "sha256": "6cc733d1d78ee81e43db3ad6048bb8ca20362577076cc811334e2dee1b6d9fb3", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/download.log", + "size": 77, + "sha256": "84a30db1c77a9c7c25f07dc350943e6ea6609ed92911dad149e2a36088053039", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/environment-install.log", + "size": 850, + "sha256": "402972df91139cccce5c4e78d58c71f2fc280c247c15c8a21e51a36e8d77e7a2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/finalize.py", + "size": 8096, + "sha256": "430991a44703de334edfcd291a50fbff9f560c5da97033a37a422e0f2462a080", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/hash_outputs.py", + "size": 1076, + "sha256": "7ddcbb5f0983ce3e83b6c9bb77d29c70863092c487f8433491fbfdeabbe24ed7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/independent-review.json", + "size": 578491, + "sha256": "d507e19b297b81b9dcbd035ead7747e6d41a8612d35dd61a252c3075462ee932", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/independent_review.py", + "size": 17768, + "sha256": "0a344bd4d189120753d40805fafc4f3977cfe43f5f99a4421a176a07fcd503e7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/manifest.json", + "size": 10497, + "sha256": "d0b80fd9af9fe9f24b825aaf2adc040f23b5f520339191fcd19372358f3e7468", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/manual-answer-review.json", + "size": 3196, + "sha256": "19bbdeced9a9cda3c3ac719b2245778bb5a723f56863b9c4f073b35a434c897a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-conversion.log", + "size": 46718, + "sha256": "86b0f251385c87edd983690acebb5311d9f7d934d91f80dfc0aab8912d13d0ac", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-gguf-metadata.json", + "size": 85463, + "sha256": "62e0f8c914512923d2328b20cd173125a3d688417436ca4b4babc706ebd4717e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-launch.log", + "size": 778, + "sha256": "ea3e770cc512da8b04940d6787e99c64efce5b0eedc6b74fb5f4a795ceedafd7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-status.json", + "size": 778, + "sha256": "ea3e770cc512da8b04940d6787e99c64efce5b0eedc6b74fb5f4a795ceedafd7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/output-checksums.json", + "size": 1380, + "sha256": "0715622d1b8d24b833d31e4af2c0de704365d877922fbe99a72e0883c3df9e1d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/output-checksums.log", + "size": 319, + "sha256": "03b3a45a5d39b0c9b466343b538350f110317117a2f97412de0594a05574e54d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantization-summary.json", + "size": 5096, + "sha256": "bbeb84c5b9e416c248c102dfeaaaf4aea99cf3d774cb08e73c2650a2b28af03d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_NL.json", + "size": 801, + "sha256": "fa467bb97c03b75982343d0c54bc180dd2ce96997cb0bbf606cc3a92b27b7a8e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_NL.log", + "size": 69666, + "sha256": "54437ca05eb10f0c5c75c31efb69ef2165295bcf873657ad32c2f6c32dd67415", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_XS.json", + "size": 803, + "sha256": "8c2dd36a9aed7361eab919393212d5ed0ed1ad03dd06ca886742f2e8d052cce5", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_XS.log", + "size": 76654, + "sha256": "16cbb78feacfd244be26d80d8ddb2b2a5f6317e3ce1ed2f96d0e2f870b00be7e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_0.json", + "size": 795, + "sha256": "01f26b719e635cc4d07bb727ff5260bc012249bea56e7c76e729fb4e0da998fe", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_0.log", + "size": 68722, + "sha256": "4289bee35b743ee4b1b1132914baf4ec65cd3e56ce4767c9c83f20a86d669615", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_1.json", + "size": 795, + "sha256": "c39ca9d15f9ae9f4db2c940f90d9ec7aab51bf2129ce6bac72c4f0ebfe2d4e78", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_1.log", + "size": 68722, + "sha256": "06de5a296c1d5578ec20b783bc73f83713c1d1333a89b2bf031189dcbc57a142", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_M.json", + "size": 803, + "sha256": "849d625003784e62b3cd840d10325ba37b611dfbd2f7dac00bef9ee66b881662", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_M.log", + "size": 76074, + "sha256": "8f214e491d4fff21b7340b42259a13cea3e1dc101b002dcb4e73d124ad5bd917", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_S.json", + "size": 802, + "sha256": "8a9d2e5299a9590218f65434653be46ba926981259e237dfef63eb2906e8fc0d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_S.log", + "size": 76074, + "sha256": "9868bb3d3c8757c774048e1ffd76191be00dc780933cc42e1b01b634f9dce1ef", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-all.log", + "size": 98, + "sha256": "66c39b8bada2ffd705f70fdfc9b09deaca32d8ff9e071d81be4e19bf7e4902c7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-build.log", + "size": 2091, + "sha256": "1ba23d0fb43512ca1396280a8fd271bdc734888855dcc745fef13919001a83dc", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize_all.py", + "size": 2784, + "sha256": "1ca2a80f507910d60625ebb25a918eb517cb20ca581ab9507f7ea09f37a96fac", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/requirements.lock.txt", + "size": 550, + "sha256": "a52a07f17ace264c4b932fa396fae80ecb0d2849faf3ea65d94c8a16ab9986b0", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/run_smoke.py", + "size": 1862, + "sha256": "2ea3dbd7c83e77a5dd827c94e58cc01fc75c8339c43626f4ef3966aa0bfb7f81", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL-launch.log", + "size": 1078, + "sha256": "4cb51193a96f44cb1c4dfbb40e17a4eb1891ad8fcd7e4d1fdb9fd3f4760d0b1d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL-status.json", + "size": 1078, + "sha256": "4cb51193a96f44cb1c4dfbb40e17a4eb1891ad8fcd7e4d1fdb9fd3f4760d0b1d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL.log", + "size": 240, + "sha256": "5b8428db0a3a50373e331706a38cee5b1668963325084adbd92cc2be9e9c3ce2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/generations.jsonl", + "size": 10136, + "sha256": "618f2ad33a69305d60fe2b62efed62c869d18cfd98bb1bd56ef9baa86f09d657", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/metadata.json", + "size": 7942, + "sha256": "09994322e103f2f5e42fc7437d4bb7ef0247541b6bb637657b77d9742c04281a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS-launch.log", + "size": 1078, + "sha256": "5d91e2fb0fa073e35874d78f66316e8780ec6aadead22663601070c706402374", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS-status.json", + "size": 1078, + "sha256": "5d91e2fb0fa073e35874d78f66316e8780ec6aadead22663601070c706402374", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS.log", + "size": 240, + "sha256": "57b02e1985f4cbfb8f5cf53f42fddd26b2c05c06e12797d2cd4ec0615a36046c", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/generations.jsonl", + "size": 10146, + "sha256": "ed5d7429d1d96a03a37a8b5f147aaa758000410c2b23316631378c6e24633c18", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/metadata.json", + "size": 7942, + "sha256": "0ca30f160b1016c3e420af1d6442ff632ef4106e5b8af2a08e44cf5f6be005ad", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0-launch.log", + "size": 1072, + "sha256": "a34cbf7863de4f68ba8dfb1526e362217939645205bc24b89132e9ba1a2d272a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0-status.json", + "size": 1072, + "sha256": "a34cbf7863de4f68ba8dfb1526e362217939645205bc24b89132e9ba1a2d272a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0.log", + "size": 240, + "sha256": "ccc8ccf7de92bf40727a101f8db236dd048440d251ea32904d23555aaa53f5ba", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/generations.jsonl", + "size": 9931, + "sha256": "e776ce4447912f4a24d38c508c9d23857ba86d3363b1bf7754e33b747df33c38", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/metadata.json", + "size": 7935, + "sha256": "df16019b9dbe81ccc58f52e8e33212cdf188b3a7774aee8e60ac1df3f16658bf", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1-launch.log", + "size": 1073, + "sha256": "452aa440c36b981157a7c7f0f965e2fab429cf62994aef4a4facc5264b0ff641", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1-status.json", + "size": 1073, + "sha256": "452aa440c36b981157a7c7f0f965e2fab429cf62994aef4a4facc5264b0ff641", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1.log", + "size": 240, + "sha256": "f3ec1f2ad96bb5a986bdeb1291ce01cff4fa23f0b045be3572fdb871f21a2385", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/generations.jsonl", + "size": 11373, + "sha256": "b191db11ab0a472ed3c28b534120d9cc6d600f5a7f62c5a6a26817f83dabfd83", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/metadata.json", + "size": 7935, + "sha256": "03c0388e81d0d2732b800c794bbb2d93bbb74b31341f7a4834e3f4e8dc7f5e3e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M-launch.log", + "size": 1079, + "sha256": "3ab5721761df874ebefb36d4ff009f8322670861483ce2325a455c79acc93fcb", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M-status.json", + "size": 1079, + "sha256": "3ab5721761df874ebefb36d4ff009f8322670861483ce2325a455c79acc93fcb", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M.log", + "size": 240, + "sha256": "1320cadc9b97567c5d8c0263157c499cabe3e6287e24ad52489422ca01443f23", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/generations.jsonl", + "size": 10097, + "sha256": "0e1e2fcad8562975a088c737a277d303d3997662ef8896ca193c6e958d1d48e8", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/metadata.json", + "size": 7942, + "sha256": "1b804e56f9c97af09b5d7cb506700056912791114c4fdff179317e96ee9c8204", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S-launch.log", + "size": 1078, + "sha256": "3a54e50628f77f1a8f553a115461904be33d3cbcae707ca13744b20ce8926057", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S-status.json", + "size": 1078, + "sha256": "3a54e50628f77f1a8f553a115461904be33d3cbcae707ca13744b20ce8926057", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S.log", + "size": 240, + "sha256": "eefda7cd128eba25b87072440d1ee6f505efd140ba3895a6f1b0056c16aba546", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/generations.jsonl", + "size": 10092, + "sha256": "77c9e1e2b3664bff2c463309aedba57bff08c35bcaabe91c9db3ab92929236de", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/metadata.json", + "size": 7942, + "sha256": "fb5c40b7727d85a850ec4e56f796e5ca235586e3e85e0e518576155133a06877", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16-launch.log", + "size": 1073, + "sha256": "a13a019caf4e22863464ff962fe4614ab2f9aca153e53e7fcd10f68de73b5f11", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16-status.json", + "size": 1073, + "sha256": "a13a019caf4e22863464ff962fe4614ab2f9aca153e53e7fcd10f68de73b5f11", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16.log", + "size": 240, + "sha256": "0d20d4887178ff0e90d47911cd591601e74668841fc3f2cc351947d41de349cf", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/generations.jsonl", + "size": 10046, + "sha256": "09a4655e77511e2f19cadc4b25bb2c52c67e547be28fd6871802069654ee5be9", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/metadata.json", + "size": 7936, + "sha256": "f80ca18420103598765cbc2da4c096f6f1eca62456eeeefabbf50e66a4c40d10", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/inputs/blue.png", + "size": 325, + "sha256": "9cbd771461ca413a0271d77d8595bfb2df9e764136279352a6901990016eceec", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/inputs/red.png", + "size": 324, + "sha256": "06196589d548330cd7dd06a644a1502e0bf21590f4031a14e4caffad5a152189", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/quantized-launch.log", + "size": 92, + "sha256": "4e71c9809735a0ae13d3114c0fe3c56db34a8ca9aa78cc389de41c25d41e53fe", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/quantized-summary.json", + "size": 473, + "sha256": "73e18201baeebd547d87161a9445f7737529e42d7a3e7030c75ff76dfca2d246", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/requests.jsonl", + "size": 849, + "sha256": "f53eac1e2a83cc0efc20c6fe94febeffba3d479b50f8aaeef4037aec815d7f1d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke_quantized.py", + "size": 1700, + "sha256": "cea924500c0721b6eafc6f2935b55f26a86d3255443fd633b9e255d6bee90422", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-tensor-summary.json", + "size": 383863, + "sha256": "aa18595a55b5c1db2aafc5bcdb3b87111b3db5e94383f323c5a36fb2f370d15b", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-verification.json", + "size": 3537, + "sha256": "953c0884b5988a16370a8464acbe7ce43553c2bff2b324b6192c839dd404598b", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-verification.log", + "size": 711, + "sha256": "23bdab2500c452c166158c15091f124b07bc2d9339da865ab4b10cdc5c4c1223", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source.json", + "size": 2769, + "sha256": "7b93144429130e36e915c33a8f00a3e53c5200fb9070ca49c4b9d9a813d15c7a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-conversion.log", + "size": 56454, + "sha256": "0c0807344c32ab1ec080e0960129d70bd8731dc348ae39482b002791f473dac2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-gguf-metadata.json", + "size": 86479, + "sha256": "6afe9cab2faf00ad9a68374facf9baf4bde178c6098809c9b7816ff01054c118", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-launch.log", + "size": 754, + "sha256": "1c7e67e1d8abc6e6d0a62d31dc32f57ceb3725bda7374ae9205b79b0b3ecddbf", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-status.json", + "size": 754, + "sha256": "1c7e67e1d8abc6e6d0a62d31dc32f57ceb3725bda7374ae9205b79b0b3ecddbf", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/verify_source.py", + "size": 882, + "sha256": "3c900930fe9badb5874b5a2da2cac5e24ceaa6cb665fb9b706dfb6ac06730e77", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/.gitattributes", + "size": 1722, + "sha256": "c58cb09727b7fea047dc29f253c6aa3632fc93b538d055cb8db9831db024d73f", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": ".gitattributes", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/README.md", + "size": 14619, + "sha256": "7fa4d4e39537a43a7d6cc6f62873eb014b2f8bc3da2142111ba2ad29d4984794", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "README.md", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/chat_template.jinja", + "size": 1032, + "sha256": "172c7450a66b9b3644538888ffa24d02047e535e9d1f911564460203fbf7e8e8", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "chat_template.jinja", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/config.json", + "size": 2005, + "sha256": "af3810295de6b08232776b74110ed482fa0183f4aeaec586ff4f7593910951cb", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "config.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/configuration_kimi_vl.py", + "size": 13151, + "sha256": "d30462b89993b9fef138db983d3884bbc39750effadf2efe67f404d28ee40e5b", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "configuration_kimi_vl.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/generation_config.json", + "size": 149, + "sha256": "da26dd1916774784790db2b83336bad62d0917356743478ba6eb0c425c53eac5", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "generation_config.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/image_processing_kimi_vl.py", + "size": 4680, + "sha256": "bb58551e088f3bb0027b1886ca5ff42776c485acec1a9aafe91553ff76926870", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "image_processing_kimi_vl.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00001-of-00007.safetensors", + "size": 4994390288, + "sha256": "a5ef3ebd9727f82e34417a778317d2cc9c08762fe0bc4a2ee333b8a52cf7c1a5", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "model-00001-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00002-of-00007.safetensors", + "size": 4995061424, + "sha256": "45ecd00decdad65e7d3f494028ed0c79d0cd56f145adae077ffa78b5b8ff95c0", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "model-00002-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00003-of-00007.safetensors", + "size": 4996100112, + "sha256": "b9ba98f01e22eea43da8cfbf6f09ff0857616cd9e1df4603a735c111755109ef", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "model-00003-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00004-of-00007.safetensors", + "size": 4996100320, + "sha256": "8f7eb3fc5c12481fd1a81d2708fa4a299ff4c207a5dbafb5b8bef25ab9fd8b23", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "model-00004-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00005-of-00007.safetensors", + "size": 4998185720, + "sha256": "db83e896b3d75f4bc51f621ae90ad61e8f6f7901f49a06b5c40348b839057206", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "model-00005-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00006-of-00007.safetensors", + "size": 4996099448, + "sha256": "abed41982a3f9c7d05f69bb560dad7bcb93cfa764c77a2b59127f35dc787983c", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "model-00006-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00007-of-00007.safetensors", + "size": 2840161216, + "sha256": "2e2ddd33f2b4f472898482860585bd6d73d4397c8c833ed9d00a2024443f7a77", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "model-00007-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model.safetensors.index.json", + "size": 588207, + "sha256": "178ba3a15cb12f6ceac42aecfe665a8f041d47e948220d75b073088957efedd8", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "model.safetensors.index.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/modeling_kimi_vl.py", + "size": 105649, + "sha256": "74e8f18afa5bf8f580ef5be5f15b51506f1e4f604df5a84f508a7796b8947c0b", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "modeling_kimi_vl.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/preprocessor_config.json", + "size": 401, + "sha256": "d968a7d7f83f82c3b0e1061079dcdbefd6f2c75b7ee4240cce995afaeae1f622", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "preprocessor_config.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/processing_kimi_vl.py", + "size": 7537, + "sha256": "f8e64816baed0a92d85d0a987b587028ad55a0779f3ace8c5b68db705dc61561", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "processing_kimi_vl.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tiktoken.model", + "size": 2795286, + "sha256": "b6c497a7469b33ced9c38afb1ad6e47f03f5e5dc05f15930799210ec050c5103", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "tiktoken.model", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tokenization_moonshot.py", + "size": 10958, + "sha256": "0ae85e29c37689fefe41b8bfdb7aebd9a0152defedbf37fae0f8413000512029", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "tokenization_moonshot.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tokenizer_config.json", + "size": 3857, + "sha256": "d7861718cab22c7962e14b4693b4009dd526115cd392dc779069a8173be95703", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": "tokenizer_config.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_NL.gguf", + "size": 9156693120, + "sha256": "294596d8c89ec237e50341a73d8122b1527db4e6eb0ed0243f86785fc772bfcd", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_XS.gguf", + "size": 8820448384, + "sha256": "6e5bdf00c77ef6f4c0a871cbf2f997cb11806b7423b50decd5e4ed3989f3b973", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_0.gguf", + "size": 9083161728, + "sha256": "e3ffa932cd1318ce1231d97d832f92b90093900b2185d50d54e39c8d9d421080", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_1.gguf", + "size": 10059476096, + "sha256": "0050110bc63babd859a849d160818e5ce46518c9dd92e38e50d072ee71a353ca", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_M.gguf", + "size": 10540747904, + "sha256": "43a34db4974f67ad13ff3e1f8347ef1b25dbc15b077146d1c74627e3294ec49d", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_S.gguf", + "size": 9713880192, + "sha256": "bb2f63e9b13a0d561e19890a6c5611cd8b27c0a406b596ebd33fab9cf88187f1", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-bf16.gguf", + "size": 31934229632, + "sha256": "6a7457a032488a1ac96b3b42cd69ad48406222d7abcd1af6042c13f5e3f33005", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/mmproj-Kimi-VL-A3B-Instruct-bf16.gguf", + "size": 906726624, + "sha256": "7b21d8dd54ebbd6a873a0a625bb0a1a7e002b975d43ba542681f5cca7d834ba3", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Instruct", + "revision": "398eede0903cd983a2bfa0cc634e9ac1d843f375", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.IQ4_XS.gguf", + "size": 8820448800, + "sha256": "c59481e1bdb3a284198ca16e523fefa1ce8a24b7dad8ad2275dccfd58807ee39", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-GGUF", + "revision": "d645665be0a3028dca3ef3d08dddb51ab23ecf31", + "filename": "Kimi-VL-A3B-Instruct.IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_M.gguf", + "size": 10540748320, + "sha256": "74e9aa21a6a6e90d6ff56b7ec311f830a0b6cf88ff7dababacc8f34c867bde1e", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-GGUF", + "revision": "d645665be0a3028dca3ef3d08dddb51ab23ecf31", + "filename": "Kimi-VL-A3B-Instruct.Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_S.gguf", + "size": 9713880608, + "sha256": "3363ac782c25fe60d0d27061285d9eddfff1af087650756cfde183296343f22f", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-GGUF", + "revision": "d645665be0a3028dca3ef3d08dddb51ab23ecf31", + "filename": "Kimi-VL-A3B-Instruct.Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_NL.gguf", + "size": 9083162400, + "sha256": "d1364554ff094ee66dfd2fb3787cc87cf3ebc5c944eb965f354e3c6eaf60aed2", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-i1-GGUF", + "revision": "e54dd1379f76c64d734756aca9574a1a5d1bea60", + "filename": "Kimi-VL-A3B-Instruct.i1-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_XS.gguf", + "size": 8745836320, + "sha256": "5d6aad466030edeb73f44b4a32c0c98d081d0e03a300366d6b63fbf469bff073", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-i1-GGUF", + "revision": "e54dd1379f76c64d734756aca9574a1a5d1bea60", + "filename": "Kimi-VL-A3B-Instruct.i1-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_0.gguf", + "size": 9108393760, + "sha256": "0ea3afdd920792fd4583d8c84a979e4e0af52a2e7456ae6bb75731da999b3b1e", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-i1-GGUF", + "revision": "e54dd1379f76c64d734756aca9574a1a5d1bea60", + "filename": "Kimi-VL-A3B-Instruct.i1-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_1.gguf", + "size": 10059476768, + "sha256": "81aaa3efc0a129abeae7149b8195d09ce5467b4436c1c412fd5cd89161d04f40", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-i1-GGUF", + "revision": "e54dd1379f76c64d734756aca9574a1a5d1bea60", + "filename": "Kimi-VL-A3B-Instruct.i1-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_K_M.gguf", + "size": 10540748576, + "sha256": "7710f9aa5bf56a38a03f26738cdbf10563a72938a41025307b57768dad40f306", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-i1-GGUF", + "revision": "e54dd1379f76c64d734756aca9574a1a5d1bea60", + "filename": "Kimi-VL-A3B-Instruct.i1-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.mmproj-f16.gguf", + "size": 905371904, + "sha256": "794ffead89866df5b3c698c74ca16bd7d31b48575123edee24f476c9a15c4ad5", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Instruct-GGUF", + "revision": "d645665be0a3028dca3ef3d08dddb51ab23ecf31", + "filename": "Kimi-VL-A3B-Instruct.mmproj-f16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/README.md", + "size": 5334, + "sha256": "ce788856c8f0224d3e4b00e81836f8d859c7918ccac3920c96c2c3eeabd7bbca", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/IQ4_NL-gguf-metadata.json", + "size": 86884, + "sha256": "e487a0d4544c3fb05b6f3665a9acab0ac02ceb098c10a4363b2505e2533fe187", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/IQ4_XS-gguf-metadata.json", + "size": 86832, + "sha256": "f9379cbaa918d9cedd95d23fc35b236fd6514c7a95c7a99498dbe157654ffd1c", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_0-gguf-metadata.json", + "size": 86302, + "sha256": "8d9f7d8f9cac6d487f32f1b32a487d4f2731337aa3c432a818062de95a6ff65f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_1-gguf-metadata.json", + "size": 86303, + "sha256": "b558901e4e47bff1486c56d7a79b991849b13b29ed9890e1c996063707485c63", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_K_M-gguf-metadata.json", + "size": 86305, + "sha256": "db935d2d82fe616f011a39bed75808827d992570b6c89a473f79001396f37e5d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_K_S-gguf-metadata.json", + "size": 86304, + "sha256": "03c46e6afd5e50ff9072ff487cafda2e1cd79983ca430e2ca58174103a0c7ef3", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/SHA256SUMS", + "size": 677, + "sha256": "7bdbaae627cf7208b14a4b8b7c46101195340a31e4269bf1a15c35e62cd9edee", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/all-converted-output-checksums.json", + "size": 1420, + "sha256": "2645320f3c591cc5255c5b39a73bb0ead833f7ef20fb47a2d9aa5c2fc6587cd2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-smoke-independent-review.json", + "size": 6330, + "sha256": "7e40e10a8a262f49b1119297599244dd17774291d3d62a5fbe4a0ca41d322811", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-structural-validation.json", + "size": 572, + "sha256": "b89250de61b1a47f4fb7cf7f55ab89d7435f2253ceb2485c097d91dc4e5b959c", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-temp08-review.json", + "size": 853, + "sha256": "5ba5b31852b5066130efda64a9ca54e199ae9817a3f2def703655c00e6e45338", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert-mmproj-launch.log", + "size": 804, + "sha256": "60d86bda5476b0bfcaecf75527969091cdc74d018e63cebb7f16dba9cfe7ed6e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert-text-launch.log", + "size": 777, + "sha256": "03c66430b6be73f91b1aadae21f2b42a5a80ffa2fc56cc65a58d7f569140e0d8", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert.py", + "size": 1600, + "sha256": "673b91c96b0b78ac9aea7d10b009b9603ea08d069be176a1ac1de29f5cae3647", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/download-command.json", + "size": 326, + "sha256": "2ba993d87a8656d882f49daa2bb2fb1f4e09085810a836b54f2fb4adb0ea2467", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/download.log", + "size": 82, + "sha256": "1d6959baa01df79aac4cf31df3f02b8a7bb4c5650d6a7f9c48adb31fbab795dd", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/finalize.py", + "size": 11032, + "sha256": "0c7dd6510b64cd2310c18f1b3abf6eda80cd7ebd044240ce6087f0d3d5ee3e8e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/hash_outputs.py", + "size": 1076, + "sha256": "eee9e5bcdf58ae2b285c59902d4f61788248fc9d6692fa9e740595eb7e71ee7a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/independent-review.json", + "size": 668757, + "sha256": "c0b1490ad85772421e1b0e4ca05f2046fdab771841ec85d61bc8ad7cc2265545", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/independent_review.py", + "size": 22320, + "sha256": "36929d630b6448503f5fc9135f8eab52ebb67dfa3ba379952a182eefe7224b2a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/manifest.json", + "size": 27119, + "sha256": "1ea5b24c2e02ab0facd7035538518600728597edece898632100de6a110227e2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/manual-answer-review.json", + "size": 2499, + "sha256": "03a571e01631ab9384d49512e5ec2f6ba40f83ca7f5d8715d14d6e5b598eebd4", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-conversion.log", + "size": 48124, + "sha256": "ec0ee65549d988fdb22505b9baba8905350cf4d1dd768fb3510ac83c8ba76d47", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-gguf-metadata.json", + "size": 85473, + "sha256": "187e63eed34cbdcb825188321777f385559ba39a4853fdf04b892d3213fd9b75", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-status.json", + "size": 804, + "sha256": "60d86bda5476b0bfcaecf75527969091cdc74d018e63cebb7f16dba9cfe7ed6e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/output-checksums.json", + "size": 1066, + "sha256": "c4b045f3fb30d5ffa047255fe5cb030fb6f0f4e5147c3012c577950c1b321d42", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/output-checksums.log", + "size": 359, + "sha256": "34501423e961dff5e96ed2f352a96a01bb3f85237910b60d2ef5d2b72304c975", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/prepare-status.json", + "size": 1208, + "sha256": "41ee38db7fe5b2177bd67256153e778094ab6659398207d3b06aabb396caf100", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/prepare_bf16.py", + "size": 1007, + "sha256": "5a2684dd31d1c5bdbbc564703e4579ca39d14c1de6e4ba30d2854742eae33214", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantization-summary.json", + "size": 5279, + "sha256": "8e1f2b8e6ee0b6b163192926066d10208c570763cdb3a52c14ff60087fd65529", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_NL.json", + "size": 833, + "sha256": "8b1cb85ffb1d590b3b06ffa0791831215833d328bedb8a52c4fc3274594ad798", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_NL.log", + "size": 69686, + "sha256": "f5075e55e59246e60e84a8b557258960de2c661074524f7391e9ba4724c9d5e0", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_XS.json", + "size": 834, + "sha256": "297854fd42d4ba7291bec7e13bc9442be53d01128e5f5493d10fc54b4a1a0115", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_XS.log", + "size": 76674, + "sha256": "6104f3a049af319ebde2ace188c43556c7ef5b0771863c2fe4e89c05fc41c7f9", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_0.json", + "size": 824, + "sha256": "f54ebc96645a0282b0e1e960ebbfe347115ff0406764112716c22834cc02a661", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_0.log", + "size": 68740, + "sha256": "307b032e7a49691d6768b7bac5065e8d888fc8f97ca308246fbcbdc2dd53c734", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_1.json", + "size": 825, + "sha256": "ffbe73a98ede18090c142c1fd9ab77b47d7beba1fa44636369d1b539b33cffb8", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_1.log", + "size": 68740, + "sha256": "6570f92cde8773c4154f6103c049fb1d4d6236edfb4282e5c4ad6da376b692cd", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_M.json", + "size": 833, + "sha256": "5c4b5e3be935ec045b0e9efe231292b522e308218bd057fce7cc40a4c46cbf13", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_M.log", + "size": 76094, + "sha256": "c0d36715c6c4e2257f0aa73ddae4b19bba94dedb739b381741fd215d824ed9b5", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_S.json", + "size": 833, + "sha256": "ad3923c9c6e9b6094c9b5617b9167cb9c0c2281f419b4cda95bf34f2467ab1df", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_S.log", + "size": 76094, + "sha256": "b0b468ea42239e99a3fda373d8ff23d6658266b575ac05f2e1519c1749edb005", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-all.log", + "size": 98, + "sha256": "7b820a3869efe92900a0ac4c4b43ca6f152b372cc500eb73b1048d5261cab841", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize_all.py", + "size": 2794, + "sha256": "180222a9664dd2dbc226dd1a9902acc483bbdcc24168d9db201aceeaca8f0894", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/rejected-models-review.json", + "size": 9067, + "sha256": "6e99230bdf3d965e045251fb8645efae89d1662a0835037f9c0c6786dfb5cabe", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/rejected-models.json", + "size": 1357, + "sha256": "c84863a324d73a38045954d0f70a9458c820b928e6834adcbcb17abbc1a572fd", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/requirements.lock.txt", + "size": 550, + "sha256": "a52a07f17ace264c4b932fa396fae80ecb0d2849faf3ea65d94c8a16ab9986b0", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/retain_passed_models.py", + "size": 3033, + "sha256": "3ca593a4d0def61c9f9db5ca4f7026f1420f88a965dce7a21aa6bccf49165e58", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/run_smoke.py", + "size": 4749, + "sha256": "7604505a30606645b3e5b2c73ddcfb24ccc702ea810740be06b35998f4f1d73a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL-launch.log", + "size": 1674, + "sha256": "c8949c6ccd2436bf3709fffa4ab17b7607603505f4f5e7894b4f6a2e32c1707f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL-status.json", + "size": 1674, + "sha256": "c8949c6ccd2436bf3709fffa4ab17b7607603505f4f5e7894b4f6a2e32c1707f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL.log", + "size": 245, + "sha256": "cbd829d93a3b7f06aab097ae80f2973efd31544dc802d9cd6f02e85fcc5c1441", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/generations.jsonl", + "size": 19125, + "sha256": "a1b5b920fffcdb6cd007adbb29d18bd4d6da03dfc433de6fe65f77606ef3206d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/metadata.json", + "size": 8051, + "sha256": "7552abe068decc358d46ffebf484b1ad6b74d65d3f16ca6cdd7379af62294bad", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS-launch.log", + "size": 1672, + "sha256": "342193699b52a16abff1a2f95a93cd56bf3ce214b265b16c162aaae8ae13e841", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS-status.json", + "size": 1672, + "sha256": "342193699b52a16abff1a2f95a93cd56bf3ce214b265b16c162aaae8ae13e841", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS.log", + "size": 245, + "sha256": "84d646a3ce8b586312abce2e4e7b82442c0867b7b71ce2ce7eb4031c8c2c3114", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/generations.jsonl", + "size": 30860, + "sha256": "6f37eca888a01c6e1a40870aed3502b229c48f15d848f72dba7004e639372025", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/metadata.json", + "size": 8051, + "sha256": "76dce01ca2bbb06c698c1ae4800a582591f33177dc4fd0bc894e732b7d576b57", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0-launch.log", + "size": 1901, + "sha256": "065da35af654520cca46c670a504b916cbb286988c6b5ccb9ec39f6f91fbfd17", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0-status.json", + "size": 1901, + "sha256": "065da35af654520cca46c670a504b916cbb286988c6b5ccb9ec39f6f91fbfd17", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0.log", + "size": 245, + "sha256": "e6027a2dcfc3b117779f9c25f264633b9f6ae1bfedecfde1ef0eab06500dd3cd", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/generations.jsonl", + "size": 23930, + "sha256": "f4f6615465697e8c867a39b1e44e593e62dbc3d94fad6263d3c49fff4290ca66", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/metadata.json", + "size": 8044, + "sha256": "0026a55a8c0f9ab40f57894163d7605fbc1ca3adc0e1e5369e9c4be7fa5cbe99", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1-launch.log", + "size": 1878, + "sha256": "68b321f24e469b735788c699c4341321bc379074af131df0047fb800a3d0f869", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1-status.json", + "size": 1878, + "sha256": "68b321f24e469b735788c699c4341321bc379074af131df0047fb800a3d0f869", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1.log", + "size": 245, + "sha256": "2d2d7b8bb8cb4f6175fdad07dddeac6feaff1dbb593d1d26d9b78980165d5fd7", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/generations.jsonl", + "size": 24896, + "sha256": "b09d332279a74bbe6a06d4fa1adaa519a3f90febf03a118b5f4ab31d24656d18", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/metadata.json", + "size": 8044, + "sha256": "1de3cfd752d1d39272ae6743e1a45783f0a710265e49af3006b79969222a405e", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M-launch.log", + "size": 1859, + "sha256": "4ee5cd758f2f94dfad8613d71da2e4498ce3f05c8c2d642a4fb3715ee0c810d2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M-status.json", + "size": 1859, + "sha256": "4ee5cd758f2f94dfad8613d71da2e4498ce3f05c8c2d642a4fb3715ee0c810d2", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M.log", + "size": 246, + "sha256": "7ec27b7bb0019df505b0a034e37363fd385ab0445889c3a65b720ff094699756", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/generations.jsonl", + "size": 66086, + "sha256": "fd117d46693e2909211d65880f38a3b811a6d822c724030dd53a3fa8caaf9087", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/metadata.json", + "size": 8051, + "sha256": "0d71355d48e23724c7c3171536a51ea534829785374b175c163c0b15f1535363", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S-launch.log", + "size": 1860, + "sha256": "129a92d94be9958fb6fc40104299895f78171c60252c9578ce83dfe80dc20493", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S-status.json", + "size": 1860, + "sha256": "129a92d94be9958fb6fc40104299895f78171c60252c9578ce83dfe80dc20493", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S.log", + "size": 244, + "sha256": "f84c50ae83e355d0507b97e5497b77b80c54d84157975a7107c1700f81d838ea", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/generations.jsonl", + "size": 20538, + "sha256": "603cd3059e7fbbb63a4861256cc3995a87576fca04a243015052192b3a9135d4", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/metadata.json", + "size": 8051, + "sha256": "402d3606ef939947e4b7c7ef89091b6ea438c519357fbfe0b197c21d318fb69f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy-launch.log", + "size": 1899, + "sha256": "35c6b21a16f3f665f2662a33c415adfe255cb1636f0736fc14bacfc663d8611d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy-status.json", + "size": 1899, + "sha256": "35c6b21a16f3f665f2662a33c415adfe255cb1636f0736fc14bacfc663d8611d", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy.log", + "size": 245, + "sha256": "5697d7fe5db1a94bbe59ebe3eb3dca474a80146e873f305f3b457cb6d5ed05f5", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/generations.jsonl", + "size": 28854, + "sha256": "207f688b2d68a53daa53b28263b465d827b398ad535a17ec6c3a4eaf61f47f32", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/metadata.json", + "size": 8052, + "sha256": "51608aca8533d1b2c40468343a9b05f29f01f5421f6587ce3ce53a3cdd2a12af", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-launch.log", + "size": 1652, + "sha256": "a396b2b76dd9d9578c069626924c60e8056103bfd345dd48ca2211b424a686d8", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-status.json", + "size": 1953, + "sha256": "4ea9d03b5774f381a629308b6a5e719d24585e53d37fa509ea61b9d6b0cac547", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-temp08-status.json", + "size": 1652, + "sha256": "a396b2b76dd9d9578c069626924c60e8056103bfd345dd48ca2211b424a686d8", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16.log", + "size": 246, + "sha256": "f61952e280bbe12b1237b26f318fc7a3c2ad2fbf05dcfaedd82f6a24754230aa", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/events.jsonl", + "size": 432, + "sha256": "d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/generations.jsonl", + "size": 37386, + "sha256": "7f967db40e35aa3d5303ee6b4e93abd14e6e88540c2d4e688385ae2856d981fd", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/metadata.json", + "size": 8059, + "sha256": "952732c12dbdd392fe70087a6ded83c23274d6f409164c75a264558642019042", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/inputs/blue.png", + "size": 325, + "sha256": "9cbd771461ca413a0271d77d8595bfb2df9e764136279352a6901990016eceec", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/inputs/red.png", + "size": 324, + "sha256": "06196589d548330cd7dd06a644a1502e0bf21590f4031a14e4caffad5a152189", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/quantized-launch.log", + "size": 88, + "sha256": "5655b3abb947ef5a35dc1fd0d90cbe3280edb4c10ce8c51a636ee27f41b13deb", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/quantized-summary.json", + "size": 469, + "sha256": "fd4a837edccb3e3873af8060249c6931579d9326aefb5b0870120b46698940ff", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/requests.jsonl", + "size": 865, + "sha256": "68d4d8d6b0bda9837b6727089bfcec7aa29603e67ea6df9756ef0154eac4468a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke_quantized.py", + "size": 1721, + "sha256": "e91983dd10fc46da904aa71a51e7c5e15ad098e7ae78a297b74d51b85ea5f810", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source-tensor-summary.json", + "size": 1698043, + "sha256": "fe1a865235c50a2a5f3cde80fdc6a10417ac3ca85e1193077ea62d4e5dceb4e1", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source-verification.json", + "size": 3537, + "sha256": "21b831d70cd0e69ba62c5d9e0faf46e762eb5c244bc471411ca41a41453fbe38", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source.json", + "size": 2774, + "sha256": "2d5860af87de9fec555d3da986a6bf73968ac0d275d86ec2028e4abecf556546", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-conversion.log", + "size": 64114, + "sha256": "aec8c260be2cc2fdcecc9999b68471c254aa0f22fb76e1abbd6902577b95f0b6", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-gguf-metadata.json", + "size": 86489, + "sha256": "b3aa4a4e7f2e86c75c2e566bb343cedd904fecb7e2eb5a083b396da450d31b46", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-status.json", + "size": 777, + "sha256": "03c66430b6be73f91b1aadae21f2b42a5a80ffa2fc56cc65a58d7f569140e0d8", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify-bf16-launch.log", + "size": 468, + "sha256": "13338e4ef72eacb7705a439730efaa7e8c80b2951487d69a1d01211b5e89c77f", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify-source-launch.log", + "size": 711, + "sha256": "ef885264b3d71f4ba2dc0126f6a9f851ef5c05c58a8d7ff0e32ccfd762bae4c6", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify_bf16.py", + "size": 2619, + "sha256": "981845bf5a7765e88109f5b64f1efbc684dc4f5fbbddd44a1477a4fd14515a9a", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify_source.py", + "size": 882, + "sha256": "3c900930fe9badb5874b5a2da2cac5e24ceaa6cb665fb9b706dfb6ac06730e77", + "sha256_evidence_kind": "local_aux_hash", + "source": null + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/.gitattributes", + "size": 1801, + "sha256": "12db7934bb09e5bfa3026498ff609bf6bb8c03894487c6ed7f680224f1e3a219", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": ".gitattributes", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/README.md", + "size": 13625, + "sha256": "840d2b966176f9e1742bd3143dcf8cde33e444734f799e1502cba9d0c85643bf", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "README.md", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/chat_template.jinja", + "size": 1032, + "sha256": "172c7450a66b9b3644538888ffa24d02047e535e9d1f911564460203fbf7e8e8", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "chat_template.jinja", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/config.json", + "size": 2005, + "sha256": "af3810295de6b08232776b74110ed482fa0183f4aeaec586ff4f7593910951cb", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "config.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/configuration_kimi_vl.py", + "size": 13151, + "sha256": "d30462b89993b9fef138db983d3884bbc39750effadf2efe67f404d28ee40e5b", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "configuration_kimi_vl.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/generation_config.json", + "size": 149, + "sha256": "35ad1985a08535077a2c1dbe678ff7c41d84f3e671864a310403a2967c663d85", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "generation_config.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/image_processing_kimi_vl.py", + "size": 4680, + "sha256": "bb58551e088f3bb0027b1886ca5ff42776c485acec1a9aafe91553ff76926870", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "image_processing_kimi_vl.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00001-of-00007.safetensors", + "size": 4994390512, + "sha256": "ad54ac1d25ae137fb4e89fcf39361c7e42f0951fff840a4d0caf06a23b0cb76f", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "model-00001-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00002-of-00007.safetensors", + "size": 4995062000, + "sha256": "40a15784c7369dea09c3d82c27e57854f14ebd0866ec68c8fa472082e8fcf597", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "model-00002-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00003-of-00007.safetensors", + "size": 4996100568, + "sha256": "b99f6b16bac0a911051719b61eb39c5ada045c1f24e5a56bb435e8d08a603eb7", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "model-00003-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00004-of-00007.safetensors", + "size": 4996100776, + "sha256": "3adb7ef982fde34b13216e9f615a8f697e9d354c53b8727ac2bc775f2971f745", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "model-00004-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00005-of-00007.safetensors", + "size": 4998186176, + "sha256": "a8fc6e1c9fbc43e4ef6f065a87d0f636524ff8374555e8f9e2cef756ac456677", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "model-00005-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00006-of-00007.safetensors", + "size": 4996099904, + "sha256": "80c5bb5a0a5017cf3baa95ada6723151df9d94a7d01024bd4b8510be2d6c6084", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "model-00006-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00007-of-00007.safetensors", + "size": 2840161552, + "sha256": "76e788219ca8b1716490932db3c3bf16b57f0a64d4af499b2237af3366049a79", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "model-00007-of-00007.safetensors", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model.safetensors.index.json", + "size": 588207, + "sha256": "178ba3a15cb12f6ceac42aecfe665a8f041d47e948220d75b073088957efedd8", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "model.safetensors.index.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/modeling_kimi_vl.py", + "size": 105842, + "sha256": "a3a7caeecdeec75bc56e6c857c16fb049c5d107957ae97765d75fd8038cf9c43", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "modeling_kimi_vl.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/preprocessor_config.json", + "size": 402, + "sha256": "48c72c768c5dfeb731c7a9ec1a144cdc0ec058b18d808767c29ba0d502934377", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "preprocessor_config.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/processing_kimi_vl.py", + "size": 7538, + "sha256": "594aa42c97e0bc8ab8d10fa514764246fa0bd74921c51a1f9bb8ea9755d21df7", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "processing_kimi_vl.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tiktoken.model", + "size": 2795286, + "sha256": "b6c497a7469b33ced9c38afb1ad6e47f03f5e5dc05f15930799210ec050c5103", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "tiktoken.model", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tokenization_moonshot.py", + "size": 10958, + "sha256": "0ae85e29c37689fefe41b8bfdb7aebd9a0152defedbf37fae0f8413000512029", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "tokenization_moonshot.py", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tokenizer_config.json", + "size": 3857, + "sha256": "d7861718cab22c7962e14b4693b4009dd526115cd392dc779069a8173be95703", + "sha256_evidence_kind": "local_aux_hash", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": "tokenizer_config.json", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_0.gguf", + "size": 9083161664, + "sha256": "9083e9ac29082a023d4f3ebd9610d89962fa205eb5da7034777b0bdf5ae0e348", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_1.gguf", + "size": 10059476032, + "sha256": "780924706c8a9df254c30b33e6384de8b01db2d81a6332f0c7f8b0c44162db76", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_M.gguf", + "size": 10540747840, + "sha256": "33b0598c3700e15456e4789608cd7396445201a881d97e14df17b48beda29492", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_S.gguf", + "size": 9713880128, + "sha256": "a709f9add5d63f4dfd5f9dbc418a1a862331c2247363417c3a56549672bd7540", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "size": 31934229568, + "sha256": "714bdf24880a7c71d4cd2a34121e39c2cbf31cbfcf1860b13e8f99ddcac0d8c8", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "size": 906726560, + "sha256": "238c5eb49a350e381d946d35d289c781334a01a88b6c0c31d6bfeef8ef45daaf", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "moonshotai/Kimi-VL-A3B-Thinking-2506", + "revision": "aa1730989e7558695b44ee493623e03bd325a994", + "filename": null, + "relationship": "derived_from_source_checkpoint" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_M.gguf", + "size": 10540748320, + "sha256": "597373061abb3d5e125c6d8b976eedb1059bb2c4e91a5509d5cc8d8d66767ca2", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-GGUF", + "revision": "abcc7e983dcee7b2dfc9c874fea55e8fc8d1576e", + "filename": "Kimi-VL-A3B-Thinking-2506.Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_S.gguf", + "size": 9713880608, + "sha256": "562745f30cd79c89dc247ad41ccdcd40e78e6d549493e9609ff5bf19aa0fa885", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-GGUF", + "revision": "abcc7e983dcee7b2dfc9c874fea55e8fc8d1576e", + "filename": "Kimi-VL-A3B-Thinking-2506.Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_NL.gguf", + "size": 9083162400, + "sha256": "9d03ed1f97009ae541f2b29ced6b564dcd947ecf430689a395be6c91a3e0b660", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-i1-GGUF", + "revision": "c896f25838c88c7dcfec7c13caccd1738281daf2", + "filename": "Kimi-VL-A3B-Thinking-2506.i1-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_XS.gguf", + "size": 8745836320, + "sha256": "8dcfc5da55f85016482ac849615ca743a4e0085f8be5052726cd7dfed04e0678", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-i1-GGUF", + "revision": "c896f25838c88c7dcfec7c13caccd1738281daf2", + "filename": "Kimi-VL-A3B-Thinking-2506.i1-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_0.gguf", + "size": 9108393760, + "sha256": "3b3bf0ced352c03af1380107323e65d26048b3fcfb442684c449229a93cd767c", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-i1-GGUF", + "revision": "c896f25838c88c7dcfec7c13caccd1738281daf2", + "filename": "Kimi-VL-A3B-Thinking-2506.i1-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_1.gguf", + "size": 10059476768, + "sha256": "61fa02dadce8e5caf65e4660db204b18024135ea8db88f35c8925eac82de73bc", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-i1-GGUF", + "revision": "c896f25838c88c7dcfec7c13caccd1738281daf2", + "filename": "Kimi-VL-A3B-Thinking-2506.i1-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_M.gguf", + "size": 10540748576, + "sha256": "8bfff5f8d6b391e3ed3c6d548760d6917cd3e17f246af8ada800b6d485d569bc", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-i1-GGUF", + "revision": "c896f25838c88c7dcfec7c13caccd1738281daf2", + "filename": "Kimi-VL-A3B-Thinking-2506.i1-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_S.gguf", + "size": 9713880864, + "sha256": "3d4efede5cbe05496dc71648a230529c03ab8ae7b68b5bd5006f4551e3b84785", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-i1-GGUF", + "revision": "c896f25838c88c7dcfec7c13caccd1738281daf2", + "filename": "Kimi-VL-A3B-Thinking-2506.i1-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.mmproj-f16.gguf", + "size": 905371904, + "sha256": "50d5a7af02a92c68c797b0d5637f75492682beca325c48bf2a09961f422a651c", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "mradermacher/Kimi-VL-A3B-Thinking-2506-GGUF", + "revision": "abcc7e983dcee7b2dfc9c874fea55e8fc8d1576e", + "filename": "Kimi-VL-A3B-Thinking-2506.mmproj-f16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_NL.gguf", + "size": 16238568480, + "sha256": "8ccfdf140472a18928bb867e05f69c215fb7eb6e9c16a212b0ffa76f2eb023e0", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "Muse-Glimmer-30B-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_XS.gguf", + "size": 15435096096, + "sha256": "b3c03d94c007ae487fd5259b340ad23286190b62b0d4d452f06bc1cf8840a7da", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "Muse-Glimmer-30B-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "size": 16265565216, + "sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "Muse-Glimmer-30B-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "size": 17828207648, + "sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "Muse-Glimmer-30B-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "size": 17306324000, + "sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "Muse-Glimmer-30B-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "size": 16320943136, + "sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "Muse-Glimmer-30B-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/bf16/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "size": 39750446272, + "sha256": "bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/bf16/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "size": 15975065088, + "sha256": "e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf", + "size": 2729046176, + "sha256": "787e0708e439f0caa8e6caaafa5f0fec38e112766c150f313ac074e5cab087fc", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "dflash-Muse-Glimmer-30B-Q8_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf", + "size": 3849173920, + "sha256": "3727a47650ae65be12e91aae49f9b9f4bef09dc6c401a54ca1bd3d1a6160f35a", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "revision": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "filename": "mmproj-Muse-Glimmer-30B-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q3_K_XL.gguf", + "size": 13360983072, + "sha256": "820d18e00c59376331eba62dd716a6bcdcaa305c2316f5da3a2fab36c7c37e15", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Muse-Glimmer-30B-GGUF", + "revision": "faa5b025c584459c13febfa5c59883516710ae39", + "filename": "Muse-Glimmer-30B-UD-Q3_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q4_K_XL.gguf", + "size": 15878222368, + "sha256": "82bece304887a313ece08400bc030f6066c7bff5b906b0cd40308ec8a409fd38", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Muse-Glimmer-30B-GGUF", + "revision": "faa5b025c584459c13febfa5c59883516710ae39", + "filename": "Muse-Glimmer-30B-UD-Q4_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/unsloth/dflash-kquant.gguf", + "size": 1631205312, + "sha256": "27d9a805fa29b943cfb6ad4843367cd4eaaaf06bd452d8cc3e00a2cd18a677bc", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "unsloth/Muse-Glimmer-30B-GGUF", + "revision": "faa5b025c584459c13febfa5c59883516710ae39", + "filename": "dflash-kquant.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "muse-glimmer-30b/unsloth/mmproj-Muse-Glimmer-30B-BF16.gguf", + "size": 3849173728, + "sha256": "d08cdcfa0b41d8e20554b52df404ba4f7b440d0bc502a90038508b6407df8ee1", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "unsloth/Muse-Glimmer-30B-GGUF", + "revision": "faa5b025c584459c13febfa5c59883516710ae39", + "filename": "mmproj-Muse-Glimmer-30B-BF16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_NL.gguf", + "size": 2775541728, + "sha256": "f007c3dbf67df668354d37ae13d87fd5789059704977959187e8342aec03b66f", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "revision": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "filename": "Qwen_Qwen3.5-4B-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_XS.gguf", + "size": 2671339488, + "sha256": "628124c61a806897d3f28dcd416be6daff94f62f731eb900d4381875eac9e412", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "revision": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "filename": "Qwen_Qwen3.5-4B-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "size": 2776033248, + "sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "revision": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "filename": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "size": 2979850208, + "sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "revision": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "filename": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "size": 3013027808, + "sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "revision": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "filename": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "size": 2846156768, + "sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "revision": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "filename": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf", + "size": 8665620192, + "sha256": "714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "revision": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "filename": "Qwen_Qwen3.5-4B-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf", + "size": 675569216, + "sha256": "463f39bd1c291c1186c319a8c90ff8640aafa678b14cbee2232d695113dfbb66", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "revision": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "filename": "mmproj-Qwen_Qwen3.5-4B-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "size": 8424393632, + "sha256": "9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "Qwen3.5-4B-BF16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "size": 2579944608, + "sha256": "ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "Qwen3.5-4B-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_XS.gguf", + "size": 2477053088, + "sha256": "658a9e7e406deb06d0179755e3c14f6a82915a4be4962a2f92a64d948d2e572f", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "Qwen3.5-4B-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "size": 2583221408, + "sha256": "298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "Qwen3.5-4B-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "size": 2784416928, + "sha256": "af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "Qwen3.5-4B-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "size": 2740937888, + "sha256": "00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "Qwen3.5-4B-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "size": 2590430368, + "sha256": "27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "Qwen3.5-4B-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-UD-Q4_K_XL.gguf", + "size": 2912109728, + "sha256": "b252c5610a42ca82d20fe2a12813e9d069eed89292907e26c783eeb0bc961bc7", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "Qwen3.5-4B-UD-Q4_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.5-4b/unsloth/mmproj-BF16.gguf", + "size": 675569344, + "sha256": "302b92d565080b9cc0281186979ae75a7429ec23d14f6f7607a035539b21f3a6", + "sha256_evidence_kind": "expected_upstream", + "source": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "revision": "e87f176479d0855a907a41277aca2f8ee7a09523", + "filename": "mmproj-BF16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "size": 39753375712, + "sha256": "dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "size": 31312565824, + "sha256": "c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_NL.gguf", + "size": 20754978432, + "sha256": "41e9f836690bde9619928538cb4dd170472d2e851243637f7092937a151297ad", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-IQ4_NL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "size": 19699553920, + "sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_0.gguf", + "size": 20836243072, + "sha256": "52312daa5b2190c1f5723d33c3315c01c55af4206f6c6e6eb63f3d8dd52bb85e", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-Q4_0.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_1.gguf", + "size": 22868448896, + "sha256": "8babe2c6f46b43815cae7ec2b970be8508d6867234ebf16c376bd9cc79477354", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-Q4_1.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "size": 22662526592, + "sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "size": 22285080192, + "sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "size": 21486360192, + "sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "size": 902822240, + "sha256": "1c625f05cd52e90abc76a5f756226c3a5fe279593379c22f6c6846c970a0cd18", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "revision": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "filename": "mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "size": 22134528992, + "sha256": "ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "revision": "a483e9e6cbd595906af30beda3187c2663a1118c", + "filename": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "size": 20893015008, + "sha256": "a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "revision": "a483e9e6cbd595906af30beda3187c2663a1118c", + "filename": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "size": 22360456160, + "sha256": "707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "revision": "a483e9e6cbd595906af30beda3187c2663a1118c", + "filename": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "relationship": "downloaded_file" + } + }, + { + "relative_path": "qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf", + "size": 902822624, + "sha256": "356dfaa3111376a4f7165e32e8749713378d1700b37cf52e0c50d9f23322334d", + "sha256_evidence_kind": "actual_full_file_verified", + "source": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "revision": "a483e9e6cbd595906af30beda3187c2663a1118c", + "filename": "mmproj-BF16.gguf", + "relationship": "byte_identical_to_pinned_huggingface_file_original_download_history_unconfirmed" + } + } + ], + "qualification": { + "created_utc": "2026-09-07T01:55:35.237827+00:00", + "total_main_checkpoints_screened": 119, + "counts": { + "retained_sparse_screen_pass": 115, + "retained_with_distribution_drift": 1, + "removed_confirmed_current_CUDA_numerical_failure": 3 + }, + "candidate_records": [ + { + "candidate_id": "candidate-001", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 17155893600, + "sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.8709941985465819, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 4612.831190107988, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.9794560185793101, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3170.1851925820665, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "14868f3cb71e61e7d383b941c8d7cc5e9bf13575619013527eedbc84ae3e4903" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.7288807563078277, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 9013.253235895914, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d437ed493bbd1ab83d0795c092a933017d0943056a3a080e3d1e2f088ffb2918" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.9046458207526079, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3435.077015006144, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ee552e15f8c74a539673af115239d1eeed10720f7207f32aa224fcdac8ee79fc" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-002", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "IQ4_NL", + "bytes": 17287670720, + "sha256": "811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.8839090124849022, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 5181.839191286958, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.9540475432012663, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3233.500330007127, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2e042a095d31ec2c92f8353da202d5e1ab76908f92ba5020c8c4318a74b7c226" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.796145253049212, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 11057.46285143907, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "bc9767c3855575241310debabca88365d1eddef362c3b4062fbe166880913cae" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.901534241204228, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3891.5569949593655, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "07a9bc988fcf1d0908171724377a982e439030e137d8cd09f3b7800b087c13b1" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-003", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_XS.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "IQ4_XS", + "bytes": 16372460480, + "sha256": "e3d40b6e363954c993a6e28b160d881dfe5a243b62746bd4092b393d4f1d54e5", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.9677256053809701, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 4972.631015222648, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.1058016521502978, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3870.322818988431, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "89cc3917e419181fa4820e1267d7254ddc82286c6c36e4c1d283452015d5317f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.7895150696344453, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 8315.469211340336, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1eb6eace4ae708e1ad261aae9ee03e96fb91924a1bbbbdf2e4fd2bc387229ba7" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.0078600943581673, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3820.5400164530142, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2782a3a023b27621f167aa58caccbdaac56376f88557d4ad63e97e8421968956" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-004", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "UD-Q3_K_XL", + "bytes": 15380222912, + "sha256": "73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716", + "disposition": "retained_with_distribution_drift", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 3.5566490669986384, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 4950.663642119001, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 3.710583906597111, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 12799.591348594313, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "558fe41a3041adf1fd2027a2122a19acf2e0dc36697a94dfad8d0421fff81ab7" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 3.364230578607934, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 4804.093129000606, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "58fde496b8b53726e58c13db7735d6d31b5015b338ef8f682f51b1bbb0d1f7d4" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 3.5951327157908715, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 1973.2528538066429, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f76ca1dbfdf077f81245174fb5d70d1c8f50e6f509cc47085f7caa519c144fd0" + } + ] + }, + "notes": [ + "Substantial distribution drift reproduced on six fixed windows, but finite metrics, source SHA, and completed coherent arithmetic operation are valid. The lower-bit UD-Q3 uses 4.0041 tensor bits/parameter versus 4.4658 for the nominal Bartowski Q3 control. Retained as an operational candidate with larger quantization loss; no general quality or isolated CUDA-cause claim.", + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 2.892545025313801, + "PPL_reference": 12964.851857612222, + "PPL_candidate": 29628.27435877505, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 3.562193272679282, + "PPL_reference": 41368.00589307904, + "PPL_candidate": 123830.27655502838, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f4bf868d0470d63c5d285bbbf3b09ddf2461bdb2b98d6760966f75bf5a3387e6" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 2.2842431543015147, + "PPL_reference": 11468.295417470643, + "PPL_candidate": 31402.622747564466, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "61893a93d73b2b20f973ff2e9a2dc26e0271ec920c2733c80c32423805c97a27" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 2.8311986489606062, + "PPL_reference": 4593.452373266919, + "PPL_candidate": 6688.462677856313, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "112bf7238aa8e2a31e5e93a7a11900843a90fe82200d3c7e26474b1022699dbc" + } + ] + }, + "additional_windows_vocabulary_policy": "allow-vocab-attr-mismatch" + }, + { + "candidate_id": "candidate-005", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 18822970304, + "sha256": "9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.57175019649433, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 5737.559393366973, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.6673691962663566, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 4020.3627168160206, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b26b254dfedcd281802d722a5d297f295fbf7d2b6e7359adcc7b517681472db7" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.5179413344548801, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 10741.009582532744, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ed80230c37971e39a2774b90cdaa0a2ee4f3c630d8ecf89d233ab74985acbf94" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.5299400587617531, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 4373.924093015307, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e8c8a7f92cf0861dffeec916ee496164142db5f817569c5537c4e2948c29696a" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-006", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_NL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 5232226784, + "sha256": "b56f70624694ca5f2362cdafe6acffe35c5e0f44693c568f3f09fa83b968fb74", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10219618652687955, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 48.45867786299725, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.10231915311877456, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 30.565795480984484, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "077cde1ebe932fd52016be49a8353575ace504e9791c661789f401399f7f2dd3" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.1031304390361306, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 86.73973201336828, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f408841129ea1e8f54af0c9dc181bac948c9330d9228681728faf2a4810dcc04" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1011389674257335, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 42.920117610717256, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0a53d416a017e507727a3081c039fd2a65e84ee1cef4552d060b492a33d4ebcb" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-007", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_XS.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 5112828384, + "sha256": "a24429604e6f680e7bdf087b863a6cecc90f80b3d908f95d888f4f05003fdee3", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10246010047470523, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 48.14783114618879, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.09755343352319916, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 29.912741558348113, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c27a6bae81b1f34bb280c2f84cc8959b2df6fa46f2d2e5a00de8683d9ec81614" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.11415407854789236, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 89.43810715431859, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "73ffba544f324dbeeb6451fa6bdd48b78e22006fdc9adbd2ea1315046b81471c" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09567278935302417, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 41.720679035907274, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1a6f37068b2e7e94eb4c89fc89b026b5278b96d3d28f502b4cbe2ceb841e359d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-008", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "IQ4_NL", + "bytes": 4835839104, + "sha256": "fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.0992462983045245, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 47.55837056144447, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.08173399371927537, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 29.515076549800362, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "38d1c43402b95b1b2920d04f620696337edd0b1a5bec01267b66deb1e3215388" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.10839668714078088, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 83.69393989535517, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2737cc820d9460c20b9391722954bd17eb2fc72985cf2749a0bb0ba42e0f724a" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.10760821405351724, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 43.54546902634053, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6e28fa91aa5a0120abbf3c3f01949807de5567b6ab493d5e19922d393b3bcc1f" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-009", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_XS.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "IQ4_XS", + "bytes": 4715416704, + "sha256": "0847f7300471e9a61abaeb46b45b3d61e393af8fa6d6aa70c563623773670dd9", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10254910436629212, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 47.01307956009178, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.08271484012158643, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 29.03780994712443, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b4ad49d770db610ebb999621b82a47417ddb2b04b04fb48d343834bec63c5819" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.11365997813516104, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 84.81749396066122, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b53fc9d024663841e69bd044b079eaff2b1d7473526b6640b1e8f073fafe84bc" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.11127249484212888, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 42.18973581085117, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cd3c7f1fab5e1b50531f85fe437ec4a5dd4b432ca7ab5540cb189a2ee8b5fb96" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-010", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q3_K_XL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "UD-Q3_K_XL", + "bytes": 4588440704, + "sha256": "7558880ee42b79ab732481bd7250e85c41d9ef044b22634b8a912eb184224009", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.576536169259216, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 141.58918199909223, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.497150870386366, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 119.74079362211874, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e838468669ec9d2e76b1f6819060c0f4519ca0c249542324beced8ca3afc33e9" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 1.5423446660580606, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 207.5218225859721, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e1645afb27bbd4c4be85cc29cc626ebe4ee68060987a74a06237ed2d83b4f1cf" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.6901129713332208, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 114.23108790426484, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2cbd8b7655143d3ec79b44d8a2a9e239f2ff681e18cc4bb9371e1d197308acf9" + } + ] + }, + "notes": [ + "Elevated distribution loss is reported; the fixed severe-failure screen did not trigger. The Bartowski nominal Q3 uses a different average bit rate.", + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-011", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q4_K_XL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 5126306944, + "sha256": "3cf61de12daa015ee0f7b68e7b7c541405bf220e1e942bad8b47cab827d7df80", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.0727525557799666, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 47.869607150910724, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.06407102536466532, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 29.60300346081908, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c01f42103b72036e1a4df73f41b6ccc56d8e79401b66ce5f7648ad84be6ce660" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.07652880535820482, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 81.48270225008788, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fcab08f5a5b8e924f979a614a1af08896380a4d957d1185570d9c971fff74521" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.07765783661702966, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 45.47559509511411, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fe6298cfa46b8b5c57f46c2990a696e48e4d8d6e7dc75c2928efe8deb4a20508" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-012", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_NL.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "IQ4_NL", + "bytes": 9156693120, + "sha256": "294596d8c89ec237e50341a73d8122b1527db4e6eb0ed0243f86785fc772bfcd", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.053061740024844574, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.450688912190714, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.046113225623184026, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.885318149808423, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4e309f68e164bdaa50ed1d13a1452cff922688ac1d58fa08282c7aa59bf5f298" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.07072297862207907, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.234775023818754, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d17a77f954a76fa676039bc6c4f136c905bc015867f9f1a1595585b826cb1ba1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.04234901582927063, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.1679053436708, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dd33e40722e13c8712717c7f00e324944ac75179399dc67e67ebd9e27415987f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-013", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_XS.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "IQ4_XS", + "bytes": 8820448384, + "sha256": "6e5bdf00c77ef6f4c0a871cbf2f997cb11806b7423b50decd5e4ed3989f3b973", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.055164947157440934, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.521949047391484, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.06823252345490675, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.993792494245979, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "596acc0a36cf92b11af3b201011a9c04ddf5f065cc8aeface01f6ae76e9e994b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.05223403468690402, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.028953912500057, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f186c5e94d7a1afc6527054102fb854f3626015831bac9b71b008fe4477bd02e" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.045028283330512016, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.438940170051554, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9b1b16b58d960db715d196bf96ceb34f7485d08d6ec20881330d32c1e48ebd1b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-014", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_NL.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "IQ4_NL", + "bytes": 9083162400, + "sha256": "d1364554ff094ee66dfd2fb3787cc87cf3ebc5c944eb965f354e3c6eaf60aed2", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04322016801491973, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.309582333375257, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04659631008054181, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.872510172382784, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4a91a15601dba04cf1115526e61bcc860f4383e1242ba7b8a137b145a60ca2d3" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04675539811852265, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.799526498078222, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1079d3b59d8e6770ae9ed0beba6cf2ec1d733d321651850a0e49a01ab7188fb9" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03630879584569473, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.108893593867595, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "345f4d547894b94b3c341f4529001f2a7f85b2274658c0f359b84dcdaac00a5b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-015", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.IQ4_XS.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 8820448800, + "sha256": "c59481e1bdb3a284198ca16e523fefa1ce8a24b7dad8ad2275dccfd58807ee39", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.055164947157440934, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.521949047391484, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.06823252345490675, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.993792494245979, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "596acc0a36cf92b11af3b201011a9c04ddf5f065cc8aeface01f6ae76e9e994b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.05223403468690402, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.028953912500057, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f186c5e94d7a1afc6527054102fb854f3626015831bac9b71b008fe4477bd02e" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.045028283330512016, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.438940170051554, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9b1b16b58d960db715d196bf96ceb34f7485d08d6ec20881330d32c1e48ebd1b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-016", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_XS.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 8745836320, + "sha256": "5d6aad466030edeb73f44b4a32c0c98d081d0e03a300366d6b63fbf469bff073", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04508017089618174, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.386365141771177, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.05122243249106938, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.995698179879965, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c0872468237bbf0b1e8f79fa06894a370925ca4f7cad27457069fbf069392770" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04728352120561313, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.785178290338033, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dd5fcf9b8cb510af150db9b236b821d7d09b7421d6224f42e31e9d164d20ae88" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03673455899186272, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.18217461077336, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7fb185c0b27f0976564ec87bcaa55a5fbfa31e43ca1e6365eff076b5faa51f5b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-017", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_NL.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "IQ4_NL", + "bytes": 9083162400, + "sha256": "9d03ed1f97009ae541f2b29ced6b564dcd947ecf430689a395be6c91a3e0b660", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1390624147742974, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.542854850786844, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.1665027725789211, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.784116117791223, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5afeed81d63379edb6af3934f8f1be9efc4617e31be808957b3b055faeb61451" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.13374242727837626, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 15.979944854627822, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5547515fa46334d38a50e868b98fec92806682fbafa3d75e54d40ca0678d32af" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.11694204446559489, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.620957812932634, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f4052d12313c6e08c8eff65bcbb23b46a0534d8d419162fdefdad3f54eb5d98d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-018", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_XS.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 8745836320, + "sha256": "8dcfc5da55f85016482ac849615ca743a4e0085f8be5052726cd7dfed04e0678", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.13003631525522066, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.379559269193802, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.13686256781337244, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.327034208209456, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f31b54ed195ec30be32fa6c67b4d015ace82f4146a127afeb75535c957648f40" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.14273063264109248, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 16.583031754051092, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a41078b2ad38ac6cadfcb76a349a59c10a6454e5dae936a3de464eebe9d8ace9" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1105157453111971, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.266143703245714, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "86dfd62966299b6abe3b182e949af4bfc41d6df6865bdd349d12ab712c23693f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-019", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_NL.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 2775541728, + "sha256": "f007c3dbf67df668354d37ae13d87fd5789059704977959187e8342aec03b66f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.023784478446108835, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.293977066123706, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02133222501558396, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.219588614725853, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c81f6480edb6a3bafbcdcb34394a226f786daccffba6392450d47d13a0ed6ff6" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.022984530057787125, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.758647554542978, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "794c10080cba033cf4ea074469b0743513287a11d30ce84f542493479137ffa3" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.027036680264955423, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.4002022412149, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "171a4b350159fa49f95c053a43836b6fda4ff709a2be7bf77741da8f6c7f7ea9" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-020", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_XS.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 2671339488, + "sha256": "628124c61a806897d3f28dcd416be6daff94f62f731eb900d4381875eac9e412", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.023796562876705615, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.182109930421692, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.022309077272513925, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.10582664829915, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f22717db60318158022b276aeec86badfe5506d810da35bce8fd3ac6af3b5d0b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.023562276031289537, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.645229010361728, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6e7f6ae0f95fe959e21d40a72316497f17a5ec716ffb4aa0d66e3498e876ba61" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02551833532631338, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.301198581920504, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5b2c4256b1f516631392ac7c36e16b9cb076b69c647b08837dbb11bfbc47223e" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-021", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "IQ4_NL", + "bytes": 2579944608, + "sha256": "ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.025707897045922554, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.234146392663085, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02512212833348267, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.245684490362607, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "47fde5db0ddecf464b8f44caebe5069ad4670fb1467efb4c879001b9ced4f22b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.025460166536704135, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.775815576974509, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "db0c3dd41d87cdba88973fc64aa0bef29507d8cdfeaa5113c07d0bd250b9aa29" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.026541396267580862, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.143715618013912, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "85d214485051b0042c871f94264e5a1cd6c889e7dc852ec5e384985accc4a5c1" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-022", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_XS.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "IQ4_XS", + "bytes": 2477053088, + "sha256": "658a9e7e406deb06d0179755e3c14f6a82915a4be4962a2f92a64d948d2e572f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.025324262998957934, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.132462127770346, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.022721007938319007, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.1172861201782815, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b20158419e24bed19c46764671df207eee94ee28782894f285abe4f1fcb5c504" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.026402621468849818, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.632898810280043, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c7a80cb885f7eba1ceef25ecbc0565a44e7e9bb3be6f8ece7056f017d81649b2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.026849159589704977, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.127468782428295, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "285d6c19c187d9dc5f5c6b47dac50c01fceb52dc9270decf67e9c948e107663c" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-023", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-UD-Q4_K_XL.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 2912109728, + "sha256": "b252c5610a42ca82d20fe2a12813e9d069eed89292907e26c783eeb0bc961bc7", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.013083331956401701, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.23897559041603, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.012917053909545667, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.034411324304445, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f93f87041e44b6232e16f24bfd3868a433399991a4f2f2fcf6d340e52690399b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01415649142780275, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.997962514987398, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "53b53b1d987e96166618386e0c5ea8ff20518d4cda9078c2222feff98f98baae" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.012176450531856687, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.269861270230182, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "47e0647ce1e0549085bda5c5acb77d377162c1c2a9e58823b8a6cebdc725fa30" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-024", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_NL.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 20754978432, + "sha256": "41e9f836690bde9619928538cb4dd170472d2e851243637f7092937a151297ad", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.021615180135507655, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.381589625434311, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019587033485099842, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.097641394049093, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "08cb5097eba3b66b8e2a36ac0a475d79a7012544a6bf1e262829d1cb07e9f567" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.021085068775161798, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.544728200194741, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3cad4978180f00a389991c9790327a789a43d14b5ce5c86ab9b7eb2ae2348c29" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02417343814626132, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.811739889992398, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fc7a1b85207b4f3a8836afab18d38a3a0a68974f46795e0cc60fa15ff3f26b0b" + } + ] + }, + "notes": [], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.026807996728183264, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 6.786749809628335, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 0.02599571733356635, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 7.856617922309115, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1fbc5a4d310278af9620850231901d341dbc06336e2c630e7bad23c9261e36bf" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 0.01975093297667484, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 5.090639071488506, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f96684041dbb40bf164124cd2d9d4008ba72ffb39d3c680c4f26aad1385cb967" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 0.034677339874308606, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 7.815874521389845, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "aeecb71fb2b98fee4624b73ff0c72309c370205276281f737694bcb830981cbc" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-025", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 19699553920, + "sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02322642581254325, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.364823325700074, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.023378685870851228, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.073767536634147, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e08cbd7c13dd9966c85f2bb3ae8f616c876695cedcbafc6a22af92f28975f880" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.023366612274456237, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.558059711914828, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "60006cdea3efda70249b8e76369e83dd7786350534155984cd70673f3921c2cd" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.022933979292322285, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.779558492446657, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2bd1a07405343b250b9cf4bbd3ce0e39de5993461a6737dded294534a36bcd89" + } + ] + }, + "notes": [], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02822878254251945, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 6.773700388422697, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 0.029002635209423592, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 7.8902791356032145, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8f2358bec16715751322dbda235c2c7cc84ca6a1f1cbf9058bc3f7b97ad3f047" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 0.018821788390952558, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 5.031125488574295, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8057ff64002e333fee7c2b218311a9ed7440b73b2835a7e3aafc5d347204d563" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 0.036861924027182205, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 7.829254889041672, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9e2f106dd63071225392b4a885fc48e567ad1ca12f94e64fbf27611d1c36f472" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-026", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-IQ4_NL.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-IQ4_NL", + "bytes": 18040888288, + "sha256": "0d17e255dc257a11f398ed4bc8d62412d8ce9ca24b3fce2947d962e4bfed5758", + "disposition": "removed_confirmed_current_CUDA_numerical_failure", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 9.364983969342475, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 64322.66605566028, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 9.054144917749891, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 43284.40659822908, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "098acef7be1465d4842ee5f39213b56e3db0ad578304746d47be4b611edda550" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 9.612933812421911, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 93918.15966843275, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "f2b9483835256cec232aa60e0ee9f91753163bf73520aba4c7ac48a780bb12a7" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 9.427873177855622, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 65465.28584402369, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "a687776d63c3b373fe10037416fb8b42e7cba1d198b2bbc252864b9d655ea1b0" + } + ] + }, + "notes": [ + "Full-file SHA matches pinned upstream; not a demonstrated corrupt download. Root cause is not isolated." + ], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 9.424356026402096, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 83250.79344678973, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 8.930305086865145, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 63011.76010139055, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "e9bf2517a2f0ba755c7b8c9295f1b39433d38fe73a69f4383bb80751c03065df" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 9.495158492817598, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 70139.05922046494, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "9ec61acc780c8019c2bbd91922d414238972802b089228950467936f6fa0a691" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 9.847604499523547, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 130552.02027557036, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "b566882a7e44a0a2039369fcd47fba47d1745d8600707a109f1c27ac09e38c30" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-027", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-IQ4_NL_XL.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-IQ4_NL_XL", + "bytes": 19500506080, + "sha256": "071ee2a008ec51372f990d8efbea92ec9dd0137974110ef68fbfde429c8c6dd4", + "disposition": "removed_confirmed_current_CUDA_numerical_failure", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 6.847529968643695, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5745.514477094899, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 6.489482927220124, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 3248.1886149799893, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "d297d1648593a58d9251dcd6f7dc1aa90c28c707fdbf15ea5eef414e1026682e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 7.11991349493756, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 8288.726741053822, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "3909f49cdcc8431eebffa7856e71eca276ecd293118344c6758d4f2bf9064f89" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 6.9331934837734, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 7044.622212356466, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "b8232a2d0e9a8216f7cb246c2b4511f3f33d225a275923f487e2c3b9906fad74" + } + ] + }, + "notes": [ + "Full-file SHA matches pinned upstream; not a demonstrated corrupt download. Root cause is not isolated." + ], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 7.132222225210246, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 7992.022468400995, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 6.772524439353569, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 7095.364540972447, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "9c4248f6eb62b6f2b3ea8ccccff2377c364b5e2ea0e995bb3c39b1345532db65" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 6.811026959208881, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 4170.659223892634, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "d69a2981d183ac9625c423446cf1fedc3819062d97ec45ed9b20c3bdbb8d5592" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 7.813115277068288, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 17250.06235505412, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "25b7ac02cf07bc5bbb5396d58f7149cdc50689934626c58f2493dd50ad234998" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-028", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-IQ4_XS.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-IQ4_XS", + "bytes": 17730509792, + "sha256": "649d7508507b84638732c4f52c24c8b15843c6dca2f3ff793ae07c14a67ebbb3", + "disposition": "removed_confirmed_current_CUDA_numerical_failure", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 9.409277993966551, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 66694.98389551807, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 9.300592603461416, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 53360.679189798706, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "7eab6cb36473fca381df9897a910aa896a4818aa98fdd62a8fef0ad074defc0f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 9.610950671925265, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 95004.14986520872, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "4c3527554c32e2a54901f8f44caf3f9754b65dec8fe11505d02b9804108743c5" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 9.316290706512975, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 58521.51913010842, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "2e36f9dcb972716d41860c1c4aeee9cac03eba9493c0c4e32c57db53be3b3b93" + } + ] + }, + "notes": [ + "Full-file SHA matches pinned upstream; not a demonstrated corrupt download. Root cause is not isolated." + ], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 3, + "KLD": 9.430330372947493, + "PPL_reference": 6.615780728789502, + "PPL_candidate": 85471.63390627233, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 9.18556794792998, + "PPL_reference": 7.767159025418989, + "PPL_candidate": 85853.40731086858, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "080465a2ac1cd7fb36066b90c3338d1f6a81ac0e65d30ec9b13b24722c1e53e3" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 9.426500731356004, + "PPL_reference": 4.98547054495033, + "PPL_candidate": 72002.35123621192, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "67238ec4ce4dad7e3aca56dee74de3ac143d4608459ba7ecb7ab946b1a4fb84a" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 9.678922439556496, + "PPL_reference": 7.477819127431604, + "PPL_candidate": 101009.40294132648, + "KLD_threshold_hit": true, + "delta_NLL_threshold_hit": true, + "metrics_sha256": "92f023f0959efdbcc86e7ed48e7e8ad8aa4755d431af6e4e00c527fcb5c00937" + } + ] + }, + "additional_windows_vocabulary_policy": "strict" + }, + { + "candidate_id": "candidate-029", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-Q4_K_M", + "bytes": 22134528992, + "sha256": "ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.010502134859054497, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.274689959531069, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.0067445308745274195, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.0498515131071064, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3f0eedfbd923ede9a37ed1229b746cd7eed90d36ac99a2aa199bde0e4148b631" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01399282212093264, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.318622621400951, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1e6027be43618061715e4471500c63fcf1c01e896fd58f783297e0dd3c73813b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.010769051581703435, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.734945484606669, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9cf2528f5d84ff266ab660cee4b5ebe4cddf0760015822f3f95091909db342e3" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-030", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-Q4_K_S", + "bytes": 20893015008, + "sha256": "a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.012073461131714253, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.345842621276376, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.011005600989449919, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.030768025410018, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "db392759267e9c53db1f6d40db06c65cf883555e841656fb80d39c6aa10e42db" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.013593851150490617, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.488109784212366, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d5509ff13b499ea2623450c1c48d0a3ec40eabecf46c7d2fa1d10b4b1fd8175f" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.011620931255202223, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.841743889348354, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "71793050f6c8fd0618ad061d264f72ef2bfba37db967c5f7b05a124b50519bd4" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-031", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 22360456160, + "sha256": "707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.009052617464377709, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.3061014522905285, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.0057613479800360055, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.0787937985438125, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8a908aa15de9c2fcab5d15a6795c2aacb148e6c2d736e3b082a970bb9b9d254c" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.011856894658170431, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.285987967397231, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4307edfb85711aad3cbee296d1b091102142c8dc7f89e03cb319cec80f4a4b7c" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.009539609754926692, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.8266824840446105, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2903c7135923436d21685399a7ef0eaaaaf8dc151d764cce5d045a89c38b5dfd" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-079", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 5465179264, + "sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018448039016069406, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.32325974014943, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02083471774880853, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.486668961113858, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "54e0907e815c3d5a64f6ccbd768cf6e7f6f0db2cafcc076c85d30a661ae71ae1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019840731938568876, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.615122134711212, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f1e80a1614968ebf035872829b5d0d8a65176f87a741684deabca77c4209b08f" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01466866736083081, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.104046793026008, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "379bceb770dfc3ce17dc4b49be68e914a1439e4b3ec7be8a3d0fadb5c6dcda22" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-080", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_XS.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 5262279808, + "sha256": "4342477286625c4cfcd70d0023bdb3ac30613fcce729123e0277097c7dc42e2d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018103651283492287, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.302404842348925, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019398662975544313, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.474711777174666, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "aad74aedd8f22a3a98da6d812c3551bf12a070183f3f79d6316534f4f64823b0" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.020454225256645597, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.567677174039947, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5dbb92b0173a6635eda61a4b852198cd67d753183899f71717bb297545651596" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.014458065618286949, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.095490800664185, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "13b04002de16bed40316f85b4d10ccdd43841d35ec017a5e09e63d28502dd3b0" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-081", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "IQ4_NL", + "bytes": 5465179744, + "sha256": "d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.017217786023406133, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.302934265661214, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.018647831173717298, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.496960139781056, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b21ed7c330b17f62e29cd38750ef826d6b9461ad30c45d539a4f58c7b379b65e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.0185309380601122, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.544921499298708, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fd32aa07fa54a3792df44e3565e62fe82a4003a8a3088008323923ce79492a5f" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.014474588836388897, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.074041800865176, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "95ca2a168ce8eb9fe2f9b54e53c63c0ccbf3bc15ac0831bb74a7df887a7b0d6d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-082", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_XS.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "IQ4_XS", + "bytes": 5281678944, + "sha256": "23ea7196ed6f595c44591266a1b4b90d56db5a66c5223d49a41a587b81ace35d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01739768527121302, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.289581206478566, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.017796977804151844, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.485264812947823, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b2bf33136ce488724391e5b52d620fe0a5e50f7574565af63ed85da2023a60e1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019476292103721718, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.470141778275535, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "40e4ab91bb223503fe6ddf7654ee1157e0fe62290ad5fa8ead03fa1d4a88769c" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.0149197859057655, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.119334900063208, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "547520359f2acd97c45b4138f1f07cab301b3451c346a21917baf04f1fac1ac9" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-083", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 6187353696, + "sha256": "b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.012324135070447308, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.351119664117333, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.015371009660986165, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.5193186669468055, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f2856e6edec630cce310272f2c09bbc58d23425db3e950d17ab2e3d5dc851e45" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.011930681453580238, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.719382603416888, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8f32d7fed8735d0d34fc25997424d45bbb8654dfe10283480ddbae5813478e71" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.009670714096775519, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.043755931474548, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9e38e55b160f636f507f425d5db5227f5797c2ca6ed0d4c89bb0e1d4dda7ca3f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-084", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_NL.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 17386275744, + "sha256": "bf516e4962edd42afebb1f2dd1cbe9f5223863adec745bc4d81a0b1211ca5111", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.017695043762586942, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.551290840378892, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.016515456099935086, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.977278592874585, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "bd3edfed23d9f772b3614c6fd4133ffec3fbf15a0d64cce108ef7b5dc4e1a856" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01952281949013245, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.037550485277322, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d47f11aefa06aecb9d4e52bbf5875690c657eac1f7a2e35dbdc711b2d5bd0ab2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.017046855697693295, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.422305328610149, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "15760f927d4db1692ba58201f772ed39dd42cdcdd7b95360d3ab6d0f5bc6c45a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-085", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_XS.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 16457999264, + "sha256": "c686a3a767fb94ef19499815036fdfb63213664cf0d5867c63848c7ec532d69c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01881347961884568, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.531049059873261, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.016211519030960644, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.9611390981629135, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "85d299ef241b32d6a30fb30cdd2f27e530c3d005663eee1a9b79f11ddc3e51a4" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.02221207246450956, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.044608994636679, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e40513362cf9fbb744cd43aa37faad34698132a5567ad5569d51864b2f34028d" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.018016847361066842, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.369194645352614, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c7734ce804fcb37483864c64c2eac0bd96992655112d53ec5cb81d576856e35e" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-086", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.IQ4_XS.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 16557090080, + "sha256": "be28be57166c9903fe701c99596aa3c7df9f8c834f3109e6e9b4668d72cc646f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02344195739298896, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.502900693429886, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.020383110703249867, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.006122228643898, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3bf37a2bdbfd89bf08d91f455d877666855dcbd1594bdb1c61ceb9951a34c6c0" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.02587992312389949, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.87727986811867, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "11028561331ce93deabee8ba1ba5f7cb063b752e433e6b6556611c54489502ef" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.024062838351817523, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.362625306476414, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "98aef1eda771443cb7f09e2a629cdfca99e789dee45b564e33db953d9a57737f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-087", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-IQ4_XS.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "IQ4_XS", + "bytes": 16368346656, + "sha256": "d768d7983f8bb8e7804812679b0626a2fc8a87383461b0285ee5e23370143f2b", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.021297824351990284, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.533055149392332, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019931147622854216, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.953826889989638, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3cc27d1f8e374b9075fbabd62c4a865c49bd37319906eab7096bcfc1ff5e0e48" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.02388909393568218, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.07596287133927, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "755907d10e93b42f2ccf4a859a88e1cbfddc383812de5a79c0ee7b389fbbfaac" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02007323149743445, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.356926537952631, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "791d31960c5f67aedaba0894b476546c001158635023724c3060e94baff56eec" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-106", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_NL.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "IQ4_NL", + "bytes": 16238568480, + "sha256": "8ccfdf140472a18928bb867e05f69c215fb7eb6e9c16a212b0ffa76f2eb023e0", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.013822652021215043, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.920863583726871, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01169428321605357, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.8307494932689226, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9308605f0b38c2597fb31a3a38dba540ba880007a4bbdb5826c57ebf69c32d4d" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014031706187030495, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.367067575196865, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a2f3f98e3fabc857adb7c9c54b22f0c39a3ec41ab1f2a342f445f079381ac393" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.015741966660561064, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.342459708936508, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cba04a8492b1ed54f837a25373f3b8d605fc6cc18ed1203d4b6b9e225ea3209d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-107", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_XS.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "IQ4_XS", + "bytes": 15435096096, + "sha256": "b3c03d94c007ae487fd5259b340ad23286190b62b0d4d452f06bc1cf8840a7da", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.015149432078010585, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.970935094253601, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.013342324615335794, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.8498284281065422, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "80e842cb92d041df4c99107cf6170077b2c1243dc8e9949e95fab9ce46efbc45" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01682354845038345, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.453132880961084, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2ec0b53ea3bebbaa136035c1cd1d4b76e93e6a22925621f9eacafecaed6b3c48" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.015282423168312508, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.409120738881072, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ef2cd557749def6c169e97d2c3a754508b16611c992e868318e620ce344a7029" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-108", + "relative_path": "muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q3_K_XL.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "unsloth", + "quant": "UD-Q3_K_XL", + "bytes": 13360983072, + "sha256": "820d18e00c59376331eba62dd716a6bcdcaa305c2316f5da3a2fab36c7c37e15", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04720273515353749, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 7.369544647263129, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04322504435096972, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 4.036181144264958, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "760890fd4919ad2bf023bd787d3b6f13dd4d5982ecdebf553ef3cf99fe31eb10" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.0468631735456595, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 9.065446781268601, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1f8c8f4c5f4b9098206177b8969b9995bfc399199caf8f52d997543d08b5148d" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.05151998756398326, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.938609056258588, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2bb796236b65567ddb8261e76daef26fb9551bc4d03aae6950c346fb8982d161" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-109", + "relative_path": "muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q4_K_XL.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "unsloth", + "quant": "UD-Q4_K_XL", + "bytes": 15878222368, + "sha256": "82bece304887a313ece08400bc030f6066c7bff5b906b0cd40308ec8a409fd38", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01279883417495957, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.890440257711031, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.012870441435681227, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.8453096597430654, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c8db561e721af6cb7af8534a0975d4074bb84669278d09b23f0dce5bd1bff08f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01267533593461617, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.152842410591068, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7c807e66bd00943a1e6053fe4d070637e6be407e0a7aa57356fdeab0e58a0856" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.012850725154581312, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.435194497099166, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "137699c84945b816d052f80dbb560ddbc3665f8be86b988ba9a37125eae68842" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-032", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_1.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 19765274976, + "sha256": "567d744757d575d84c0a42278091223aa2351cdae8f375d4962eec44272659be", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.6528547646572396, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 5532.618748666471, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.7705567402420124, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3689.04214687371, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6a5395d90fd176ca1b8c99cebf8b9290e4dd47e0713b53a526fe2193f364573e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.5196419237001277, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 12092.262661056915, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8cb27a3ab51fdcf0b05c361e602d507c6326c277dbd2850bfea27979fe25c051" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.6683656300295785, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3796.3919449508844, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "064aac3cabbe153775ec205b61815fdd79f6e56343f07b34f60468005bb40d16" + } + ] + }, + "notes": [], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.6224143727870406, + "PPL_reference": 12964.851857612222, + "PPL_candidate": 15518.455668029836, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 0.6883657327750027, + "PPL_reference": 41368.00589307904, + "PPL_candidate": 61547.77679512446, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "aa74620fd52ac530a99e17d14e7ea52b012f70c1e34a0e437912baa1280d2ae3" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 0.5317285359571035, + "PPL_reference": 11468.295417470643, + "PPL_candidate": 10112.449831469949, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "befbd757c71c866972ba10a128c3ffae142c2df359c2416c0491ce08943575db" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 0.6471488496290155, + "PPL_reference": 4593.452373266919, + "PPL_candidate": 6004.498622047255, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f799c6dc58189f899f4a7df99ab47f4e0bbf8146641a3cd7815871bfb0d1c2e6" + } + ] + }, + "additional_windows_vocabulary_policy": "allow-vocab-attr-mismatch" + }, + { + "candidate_id": "candidate-033", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "Q4_1", + "bytes": 19118091200, + "sha256": "4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.8149144278771223, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 7402.897871001241, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.8423449535125839, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 5924.719251065625, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "403fde4fd60f51475dd2f3b13e9ae1eac01b099649661aafe8bb59231e69a601" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.5815311898933425, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 16229.478025315737, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ba163b0a07db182e7e6dcf93235ccfb14023d86f9cc93a374a1e82b110e6e5d2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.0208671402254406, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 4219.227528645361, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4d0d7db40ac72214d0b201712cf7bf7b5d97bc3dbf877e8eb99d87d23708b0e2" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-034", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 5458479584, + "sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.13131703716239415, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 48.86211380982973, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.1141460199393832, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 31.63860212710171, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "aab77ac625d24359e6eaa0abfaf35f037a08c92929dfd6d244b6f8fcdc2506bc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.12661677503345034, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 75.11419637025064, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "03fad74873075a73d05b06a233c175d7dfbb97a4209b1e18caffdce8a8436c06" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1531883165143489, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 49.08823766133249, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1c49c326165f07c2fdc00943a0743252618b0a005bd508d2b9133e2d69d9b9c3" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-035", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_1.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "Q4_1", + "bytes": 5074390144, + "sha256": "430685a687edf70c4fdb1158aa92c34dbb38e1230f674849f198a954cc748405", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1184458912119893, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 51.533624339525346, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.10838170822427366, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 32.64592252508017, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b99cd45a6647e474fe978818f7f3fcd530b4be2e32a3ed85e87dc3fdc90b19e5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.11611990461738896, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 85.1975977261115, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1426aa7f700b60668a360e0e05845395275b6e8aafb2b204619731511ae0b7dd" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.13083606079430532, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 49.205739932032344, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "90640d218de0313380f8315c2730d7a76b4f941fa92ae5dcf12b28950cf3e46f" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-036", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_1.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "Q4_1", + "bytes": 10059476096, + "sha256": "0050110bc63babd859a849d160818e5ce46518c9dd92e38e50d072ee71a353ca", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.052384034123455644, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.244260337635893, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.05894236604133267, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.6232886969458376, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "221ffe324d8fb99df19af4148679f08640e5b9544f5baf942392a4329cd8701b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.05506409567523424, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.182057616954745, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0017cd5b3f05a2ee9832c4985233d27a7531beea8f97c464fa30cfec5bc9151d" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.043145640653800034, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 8.9555264435582, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "91539343b67be9402a03dcfad37abd6380aa2019801087de89f27c43de9d74d5" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-037", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_1.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_1", + "bytes": 10059476768, + "sha256": "81aaa3efc0a129abeae7149b8195d09ce5467b4436c1c412fd5cd89161d04f40", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.049663856853532196, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.369355692122718, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.07267542058015904, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.868135437964154, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f569ebe0f374548ce1fe51a4a8ff8266d6c201b025c84596c9a2afeda31a21de" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03751249598654777, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.96581583694961, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "942d3cc8a594592adf20561219225aa820a334bb367f20d0b2b8aff968c3b429" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.038803653993889776, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.169298058980294, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "96a021ec9b0cf78f744fdeda13b91bdecc58dc1564d5ae2c59a37f88beb6d720" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-038", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_1.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "llamacpp", + "quant": "Q4_1", + "bytes": 10059476032, + "sha256": "780924706c8a9df254c30b33e6384de8b01db2d81a6332f0c7f8b0c44162db76", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1811040221525973, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 13.079243036549581, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.24818223444277002, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.966284930393742, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ffc68626c94bab539d8ee7406587e2adc679ae75cc99d1d14c39787bf90de8f5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.14884040800581502, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 18.128574917585485, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4cce5de6d2d6ab10e8048bdf6f43ab148bbe24981803f7c8311b102bacbf3192" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.14628942400920683, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.383712606911127, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a259ef710cd665f3fe6fe4270e3c661d8867ed4b8a82217760086f49bee23e0e" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-039", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_1.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_1", + "bytes": 10059476768, + "sha256": "61fa02dadce8e5caf65e4660db204b18024135ea8db88f35c8925eac82de73bc", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.14711698559392947, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.509232252773417, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.20607207037130282, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 8.822156765113235, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "21c03ddee52b6fea98818c4be2327fd49ab39422d8d44327b9eb5ba64a598823" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.13763170110453526, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.908684817208048, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9cb06299ef580898972b6b2313f99df191e03b27e6a5cac1249a61c3b080ac37" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09764718530595036, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.389492123021427, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2d227aae487e7e34d3fd7c55bd6e3c489b74416d7c8a3c1f079197874ddce7f2" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-040", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 2979850208, + "sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02117895370244393, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.230062466611084, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.021053443715071826, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.025851833857755, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f5f9660bbf6c3ce46bfc0cb4536e396e73f245c63eb8faec5d288732be7e87dc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.021369748697653967, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 10.048422117516576, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d0483a780a88363d9099a03260d3fddd278d8b0c894db5460ee91ef1059a7709" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.021113668694605996, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.206468573158855, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b5edc2df83e51b6f2cb47e467fecf7f7f5a58146937ac0ee6faa94e826aa1872" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-041", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "Q4_1", + "bytes": 2784416928, + "sha256": "af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.024893953028052185, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.246619034087734, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02786410991315921, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.1607528104208695, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8541fe8d624cbdf38709a77d39c31849bd1d993462f1844fc30c29650a27ebec" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.022364911958021705, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.887434226331717, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ec95d15d0b28c2c00db6c11ebae90411825ad7513d2437e6f335d455d64dfef9" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02445283721297564, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.206835952646149, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "27e69ba6051c61a2fb222eb3de8307d75bbbfb9d24a7a1aa84271bab36062a79" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-042", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_1.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 22868448896, + "sha256": "8babe2c6f46b43815cae7ec2b970be8508d6867234ebf16c376bd9cc79477354", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01873216845401442, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.383768516850679, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01520064373932508, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.129105171523135, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7ee2a0bd6c3c41152df2555a01715f5a4f06fdd4f160eb5731cffff0c474e111" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.020238842584883825, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.3757008551701135, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "58234e05001d4c891272146217cf38a0cd4474fd36309756d77ad395b1db11db" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02075701903783435, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.927550445007792, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "688bd4cc6b813af902ad487b911fb8e75f0344ab8521ec2278dc4ee12f493898" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-088", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 6008603776, + "sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01801804254925986, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.46782674114322, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.021102599602206916, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.609829764398968, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cd5434807fe5cb59ce589fce6130ff49081124e8a046b24e03206bc9dcf671e1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019234970818191262, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.865308332762563, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9eec9e6c2fee175104bfe7975f7052043fe3d018b83374d8f65c4f435affa085" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.013716557227381403, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.157715542458357, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f1eea94cbb59e9f4a607ccb4dc61c03032aede21f591fc31076e6ea9f61f68c5" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-089", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "Q4_1", + "bytes": 6008604256, + "sha256": "66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018926200252666326, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.437579538023023, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02357248464735471, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.606249496777617, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e9385c0c991a6d3d9247af0b510e8baebd67a7dc93536e0f3241e77da7404378" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019460857212292397, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.736274355046906, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1ae5aa29ca09ae63c9e4c631e7822c8d42e28ad75111e274112e77dafcca1fd3" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.013745258898351868, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.173912814339321, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cd5e7f064095ab568e0a2286ac281461680e205ddfd4ade68625fabcd95555d6" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-090", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 19214517152, + "sha256": "f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.022594635411194518, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.495227405574473, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.020852574478899412, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.982115315161948, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9f6b1b69e2f389e4515782aacef435c78be5ed289e50a24a94576238409e978c" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.023158123755734672, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.894530342969823, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fa846465ddcece7af5752b897fefd650bde48363976a5d092df24f7aa8baa28d" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.02377320799894947, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.357979837418227, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9ecf29d755a2d955480f523eb0359d02f9aac45913a752d0b24c0c7cc565065b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-091", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_1", + "bytes": 19192497696, + "sha256": "cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02157982843125029, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.527111650123857, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019501507319167125, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.0966445078471025, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6ae4970b81cba0728875c6f146005f8322195cbe2459c40856075aa0b0e42e7c" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.023305567408392652, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.051290437655311, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b9535fbce3d4a178407366f2e1a8355d6a1903269b0d9a072a2b48073b4763e1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.021932410566191097, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.117964558082738, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a8c38de6dd9f57c27b043c93a67e92412584050dce98b17354c09d7cb5a59927" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-110", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "Q4_1", + "bytes": 17828207648, + "sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.012278850396166663, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.841468964292593, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.009964265695232682, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.819588476116318, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "80180d4445ea56b31ead983059a45228a846e6ef9287353bff87b4c1c166a894" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014107960268611528, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.103195799110969, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "54f7eafc9adc2c664999020e4fbd074884bb3e17e1ef142d59b9c7228e5e78e4" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.012764325224655777, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.34606437007683, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "06ac76952b52c0a0cd6c4d9cee9e073bec58cb5c028e30fcc0a6555ec157d062" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-043", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_0.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 18076264800, + "sha256": "4591e5ee10527739514d6db436b51169c882949e3858d30285aa997b0b253554", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.2050026099251978, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 2290.0114885013973, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.050905966150568, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3467.3528966044214, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5c9163f8b980fad1df22b124d11371ebc9ee65f56b3a86222630c9cfcf69fb8d" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 1.514681828419438, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 2581.5152533781834, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9b85739651ddf6c1ea421db88e3cdc157f69300feaa2ac451c492d5098554fc2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.0494200352055878, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 1341.6531132409946, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b358c0dcfc4c0c668d71d19d80dbba1e8d7231a7dcce20c5f7dd48eb369c31dc" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-044", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_0.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "Q4_0", + "bytes": 17338248128, + "sha256": "5c558b9b009e3ee69bde43e2b98a45d1f5afd316b9fbf447edd2ad4945a187bc", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.1275477041460908, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 2660.5518982665335, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.3103712348272818, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 2822.3925493798642, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3f38defc26270900617c466037b3acf07e75c3acd8ab06433e1024b9f07d8fcc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 1.1588903678153193, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 4269.2800423118115, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "eacac36b0b4f63396ad9b01268ed963a3459e2bd08f10265e2a7dd4a1200aafd" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.9133815097956717, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 1562.9430177409117, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ba6483eb36f00d1fb8fd0536b3d974f6cb58cd4a95aa101571e2b0e6f8d240ea" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-045", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 5223860704, + "sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.3250852422634452, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 66.05719105004967, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.3184440132452044, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 38.21031736005719, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "272baf0cb38b8730faea2e390d7db80bc53b7ee9f775d592649672bf50df3614" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.34072330973500337, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 116.97504537102407, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e7a879b9e48d1d7181f187ef5e123a63d13f299203338651aeeaa504fcd82bd8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.31608840381012776, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 64.48911835360262, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "633c2553473448dd91beaecd125176ee8a198ae17b1eec011ca013b9081575ed" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-046", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_0.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "Q4_0", + "bytes": 4836002944, + "sha256": "4a403d2e4d80281063e4f517b1c061ded8476b4011a4fc2ba7dbff707075547e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.17466558498399098, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 56.82823541655337, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.14466138562388947, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 35.721235612253, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "10025a2174c41d9a370791a6b128858ecd5041e3625b38c34cedb54190ca6128" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.19830938183967645, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 92.39797279817746, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dd757fe0f82d8935a4e4d7e314d45393710fc5944fe15c589329ddc9d555c416" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.18102598748840706, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 55.60368788025716, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0c5c13dd5e8c20d57a372d63f839520ed19fd28b0fb5b77e87edce4f8f41e2b3" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-047", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_0.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "Q4_0", + "bytes": 9083161728, + "sha256": "e3ffa932cd1318ce1231d97d832f92b90093900b2185d50d54e39c8d9d421080", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.06045780804814926, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.464154517673812, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.07010162521386092, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.8707128491822, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fc658a81a3f5208c2af7b985c22e07203704a282935acae72804419a7413429c" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.05964614782428458, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.284696233396653, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "3c7014e83d71497772e4e8ae7fcc37771e972df589587ef7427a6b91e9560433" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.05162565110630228, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.195633159148125, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "13bcb563fd821ea921dd11af36f839efdda8bd9159c8efc5c5405c07ff55577a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-048", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_0.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_0", + "bytes": 9108393760, + "sha256": "0ea3afdd920792fd4583d8c84a979e4e0af52a2e7456ae6bb75731da999b3b1e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.05337949044904211, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.389658961961943, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.06295669490897197, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.758866103937971, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "474a470283637e4df5950d0c1e20649d27727bf24b9e2b6f0c49186749f3a1bc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.054226805023284336, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.988661034969297, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "52157bfcfc0dc63f4ebaf7e83c56943cbbedf5461612f1518502448bd24208e5" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.04295497141487003, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.433540072132685, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "73c92148d6c620ce50c4a00345c4bc5865802dc22b2b85766a0f583b6dfec3e5" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-049", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_0.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "llamacpp", + "quant": "Q4_0", + "bytes": 9083161664, + "sha256": "9083e9ac29082a023d4f3ebd9610d89962fa205eb5da7034777b0bdf5ae0e348", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1805879139745622, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.690078252210245, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.206644243619631, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.070377475634153, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "73fb28a1434340e5bd48e25b300bccc88cd75bd65998d0ba4b8202b6f63735bc" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.19867505282924028, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.957049798274838, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f1141815ea6f829128ec663c979c697a73c00aa029cbd8d30ef34637b18a0408" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1364444454748153, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.546787778460216, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "bdced2e112f572576692b84f7bb16482b068ce5d101a5921a1cef728db017971" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-050", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_0.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_0", + "bytes": 9108393760, + "sha256": "3b3bf0ced352c03af1380107323e65d26048b3fcfb442684c449229a93cd767c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.1598954956395912, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 13.066403552638132, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.16511290833511214, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 9.416806168419123, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "89d5f77b5f2c334d2646127cba2c9b37411632605c6b0e75c8d75920de30a211" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.17523175805416066, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 18.16025273650983, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "24b2a788b33ab6dce6e3fd5cdc1be2b354a84b5b3e4eae7806d00d060c055757" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.13934182052950086, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 13.044957902678066, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "06bc2090ade54963d9112c9c571f4cd9906a639cdd0e5c789b168543941b47f5" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-051", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 2776033248, + "sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.030247619453139658, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.269669308139676, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02691979006930898, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.179042119584652, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ca354a8ed7ca7c42b161f22478fd89e4ece0cd321508e6b2bc02fcbc1b5ec21f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03233457144273345, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 10.02778704944862, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "14e490772699d9d6bb534962d11c25689a164d20a9f057df353157e024e886b7" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03148849684737655, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.127212691710987, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8c2b2d41450600cb1fe470ddd93d68ba636d3cecefb9be108a74aebcd51678f8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-052", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "Q4_0", + "bytes": 2583221408, + "sha256": "298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.03243738571656495, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.228466270592412, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.028085233044140633, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.1934418266852385, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "92844b245e4244734188cab769e8d62b5a8b2844e1ca0fd55d80206f16f99a3b" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.032620629749555305, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.904145110793616, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d96537f280e88f1ef58dc22f5f738882ca57f3ec9fbde647356f4e2c78668f0f" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03660629435599891, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.082546337541565, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4d49364ad8171a2848564c92560525898c766d7ff3778563bf4ea04499a1c75a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-053", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_0.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 20836243072, + "sha256": "52312daa5b2190c1f5723d33c3315c01c55af4206f6c6e6eb63f3d8dd52bb85e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.028529380982948785, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.395303722271188, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.026113350046726318, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.212260790919911, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "94c8ee53dcabcdc88ade7720f000b3bc41e769a6c9a3a3af0e7021bfe3c3fecd" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.026137283355616072, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.3293393706800645, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d7896350e1faac2260fc3c7896b7b79e12a0a961c43eff209c65016f73c419af" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03333750954650396, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.89079703142734, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9494e5de7b91c45393c7a7fb1234bb55f9db3a451d388bbf6039645fe8e40d87" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-092", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 5477467264, + "sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02804298717779733, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.416868563120732, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.031164711224320463, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.377231350979559, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c7438bcfa1fdcf2fb6d9f77ceb9485d0533421ec3894530010a2b07beceac542" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.027918232325721284, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.970308597292751, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "730bfaef96b473e70965924ed934c0293449e309eeee6f09c56a68bd8e6b1d18" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.025046017983350242, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.348752161653259, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "08d2016b87dec4d9858f61b9ae4d0e4f732e7c4d2a32fcdb7696f083d497a895" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-093", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "Q4_0", + "bytes": 5477467744, + "sha256": "c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.027953883222480252, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.400938926458278, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.03094981047140173, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.363255996741527, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6735622dbe59f867e17a3e6bba6fe7e1f967e392079dd5e9aafbc1142638eb29" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.02764712083360292, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.964240607071385, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0440d750ad2e2a47f08bc4440435f72d2a63817be795f4238825598c34a69b37" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.0252647183624361, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.32407076502743, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "de09f59601630e30e1026c0575322204b52d0342a5baadd10b81c9c1621a6d53" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-094", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 17631642528, + "sha256": "b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.02936553050985139, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.365596839351788, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.027544030604518682, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.912029897827201, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2f08b2db437e2bcb47c4c267dd4a71d2198d1cc6230c9b801eda125ac6dae32a" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03076412636824791, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.822367127765576, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0855236251d3f1324854ef81238b6888b93b89e131a35f49c6df3b1998a641f8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.029788434556787573, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.081798392264881, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6c979f5d1d9acebae1f436b0ed01d69e222af5617c1299fc2dd92050b82a678b" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-095", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_0", + "bytes": 17379984928, + "sha256": "6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.033819478748590294, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.398199780901626, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.028026350820768747, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.973922319907754, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "87782950963b343ae294984d719ce1da9ae8b8c987ad40ddcc426b144fa34fba" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03437313342848189, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.82919208226707, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b9e01128f3e228220a07d92f1644c9a3a76040d6def52e43f2032fe666334701" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03905895199652025, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.087445741290056, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7d4546231d39ce7ba49a4f3c09a17dec5c22af3c804c2fdf4b9457398a8872f8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-111", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "Q4_0", + "bytes": 16265565216, + "sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018935528782238184, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.99840604836308, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.017326034894343888, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.871735916610402, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9c3c6bc7fd92c45abb98b4dc3368fe96bfbeb24747d89f6524d01d4841ea3657" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.019771851714879222, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.4183024116301, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "310b48cb0937fe1d3ff0688dda5d306cb8f7d338cb3fc5c63f325c4d242f447e" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01970869973749145, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.516401535256465, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "28d35cf4c0f837c8d0508f4f14df21654084814569635f9e482a3c8d516f3963" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-054", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 19598489952, + "sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.4570696355057695, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 6318.7442797201575, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.5646540567436985, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 4607.161732909864, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "74e8b46b10534ede0e5fb646c60a6a2596c96fcec0afa33cbf33dec6fb99ca1a" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.3763286524649558, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 16193.583197113392, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fb0d8ae93125ea332fb7aa38300936d5facbd75432efb8996024c9e511112955" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.4302261973086542, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3381.55086286102, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e9c20d31c5404044ea6876f943f077b546e74a924eb21a205f35dc3db74ec9f8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-055", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "Q4_K_M", + "bytes": 18323733440, + "sha256": "38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.877349805047552, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 9691.867815554595, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.0610442601033117, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 8886.206077154957, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d2668f1da8fefc49dafd42f336c24822825ec826682752fb0b0fcdf2157be5b1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.6399580626081816, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 14050.82213583785, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5e4f0d9c8a2f55fee33addbd36828e168116facc4ccbb220445da79ed50a4c0b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.9310470924311627, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 7291.289295788462, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "68e5a736e9c0a030bf1c8f6db83933b51e82fd378433743dc44aafd221dc9470" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-056", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 5405170144, + "sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.08662593214080397, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 51.563036336994415, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.07222797923510113, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 33.260995642334606, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ea60040d5c927385f9681035659fd08035c7a677532f96e2ca5521777bc25a83" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.08873048958161937, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 80.88237897825915, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "26df3be340416e7dc42e67edc011bca3a164a2687e2f8331fb1716408620b2b1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09891932760569142, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 50.9596325551882, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7ef8724a13c504d9096ba5cb11492c096c4a2da58e1a7fadc256646ca847b936" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-057", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "Q4_K_M", + "bytes": 4977171584, + "sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10543335651853876, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 50.05581951414737, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.0993351988371831, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 31.91986711717284, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "295125b172fe4b1bcfb06df4b2445f6d33341080ec0e7dd5ecb6787a8338c083" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.10871055292203598, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 84.64947474230517, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7571a294d70b674c1f44e945a629acf8f8ce88c3a1b5ca37757930f8d30094d9" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.10825431779639717, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 46.41714085288227, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5631f07108b06506308e7f317195abec5b5dc19b829d40593ed629cfac18d601" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-058", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "Q4_K_M", + "bytes": 10540747904, + "sha256": "43a34db4974f67ad13ff3e1f8347ef1b25dbc15b077146d1c74627e3294ec49d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.03988522014494913, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.364656300809736, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04997667807590772, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.7734199408302675, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c88f6b8f24876df2f66625f0af6b2159033633d9c3a994882e19e2127a055e93" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.037565777534687456, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.154352440677426, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8a1d429f473d40c505bcbab2413219d12b8e5b00ee15ed5edf599f2ba7a202e1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.032113204824252214, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.141136189489542, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fb15120fc1efdbaa83e3c00378a0d8ec2894383ba1fa83beb9512d13d863f205" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-059", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 10540748320, + "sha256": "74e9aa21a6a6e90d6ff56b7ec311f830a0b6cf88ff7dababacc8f34c867bde1e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.03988522014494913, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.364656300809736, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04997667807590772, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.7734199408302675, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c88f6b8f24876df2f66625f0af6b2159033633d9c3a994882e19e2127a055e93" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.037565777534687456, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.154352440677426, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8a1d429f473d40c505bcbab2413219d12b8e5b00ee15ed5edf599f2ba7a202e1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.032113204824252214, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.141136189489542, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fb15120fc1efdbaa83e3c00378a0d8ec2894383ba1fa83beb9512d13d863f205" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-060", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 10540748576, + "sha256": "7710f9aa5bf56a38a03f26738cdbf10563a72938a41025307b57768dad40f306", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04031790718154595, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.252361572438242, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.05467538353807992, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.780975892849137, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2c191831b6364d1e767cc5d09eea977c8660f6ea5a92d67f444a166238531040" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.03176626498735619, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 8.904982953746734, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e24a8ec7a04674ee0946347d4ea92f9df397710bc4289bfcfd60da005cc01043" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.034512073019201735, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 8.959601584776959, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0eff9855feec166e2e2eb6d234cdbb12397a32c943faf52a7b60ba947490d408" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-061", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "llamacpp", + "quant": "Q4_K_M", + "bytes": 10540747840, + "sha256": "33b0598c3700e15456e4789608cd7396445201a881d97e14df17b48beda29492", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.12046880669483287, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.858271291194107, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.1541783067738174, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 10.05940360966547, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9994156331e9f89533c985a7b26ac32e65654cd6afda0c64f40020bee7efe4e5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.10930876374905518, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 16.94323934570245, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6b4f4eaf2e936b4cd582ceaf7ef5d7de5b72d44bf987b860ded75cadafbefde0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09791934956162603, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.473234123208863, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "08eb9c51392bfcee5d489cfc79adfe71fae53220da28fbcba9fd4d58573d8fe8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-062", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 10540748320, + "sha256": "597373061abb3d5e125c6d8b976eedb1059bb2c4e91a5509d5cc8d8d66767ca2", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.12046880669483287, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.858271291194107, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.1541783067738174, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 10.05940360966547, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9994156331e9f89533c985a7b26ac32e65654cd6afda0c64f40020bee7efe4e5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.10930876374905518, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 16.94323934570245, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6b4f4eaf2e936b4cd582ceaf7ef5d7de5b72d44bf987b860ded75cadafbefde0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.09791934956162603, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.473234123208863, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "08eb9c51392bfcee5d489cfc79adfe71fae53220da28fbcba9fd4d58573d8fe8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-063", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_M.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 10540748576, + "sha256": "8bfff5f8d6b391e3ed3c6d548760d6917cd3e17f246af8ada800b6d485d569bc", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10719487744779078, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.360339181372288, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.13706825205236764, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 8.782103471879436, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6a109e70f47b5df01606912bdffb6073dc1f61d59aac7e6de237be75dae68957" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.0988141334705884, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.253152410601295, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2ceb04a39a4214f56f6d0ecafe70fc3a3720e7d366bf7f24aff7df36e34dc7b1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.08570224682041633, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.463044818658016, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "11de826b17a732774ee7b42210e369ee7fb1e5e7d4ee15e62aef4d6a207350d8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-064", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 3013027808, + "sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.015831967668737276, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.14830958896456, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01629709280218687, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.087289251834771, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "326646da7b3c90fbbc907dfe94dcde8fece6a375daac47a90824f73d5f21df41" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014534614315447935, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.844151471833001, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5e93960c1afc7c318908c0c1e3bd58ea122ad5895335354a3b0ab24281dba4cb" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.016664195888577024, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.028182669445815, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "fd90b408ad0a97576b188e435ebbc90620461c8b40111b2a191ce62d6c291534" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-065", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "Q4_K_M", + "bytes": 2740937888, + "sha256": "00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01833788689902362, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.142159220492545, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.020179507653283864, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.096758699650941, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ef5ed2c67d2a191352f5d57fb412e5ad51b3729b70ffe6d72254790a5d8ded32" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.018415715016924558, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.740546759510513, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "14c1ef50afd9357bb0ea020f8c45785d594fead54de46a6d4d0e74d4b447ab26" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.016418438026862443, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.089425412352565, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9db8cdfaf622ce9a766b48e1b5492cb051816d39ce5f62dde2e76f07f5642548" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-066", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 22285080192, + "sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.014812772117661247, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.269394184937695, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.011213701742287176, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.01809997122231, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6a9ff7f8c760d64e7a4eb9987c20d15c5a7935b501eda8ba8f02b52cfacb3dd4" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.016574646702295415, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.334132257025886, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "71d8d178313c29a83790afd8431fb2e330462229c476005288cf1ebdc423f5a2" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.016649967908401155, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.748760269524338, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c7bbcc459b5f12f36cc4cf1e34bb6a808eb69141c4b87341c2949e04bf98772e" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-096", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 6166578304, + "sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.013864166723531413, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.3657652244774665, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.0149957760161005, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.511439504946498, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "50e210d22ec6e0b02c05603f3e0d679a1bc6936dceb3ea7bdedbc45c9fb123b1" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014658740021952646, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.79336204649421, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6e9b41d9c1a6396288c49535f7bd7cb0d89ce9d5aa50f58cb6c785588ba23e5c" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01193798413254109, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.044960363411752, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ce49240579f0f086edbe027b60a3788692428a6b3193c89d4669bcac742b8768" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-097", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "Q4_K_M", + "bytes": 6166578784, + "sha256": "4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.0147697689796967, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.433224558075201, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01942318991680067, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.608244420279362, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cb9f73aa54d89189f8380323ea87e479a429d82f3238c1fa51d1bce67a2d21fb" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.013709148441148946, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.762621811113018, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5113d9c27283cb66d5978e1701def0e0828b93e1b3a3daca53815f459124fbfd" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.011176968581140482, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.1291383240247, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4c59ca6127dd06a5f255f0a5c37bd888b5edd8f0aa0bfa380a863083a2b158c7" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-098", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 18632180640, + "sha256": "c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.014023801192911987, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.421016784728394, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.011564675226359074, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.058971408511723, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "6828a51c33af6fa444a3d62bfe773854a7e0e5a0fef4dbcbf273d326c66574fd" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01692558388352368, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.862245917692091, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "64f381802b6c7ca7ee5fa2a45188cd4c69947fa26e7bc5cb2cb6a31077acc323" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.013581144468853203, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 9.993528797320044, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2c0cae872289a675c10f48bebb282d0e150cba2b886f1eadad9084ce6e3072fc" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-099", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 18556683552, + "sha256": "497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.022191786791121187, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.431689833167503, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.01809823146539647, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.053181463072436, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "8364ee2af1605cd82a1f200df281d96f07d899400d6af5d5afa90f6504b05d0a" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.025189708871510126, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 9.911448583449362, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f0d59603a0d11456752a403d5a392643376911f4b913dec5897d22860cb13df5" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.023287420036456966, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 9.991323964240499, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0578a78a1404390675538d4d2c2fa6be69426c9d1e6db75eeac0a5b6eebbffe7" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-100", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_K_M", + "bytes": 18556683808, + "sha256": "97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01858996156262543, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.610812256916446, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.016023484152871144, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.1144196414458465, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "002f48a7bb71dbc48155abe86f2e7c06a501238ad3d4d59dd41066a51fa3cbf4" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.020056610534258796, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.2105169953052, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0ce1a50e655e2f8da7b64cc6b979202854572f35d651c506a6819ee2f0f31da1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.019689790000746357, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.226555668598044, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cf35a3aa3941caae37ea0b6b617ba712db11cd30d4fcd6a00c033da7259f2900" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-112", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "Q4_K_M", + "bytes": 17306324000, + "sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.008849923204210578, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.860374745196291, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.007822461206338479, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.817830941426459, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d840b50c0646136eed298c9d0467dfd0579b2a26d256b86e3359fab32f237f70" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.009928459800939177, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.157253690400037, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "84685d9178e74f7a5aa9ffb1261cc56e0cbf17b0f35312a8e657c376058ec169" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.008798848605354079, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.36771036482382, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ff2094efafefe48da41d1a3eb4a9e5d38d371b2f283251faa7c1bb982d06e71f" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-067", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 18195655008, + "sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.6756041727003326, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 4489.873239674906, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.637118064890597, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 3153.518994005527, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "312ce455171be90606c3f163c2de3d85e7de782d36789bf835bf8f6ec8ae8f3e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.572453897975727, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 9127.011906130489, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7825dbfcced393e504d19451813bf050dad7caeed906567b303fb8a60a006dec" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.8172405552346735, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 3144.6924042799283, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2ab9e1f331593d019956840fccf645bd3b669ae466d7e1b070ba4e668d50e18d" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-068", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "unsloth", + "quant": "Q4_K_S", + "bytes": 17399835584, + "sha256": "41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.7689629351548548, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 7004.109622454445, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.7568346102687087, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 5300.3132809151575, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ab0541c1965d3227bdc1d6c3ed7d401c25d8657ac4e098d3ba3d5b9e0c3c09fe" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.6979454491944839, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 12321.585391366641, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "21f02170d79e7ef76a0a38cfec569863b6c74105489d576572e15578f16b3823" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.8521087460013717, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 5261.271010388279, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0803a6c469f585c6738a4eebd67589c5a7b3375ed92477846987d0f79906458d" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-069", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_S.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 5235657184, + "sha256": "81508a92a401ccd81292b0da59f43af7360b7b2215a67bc7901830d58bfdf260", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.12331414187791713, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 50.230273483794136, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.09353422899947295, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 32.48553681541135, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "2bec25633245b470c0abdb7404cfc7dc70c979a660d102cbcaf60663bd9720de" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.13331240370895028, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 78.52484472503465, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "19a9e4366016a89afce99f171981be1ad138c44524a2200f2466bef1b105e0d6" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.14309579292532817, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 49.68204846092225, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f1c955f45610874c8085d0a32a0bad1ba9881b109aa15ba9b1f1c5a86bd5c861" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-070", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "unsloth", + "quant": "Q4_K_S", + "bytes": 4844850304, + "sha256": "0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "allow-vocab-attr-mismatch", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.11758471833069156, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 50.905917230232056, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.10933830564132449, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 33.8384879984229, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "38fbaa7ab7c01c5bdc9484807887f34bea4b39cba544c5a1e15c7d90455d5a5f" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.11571654231911675, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 88.16383138688452, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f353046123628732f4116b1461be952dce89f489f1e7106e80f6b1a1a7f7e8a0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.12769930703163346, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 44.218437929543676, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "95fc67345d30594178ec15b18be6b0cb6f07d4f1fdcd66b3ae21078e6e7af18a" + } + ] + }, + "notes": [ + "Retained under the audited no-tool vocabulary-attribute compatibility policy; use one consistent policy for the entire base checkpoint comparison." + ] + }, + { + "candidate_id": "candidate-071", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "llamacpp", + "quant": "Q4_K_S", + "bytes": 9713880192, + "sha256": "bb2f63e9b13a0d561e19890a6c5611cd8b27c0a406b596ebd33fab9cf88187f1", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04110306793067305, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.429872616859555, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04507611357715659, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.834302764067871, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "958c5bc0445ba29536e0746c9d7af9311e40b5d4d9ac64b4c0d49aa48d6edde8" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04146214554637874, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.171417784106705, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1477d3a25c948d135e25ed5f960ceca074fb7791b9d6022238689340f95182a8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03677094466848383, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.250682609960176, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cf8f01aa151a21b0071558abcb708a5b42cc288da4383438dfb13766a8a4765a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-072", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-instruct", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 9713880608, + "sha256": "3363ac782c25fe60d0d27061285d9eddfff1af087650756cfde183296343f22f", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04110306793067305, + "PPL_reference": 7.111385017484427, + "PPL_candidate": 7.429872616859555, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04507611357715659, + "PPL_reference": 4.5615935275232555, + "PPL_candidate": 4.834302764067871, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "958c5bc0445ba29536e0746c9d7af9311e40b5d4d9ac64b4c0d49aa48d6edde8" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04146214554637874, + "PPL_reference": 8.83699003594395, + "PPL_candidate": 9.171417784106705, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1477d3a25c948d135e25ed5f960ceca074fb7791b9d6022238689340f95182a8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03677094466848383, + "PPL_reference": 8.921577001259887, + "PPL_candidate": 9.250682609960176, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "cf8f01aa151a21b0071558abcb708a5b42cc288da4383438dfb13766a8a4765a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-073", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "llamacpp", + "quant": "Q4_K_S", + "bytes": 9713880128, + "sha256": "a709f9add5d63f4dfd5f9dbc418a1a862331c2247363417c3a56549672bd7540", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.14867650673862526, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 13.1900782500094, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.21536631866996792, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 10.766118630505284, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5a48d308f6259486c03b6993377fc20aa54cc14ceccf3220ab81227e29b8fb17" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.12046729067195544, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.047350387164236, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "94c94d3c1e48ad195a2760474a5361c949c492cdabc9436dc1b59f2c442e584b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1101959108739524, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.503340761200455, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "29a26ee6baec44fa320debf765666e0a89994c70b39733a5891cdab946393bc2" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-074", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 9713880608, + "sha256": "562745f30cd79c89dc247ad41ccdcd40e78e6d549493e9609ff5bf19aa0fa885", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.14867650673862526, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 13.1900782500094, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.21536631866996792, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 10.766118630505284, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5a48d308f6259486c03b6993377fc20aa54cc14ceccf3220ab81227e29b8fb17" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.12046729067195544, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.047350387164236, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "94c94d3c1e48ad195a2760474a5361c949c492cdabc9436dc1b59f2c442e584b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.1101959108739524, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.503340761200455, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "29a26ee6baec44fa320debf765666e0a89994c70b39733a5891cdab946393bc2" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-075", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_S.gguf", + "checkpoint": "kimi-vl-a3b-thinking-2506", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 9713880864, + "sha256": "3d4efede5cbe05496dc71648a230529c03ab8ae7b68b5bd5006f4551e3b84785", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.10698238505105989, + "PPL_reference": 12.337318750489342, + "PPL_candidate": 12.36973048432152, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.13128554689736155, + "PPL_reference": 8.681496608383137, + "PPL_candidate": 8.789190176888694, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ec701680c8a8b454cfda488e61e92e916c481b7cea4b2334263e92779979617e" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.1027536091933072, + "PPL_reference": 17.509813913025035, + "PPL_candidate": 17.099107653243728, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0b31d19abbac6518c8b2011164cf04ad8e7ef5e62d15ecae7aa34fb19f23f5a1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.08690799906251093, + "PPL_reference": 12.353392086342632, + "PPL_candidate": 12.593846723875805, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "bc814f0e17462b8c415d1abff401200a9533854affe7cc6ff5431664e0825ef8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-076", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 2846156768, + "sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.019304276224305368, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.278649044706267, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.019864193024445472, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.108591452726072, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9327d1817fd55fea1286d82f78d09a82df5f7d711e797718b9ccd6006e86d7fd" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.018546304460598514, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 10.002353570476535, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e80a06743dbebba6d0d37bea9cff4c5827b2761ec36eeaacd4ec5ec5243ed0be" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.019502331187872115, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.286138005978925, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "578aaea5054be016a8eba3985a014439ac9838f576fe44e223f5854c1afbcaad" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-077", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "Q4_K_S", + "bytes": 2590430368, + "sha256": "27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.021411568882693577, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.162794399790577, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.021480590065224462, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 6.073702731465697, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "abeffb05feaf1784f0c9025b0a6104970fb118e89cf0714f39185b0044ba3bcf" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.020948189767224512, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.790801428217659, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "39c3b0ece46b8da37d301c4d96b6fba627c47194c7a5c1d75e12dc4ea22b2344" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.021805926815631763, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.146286450765157, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "7ef0ed840bd53fc4b92ef817296b233444afce4ba796b761df1b10dc65226440" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-078", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 21486360192, + "sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.01656458031940529, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.311338564047296, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.014083104957789966, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.078280338184241, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "90091bd0d2fdbd4b8f9c7cf3056c0459e61134d37e3fa492e1732208396de96a" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.018483469562554592, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.378692798261548, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "545752a321efdbc43ef3b0a8c11e6bd5a5e26237288729246c31f4f0e7a69ade" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01712716643787131, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.75974418673584, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "189280212003a5ab0654141229b741f2e994c90c9d6f79bb7e3b25895328b3b4" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-101", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 5758485632, + "sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.015079471697119035, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.394570006089792, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.016860166597138786, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.541665636568304, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e168ccaa140ec81c7d66d48204b61dfe30f1a6d7c74412b25e918b76bed97312" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014672235710758305, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.781065408292344, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c5ae52f4152438db7bb52c835607d3ef95b8d968b7ea07316a0bf94fb4f48fa4" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.013706012783460014, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.102013047405416, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "52d7908a1ec6f31ec5c0740cc383c79b6498304692ed4458a1354ff57757bc43" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-102", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "unsloth", + "quant": "Q4_K_S", + "bytes": 5758486112, + "sha256": "258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.016620197272167615, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.449245025048584, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.02124540006162025, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.605778663716155, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1e726ed4a8ed69d2192eda8b29eab2eaa318a32201c78f5f5e8388e174544cb3" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01562373113073965, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 9.806335574766381, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5790cbd6cbe7fa42bc2159ecc66a35dc2baffa3d750a2575709f6be6920509b0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.012991460624142942, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.152230816519202, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ecf2b3604da44c954e7887b4b7f8ebf5aad64df8ee36ff260141635b8075fcf4" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-103", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 17984488352, + "sha256": "a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.018414136229848915, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.514265631895391, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.017550281527837615, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.097095523242564, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "91bbfdb6b7780548b9217e201caaf5ebedd6699a7875569abea275caf88d2db6" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.01875196904878548, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.012690271775817, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0920681ec96ff4f95af62a65f68ca3e08ad53ef3c0f67b4a96c38d4876adbb5b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.018940158112923645, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.110387587461721, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "282fa068ccaf6a9c212fa5230bbdf7bfed1c60111857dde5950b0005b4c166c8" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-104", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 17456006432, + "sha256": "adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.029707883974638697, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.491423178521313, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.024968826200358764, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 5.944948937666706, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "1cb5561985fac512a6c8465ded624f742b4572da3f5a92b5498d0ea3306f40ff" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.033949248667574344, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.038813737270969, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e2d509c0e060b1bf0ea79f84dc6de06d8846209b05cd80d8a2ec163dd97c9d24" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.03020557705598299, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.259139369954868, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "0e9af67613bbb8d49a0e5988c7bcd1735b0ca8a03fc635128db74087b67ac35a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-105", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "mradermacher", + "quant": "Q4_K_S", + "bytes": 17456006688, + "sha256": "30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.022032634280481918, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.619069578972605, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.018576335158255592, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.0761259360995705, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "efe0c715385cbfa808181c270ba6c5013e5125b387de6d3c64734838927de526" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.024546924276760633, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.139911147541968, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ae018d7b0607becab9ffbe56dbf995a551e165ed2f7413f00f636314595d11c8" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.022974643406429525, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 10.392505041389839, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d30cf5f7d3e61f9d4f27ad0a04da668ca17786376310dbbb6304610466325355" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "candidate-113", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "checkpoint": "muse-glimmer-30b", + "provider": "bartowski", + "quant": "Q4_K_S", + "bytes": 16320943136, + "sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": true, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.012613234486114861, + "PPL_reference": 6.82042438474471, + "PPL_candidate": 6.8356960737813806, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.011791560856768763, + "PPL_reference": 3.747106085085366, + "PPL_candidate": 3.8318364617695204, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "a912b24555635193978c0fe5bc3f196fb22f8a432eadf0dff3ae91edc6256bf5" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.013597322522982009, + "PPL_reference": 8.237911099565743, + "PPL_candidate": 8.145975021348615, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f88c6d8f6bd63b77586246c322a3d532e68d64dc4e45cd963c23a9b745da2d61" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01245082007859381, + "PPL_reference": 10.278295649168648, + "PPL_candidate": 10.23288740343954, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e80eb6321787d56c92e7d6d0877cf2cd1bba0b64b444ad5ac5d0dc93f70c66e1" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-01", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "checkpoint": "gemma-4-31b-it", + "provider": "bartowski", + "quant": "Q3_K_XL", + "bytes": 17151936864, + "sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.556931254935717, + "PPL_reference": 5067.538937155888, + "PPL_candidate": 1956.9190003015756, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 1.3294554131799732, + "PPL_reference": 3656.920457481433, + "PPL_candidate": 2235.8443120766424, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dc80f7496250bd7e689325086fd1b0739bd9f8ab3942b29d0437ab2b3a0529fa" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 1.386536583706327, + "PPL_reference": 12061.511638126502, + "PPL_candidate": 4493.028353143813, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "32601cbedad48198607d7ef927cc9b665964e228881b459d36af638efe2c6af0" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 1.9548017679208514, + "PPL_reference": 2950.3533248077597, + "PPL_candidate": 745.998289189889, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "e961f7b12ed7f5711ec1e2e24a3c65beb6912482ae6ef94430224a1b00c6d938" + } + ] + }, + "notes": [], + "additional_windows": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 1.2380262589156958, + "PPL_reference": 12964.851857612222, + "PPL_candidate": 5500.726893369814, + "windows": [ + { + "offset": 51200, + "targets": 255, + "KLD": 1.0680028441942875, + "PPL_reference": 41368.00589307904, + "PPL_candidate": 14167.418890093528, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c6f61ccc0b0d1b3269b1398bc38cb85b9ed87b4c45216ffb4cf0ee623053e29c" + }, + { + "offset": 76800, + "targets": 255, + "KLD": 1.581600938922496, + "PPL_reference": 11468.295417470643, + "PPL_candidate": 4368.196932205284, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "385fc8ca9c0b7c555a87cbd8c0141c3a967bdf59adb76854a022c2e9f494046a" + }, + { + "offset": 102400, + "targets": 255, + "KLD": 1.0644749936303044, + "PPL_reference": 4593.452373266919, + "PPL_candidate": 2689.4737195815364, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c1d6be58fd18272de5e834f3acd5107cf5c1b171a02c056ddb1eadf5fb7d2350" + } + ] + }, + "additional_windows_vocabulary_policy": "allow-vocab-attr-mismatch" + }, + { + "candidate_id": "supplemental-six-02", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q3_K_XL.gguf", + "checkpoint": "gemma-4-e4b-it", + "provider": "bartowski", + "quant": "Q3_K_XL", + "bytes": 5879378400, + "sha256": "00c50656f4b16b98ff9e07199e3c9fb5e776c159a62aaae9f56628b375f689f7", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "allow-vocab-attr-mismatch", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.6462462495902597, + "PPL_reference": 48.80664182909986, + "PPL_candidate": 63.492111943057054, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.6920195699779488, + "PPL_reference": 28.983472973638918, + "PPL_candidate": 38.39764727181369, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "eaa37961184243836509ea85cd5c8938777e111b1954e9eecb9fda8e419c4bb7" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.6866417619076802, + "PPL_reference": 82.35628233465113, + "PPL_candidate": 122.46719335957047, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "869d7aa3453d7766e3b4dae43a6ff74e1aec5bec95ac154cd11e88e8d5e8480a" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.56007741688515, + "PPL_reference": 48.70680278726518, + "PPL_candidate": 54.429574600330696, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "9fd52b10f79f9aeacdf0204ee13e667304754bf40d82d516b986304313ed69ad" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-03", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "checkpoint": "qwen3.5-4b", + "provider": "unsloth", + "quant": "BF16", + "bytes": 8424393632, + "sha256": "9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 3.4151522153303226e-05, + "PPL_reference": 8.062614791448537, + "PPL_candidate": 8.061376191627067, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 2.1333844481679207e-05, + "PPL_reference": 5.982436281568651, + "PPL_candidate": 5.982542639370995, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "4036b1180f293cb7dd0b34fe207fc1beef88f78f71c4543a805d3dbe83b65ca4" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 3.905387228962049e-05, + "PPL_reference": 9.653355865192841, + "PPL_candidate": 9.641591050645125, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "afe24243e40dec81d3e337ea042e4568c9adef093ae0a8dc5351522821f260d1" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 4.2066849688609965e-05, + "PPL_reference": 9.07551616546219, + "PPL_candidate": 9.082241706232573, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "b83ebeac735084602d6be36f022cf77c87d514c71c202d0a2aad7937c3b08011" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-04", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "checkpoint": "qwen3.6-35b-a3b", + "provider": "bartowski", + "quant": "Q4_K_L", + "bytes": 22662526592, + "sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.013140147194950992, + "PPL_reference": 5.292150596704641, + "PPL_candidate": 5.322122377600644, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.00828490790666367, + "PPL_reference": 4.064803471700802, + "PPL_candidate": 4.038973741526068, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "81fefb34605db9cd4e318d680d9c93f68e298c696639cc676eeadae5cdbad523" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.014749622123870758, + "PPL_reference": 6.30574099357949, + "PPL_candidate": 6.376088010361812, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "5d70fa89889358d8cc3354ade28a6dacb66ebdd4c95fcbaf5d6280447f08170b" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.01638591155431855, + "PPL_reference": 5.7825700383489576, + "PPL_candidate": 5.853683497364457, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "f42eea5bafa5d27b9b9f88f764b24af4740cb22a97005ef9ce432f6858124b5c" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-05", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "checkpoint": "internvl3.5-30b-a3b", + "provider": "bartowski", + "quant": "Q3_K_XL", + "bytes": 14855269280, + "sha256": "c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.043466665554567525, + "PPL_reference": 8.377787248611828, + "PPL_candidate": 8.545446257163075, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.03463611797283678, + "PPL_reference": 5.955337130270298, + "PPL_candidate": 6.153643225428043, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "d6dcc0e6750f5378609508f471dae8c63c8eb0225f58c38a3e266e792d30ac93" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.049050982141546, + "PPL_reference": 9.76717143492117, + "PPL_candidate": 10.25965131659381, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "c8db3e0ec1b14f3f4246b83973994e5116496836a20600a3c220d0dad6c67a38" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.0467128965493198, + "PPL_reference": 10.10910761406829, + "PPL_candidate": 9.884149994192821, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "dbea51a09dca1019c8bacf8368c2fe19bc6a4262d8fa4d9c15a9b54f85485b0a" + } + ] + }, + "notes": [] + }, + { + "candidate_id": "supplemental-six-06", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "checkpoint": "glm-4.6v-flash", + "provider": "bartowski", + "quant": "Q3_K_XL", + "bytes": 5739775104, + "sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e", + "disposition": "retained_sparse_screen_pass", + "numerical_screen_vocabulary_policy": "strict", + "formal_family_comparison_policy": "strict", + "short_generation_checked": false, + "numerical_screen": { + "targets": 765, + "checks_failed": 0, + "threshold_hit_windows": 0, + "KLD": 0.04094394224654512, + "PPL_reference": 7.257219855189762, + "PPL_candidate": 7.4858822204197635, + "windows": [ + { + "offset": 0, + "targets": 255, + "KLD": 0.04655583102681775, + "PPL_reference": 4.4013155301575235, + "PPL_candidate": 4.5345676946859665, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "df0ff1b6e33f730c69401eb1430f523494bdb1f33d5537421fc954ea4f7454d3" + }, + { + "offset": 5120, + "targets": 255, + "KLD": 0.04715221007519693, + "PPL_reference": 9.621578812053395, + "PPL_candidate": 10.082264129881423, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "ac49a3668c59053ad17b72dfcce955b44fcd4253f19b7c7e0e346218dcbc6093" + }, + { + "offset": 25600, + "targets": 255, + "KLD": 0.029123785637620685, + "PPL_reference": 9.025722866900315, + "PPL_candidate": 9.175611333295652, + "KLD_threshold_hit": false, + "delta_NLL_threshold_hit": false, + "metrics_sha256": "939cc2bb6947db14e2c4bc9f20a20a9a2aab487359b6f0a36e52a15b906888b3" + } + ] + }, + "notes": [] + } + ], + "runtime": { + "CUDA": "13.2.51", + "GPU": "NVIDIA RTX PRO 6000", + "upstream_base": "6a1a922d269908a29cbd4b49c27e6a8e7fd10fae", + "ctx": 512, + "batch": 512, + "ubatch": 512, + "tf_chunk": 512, + "n_seq": 1, + "threads": 8, + "metric_threads": 8, + "flash_attention": true, + "all_layers_on_GPU": true, + "KV": "f16", + "MTP": false, + "decode_shape": "prefill257 + TF254, 255 target metrics per window; not the matched full512 PPL bridge" + }, + "limitations": [ + "Sparse operational/numerical qualification, not full-corpus or all-image quality certification.", + "A fixed KLD threshold is a screening flag, not automatic proof of unusability.", + "The original 113 had two capped short text/image operations; the supplemental six have structural, full-file SHA, full-corpus tokenizer and sparse numerical checks.", + "Projectors, draft heads, split reference shards and original source tensors are auxiliary artifacts, not standalone candidate entries.", + "Gemma vocabulary/template compatibility is limited to the audited no-tool benchmark prompts." + ], + "removed_files": 3, + "removed_bytes": 55271904160 + }, + "excluded_directories": [ + ".cache", + ".codex-work", + ".git", + ".venv", + "__pycache__" + ] +} diff --git a/bpw/BPW.csv b/bpw/BPW.csv new file mode 100644 index 0000000000000000000000000000000000000000..1203c0956cd4b45ee828d07a71825f91087cb601 --- /dev/null +++ b/bpw/BPW.csv @@ -0,0 +1,71 @@ +family,producer,model,shards,main_parameters,main_bpw,llama_cpp_bpw,hf_estimated_bpw,embedded_mtp_parameters,embedded_mtp_bytes,main_tensor_bytes,llama_cpp_parameters,llama_cpp_tensor_bytes,file_bytes,hf_gguf_total,hf_repo,hf_commit +gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16.gguf,2,30697345596,16.000694143144507,16.000694143144507,16.00482093227042,0,0,61397354736,30697345596,61397354736,61413189920,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14 +gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf,1,30697345596,4.46685093299622,4.46685093299622,4.470977738801101,0,0,17140058352,30697345596,17140058352,17155893600,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14 +gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf,1,30697345596,4.4658197725689766,4.4658197725689766,4.4699465783738574,0,0,17136101616,30697345596,17136101616,17151936864,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14 +gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf,1,30697345596,5.1034131645706085,5.1034131645706085,5.107539970375489,0,0,19582654704,30697345596,19582654704,19598489952,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14 +gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf,1,30697345596,4.737821960050881,4.737821960050881,4.741948765855762,0,0,18179819760,30697345596,18179819760,18195655008,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14 +gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf,1,30697345596,4.50119305852962,4.50119305852962,4.505320022784683,0,0,17271834864,30697345596,17271834864,17287670720,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec +gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf,1,30697345596,4.978216838784682,4.978216838784682,4.982343803039745,0,0,19102255344,30697345596,19102255344,19118091200,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec +gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf,1,30697345596,4.771200174750119,4.771200174750119,4.7753271390051815,0,0,18307897584,30697345596,18307897584,18323733440,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec +gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf,1,30697345596,4.530424214988859,4.530424214988859,4.5345511792439215,0,0,17383999728,30697345596,17383999728,17399835584,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec +gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf,1,30697345596,4.004095274739858,4.004095274739858,4.008222238994921,0,0,15364387056,30697345596,15364387056,15380222912,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec +gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf,1,30697345596,4.9013057208309645,4.9013057208309645,4.905432685086026,0,0,18807134448,30697345596,18807134448,18822970304,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec +gemma-4-e4b-it,bartowski,gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf,1,7518069290,5.541883956751881,5.541883956751881,5.558725787162837,0,0,5208033448,7518069290,5208033448,5223860704,7518069290,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66 +gemma-4-e4b-it,bartowski,gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf,1,7518069290,5.79154260814215,5.79154260814215,5.808384438553106,0,0,5442652328,7518069290,5442652328,5458479584,7518069290,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66 +gemma-4-e4b-it,bartowski,gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf,1,7518069290,5.734815873717492,5.734815873717492,5.75165770412845,0,0,5389342888,7518069290,5389342888,5405170144,7518069290,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66 +gemma-4-e4b-it,bartowski,gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf,1,7518069290,16.00120414319831,16.00120414319831,16.018045701198904,0,0,15037270184,7518069290,15037270184,15053097184,7518069290,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66 +gemma-4-e4b-it,unsloth,gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf,1,7518069290,16.00120414319831,16.00120414319831,16.018046416276114,0,0,15037270184,7518069290,15037270184,15053097856,7518069290,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3 +gemma-4-e4b-it,unsloth,gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf,1,7518069290,5.128988297472848,5.128988297472848,5.145830842961012,0,0,4820011176,7518069290,4820011176,4835839104,7518069290,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3 +gemma-4-e4b-it,unsloth,gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf,1,7518069290,5.279380611827269,5.279380611827269,5.296223157315434,0,0,4961343656,7518069290,4961343656,4977171584,7518069290,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3 +gemma-4-e4b-it,unsloth,gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf,1,7518069290,5.138577142323731,5.138577142323731,5.155419687811896,0,0,4829022376,7518069290,4829022376,4844850304,7518069290,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3 +glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf,1,9400279040,4.6431295996932445,4.6431295996932445,4.651078327138681,0,0,5455839232,9400279040,5455839232,5465179264,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa +glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf,1,9400279040,4.876821249765794,4.876821249765794,4.88476997721123,0,0,5730435072,9400279040,5730435072,5739775104,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa +glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf,1,9400279040,4.653587161599833,4.653587161599833,4.661535889045268,0,0,5468127232,9400279040,5468127232,5477467264,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa +glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf,1,9400279040,5.105604817450185,5.105604817450185,5.113553544895621,0,0,5999263744,9400279040,5999263744,6008603776,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa +glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf,1,9400279040,5.240047233321278,5.240047233321278,5.247995960766714,0,0,6157238272,9400279040,6157238272,6166578304,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa +glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf,1,9400279040,4.892744630695558,4.892744630695558,4.900693358140994,0,0,5749145600,9400279040,5749145600,5758485632,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa +glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf,1,9400279040,16.00143617183517,16.00143617183517,16.0093846541815,0,0,18802245632,9400279040,18802245632,18811585376,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa +glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf,1,9400279040,4.6431295996932445,4.6431295996932445,4.651078735637192,0,0,5455839232,9400279040,5455839232,5465179744,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8 +glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf,1,9400279040,4.653587161599833,4.653587161599833,4.66153629754378,0,0,5468127232,9400279040,5468127232,5477467744,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8 +glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf,1,9400279040,5.105604817450185,5.105604817450185,5.113553953394132,0,0,5999263744,9400279040,5999263744,6008604256,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8 +glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf,1,9400279040,5.240047233321278,5.240047233321278,5.247996369265225,0,0,6157238272,9400279040,6157238272,6166578784,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8 +glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf,1,9400279040,4.892744630695558,4.892744630695558,4.900693766639506,0,0,5749145600,9400279040,5749145600,5758486112,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8 +glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf,1,9400279040,5.257727484651349,5.257727484651349,5.265676620595297,0,0,6178013184,9400279040,6178013184,6187353696,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8 +internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf,1,30532122624,3.890801228821896,3.890801228821896,3.8923646319494094,0,0,14849302528,30532122624,14849302528,14855269280,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9 +internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf,1,30532122624,4.6182641129955915,4.6182641129955915,4.619827516123106,0,0,17625675776,30532122624,17625675776,17631642528,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9 +internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf,1,30532122624,5.033007534143985,5.033007534143985,5.034570937271498,0,0,19208550400,30532122624,19208550400,19214517152,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9 +internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf,1,30532122624,4.880424231850484,4.880424231850484,4.881987634977999,0,0,18626213888,30532122624,18626213888,18632180640,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9 +internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf,1,30532122624,4.710716466432072,4.710716466432072,4.712279869559586,0,0,17978521600,30532122624,17978521600,17984488352,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9 +internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf,2,30532122624,16.006704469863458,16.006704469863458,16.008267856221746,0,0,61089832960,30532122624,61089832960,61095799648,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9 +internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf,1,30532122624,4.860642450431683,4.860642450431683,4.862205954174541,0,0,18550716416,30532122624,18550716416,18556683552,30532122624,mradermacher/InternVL3_5-30B-A3B-GGUF,21b0a0caee18e68b38b257a60ac86f883cd65059 +internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf,1,30532122624,4.572243996500465,4.572243996500465,4.573807500243322,0,0,17450039296,30532122624,17450039296,17456006432,30532122624,mradermacher/InternVL3_5-30B-A3B-GGUF,21b0a0caee18e68b38b257a60ac86f883cd65059 +internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf,1,30532122624,4.552324841599588,4.552324841599588,4.553888412419341,0,0,17374017536,30532122624,17374017536,17379984928,30532122624,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95 +internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf,1,30532122624,5.027237847896834,5.027237847896834,5.028801418716587,0,0,19186530304,30532122624,19186530304,19192497696,30532122624,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95 +internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf,1,30532122624,4.860642450431683,4.860642450431683,4.862206021251437,0,0,18550716416,30532122624,18550716416,18556683808,30532122624,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95 +internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf,1,30532122624,4.572243996500465,4.572243996500465,4.573807567320217,0,0,17450039296,30532122624,17450039296,17456006688,30532122624,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95 +kimi-vl-a3b-separate,ggml-org,kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf,1,15960110208,16.003544837677353,16.003544837677353,16.007022002639044,0,0,31927292416,15960110208,31927292416,31934229408,15960110208,ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF,e7dcd093335f922a057772febc7ab27eda985b40 +muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf,1,27854794240,4.667764100346124,4.667764100346124,4.671530531040103,0,0,16252451072,27854794240,16252451072,16265565216,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857 +muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf,1,27854794240,5.116560790362528,5.116560790362528,5.120327221056507,0,0,17815093504,27854794240,17815093504,17828207648,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857 +muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf,1,27854794240,4.966673875096626,4.966673875096626,4.970440305790605,0,0,17293209856,27854794240,17293209856,17306324000,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857 +muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf,1,27854794240,4.68366884393112,4.68366884393112,4.6874352746250985,0,0,16307828992,27854794240,16307828992,16320943136,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857 +muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16.gguf,2,27854794240,16.000806706946257,16.000806706946257,16.00457311006868,0,0,55712397312,27854794240,55712397312,55725511360,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857 +qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf,1,4205751296,5.015775548131698,5.112972644422943,5.1332558926113245,120599552,128176128,2636888064,4326350848,2765064192,2776033248,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6 +qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf,1,4205751296,5.403467440790869,5.489857399563356,5.510140647751737,120599552,128176128,2840705024,4326350848,2968881152,2979850208,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6 +qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf,1,4205751296,5.466576450648973,5.551207208981309,5.571490457169691,120599552,128176128,2873882624,4326350848,3002058752,3013027808,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6 +qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf,1,4205751296,5.1491615047700625,5.242640389760641,5.262923637949023,120599552,128176128,2707011584,4326350848,2835187712,2846156768,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6 +qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf,1,4205751296,16.003657985201034,16.003605248059625,16.023888022869844,120599552,241225728,8413425664,4326350848,8654651392,8665620192,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6 +qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf,1,4205751296,16.003657985201034,16.003657985201034,16.0245207842171,0,0,8413425664,4205751296,8413425664,8424393632,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523 +qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf,1,4205751296,4.8865968588172075,4.8865968588172075,4.907460144785508,0,0,2568976384,4205751296,2568976384,2579944608,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523 +qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf,1,4205751296,4.892829847445168,4.892829847445168,4.913693133413469,0,0,2572253184,4205751296,2572253184,2583221408,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523 +qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf,1,4205751296,5.27553534920197,5.27553534920197,5.296398635170271,0,0,2773448704,4205751296,2773448704,2784416928,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523 +qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf,1,4205751296,5.192831381344714,5.192831381344714,5.213694667313015,0,0,2729969664,4205751296,2729969664,2740937888,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523 +qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf,1,4205751296,4.906542422426683,4.906542422426683,4.927405708394984,0,0,2579462144,4205751296,2579462144,2590430368,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523 +qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16.gguf,2,34660610688,16.01025405960672,16.010014969206477,16.012491363215652,844640768,1689303040,69365647872,35505251456,71054950912,71065941536,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f +qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf,1,34660610688,4.337051653046743,4.436203072528381,4.438679488168163,844640768,897955840,18790607360,35505251456,19688563200,19699553920,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f +qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf,1,34660610688,5.020934045926987,5.103816465025404,5.106292880665185,844640768,897955840,21753580032,35505251456,22651535872,22662526592,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f +qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf,1,34660610688,4.9338158117106055,5.018770702041807,5.021247117681588,844640768,897955840,21376133632,35505251456,22274089472,22285080192,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f +qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf,1,34660610688,4.749463606911968,4.838804084767781,4.841280500407562,844640768,897955840,20577413632,35505251456,21475369472,21486360192,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f +qwen3.6-35b-a3b,unsloth,qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf,1,34660610688,3.8855683765152706,3.8855683765152706,3.8881049845627,0,0,16834521600,34660610688,16834521600,16845511648,34660610688,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c +qwen3.6-35b-a3b,unsloth,qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf,1,34660610688,5.106324096397871,5.106324096397871,5.108860704445301,0,0,22123538944,34660610688,22123538944,22134528992,34660610688,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c +qwen3.6-35b-a3b,unsloth,qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf,1,34660610688,4.8197708108425585,4.8197708108425585,4.822307418889988,0,0,20882024960,34660610688,20882024960,20893015008,34660610688,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c +qwen3.6-35b-a3b,unsloth,qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf,1,34660610688,5.15847024466599,5.15847024466599,5.161006852713419,0,0,22349466112,34660610688,22349466112,22360456160,34660610688,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c diff --git a/bpw/BPW.json b/bpw/BPW.json new file mode 100644 index 0000000000000000000000000000000000000000..60a5a2307cf48f3ef430ad18e2fb15f5297468fa --- /dev/null +++ b/bpw/BPW.json @@ -0,0 +1,2087 @@ +{ + "provenance": { + "created_utc": "2026-09-06T11:32:10.745771+00:00", + "models_dir": "/home/ubuntu/models", + "library": "/home/ubuntu/projects/llama.cpp/build/bin/libggml-base.so.0.23.0", + "library_sha256": "a591ae0a3ab643b34f6eb222c842a6abe28a2b988f3fbf0c49727b4451c4762f", + "script_sha256": "935b10b1bed14e5e60a00c09009637fa73b1a7d66fb5a5bf8f5d6aba24675218", + "method": "llama.cpp native gguf_init_from_file(no_alloc=true, ctx=NULL), gguf_get_tensor_size/ne; metadata only", + "main_bpw": "8 * main tensor bytes / main stored parameter count; embedded nextn blocks excluded", + "llama_cpp_bpw": "8 * all tensor bytes / all stored parameter count; matches llama_model_loader.print_info", + "file_bpw_local_parameters": "8 * file bytes / all stored parameter count; includes GGUF metadata and padding" + }, + "rows": [ + { + "family": "gemma-4-31b-it", + "producer": "bartowski", + "model": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16.gguf", + "shards": 2, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 61397354736, + "main_bpw": 16.000694143144507, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 61397354736, + "llama_cpp_bpw": 16.000694143144507, + "file_bytes": 61413189920, + "file_bpw_local_parameters": 16.00482093227042, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-31B-it-GGUF", + "hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 16.00482093227042 + }, + { + "family": "gemma-4-31b-it", + "producer": "bartowski", + "model": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 17140058352, + "main_bpw": 4.46685093299622, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 17140058352, + "llama_cpp_bpw": 4.46685093299622, + "file_bytes": 17155893600, + "file_bpw_local_parameters": 4.470977738801101, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-31B-it-GGUF", + "hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.470977738801101 + }, + { + "family": "gemma-4-31b-it", + "producer": "bartowski", + "model": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 17136101616, + "main_bpw": 4.4658197725689766, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 17136101616, + "llama_cpp_bpw": 4.4658197725689766, + "file_bytes": 17151936864, + "file_bpw_local_parameters": 4.4699465783738574, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-31B-it-GGUF", + "hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.4699465783738574 + }, + { + "family": "gemma-4-31b-it", + "producer": "bartowski", + "model": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 19582654704, + "main_bpw": 5.1034131645706085, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 19582654704, + "llama_cpp_bpw": 5.1034131645706085, + "file_bytes": 19598489952, + "file_bpw_local_parameters": 5.107539970375489, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-31B-it-GGUF", + "hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 5.107539970375489 + }, + { + "family": "gemma-4-31b-it", + "producer": "bartowski", + "model": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 18179819760, + "main_bpw": 4.737821960050881, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 18179819760, + "llama_cpp_bpw": 4.737821960050881, + "file_bytes": 18195655008, + "file_bpw_local_parameters": 4.741948765855762, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-31B-it-GGUF", + "hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.741948765855762 + }, + { + "family": "gemma-4-31b-it", + "producer": "unsloth", + "model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 17271834864, + "main_bpw": 4.50119305852962, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 17271834864, + "llama_cpp_bpw": 4.50119305852962, + "file_bytes": 17287670720, + "file_bpw_local_parameters": 4.505320022784683, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf" + ], + "hf_repo": "unsloth/gemma-4-31B-it-GGUF", + "hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.505320022784683 + }, + { + "family": "gemma-4-31b-it", + "producer": "unsloth", + "model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 19102255344, + "main_bpw": 4.978216838784682, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 19102255344, + "llama_cpp_bpw": 4.978216838784682, + "file_bytes": 19118091200, + "file_bpw_local_parameters": 4.982343803039745, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf" + ], + "hf_repo": "unsloth/gemma-4-31B-it-GGUF", + "hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.982343803039745 + }, + { + "family": "gemma-4-31b-it", + "producer": "unsloth", + "model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 18307897584, + "main_bpw": 4.771200174750119, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 18307897584, + "llama_cpp_bpw": 4.771200174750119, + "file_bytes": 18323733440, + "file_bpw_local_parameters": 4.7753271390051815, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf" + ], + "hf_repo": "unsloth/gemma-4-31B-it-GGUF", + "hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.7753271390051815 + }, + { + "family": "gemma-4-31b-it", + "producer": "unsloth", + "model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 17383999728, + "main_bpw": 4.530424214988859, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 17383999728, + "llama_cpp_bpw": 4.530424214988859, + "file_bytes": 17399835584, + "file_bpw_local_parameters": 4.5345511792439215, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf" + ], + "hf_repo": "unsloth/gemma-4-31B-it-GGUF", + "hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.5345511792439215 + }, + { + "family": "gemma-4-31b-it", + "producer": "unsloth", + "model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 15364387056, + "main_bpw": 4.004095274739858, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 15364387056, + "llama_cpp_bpw": 4.004095274739858, + "file_bytes": 15380222912, + "file_bpw_local_parameters": 4.008222238994921, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf" + ], + "hf_repo": "unsloth/gemma-4-31B-it-GGUF", + "hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.008222238994921 + }, + { + "family": "gemma-4-31b-it", + "producer": "unsloth", + "model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 30697345596, + "main_tensor_bytes": 18807134448, + "main_bpw": 4.9013057208309645, + "llama_cpp_parameters": 30697345596, + "llama_cpp_tensor_bytes": 18807134448, + "llama_cpp_bpw": 4.9013057208309645, + "file_bytes": 18822970304, + "file_bpw_local_parameters": 4.905432685086026, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 833, + "files": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf" + ], + "hf_repo": "unsloth/gemma-4-31B-it-GGUF", + "hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_estimated_bpw": 4.905432685086026 + }, + { + "family": "gemma-4-e4b-it", + "producer": "bartowski", + "model": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 7518069290, + "main_tensor_bytes": 5208033448, + "main_bpw": 5.541883956751881, + "llama_cpp_parameters": 7518069290, + "llama_cpp_tensor_bytes": 5208033448, + "llama_cpp_bpw": 5.541883956751881, + "file_bytes": 5223860704, + "file_bpw_local_parameters": 5.558725787162837, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 720, + "files": [ + "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-E4B-it-GGUF", + "hf_commit": "029e94146666900b08caf49a3b47b413dfa8ec66", + "hf_gguf_total": 7518069290, + "hf_estimated_bpw": 5.558725787162837 + }, + { + "family": "gemma-4-e4b-it", + "producer": "bartowski", + "model": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 7518069290, + "main_tensor_bytes": 5442652328, + "main_bpw": 5.79154260814215, + "llama_cpp_parameters": 7518069290, + "llama_cpp_tensor_bytes": 5442652328, + "llama_cpp_bpw": 5.79154260814215, + "file_bytes": 5458479584, + "file_bpw_local_parameters": 5.808384438553106, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 720, + "files": [ + "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-E4B-it-GGUF", + "hf_commit": "029e94146666900b08caf49a3b47b413dfa8ec66", + "hf_gguf_total": 7518069290, + "hf_estimated_bpw": 5.808384438553106 + }, + { + "family": "gemma-4-e4b-it", + "producer": "bartowski", + "model": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 7518069290, + "main_tensor_bytes": 5389342888, + "main_bpw": 5.734815873717492, + "llama_cpp_parameters": 7518069290, + "llama_cpp_tensor_bytes": 5389342888, + "llama_cpp_bpw": 5.734815873717492, + "file_bytes": 5405170144, + "file_bpw_local_parameters": 5.75165770412845, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 720, + "files": [ + "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-E4B-it-GGUF", + "hf_commit": "029e94146666900b08caf49a3b47b413dfa8ec66", + "hf_gguf_total": 7518069290, + "hf_estimated_bpw": 5.75165770412845 + }, + { + "family": "gemma-4-e4b-it", + "producer": "bartowski", + "model": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 7518069290, + "main_tensor_bytes": 15037270184, + "main_bpw": 16.00120414319831, + "llama_cpp_parameters": 7518069290, + "llama_cpp_tensor_bytes": 15037270184, + "llama_cpp_bpw": 16.00120414319831, + "file_bytes": 15053097184, + "file_bpw_local_parameters": 16.018045701198904, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 720, + "files": [ + "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf" + ], + "hf_repo": "bartowski/google_gemma-4-E4B-it-GGUF", + "hf_commit": "029e94146666900b08caf49a3b47b413dfa8ec66", + "hf_gguf_total": 7518069290, + "hf_estimated_bpw": 16.018045701198904 + }, + { + "family": "gemma-4-e4b-it", + "producer": "unsloth", + "model": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 7518069290, + "main_tensor_bytes": 15037270184, + "main_bpw": 16.00120414319831, + "llama_cpp_parameters": 7518069290, + "llama_cpp_tensor_bytes": 15037270184, + "llama_cpp_bpw": 16.00120414319831, + "file_bytes": 15053097856, + "file_bpw_local_parameters": 16.018046416276114, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 720, + "files": [ + "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf" + ], + "hf_repo": "unsloth/gemma-4-E4B-it-GGUF", + "hf_commit": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "hf_gguf_total": 7518069290, + "hf_estimated_bpw": 16.018046416276114 + }, + { + "family": "gemma-4-e4b-it", + "producer": "unsloth", + "model": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 7518069290, + "main_tensor_bytes": 4820011176, + "main_bpw": 5.128988297472848, + "llama_cpp_parameters": 7518069290, + "llama_cpp_tensor_bytes": 4820011176, + "llama_cpp_bpw": 5.128988297472848, + "file_bytes": 4835839104, + "file_bpw_local_parameters": 5.145830842961012, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 720, + "files": [ + "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf" + ], + "hf_repo": "unsloth/gemma-4-E4B-it-GGUF", + "hf_commit": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "hf_gguf_total": 7518069290, + "hf_estimated_bpw": 5.145830842961012 + }, + { + "family": "gemma-4-e4b-it", + "producer": "unsloth", + "model": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 7518069290, + "main_tensor_bytes": 4961343656, + "main_bpw": 5.279380611827269, + "llama_cpp_parameters": 7518069290, + "llama_cpp_tensor_bytes": 4961343656, + "llama_cpp_bpw": 5.279380611827269, + "file_bytes": 4977171584, + "file_bpw_local_parameters": 5.296223157315434, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 720, + "files": [ + "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf" + ], + "hf_repo": "unsloth/gemma-4-E4B-it-GGUF", + "hf_commit": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "hf_gguf_total": 7518069290, + "hf_estimated_bpw": 5.296223157315434 + }, + { + "family": "gemma-4-e4b-it", + "producer": "unsloth", + "model": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "shards": 1, + "architecture": "gemma4", + "main_parameters": 7518069290, + "main_tensor_bytes": 4829022376, + "main_bpw": 5.138577142323731, + "llama_cpp_parameters": 7518069290, + "llama_cpp_tensor_bytes": 4829022376, + "llama_cpp_bpw": 5.138577142323731, + "file_bytes": 4844850304, + "file_bpw_local_parameters": 5.155419687811896, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 720, + "files": [ + "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf" + ], + "hf_repo": "unsloth/gemma-4-E4B-it-GGUF", + "hf_commit": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "hf_gguf_total": 7518069290, + "hf_estimated_bpw": 5.155419687811896 + }, + { + "family": "glm-4.6v-flash", + "producer": "bartowski", + "model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5455839232, + "main_bpw": 4.6431295996932445, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5455839232, + "llama_cpp_bpw": 4.6431295996932445, + "file_bytes": 5465179264, + "file_bpw_local_parameters": 4.651078327138681, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf" + ], + "hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 4.651078327138681 + }, + { + "family": "glm-4.6v-flash", + "producer": "bartowski", + "model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5730435072, + "main_bpw": 4.876821249765794, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5730435072, + "llama_cpp_bpw": 4.876821249765794, + "file_bytes": 5739775104, + "file_bpw_local_parameters": 4.88476997721123, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf" + ], + "hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 4.88476997721123 + }, + { + "family": "glm-4.6v-flash", + "producer": "bartowski", + "model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5468127232, + "main_bpw": 4.653587161599833, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5468127232, + "llama_cpp_bpw": 4.653587161599833, + "file_bytes": 5477467264, + "file_bpw_local_parameters": 4.661535889045268, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf" + ], + "hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 4.661535889045268 + }, + { + "family": "glm-4.6v-flash", + "producer": "bartowski", + "model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5999263744, + "main_bpw": 5.105604817450185, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5999263744, + "llama_cpp_bpw": 5.105604817450185, + "file_bytes": 6008603776, + "file_bpw_local_parameters": 5.113553544895621, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf" + ], + "hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 5.113553544895621 + }, + { + "family": "glm-4.6v-flash", + "producer": "bartowski", + "model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 6157238272, + "main_bpw": 5.240047233321278, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 6157238272, + "llama_cpp_bpw": 5.240047233321278, + "file_bytes": 6166578304, + "file_bpw_local_parameters": 5.247995960766714, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf" + ], + "hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 5.247995960766714 + }, + { + "family": "glm-4.6v-flash", + "producer": "bartowski", + "model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5749145600, + "main_bpw": 4.892744630695558, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5749145600, + "llama_cpp_bpw": 4.892744630695558, + "file_bytes": 5758485632, + "file_bpw_local_parameters": 4.900693358140994, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf" + ], + "hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 4.900693358140994 + }, + { + "family": "glm-4.6v-flash", + "producer": "bartowski", + "model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 18802245632, + "main_bpw": 16.00143617183517, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 18802245632, + "llama_cpp_bpw": 16.00143617183517, + "file_bytes": 18811585376, + "file_bpw_local_parameters": 16.0093846541815, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf" + ], + "hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 16.0093846541815 + }, + { + "family": "glm-4.6v-flash", + "producer": "unsloth", + "model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5455839232, + "main_bpw": 4.6431295996932445, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5455839232, + "llama_cpp_bpw": 4.6431295996932445, + "file_bytes": 5465179744, + "file_bpw_local_parameters": 4.651078735637192, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf" + ], + "hf_repo": "unsloth/GLM-4.6V-Flash-GGUF", + "hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 4.651078735637192 + }, + { + "family": "glm-4.6v-flash", + "producer": "unsloth", + "model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5468127232, + "main_bpw": 4.653587161599833, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5468127232, + "llama_cpp_bpw": 4.653587161599833, + "file_bytes": 5477467744, + "file_bpw_local_parameters": 4.66153629754378, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf" + ], + "hf_repo": "unsloth/GLM-4.6V-Flash-GGUF", + "hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 4.66153629754378 + }, + { + "family": "glm-4.6v-flash", + "producer": "unsloth", + "model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5999263744, + "main_bpw": 5.105604817450185, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5999263744, + "llama_cpp_bpw": 5.105604817450185, + "file_bytes": 6008604256, + "file_bpw_local_parameters": 5.113553953394132, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf" + ], + "hf_repo": "unsloth/GLM-4.6V-Flash-GGUF", + "hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 5.113553953394132 + }, + { + "family": "glm-4.6v-flash", + "producer": "unsloth", + "model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 6157238272, + "main_bpw": 5.240047233321278, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 6157238272, + "llama_cpp_bpw": 5.240047233321278, + "file_bytes": 6166578784, + "file_bpw_local_parameters": 5.247996369265225, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf" + ], + "hf_repo": "unsloth/GLM-4.6V-Flash-GGUF", + "hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 5.247996369265225 + }, + { + "family": "glm-4.6v-flash", + "producer": "unsloth", + "model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 5749145600, + "main_bpw": 4.892744630695558, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 5749145600, + "llama_cpp_bpw": 4.892744630695558, + "file_bytes": 5758486112, + "file_bpw_local_parameters": 4.900693766639506, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf" + ], + "hf_repo": "unsloth/GLM-4.6V-Flash-GGUF", + "hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 4.900693766639506 + }, + { + "family": "glm-4.6v-flash", + "producer": "unsloth", + "model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "shards": 1, + "architecture": "glm4", + "main_parameters": 9400279040, + "main_tensor_bytes": 6178013184, + "main_bpw": 5.257727484651349, + "llama_cpp_parameters": 9400279040, + "llama_cpp_tensor_bytes": 6178013184, + "llama_cpp_bpw": 5.257727484651349, + "file_bytes": 6187353696, + "file_bpw_local_parameters": 5.265676620595297, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 523, + "files": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf" + ], + "hf_repo": "unsloth/GLM-4.6V-Flash-GGUF", + "hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_estimated_bpw": 5.265676620595297 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "bartowski", + "model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 14849302528, + "main_bpw": 3.890801228821896, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 14849302528, + "llama_cpp_bpw": 3.890801228821896, + "file_bytes": 14855269280, + "file_bpw_local_parameters": 3.8923646319494094, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf" + ], + "hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 3.8923646319494094 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "bartowski", + "model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 17625675776, + "main_bpw": 4.6182641129955915, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 17625675776, + "llama_cpp_bpw": 4.6182641129955915, + "file_bytes": 17631642528, + "file_bpw_local_parameters": 4.619827516123106, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf" + ], + "hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 4.619827516123106 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "bartowski", + "model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 19208550400, + "main_bpw": 5.033007534143985, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 19208550400, + "llama_cpp_bpw": 5.033007534143985, + "file_bytes": 19214517152, + "file_bpw_local_parameters": 5.034570937271498, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf" + ], + "hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 5.034570937271498 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "bartowski", + "model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 18626213888, + "main_bpw": 4.880424231850484, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 18626213888, + "llama_cpp_bpw": 4.880424231850484, + "file_bytes": 18632180640, + "file_bpw_local_parameters": 4.881987634977999, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf" + ], + "hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 4.881987634977999 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "bartowski", + "model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 17978521600, + "main_bpw": 4.710716466432072, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 17978521600, + "llama_cpp_bpw": 4.710716466432072, + "file_bytes": 17984488352, + "file_bpw_local_parameters": 4.712279869559586, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf" + ], + "hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 4.712279869559586 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "bartowski", + "model": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf", + "shards": 2, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 61089832960, + "main_bpw": 16.006704469863458, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 61089832960, + "llama_cpp_bpw": 16.006704469863458, + "file_bytes": 61095799648, + "file_bpw_local_parameters": 16.008267856221746, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf" + ], + "hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 16.008267856221746 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "mradermacher", + "model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 18550716416, + "main_bpw": 4.860642450431683, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 18550716416, + "llama_cpp_bpw": 4.860642450431683, + "file_bytes": 18556683552, + "file_bpw_local_parameters": 4.862205954174541, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf" + ], + "hf_repo": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "hf_commit": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 4.862205954174541 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "mradermacher", + "model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 17450039296, + "main_bpw": 4.572243996500465, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 17450039296, + "llama_cpp_bpw": 4.572243996500465, + "file_bytes": 17456006432, + "file_bpw_local_parameters": 4.573807500243322, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf" + ], + "hf_repo": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "hf_commit": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 4.573807500243322 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "mradermacher", + "model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 17374017536, + "main_bpw": 4.552324841599588, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 17374017536, + "llama_cpp_bpw": 4.552324841599588, + "file_bytes": 17379984928, + "file_bpw_local_parameters": 4.553888412419341, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf" + ], + "hf_repo": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "hf_commit": "120d600e464788a15e2140e1c9650c543d575d95", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 4.553888412419341 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "mradermacher", + "model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 19186530304, + "main_bpw": 5.027237847896834, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 19186530304, + "llama_cpp_bpw": 5.027237847896834, + "file_bytes": 19192497696, + "file_bpw_local_parameters": 5.028801418716587, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf" + ], + "hf_repo": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "hf_commit": "120d600e464788a15e2140e1c9650c543d575d95", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 5.028801418716587 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "mradermacher", + "model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 18550716416, + "main_bpw": 4.860642450431683, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 18550716416, + "llama_cpp_bpw": 4.860642450431683, + "file_bytes": 18556683808, + "file_bpw_local_parameters": 4.862206021251437, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf" + ], + "hf_repo": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "hf_commit": "120d600e464788a15e2140e1c9650c543d575d95", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 4.862206021251437 + }, + { + "family": "internvl3.5-30b-a3b", + "producer": "mradermacher", + "model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "shards": 1, + "architecture": "qwen3moe", + "main_parameters": 30532122624, + "main_tensor_bytes": 17450039296, + "main_bpw": 4.572243996500465, + "llama_cpp_parameters": 30532122624, + "llama_cpp_tensor_bytes": 17450039296, + "llama_cpp_bpw": 4.572243996500465, + "file_bytes": 17456006688, + "file_bpw_local_parameters": 4.573807567320217, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 579, + "files": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf" + ], + "hf_repo": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "hf_commit": "120d600e464788a15e2140e1c9650c543d575d95", + "hf_gguf_total": 30532122624, + "hf_estimated_bpw": 4.573807567320217 + }, + { + "family": "kimi-vl-a3b-separate", + "producer": "ggml-org", + "model": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "shards": 1, + "architecture": "deepseek2", + "main_parameters": 15960110208, + "main_tensor_bytes": 31927292416, + "main_bpw": 16.003544837677353, + "llama_cpp_parameters": 15960110208, + "llama_cpp_tensor_bytes": 31927292416, + "llama_cpp_bpw": 16.003544837677353, + "file_bytes": 31934229408, + "file_bpw_local_parameters": 16.007022002639044, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 430, + "files": [ + "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf" + ], + "hf_repo": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF", + "hf_commit": "e7dcd093335f922a057772febc7ab27eda985b40", + "hf_gguf_total": 15960110208, + "hf_estimated_bpw": 16.007022002639044 + }, + { + "family": "muse-glimmer-30b", + "producer": "bartowski", + "model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "shards": 1, + "architecture": "muse-glimmer", + "main_parameters": 27854794240, + "main_tensor_bytes": 16252451072, + "main_bpw": 4.667764100346124, + "llama_cpp_parameters": 27854794240, + "llama_cpp_tensor_bytes": 16252451072, + "llama_cpp_bpw": 4.667764100346124, + "file_bytes": 16265565216, + "file_bpw_local_parameters": 4.671530531040103, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 731, + "files": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf" + ], + "hf_repo": "bartowski/Muse-Glimmer-30B-GGUF", + "hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_estimated_bpw": 4.671530531040103 + }, + { + "family": "muse-glimmer-30b", + "producer": "bartowski", + "model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "shards": 1, + "architecture": "muse-glimmer", + "main_parameters": 27854794240, + "main_tensor_bytes": 17815093504, + "main_bpw": 5.116560790362528, + "llama_cpp_parameters": 27854794240, + "llama_cpp_tensor_bytes": 17815093504, + "llama_cpp_bpw": 5.116560790362528, + "file_bytes": 17828207648, + "file_bpw_local_parameters": 5.120327221056507, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 731, + "files": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf" + ], + "hf_repo": "bartowski/Muse-Glimmer-30B-GGUF", + "hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_estimated_bpw": 5.120327221056507 + }, + { + "family": "muse-glimmer-30b", + "producer": "bartowski", + "model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "shards": 1, + "architecture": "muse-glimmer", + "main_parameters": 27854794240, + "main_tensor_bytes": 17293209856, + "main_bpw": 4.966673875096626, + "llama_cpp_parameters": 27854794240, + "llama_cpp_tensor_bytes": 17293209856, + "llama_cpp_bpw": 4.966673875096626, + "file_bytes": 17306324000, + "file_bpw_local_parameters": 4.970440305790605, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 731, + "files": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf" + ], + "hf_repo": "bartowski/Muse-Glimmer-30B-GGUF", + "hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_estimated_bpw": 4.970440305790605 + }, + { + "family": "muse-glimmer-30b", + "producer": "bartowski", + "model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "shards": 1, + "architecture": "muse-glimmer", + "main_parameters": 27854794240, + "main_tensor_bytes": 16307828992, + "main_bpw": 4.68366884393112, + "llama_cpp_parameters": 27854794240, + "llama_cpp_tensor_bytes": 16307828992, + "llama_cpp_bpw": 4.68366884393112, + "file_bytes": 16320943136, + "file_bpw_local_parameters": 4.6874352746250985, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 731, + "files": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf" + ], + "hf_repo": "bartowski/Muse-Glimmer-30B-GGUF", + "hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_estimated_bpw": 4.6874352746250985 + }, + { + "family": "muse-glimmer-30b", + "producer": "bartowski", + "model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16.gguf", + "shards": 2, + "architecture": "muse-glimmer", + "main_parameters": 27854794240, + "main_tensor_bytes": 55712397312, + "main_bpw": 16.000806706946257, + "llama_cpp_parameters": 27854794240, + "llama_cpp_tensor_bytes": 55712397312, + "llama_cpp_bpw": 16.000806706946257, + "file_bytes": 55725511360, + "file_bpw_local_parameters": 16.00457311006868, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 731, + "files": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf" + ], + "hf_repo": "bartowski/Muse-Glimmer-30B-GGUF", + "hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_estimated_bpw": 16.00457311006868 + }, + { + "family": "qwen3.5-4b", + "producer": "bartowski", + "model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2636888064, + "main_bpw": 5.015775548131698, + "llama_cpp_parameters": 4326350848, + "llama_cpp_tensor_bytes": 2765064192, + "llama_cpp_bpw": 5.112972644422943, + "file_bytes": 2776033248, + "file_bpw_local_parameters": 5.1332558926113245, + "embedded_mtp_parameters": 120599552, + "embedded_mtp_bytes": 128176128, + "embedded_mtp_tensors": [ + "blk.32.attn_k.weight", + "blk.32.attn_k_norm.weight", + "blk.32.attn_norm.weight", + "blk.32.attn_output.weight", + "blk.32.attn_q.weight", + "blk.32.attn_q_norm.weight", + "blk.32.attn_v.weight", + "blk.32.ffn_down.weight", + "blk.32.ffn_gate.weight", + "blk.32.ffn_up.weight", + "blk.32.nextn.eh_proj.weight", + "blk.32.nextn.enorm.weight", + "blk.32.nextn.hnorm.weight", + "blk.32.nextn.shared_head_norm.weight", + "blk.32.post_attention_norm.weight" + ], + "tensor_count": 441, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_estimated_bpw": 5.1332558926113245 + }, + { + "family": "qwen3.5-4b", + "producer": "bartowski", + "model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2840705024, + "main_bpw": 5.403467440790869, + "llama_cpp_parameters": 4326350848, + "llama_cpp_tensor_bytes": 2968881152, + "llama_cpp_bpw": 5.489857399563356, + "file_bytes": 2979850208, + "file_bpw_local_parameters": 5.510140647751737, + "embedded_mtp_parameters": 120599552, + "embedded_mtp_bytes": 128176128, + "embedded_mtp_tensors": [ + "blk.32.attn_k.weight", + "blk.32.attn_k_norm.weight", + "blk.32.attn_norm.weight", + "blk.32.attn_output.weight", + "blk.32.attn_q.weight", + "blk.32.attn_q_norm.weight", + "blk.32.attn_v.weight", + "blk.32.ffn_down.weight", + "blk.32.ffn_gate.weight", + "blk.32.ffn_up.weight", + "blk.32.nextn.eh_proj.weight", + "blk.32.nextn.enorm.weight", + "blk.32.nextn.hnorm.weight", + "blk.32.nextn.shared_head_norm.weight", + "blk.32.post_attention_norm.weight" + ], + "tensor_count": 441, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_estimated_bpw": 5.510140647751737 + }, + { + "family": "qwen3.5-4b", + "producer": "bartowski", + "model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2873882624, + "main_bpw": 5.466576450648973, + "llama_cpp_parameters": 4326350848, + "llama_cpp_tensor_bytes": 3002058752, + "llama_cpp_bpw": 5.551207208981309, + "file_bytes": 3013027808, + "file_bpw_local_parameters": 5.571490457169691, + "embedded_mtp_parameters": 120599552, + "embedded_mtp_bytes": 128176128, + "embedded_mtp_tensors": [ + "blk.32.attn_k.weight", + "blk.32.attn_k_norm.weight", + "blk.32.attn_norm.weight", + "blk.32.attn_output.weight", + "blk.32.attn_q.weight", + "blk.32.attn_q_norm.weight", + "blk.32.attn_v.weight", + "blk.32.ffn_down.weight", + "blk.32.ffn_gate.weight", + "blk.32.ffn_up.weight", + "blk.32.nextn.eh_proj.weight", + "blk.32.nextn.enorm.weight", + "blk.32.nextn.hnorm.weight", + "blk.32.nextn.shared_head_norm.weight", + "blk.32.post_attention_norm.weight" + ], + "tensor_count": 441, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_estimated_bpw": 5.571490457169691 + }, + { + "family": "qwen3.5-4b", + "producer": "bartowski", + "model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2707011584, + "main_bpw": 5.1491615047700625, + "llama_cpp_parameters": 4326350848, + "llama_cpp_tensor_bytes": 2835187712, + "llama_cpp_bpw": 5.242640389760641, + "file_bytes": 2846156768, + "file_bpw_local_parameters": 5.262923637949023, + "embedded_mtp_parameters": 120599552, + "embedded_mtp_bytes": 128176128, + "embedded_mtp_tensors": [ + "blk.32.attn_k.weight", + "blk.32.attn_k_norm.weight", + "blk.32.attn_norm.weight", + "blk.32.attn_output.weight", + "blk.32.attn_q.weight", + "blk.32.attn_q_norm.weight", + "blk.32.attn_v.weight", + "blk.32.ffn_down.weight", + "blk.32.ffn_gate.weight", + "blk.32.ffn_up.weight", + "blk.32.nextn.eh_proj.weight", + "blk.32.nextn.enorm.weight", + "blk.32.nextn.hnorm.weight", + "blk.32.nextn.shared_head_norm.weight", + "blk.32.post_attention_norm.weight" + ], + "tensor_count": 441, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_estimated_bpw": 5.262923637949023 + }, + { + "family": "qwen3.5-4b", + "producer": "bartowski", + "model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 8413425664, + "main_bpw": 16.003657985201034, + "llama_cpp_parameters": 4326350848, + "llama_cpp_tensor_bytes": 8654651392, + "llama_cpp_bpw": 16.003605248059625, + "file_bytes": 8665620192, + "file_bpw_local_parameters": 16.023888022869844, + "embedded_mtp_parameters": 120599552, + "embedded_mtp_bytes": 241225728, + "embedded_mtp_tensors": [ + "blk.32.ffn_down.weight", + "blk.32.ffn_gate.weight", + "blk.32.ffn_up.weight", + "blk.32.nextn.eh_proj.weight", + "blk.32.attn_norm.weight", + "blk.32.post_attention_norm.weight", + "blk.32.attn_k_norm.weight", + "blk.32.attn_k.weight", + "blk.32.attn_output.weight", + "blk.32.attn_q_norm.weight", + "blk.32.attn_q.weight", + "blk.32.attn_v.weight", + "blk.32.nextn.shared_head_norm.weight", + "blk.32.nextn.enorm.weight", + "blk.32.nextn.hnorm.weight" + ], + "tensor_count": 441, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_estimated_bpw": 16.023888022869844 + }, + { + "family": "qwen3.5-4b", + "producer": "unsloth", + "model": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 8413425664, + "main_bpw": 16.003657985201034, + "llama_cpp_parameters": 4205751296, + "llama_cpp_tensor_bytes": 8413425664, + "llama_cpp_bpw": 16.003657985201034, + "file_bytes": 8424393632, + "file_bpw_local_parameters": 16.0245207842171, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 426, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf" + ], + "hf_repo": "unsloth/Qwen3.5-4B-GGUF", + "hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_estimated_bpw": 16.0245207842171 + }, + { + "family": "qwen3.5-4b", + "producer": "unsloth", + "model": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2568976384, + "main_bpw": 4.8865968588172075, + "llama_cpp_parameters": 4205751296, + "llama_cpp_tensor_bytes": 2568976384, + "llama_cpp_bpw": 4.8865968588172075, + "file_bytes": 2579944608, + "file_bpw_local_parameters": 4.907460144785508, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 426, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf" + ], + "hf_repo": "unsloth/Qwen3.5-4B-GGUF", + "hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_estimated_bpw": 4.907460144785508 + }, + { + "family": "qwen3.5-4b", + "producer": "unsloth", + "model": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2572253184, + "main_bpw": 4.892829847445168, + "llama_cpp_parameters": 4205751296, + "llama_cpp_tensor_bytes": 2572253184, + "llama_cpp_bpw": 4.892829847445168, + "file_bytes": 2583221408, + "file_bpw_local_parameters": 4.913693133413469, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 426, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf" + ], + "hf_repo": "unsloth/Qwen3.5-4B-GGUF", + "hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_estimated_bpw": 4.913693133413469 + }, + { + "family": "qwen3.5-4b", + "producer": "unsloth", + "model": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2773448704, + "main_bpw": 5.27553534920197, + "llama_cpp_parameters": 4205751296, + "llama_cpp_tensor_bytes": 2773448704, + "llama_cpp_bpw": 5.27553534920197, + "file_bytes": 2784416928, + "file_bpw_local_parameters": 5.296398635170271, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 426, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf" + ], + "hf_repo": "unsloth/Qwen3.5-4B-GGUF", + "hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_estimated_bpw": 5.296398635170271 + }, + { + "family": "qwen3.5-4b", + "producer": "unsloth", + "model": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2729969664, + "main_bpw": 5.192831381344714, + "llama_cpp_parameters": 4205751296, + "llama_cpp_tensor_bytes": 2729969664, + "llama_cpp_bpw": 5.192831381344714, + "file_bytes": 2740937888, + "file_bpw_local_parameters": 5.213694667313015, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 426, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf" + ], + "hf_repo": "unsloth/Qwen3.5-4B-GGUF", + "hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_estimated_bpw": 5.213694667313015 + }, + { + "family": "qwen3.5-4b", + "producer": "unsloth", + "model": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "shards": 1, + "architecture": "qwen35", + "main_parameters": 4205751296, + "main_tensor_bytes": 2579462144, + "main_bpw": 4.906542422426683, + "llama_cpp_parameters": 4205751296, + "llama_cpp_tensor_bytes": 2579462144, + "llama_cpp_bpw": 4.906542422426683, + "file_bytes": 2590430368, + "file_bpw_local_parameters": 4.927405708394984, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 426, + "files": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf" + ], + "hf_repo": "unsloth/Qwen3.5-4B-GGUF", + "hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_estimated_bpw": 4.927405708394984 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "bartowski", + "model": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "shards": 2, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 69365647872, + "main_bpw": 16.01025405960672, + "llama_cpp_parameters": 35505251456, + "llama_cpp_tensor_bytes": 71054950912, + "llama_cpp_bpw": 16.010014969206477, + "file_bytes": 71065941536, + "file_bpw_local_parameters": 16.012491363215652, + "embedded_mtp_parameters": 844640768, + "embedded_mtp_bytes": 1689303040, + "embedded_mtp_tensors": [ + "blk.40.ffn_gate_exps.weight", + "blk.40.ffn_up_exps.weight", + "blk.40.nextn.eh_proj.weight", + "blk.40.attn_norm.weight", + "blk.40.ffn_down_exps.weight", + "blk.40.ffn_gate_inp.weight", + "blk.40.ffn_down_shexp.weight", + "blk.40.ffn_gate_shexp.weight", + "blk.40.ffn_up_shexp.weight", + "blk.40.ffn_gate_inp_shexp.weight", + "blk.40.post_attention_norm.weight", + "blk.40.attn_k_norm.weight", + "blk.40.attn_k.weight", + "blk.40.attn_output.weight", + "blk.40.attn_q_norm.weight", + "blk.40.attn_q.weight", + "blk.40.attn_v.weight", + "blk.40.nextn.shared_head_norm.weight", + "blk.40.nextn.enorm.weight", + "blk.40.nextn.hnorm.weight" + ], + "tensor_count": 753, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_estimated_bpw": 16.012491363215652 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "bartowski", + "model": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "shards": 1, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 18790607360, + "main_bpw": 4.337051653046743, + "llama_cpp_parameters": 35505251456, + "llama_cpp_tensor_bytes": 19688563200, + "llama_cpp_bpw": 4.436203072528381, + "file_bytes": 19699553920, + "file_bpw_local_parameters": 4.438679488168163, + "embedded_mtp_parameters": 844640768, + "embedded_mtp_bytes": 897955840, + "embedded_mtp_tensors": [ + "blk.40.attn_k.weight", + "blk.40.attn_k_norm.weight", + "blk.40.attn_norm.weight", + "blk.40.attn_output.weight", + "blk.40.attn_q.weight", + "blk.40.attn_q_norm.weight", + "blk.40.attn_v.weight", + "blk.40.ffn_down_exps.weight", + "blk.40.ffn_down_shexp.weight", + "blk.40.ffn_gate_exps.weight", + "blk.40.ffn_gate_inp.weight", + "blk.40.ffn_gate_inp_shexp.weight", + "blk.40.ffn_gate_shexp.weight", + "blk.40.ffn_up_exps.weight", + "blk.40.ffn_up_shexp.weight", + "blk.40.nextn.eh_proj.weight", + "blk.40.nextn.enorm.weight", + "blk.40.nextn.hnorm.weight", + "blk.40.nextn.shared_head_norm.weight", + "blk.40.post_attention_norm.weight" + ], + "tensor_count": 753, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_estimated_bpw": 4.438679488168163 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "bartowski", + "model": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "shards": 1, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 21753580032, + "main_bpw": 5.020934045926987, + "llama_cpp_parameters": 35505251456, + "llama_cpp_tensor_bytes": 22651535872, + "llama_cpp_bpw": 5.103816465025404, + "file_bytes": 22662526592, + "file_bpw_local_parameters": 5.106292880665185, + "embedded_mtp_parameters": 844640768, + "embedded_mtp_bytes": 897955840, + "embedded_mtp_tensors": [ + "blk.40.attn_k.weight", + "blk.40.attn_k_norm.weight", + "blk.40.attn_norm.weight", + "blk.40.attn_output.weight", + "blk.40.attn_q.weight", + "blk.40.attn_q_norm.weight", + "blk.40.attn_v.weight", + "blk.40.ffn_down_exps.weight", + "blk.40.ffn_down_shexp.weight", + "blk.40.ffn_gate_exps.weight", + "blk.40.ffn_gate_inp.weight", + "blk.40.ffn_gate_inp_shexp.weight", + "blk.40.ffn_gate_shexp.weight", + "blk.40.ffn_up_exps.weight", + "blk.40.ffn_up_shexp.weight", + "blk.40.nextn.eh_proj.weight", + "blk.40.nextn.enorm.weight", + "blk.40.nextn.hnorm.weight", + "blk.40.nextn.shared_head_norm.weight", + "blk.40.post_attention_norm.weight" + ], + "tensor_count": 753, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_estimated_bpw": 5.106292880665185 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "bartowski", + "model": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "shards": 1, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 21376133632, + "main_bpw": 4.9338158117106055, + "llama_cpp_parameters": 35505251456, + "llama_cpp_tensor_bytes": 22274089472, + "llama_cpp_bpw": 5.018770702041807, + "file_bytes": 22285080192, + "file_bpw_local_parameters": 5.021247117681588, + "embedded_mtp_parameters": 844640768, + "embedded_mtp_bytes": 897955840, + "embedded_mtp_tensors": [ + "blk.40.attn_k.weight", + "blk.40.attn_k_norm.weight", + "blk.40.attn_norm.weight", + "blk.40.attn_output.weight", + "blk.40.attn_q.weight", + "blk.40.attn_q_norm.weight", + "blk.40.attn_v.weight", + "blk.40.ffn_down_exps.weight", + "blk.40.ffn_down_shexp.weight", + "blk.40.ffn_gate_exps.weight", + "blk.40.ffn_gate_inp.weight", + "blk.40.ffn_gate_inp_shexp.weight", + "blk.40.ffn_gate_shexp.weight", + "blk.40.ffn_up_exps.weight", + "blk.40.ffn_up_shexp.weight", + "blk.40.nextn.eh_proj.weight", + "blk.40.nextn.enorm.weight", + "blk.40.nextn.hnorm.weight", + "blk.40.nextn.shared_head_norm.weight", + "blk.40.post_attention_norm.weight" + ], + "tensor_count": 753, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_estimated_bpw": 5.021247117681588 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "bartowski", + "model": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "shards": 1, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 20577413632, + "main_bpw": 4.749463606911968, + "llama_cpp_parameters": 35505251456, + "llama_cpp_tensor_bytes": 21475369472, + "llama_cpp_bpw": 4.838804084767781, + "file_bytes": 21486360192, + "file_bpw_local_parameters": 4.841280500407562, + "embedded_mtp_parameters": 844640768, + "embedded_mtp_bytes": 897955840, + "embedded_mtp_tensors": [ + "blk.40.attn_k.weight", + "blk.40.attn_k_norm.weight", + "blk.40.attn_norm.weight", + "blk.40.attn_output.weight", + "blk.40.attn_q.weight", + "blk.40.attn_q_norm.weight", + "blk.40.attn_v.weight", + "blk.40.ffn_down_exps.weight", + "blk.40.ffn_down_shexp.weight", + "blk.40.ffn_gate_exps.weight", + "blk.40.ffn_gate_inp.weight", + "blk.40.ffn_gate_inp_shexp.weight", + "blk.40.ffn_gate_shexp.weight", + "blk.40.ffn_up_exps.weight", + "blk.40.ffn_up_shexp.weight", + "blk.40.nextn.eh_proj.weight", + "blk.40.nextn.enorm.weight", + "blk.40.nextn.hnorm.weight", + "blk.40.nextn.shared_head_norm.weight", + "blk.40.post_attention_norm.weight" + ], + "tensor_count": 753, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf" + ], + "hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_estimated_bpw": 4.841280500407562 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "unsloth", + "model": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "shards": 1, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 16834521600, + "main_bpw": 3.8855683765152706, + "llama_cpp_parameters": 34660610688, + "llama_cpp_tensor_bytes": 16834521600, + "llama_cpp_bpw": 3.8855683765152706, + "file_bytes": 16845511648, + "file_bpw_local_parameters": 3.8881049845627, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 733, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf" + ], + "hf_repo": "unsloth/Qwen3.6-35B-A3B-GGUF", + "hf_commit": "a483e9e6cbd595906af30beda3187c2663a1118c", + "hf_gguf_total": 34660610688, + "hf_estimated_bpw": 3.8881049845627 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "unsloth", + "model": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "shards": 1, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 22123538944, + "main_bpw": 5.106324096397871, + "llama_cpp_parameters": 34660610688, + "llama_cpp_tensor_bytes": 22123538944, + "llama_cpp_bpw": 5.106324096397871, + "file_bytes": 22134528992, + "file_bpw_local_parameters": 5.108860704445301, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 733, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf" + ], + "hf_repo": "unsloth/Qwen3.6-35B-A3B-GGUF", + "hf_commit": "a483e9e6cbd595906af30beda3187c2663a1118c", + "hf_gguf_total": 34660610688, + "hf_estimated_bpw": 5.108860704445301 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "unsloth", + "model": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "shards": 1, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 20882024960, + "main_bpw": 4.8197708108425585, + "llama_cpp_parameters": 34660610688, + "llama_cpp_tensor_bytes": 20882024960, + "llama_cpp_bpw": 4.8197708108425585, + "file_bytes": 20893015008, + "file_bpw_local_parameters": 4.822307418889988, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 733, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf" + ], + "hf_repo": "unsloth/Qwen3.6-35B-A3B-GGUF", + "hf_commit": "a483e9e6cbd595906af30beda3187c2663a1118c", + "hf_gguf_total": 34660610688, + "hf_estimated_bpw": 4.822307418889988 + }, + { + "family": "qwen3.6-35b-a3b", + "producer": "unsloth", + "model": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "shards": 1, + "architecture": "qwen35moe", + "main_parameters": 34660610688, + "main_tensor_bytes": 22349466112, + "main_bpw": 5.15847024466599, + "llama_cpp_parameters": 34660610688, + "llama_cpp_tensor_bytes": 22349466112, + "llama_cpp_bpw": 5.15847024466599, + "file_bytes": 22360456160, + "file_bpw_local_parameters": 5.161006852713419, + "embedded_mtp_parameters": 0, + "embedded_mtp_bytes": 0, + "embedded_mtp_tensors": [], + "tensor_count": 733, + "files": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf" + ], + "hf_repo": "unsloth/Qwen3.6-35B-A3B-GGUF", + "hf_commit": "a483e9e6cbd595906af30beda3187c2663a1118c", + "hf_gguf_total": 34660610688, + "hf_estimated_bpw": 5.161006852713419 + } + ], + "excluded": [ + { + "path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/mmproj-BF16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/mmproj-BF16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/mmproj-BF16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/qwen3.5-4b/unsloth/mmproj-BF16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "reason": "auxiliary filename/directory" + }, + { + "path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf", + "reason": "auxiliary filename/directory" + } + ], + "errors": [] +} diff --git a/bpw/REPORT.md b/bpw/REPORT.md new file mode 100644 index 0000000000000000000000000000000000000000..369f963f1f83fd33cb9174cc8045b7a86b89998b --- /dev/null +++ b/bpw/REPORT.md @@ -0,0 +1,180 @@ +# 本機模型 BPW:HF 初估與 llama.cpp 精確計算 + +掃描時間:2026-09-06T11:32:10.745771+00:00。來源:`~/models/`。 + +目前共有 **70 組模型/量化版本、8 個 family**。主模型共 74 個 GGUF,分片合併為一筆;排除 15 個 mmproj/MTP/DFlash 檔案,0 個掃描錯誤。 + +完整可排序結果:[BPW.csv](BPW.csv);含檔案與來源資訊:[BPW.json](BPW.json)。 + +## 三種 BPW 的意義 + +- **主模型 BPW**:`8 × 主模型 tensor bytes ÷ 主模型實際儲存參數量`。排除內嵌 MTP 的 bytes 和 parameters;本次主表使用這個值。 +- **llama.cpp BPW**:`8 × 全部 tensor bytes ÷ 全部實際儲存參數量`。與 `llama_model_loader::print_info` 的 BPW 公式相同;檔案內含 MTP 時也會算進去。 +- **HF 初估**:保留原始程式的 `8 × 合併後 sibling.size ÷ info.gguf["total"]`,包含 GGUF metadata 與 padding。 + +精確值直接呼叫本機 llama.cpp 的 `libggml-base.so`,使用 `gguf_init_from_file(no_alloc=true, ctx=NULL)`、`gguf_get_tensor_size` 與 `gguf_get_tensor_ne`。只讀 header/tensor descriptors,不讀 tensor payload、不建立模型 context,也不使用 GPU。 + +分母採用 tensor shape 的實際元素數總和,包含全部 MoE experts;不是模型名稱的 4B/30B,也不是每 token 的 active parameters。BF16 檔案可能混有 F32 tensors,因此 BPW 可以稍高於 16。 + +所有 70 組 HF 分母都與 native 全 tensor 參數量一致;對應檔名與大小已核對。Hub 配對採 metadata 與檔案大小,沒有為此讀完整權重計算本機 SHA256。 + +## 各 family 總覽 + +| Family | 主模型參數量 | 版本數 | 量化版本主模型 BPW 範圍 | +|---|---:|---:|---:| +| gemma-4-31b-it | 30,697,345,596 | 11 | 4.0041–5.1034 | +| gemma-4-e4b-it | 7,518,069,290 | 8 | 5.1290–5.7915 | +| glm-4.6v-flash | 9,400,279,040 | 13 | 4.6431–5.2577 | +| internvl3.5-30b-a3b | 30,532,122,624 | 12 | 3.8908–5.0330 | +| kimi-vl-a3b-separate | 15,960,110,208 | 1 | 僅 BF16 | +| muse-glimmer-30b | 27,854,794,240 | 5 | 4.6678–5.1166 | +| qwen3.5-4b | 4,205,751,296 | 11 | 4.8866–5.4666 | +| qwen3.6-35b-a3b | 34,660,610,688 | 9 | 3.8856–5.1585 | + +## 排除內嵌 MTP + +bartowski Qwen3.5-4B 檔案內另有 **120,599,552** 個 MTP parameters;Qwen3.6-35B-A3B 另有 **844,640,768** 個。依 llama.cpp 的 `n_layer = n_layer_all - n_layer_nextn`,扣除完整尾端 MTP block,包含名稱沒有 `nextn` 字樣的 attention/FFN tensors。扣除後,兩個 family 的 bartowski 與 unsloth 主模型參數量、tensor 名稱與 shape 集合全部相同([shape 驗證](main-tensor-shape-validation.json))。 + +例如 Qwen3.5-4B bartowski Q4_K_M:主模型 **5.4666 BPW**,llama.cpp 全 tensor **5.5512 BPW**。因此不能直接用未調整的檔案 BPW 比較兩家主模型。 + +## 每個模型的完整結果 + +BPW 顯示六位小數;CSV/JSON 保存完整浮點值。BF16 分片已合併,檔名連結指向第一片。 + +### gemma-4-31b-it + +| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 | +|---|---|---:|---:|---:| +| bartowski | [google_gemma-4-31B-it-bf16.gguf](../gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf) (2 shards) | 16.000694 | 16.000694 | 16.004821 | +| bartowski | [google_gemma-4-31B-it-IQ4_XS.gguf](../gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf) | 4.466851 | 4.466851 | 4.470978 | +| bartowski | [google_gemma-4-31B-it-Q3_K_XL.gguf](../gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf) | 4.465820 | 4.465820 | 4.469947 | +| bartowski | [google_gemma-4-31B-it-Q4_K_M.gguf](../gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf) | 5.103413 | 5.103413 | 5.107540 | +| bartowski | [google_gemma-4-31B-it-Q4_K_S.gguf](../gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf) | 4.737822 | 4.737822 | 4.741949 | +| unsloth | [gemma-4-31B-it-IQ4_NL.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf) | 4.501193 | 4.501193 | 4.505320 | +| unsloth | [gemma-4-31B-it-Q4_1.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf) | 4.978217 | 4.978217 | 4.982344 | +| unsloth | [gemma-4-31B-it-Q4_K_M.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf) | 4.771200 | 4.771200 | 4.775327 | +| unsloth | [gemma-4-31B-it-Q4_K_S.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf) | 4.530424 | 4.530424 | 4.534551 | +| unsloth | [gemma-4-31B-it-UD-Q3_K_XL.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf) | 4.004095 | 4.004095 | 4.008222 | +| unsloth | [gemma-4-31B-it-UD-Q4_K_XL.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf) | 4.901306 | 4.901306 | 4.905433 | + +### gemma-4-e4b-it + +| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 | +|---|---|---:|---:|---:| +| bartowski | [google_gemma-4-E4B-it-Q4_0.gguf](../gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf) | 5.541884 | 5.541884 | 5.558726 | +| bartowski | [google_gemma-4-E4B-it-Q4_1.gguf](../gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf) | 5.791543 | 5.791543 | 5.808384 | +| bartowski | [google_gemma-4-E4B-it-Q4_K_M.gguf](../gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf) | 5.734816 | 5.734816 | 5.751658 | +| bartowski | [google_gemma-4-E4B-it-bf16.gguf](../gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf) | 16.001204 | 16.001204 | 16.018046 | +| unsloth | [gemma-4-E4B-it-BF16.gguf](../gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf) | 16.001204 | 16.001204 | 16.018046 | +| unsloth | [gemma-4-E4B-it-IQ4_NL.gguf](../gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf) | 5.128988 | 5.128988 | 5.145831 | +| unsloth | [gemma-4-E4B-it-Q4_K_M.gguf](../gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf) | 5.279381 | 5.279381 | 5.296223 | +| unsloth | [gemma-4-E4B-it-Q4_K_S.gguf](../gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf) | 5.138577 | 5.138577 | 5.155420 | + +### glm-4.6v-flash + +| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 | +|---|---|---:|---:|---:| +| bartowski | [zai-org_GLM-4.6V-Flash-IQ4_NL.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf) | 4.643130 | 4.643130 | 4.651078 | +| bartowski | [zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf) | 4.876821 | 4.876821 | 4.884770 | +| bartowski | [zai-org_GLM-4.6V-Flash-Q4_0.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf) | 4.653587 | 4.653587 | 4.661536 | +| bartowski | [zai-org_GLM-4.6V-Flash-Q4_1.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf) | 5.105605 | 5.105605 | 5.113554 | +| bartowski | [zai-org_GLM-4.6V-Flash-Q4_K_M.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf) | 5.240047 | 5.240047 | 5.247996 | +| bartowski | [zai-org_GLM-4.6V-Flash-Q4_K_S.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf) | 4.892745 | 4.892745 | 4.900693 | +| bartowski | [zai-org_GLM-4.6V-Flash-bf16.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf) | 16.001436 | 16.001436 | 16.009385 | +| unsloth | [GLM-4.6V-Flash-IQ4_NL.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf) | 4.643130 | 4.643130 | 4.651079 | +| unsloth | [GLM-4.6V-Flash-Q4_0.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf) | 4.653587 | 4.653587 | 4.661536 | +| unsloth | [GLM-4.6V-Flash-Q4_1.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf) | 5.105605 | 5.105605 | 5.113554 | +| unsloth | [GLM-4.6V-Flash-Q4_K_M.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf) | 5.240047 | 5.240047 | 5.247996 | +| unsloth | [GLM-4.6V-Flash-Q4_K_S.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf) | 4.892745 | 4.892745 | 4.900694 | +| unsloth | [GLM-4.6V-Flash-UD-Q4_K_XL.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf) | 5.257727 | 5.257727 | 5.265677 | + +### internvl3.5-30b-a3b + +| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 | +|---|---|---:|---:|---:| +| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf) | 3.890801 | 3.890801 | 3.892365 | +| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf) | 4.618264 | 4.618264 | 4.619828 | +| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf) | 5.033008 | 5.033008 | 5.034571 | +| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf) | 4.880424 | 4.880424 | 4.881988 | +| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf) | 4.710716 | 4.710716 | 4.712280 | +| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf](../internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf) (2 shards) | 16.006704 | 16.006704 | 16.008268 | +| mradermacher | [InternVL3_5-30B-A3B.Q4_K_M.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf) | 4.860642 | 4.860642 | 4.862206 | +| mradermacher | [InternVL3_5-30B-A3B.Q4_K_S.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf) | 4.572244 | 4.572244 | 4.573808 | +| mradermacher | [InternVL3_5-30B-A3B.i1-Q4_0.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf) | 4.552325 | 4.552325 | 4.553888 | +| mradermacher | [InternVL3_5-30B-A3B.i1-Q4_1.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf) | 5.027238 | 5.027238 | 5.028801 | +| mradermacher | [InternVL3_5-30B-A3B.i1-Q4_K_M.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf) | 4.860642 | 4.860642 | 4.862206 | +| mradermacher | [InternVL3_5-30B-A3B.i1-Q4_K_S.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf) | 4.572244 | 4.572244 | 4.573808 | + +### kimi-vl-a3b-separate + +| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 | +|---|---|---:|---:|---:| +| ggml-org | [Kimi-VL-A3B-Thinking-2506-bf16.gguf](../kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf) | 16.003545 | 16.003545 | 16.007022 | + +### muse-glimmer-30b + +| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 | +|---|---|---:|---:|---:| +| bartowski | [Muse-Glimmer-30B-Q4_0.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf) | 4.667764 | 4.667764 | 4.671531 | +| bartowski | [Muse-Glimmer-30B-Q4_1.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf) | 5.116561 | 5.116561 | 5.120327 | +| bartowski | [Muse-Glimmer-30B-Q4_K_M.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf) | 4.966674 | 4.966674 | 4.970440 | +| bartowski | [Muse-Glimmer-30B-Q4_K_S.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf) | 4.683669 | 4.683669 | 4.687435 | +| bartowski | [Muse-Glimmer-30B-bf16.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf) (2 shards) | 16.000807 | 16.000807 | 16.004573 | + +### qwen3.5-4b + +| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 | +|---|---|---:|---:|---:| +| bartowski | [Qwen_Qwen3.5-4B-Q4_0.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf) | 5.015776 | 5.112973 | 5.133256 | +| bartowski | [Qwen_Qwen3.5-4B-Q4_1.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf) | 5.403467 | 5.489857 | 5.510141 | +| bartowski | [Qwen_Qwen3.5-4B-Q4_K_M.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf) | 5.466576 | 5.551207 | 5.571490 | +| bartowski | [Qwen_Qwen3.5-4B-Q4_K_S.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf) | 5.149162 | 5.242640 | 5.262924 | +| bartowski | [Qwen_Qwen3.5-4B-bf16.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf) | 16.003658 | 16.003605 | 16.023888 | +| unsloth | [Qwen3.5-4B-BF16.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf) | 16.003658 | 16.003658 | 16.024521 | +| unsloth | [Qwen3.5-4B-IQ4_NL.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf) | 4.886597 | 4.886597 | 4.907460 | +| unsloth | [Qwen3.5-4B-Q4_0.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf) | 4.892830 | 4.892830 | 4.913693 | +| unsloth | [Qwen3.5-4B-Q4_1.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf) | 5.275535 | 5.275535 | 5.296399 | +| unsloth | [Qwen3.5-4B-Q4_K_M.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf) | 5.192831 | 5.192831 | 5.213695 | +| unsloth | [Qwen3.5-4B-Q4_K_S.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf) | 4.906542 | 4.906542 | 4.927406 | + +### qwen3.6-35b-a3b + +| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 | +|---|---|---:|---:|---:| +| bartowski | [Qwen_Qwen3.6-35B-A3B-bf16.gguf](../qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf) (2 shards) | 16.010254 | 16.010015 | 16.012491 | +| bartowski | [Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf](../qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf) | 4.337052 | 4.436203 | 4.438679 | +| bartowski | [Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf](../qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf) | 5.020934 | 5.103816 | 5.106293 | +| bartowski | [Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf](../qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf) | 4.933816 | 5.018771 | 5.021247 | +| bartowski | [Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf](../qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf) | 4.749464 | 4.838804 | 4.841281 | +| unsloth | [Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf](../qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf) | 3.885568 | 3.885568 | 3.888105 | +| unsloth | [Qwen3.6-35B-A3B-UD-Q4_K_M.gguf](../qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf) | 5.106324 | 5.106324 | 5.108861 | +| unsloth | [Qwen3.6-35B-A3B-UD-Q4_K_S.gguf](../qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf) | 4.819771 | 4.819771 | 4.822307 | +| unsloth | [Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf](../qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf) | 5.158470 | 5.158470 | 5.161007 | + +## 重跑方式 + +先用原公式取得 HF 初估: + +```bash +~/projects/llama.cpp/.venv/bin/python ~/models/bpw/hf/scan_hf.py \ + --models-dir ~/models --out ~/models/bpw/hf +``` + +再取得 llama.cpp native 精確值,重建並列表格: + +```bash +python3 ~/models/bpw/scan_native_bpw.py --models-dir ~/models --out ~/models/bpw +python3 ~/models/bpw/build_report.py +``` + +Native scanner 僅需 Python 標準庫及本機 llama.cpp `build/bin/libggml-base.so`;其他 build 可用 `--library <路徑>` 指定。換模型目錄或輸出位置時,HF 與 native 使用同一批模型,並把兩份輸出放在上述相對結構。遇到缺片或錯誤會記錄並繼續其他模型,native scanner 最終回傳非零 exit code。 + +## 驗證與來源 + +- [HF 配對/分片測試](hf/checks.log),以及每個 repo 的固定 commit 與原始 metadata:`hf/repo-metadata/`。 +- [本次更新驗證](refresh-validation.json):目前全部 tensor 數量/bytes、HF 配對、檔案清單與 MTP 主模型 shape;新增模型另以 GGUFReader 交叉檢查。初版的測試結果保留在 [validation.json](validation.json) 與 [validation.log](validation.log)。 +- [初版 GPT-6-Astra max review](REVIEW.md):保留當時 82 筆的掃描器與數值審查,並非本次模型清單的 review。 +- [Native 原始 metadata 與 library hash](native-bpw.json);掃描輸出:[native-scan.log](native-scan.log)。 +- 本機 llama.cpp 原始碼:[tensor 統計與 BPW 公式](/home/ubuntu/projects/llama.cpp/src/llama-model-loader.cpp:591)、[MTP layer 邊界](/home/ubuntu/projects/llama.cpp/src/llama-hparams.cpp:347)。 + +本次掃描只讀 metadata。已刪除的模型不再列入目前表格;報告與數據直接更新為最新版,刪除紀錄是同目錄的 `model-removals*.json`。所有腳本、結果與 logs 都集中在 `~/models/bpw/`。 diff --git a/bpw/REVIEW.md b/bpw/REVIEW.md new file mode 100644 index 0000000000000000000000000000000000000000..a95ce8d057bacbf9d7e36b20adc8989195b17a6c --- /dev/null +++ b/bpw/REVIEW.md @@ -0,0 +1,15 @@ +# 初版 BPW 數值與配對 review + +本紀錄對應初版的 82 筆結果;最新模型清單的驗證請看 `refresh-validation.json`。 + +日期:2026-09-06。Reviewer:GPT-6-Astra max。 + +結果:通過,沒有影響本次 82 筆結果或敘述的 blocking issue。 + +- 核對 gguf.h ctypes ABI 與 no_alloc=true、ctx=NULL 的 metadata-only 讀取行為。 +- 依 gguf-py quant block/type size 表獨立重算全部 51,764 個 tensor descriptors,86 檔的元素數與 payload bytes 完全一致。 +- 82 筆 main/llama.cpp/HF BPW、MTP block 邊界與 HF metadata commit/sibling size/total 全部一致。 +- Qwen3.5、Qwen3.6 排除完整 MTP blocks 後,各 family 的 bartowski/unsloth 主模型 tensor 名稱與 shape 集合一致。 +- 報告區分內嵌 MTP 與 metadata/padding,也明列未做完整權重 SHA256。 + +原始掃描/驗證腳本與 logs 位於同目錄及 hf/。 diff --git a/bpw/build_report.py b/bpw/build_report.py new file mode 100644 index 0000000000000000000000000000000000000000..f37fa7052147c1881ae0333bdfc6a4e0ea37fd70 --- /dev/null +++ b/bpw/build_report.py @@ -0,0 +1,75 @@ +#!/usr/bin/env python3 +"""Join saved HF estimates and native GGUF measurements by exact local file sets.""" +import csv +import json +from pathlib import Path +import re + +ROOT=Path(__file__).resolve().parent +native=json.loads((ROOT/'native-bpw.json').read_text()) +hf=json.loads((ROOT/'hf/hf-bpw-estimates.json').read_text()) +lookup={tuple(sorted(r['local_paths'])):r for r in hf} +assert len(lookup)==len(hf) +rows=[] +for row in native['rows']: + h=lookup[tuple(sorted(row['files']))] + assert h['status']=='comparable' and h['hf_sibling_bytes']==row['file_bytes'] + assert h['hf_gguf_total']==row['llama_cpp_parameters'] + rows.append({**row,'hf_repo':h['repo_id'],'hf_commit':h['repo_commit_sha'], + 'hf_gguf_total':h['hf_gguf_total'],'hf_estimated_bpw':h['hf_file_size_bpw_estimate']}) +assert len(rows)==len(hf) +fields=['family','producer','model','shards','main_parameters','main_bpw','llama_cpp_bpw','hf_estimated_bpw', + 'embedded_mtp_parameters','embedded_mtp_bytes','main_tensor_bytes','llama_cpp_parameters','llama_cpp_tensor_bytes', + 'file_bytes','hf_gguf_total','hf_repo','hf_commit'] +with (ROOT/'BPW.csv').open('w',newline='') as f: + writer=csv.DictWriter(f,fieldnames=fields,extrasaction='ignore');writer.writeheader();writer.writerows(rows) +(ROOT/'BPW.json').write_text(json.dumps({'provenance':native['provenance'],'rows':rows,'excluded':native['excluded'],'errors':native['errors']},indent=2)+'\n') + +lines=['# 本機模型 BPW:HF 初估與 llama.cpp 精確計算', '', + f"掃描時間:{native['provenance']['created_utc']}。來源:`~/models/`。", '', + f"目前共有 **{len(rows)} 組模型/量化版本、{len({r['family'] for r in rows})} 個 family**。主模型共 {sum(r['shards'] for r in rows)} 個 GGUF,分片合併為一筆;排除 {len(native['excluded'])} 個 mmproj/MTP/DFlash 檔案,{len(native['errors'])} 個掃描錯誤。", '', + '完整可排序結果:[BPW.csv](BPW.csv);含檔案與來源資訊:[BPW.json](BPW.json)。', '', + '## 三種 BPW 的意義', '', + '- **主模型 BPW**:`8 × 主模型 tensor bytes ÷ 主模型實際儲存參數量`。排除內嵌 MTP 的 bytes 和 parameters;本次主表使用這個值。', + '- **llama.cpp BPW**:`8 × 全部 tensor bytes ÷ 全部實際儲存參數量`。與 `llama_model_loader::print_info` 的 BPW 公式相同;檔案內含 MTP 時也會算進去。', + '- **HF 初估**:保留原始程式的 `8 × 合併後 sibling.size ÷ info.gguf["total"]`,包含 GGUF metadata 與 padding。', '', + '精確值直接呼叫本機 llama.cpp 的 `libggml-base.so`,使用 `gguf_init_from_file(no_alloc=true, ctx=NULL)`、`gguf_get_tensor_size` 與 `gguf_get_tensor_ne`。只讀 header/tensor descriptors,不讀 tensor payload、不建立模型 context,也不使用 GPU。', '', + '分母採用 tensor shape 的實際元素數總和,包含全部 MoE experts;不是模型名稱的 4B/30B,也不是每 token 的 active parameters。BF16 檔案可能混有 F32 tensors,因此 BPW 可以稍高於 16。', '', + f'所有 {len(rows)} 組 HF 分母都與 native 全 tensor 參數量一致;對應檔名與大小已核對。Hub 配對採 metadata 與檔案大小,沒有為此讀完整權重計算本機 SHA256。', '', + '## 各 family 總覽', '', + '| Family | 主模型參數量 | 版本數 | 量化版本主模型 BPW 範圍 |', + '|---|---:|---:|---:|'] +floatfile=re.compile(r'(^|[-_.])(bf16|f16|fp16|f32)([-_.]|$)',re.I) +for family in sorted({r['family'] for r in rows}): + group=[r for r in rows if r['family']==family] + params=sorted({r['main_parameters'] for r in group}) + quant=[r['main_bpw'] for r in group if not floatfile.search(Path(r['model']).name)] + spread=f'{min(quant):.4f}–{max(quant):.4f}' if quant else '僅 BF16' + lines.append(f"| {family} | {' / '.join(f'{p:,}' for p in params)} | {len(group)} | {spread} |") +lines += ['', '## 排除內嵌 MTP', '', + 'bartowski Qwen3.5-4B 檔案內另有 **120,599,552** 個 MTP parameters;Qwen3.6-35B-A3B 另有 **844,640,768** 個。依 llama.cpp 的 `n_layer = n_layer_all - n_layer_nextn`,扣除完整尾端 MTP block,包含名稱沒有 `nextn` 字樣的 attention/FFN tensors。扣除後,兩個 family 的 bartowski 與 unsloth 主模型參數量、tensor 名稱與 shape 集合全部相同([shape 驗證](main-tensor-shape-validation.json))。', '', + '例如 Qwen3.5-4B bartowski Q4_K_M:主模型 **5.4666 BPW**,llama.cpp 全 tensor **5.5512 BPW**。因此不能直接用未調整的檔案 BPW 比較兩家主模型。', '', + '## 每個模型的完整結果', '', + 'BPW 顯示六位小數;CSV/JSON 保存完整浮點值。BF16 分片已合併,檔名連結指向第一片。'] +for family in sorted({r['family'] for r in rows}): + lines += ['',f'### {family}','', '| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |', '|---|---|---:|---:|---:|'] + for r in [r for r in rows if r['family']==family]: + path=Path(r['files'][0]).relative_to(Path(native['provenance']['models_dir'])) + name=Path(r['model']).name + suffix=f" ({r['shards']} shards)" if r['shards']>1 else '' + lines.append(f"| {r['producer']} | [{name}](../{path}){suffix} | {r['main_bpw']:.6f} | {r['llama_cpp_bpw']:.6f} | {r['hf_estimated_bpw']:.6f} |") +lines += ['', '## 重跑方式', '', '先用原公式取得 HF 初估:', '', '```bash', + '~/projects/llama.cpp/.venv/bin/python ~/models/bpw/hf/scan_hf.py \\', + ' --models-dir ~/models --out ~/models/bpw/hf', '```', '', '再取得 llama.cpp native 精確值,重建並列表格:', '', '```bash', + 'python3 ~/models/bpw/scan_native_bpw.py --models-dir ~/models --out ~/models/bpw', + 'python3 ~/models/bpw/build_report.py', '```', '', + 'Native scanner 僅需 Python 標準庫及本機 llama.cpp `build/bin/libggml-base.so`;其他 build 可用 `--library <路徑>` 指定。換模型目錄或輸出位置時,HF 與 native 使用同一批模型,並把兩份輸出放在上述相對結構。遇到缺片或錯誤會記錄並繼續其他模型,native scanner 最終回傳非零 exit code。', '', + '## 驗證與來源', '', + '- [HF 配對/分片測試](hf/checks.log),以及每個 repo 的固定 commit 與原始 metadata:`hf/repo-metadata/`。', + '- [本次更新驗證](refresh-validation.json):目前全部 tensor 數量/bytes、HF 配對、檔案清單與 MTP 主模型 shape;新增模型另以 GGUFReader 交叉檢查。初版的測試結果保留在 [validation.json](validation.json) 與 [validation.log](validation.log)。', + '- [初版 GPT-6-Astra max review](REVIEW.md):保留當時 82 筆的掃描器與數值審查,並非本次模型清單的 review。', + '- [Native 原始 metadata 與 library hash](native-bpw.json);掃描輸出:[native-scan.log](native-scan.log)。', + '- 本機 llama.cpp 原始碼:[tensor 統計與 BPW 公式](/home/ubuntu/projects/llama.cpp/src/llama-model-loader.cpp:591)、[MTP layer 邊界](/home/ubuntu/projects/llama.cpp/src/llama-hparams.cpp:347)。', '', + '本次掃描只讀 metadata。已刪除的模型不再列入目前表格;報告與數據直接更新為最新版,刪除紀錄是同目錄的 `model-removals*.json`。所有腳本、結果與 logs 都集中在 `~/models/bpw/`。', ''] +(ROOT/'REPORT.md').write_text('\n'.join(lines)) +print('Saved REPORT.md, BPW.csv and BPW.json:',len(rows),'rows') diff --git a/bpw/hf/README.md b/bpw/hf/README.md new file mode 100644 index 0000000000000000000000000000000000000000..460ac5269b8e9c067506924441f4d4fa51e0f56a --- /dev/null +++ b/bpw/hf/README.md @@ -0,0 +1,21 @@ +# Hugging Face file-size BPW preliminary scan + +Scope: visible GGUF files currently under /home/ubuntu/models. No model bytes were downloaded, hashed, modified, or uploaded. + +Method: `HfApi.model_info(repo, files_metadata=True)`; sum matched HF sibling sizes over a complete local shard set, multiply by 8, divide by `info.gguf['total']`. Repositories were discovered with HF API author+family searches, then matched using unique basenames or exact publisher-relative paths and equal local/HF sizes. Multiple valid repository matches remain ambiguous rather than being guessed. + +Result: 89 visible GGUF files, 15 projector/assistant exclusions, 74 main-model files, 70 variant rows after shard merging. All 70 rows matched and have usable HF totals. 15 repositories supply matches; 32 candidate repositories were checked. No missing metadata, size mismatch, ambiguous matches, incomplete shards, or API failures occurred in this inventory. + +Files: +- scan_hf.py: standalone reproducible metadata-only scanner. +- hf-bpw-estimates.csv / .json: one row per local model/quantization variant, with grouped shards. +- file-matches.json: every local file and all candidate matches. +- repo-metadata/: queried repository commit, gguf metadata, GGUF sibling paths/sizes/LFS digests. +- repository-discovery.json: actual API search results. +- inventory.json / excluded.json: complete visible main-model/excluded inventory. +- summary.json / scan.log: counts, method, API progress and status. +- check_scan.py / checks.log: seven CPU-only matching/aggregation/adversarial reconciliation checks. + +The numeric output is whole-file size per repository-reported parameter count, not native tensor BPW. File headers, alignment, mixed tensor storage, and denominator definitions can matter. Local/remote size agreement is not a SHA256 identity proof. This scan intentionally does not read weight payloads; native results are authoritative for tensor-exact BPW. + +In particular, Qwen3.5 HF totals are 4,326,350,848 for bartowski/Qwen_Qwen3.5-4B-GGUF versus 4,205,751,296 for unsloth/Qwen3.5-4B-GGUF. Qwen3.6 totals are 35,505,251,456 versus 34,660,610,688 respectively. These raw repository denominators were preserved, not normalized. Any interpretation of embedded MTP or other tensor differences belongs with the native scan. diff --git a/bpw/hf/check_scan.py b/bpw/hf/check_scan.py new file mode 100644 index 0000000000000000000000000000000000000000..67b2afce235ee9feeac6de0565e68be65fbb995b --- /dev/null +++ b/bpw/hf/check_scan.py @@ -0,0 +1,41 @@ +import copy +import importlib.util +import json +from pathlib import Path + +base = Path(__file__).resolve().parent +spec = importlib.util.spec_from_file_location('scan_hf', base / 'scan_hf.py') +scan = importlib.util.module_from_spec(spec) +spec.loader.exec_module(scan) +local = {'local_path': '/models/family/owner/BF16/model-00001-of-00002.gguf', + 'relative_path': 'family/owner/BF16/model-00001-of-00002.gguf', 'family': 'family', + 'publisher': 'owner', 'basename': 'model-00001-of-00002.gguf', 'size': 10, + 'publisher_relative_path': 'BF16/model-00001-of-00002.gguf'} +repo = {'repo_id': 'owner/verified-GGUF', 'commit_sha': 'a' * 40, 'gguf': {'total': 20}, + 'siblings': [{'rfilename': 'BF16/model-00001-of-00002.gguf', 'size': 10}]} +matched = scan.match_file(local, [repo]) +assert matched['match_status'] == 'matched' +mismatch = copy.deepcopy(repo) +mismatch['siblings'][0]['size'] = 11 +assert scan.match_file(local, [mismatch])['match_status'] == 'local_remote_size_mismatch' +other = copy.deepcopy(repo) +other['repo_id'] = 'owner/ambiguous-GGUF' +assert scan.match_file(local, [repo, other])['match_status'] == 'ambiguous_repository_or_sibling' +assert scan.aggregate([matched])[0]['status'] == 'incomplete_or_inconsistent_local_shards' +second_local = {k: v.replace('00001-of', '00002-of') if isinstance(v, str) else v for k, v in local.items()} +second_repo = copy.deepcopy(repo) +second_repo['siblings'][0]['rfilename'] = second_local['publisher_relative_path'] +complete = scan.aggregate([matched, scan.match_file(second_local, [second_repo])])[0] +assert complete['status'] == 'comparable' and complete['hf_file_size_bpw_estimate'] == 8 +single = {k: v.replace('-00001-of-00002', '') if isinstance(v, str) else v for k, v in local.items()} +missing = copy.deepcopy(repo) +missing['gguf'] = None +missing['siblings'][0]['rfilename'] = single['publisher_relative_path'] +assert scan.aggregate([scan.match_file(single, [missing])])[0]['status'] == 'missing_or_invalid_gguf_total' +rows = json.loads((base / 'hf-bpw-estimates.json').read_text()) +files = json.loads((base / 'inventory.json').read_text()) +assert rows and sum(row['local_shards'] for row in rows) == len(files) +assert {p for row in rows for p in row['local_paths']} == {row['local_path'] for row in files} +assert all(row['local_bytes'] == row['hf_sibling_bytes'] and row['status'] == 'comparable' for row in rows) +assert all(len(row['repo_commit_sha']) == 40 for row in rows) +print('7 checks passed: unique match, mismatch rejection, ambiguous repo rejection, missing shard rejection, shard sum BPW, missing total rejection, complete actual inventory reconciliation.') diff --git a/bpw/hf/checks.log b/bpw/hf/checks.log new file mode 100644 index 0000000000000000000000000000000000000000..01243d161c59200d80009b454f34a860aeb674be --- /dev/null +++ b/bpw/hf/checks.log @@ -0,0 +1 @@ +7 checks passed: unique match, mismatch rejection, ambiguous repo rejection, missing shard rejection, shard sum BPW, missing total rejection, complete actual inventory reconciliation. diff --git a/bpw/hf/excluded.json b/bpw/hf/excluded.json new file mode 100644 index 0000000000000000000000000000000000000000..cb20d596f205c197dd77e28da896932b13eebda1 --- /dev/null +++ b/bpw/hf/excluded.json @@ -0,0 +1,137 @@ +[ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf", + "relative_path": "gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "mmproj-google_gemma-4-31B-it-bf16.gguf", + "size": 1200726208, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf", + "relative_path": "gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "mtp-google_gemma-4-31B-it-Q8_0.gguf", + "size": 514705920, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/mmproj-BF16.gguf", + "relative_path": "gemma-4-31b-it/unsloth/mmproj-BF16.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "mmproj-BF16.gguf", + "size": 1200726496, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "mmproj-google_gemma-4-E4B-it-bf16.gguf", + "size": 991552000, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/mmproj-BF16.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/mmproj-BF16.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "mmproj-BF16.gguf", + "size": 991552320, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf", + "relative_path": "glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf", + "size": 1840903936, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/mmproj-BF16.gguf", + "relative_path": "glm-4.6v-flash/unsloth/mmproj-BF16.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "mmproj-BF16.gguf", + "size": 1840904320, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf", + "size": 637310368, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "family": "kimi-vl-a3b-separate", + "publisher": "ggml-org", + "basename": "mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "size": 906726464, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf", + "relative_path": "muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "dflash-Muse-Glimmer-30B-Q8_0.gguf", + "size": 2729046176, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf", + "relative_path": "muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "mmproj-Muse-Glimmer-30B-bf16.gguf", + "size": 3849173920, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf", + "relative_path": "qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "mmproj-Qwen_Qwen3.5-4B-bf16.gguf", + "size": 675569216, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/mmproj-BF16.gguf", + "relative_path": "qwen3.5-4b/unsloth/mmproj-BF16.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "mmproj-BF16.gguf", + "size": 675569344, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "size": 902822240, + "reason": "projector_or_assistant" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "mmproj-BF16.gguf", + "size": 902822624, + "reason": "projector_or_assistant" + } +] diff --git a/bpw/hf/file-matches.json b/bpw/hf/file-matches.json new file mode 100644 index 0000000000000000000000000000000000000000..261b77bedd2e8491a2fad637e6f2fcde50f29690 --- /dev/null +++ b/bpw/hf/file-matches.json @@ -0,0 +1,2628 @@ +[ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-IQ4_XS.gguf", + "size": 17155893600, + "publisher_relative_path": "google_gemma-4-31B-it-IQ4_XS.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-IQ4_XS.gguf", + "sibling_size": 17155893600, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-IQ4_XS.gguf", + "sibling_size": 17155893600, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "size": 17151936864, + "publisher_relative_path": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "sibling_size": 17151936864, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "sibling_size": 17151936864, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q4_K_M.gguf", + "size": 19598489952, + "publisher_relative_path": "google_gemma-4-31B-it-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q4_K_M.gguf", + "sibling_size": 19598489952, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q4_K_M.gguf", + "sibling_size": 19598489952, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q4_K_S.gguf", + "size": 18195655008, + "publisher_relative_path": "google_gemma-4-31B-it-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q4_K_S.gguf", + "sibling_size": 18195655008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q4_K_S.gguf", + "sibling_size": 18195655008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "size": 39996137216, + "publisher_relative_path": "bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "sibling_size": 39996137216, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "sibling_size": 39996137216, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "size": 21417052704, + "publisher_relative_path": "bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "sibling_size": 21417052704, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "sibling_size": 21417052704, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-IQ4_NL.gguf", + "size": 17287670720, + "publisher_relative_path": "gemma-4-31B-it-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-IQ4_NL.gguf", + "sibling_size": 17287670720, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-IQ4_NL.gguf", + "sibling_size": 17287670720, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_1.gguf", + "size": 19118091200, + "publisher_relative_path": "gemma-4-31B-it-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_1.gguf", + "sibling_size": 19118091200, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_1.gguf", + "sibling_size": 19118091200, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_K_M.gguf", + "size": 18323733440, + "publisher_relative_path": "gemma-4-31B-it-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_K_M.gguf", + "sibling_size": 18323733440, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_K_M.gguf", + "sibling_size": 18323733440, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_K_S.gguf", + "size": 17399835584, + "publisher_relative_path": "gemma-4-31B-it-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_K_S.gguf", + "sibling_size": 17399835584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_K_S.gguf", + "sibling_size": 17399835584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "size": 15380222912, + "publisher_relative_path": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "sibling_size": 15380222912, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "sibling_size": 15380222912, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "size": 18822970304, + "publisher_relative_path": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "sibling_size": 18822970304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "sibling_size": 18822970304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_0.gguf", + "size": 5223860704, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_0.gguf", + "sibling_size": 5223860704, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_0.gguf", + "sibling_size": 5223860704, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_1.gguf", + "size": 5458479584, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_1.gguf", + "sibling_size": 5458479584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_1.gguf", + "sibling_size": 5458479584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "size": 5405170144, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "sibling_size": 5405170144, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "sibling_size": 5405170144, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-bf16.gguf", + "size": 15053097184, + "publisher_relative_path": "google_gemma-4-E4B-it-bf16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-bf16.gguf", + "sibling_size": 15053097184, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-bf16.gguf", + "sibling_size": 15053097184, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-BF16.gguf", + "size": 15053097856, + "publisher_relative_path": "gemma-4-E4B-it-BF16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-BF16.gguf", + "sibling_size": 15053097856, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "38e0dba6818d18e2b41062c7b3b9083dcfddc44767078c415ff7e13661911ba5" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-BF16.gguf", + "sibling_size": 15053097856, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "38e0dba6818d18e2b41062c7b3b9083dcfddc44767078c415ff7e13661911ba5" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-IQ4_NL.gguf", + "size": 4835839104, + "publisher_relative_path": "gemma-4-E4B-it-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-IQ4_NL.gguf", + "sibling_size": 4835839104, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-IQ4_NL.gguf", + "sibling_size": 4835839104, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-Q4_K_M.gguf", + "size": 4977171584, + "publisher_relative_path": "gemma-4-E4B-it-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-Q4_K_M.gguf", + "sibling_size": 4977171584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-Q4_K_M.gguf", + "sibling_size": 4977171584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87" + } + ] + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-Q4_K_S.gguf", + "size": 4844850304, + "publisher_relative_path": "gemma-4-E4B-it-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-Q4_K_S.gguf", + "sibling_size": 4844850304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-Q4_K_S.gguf", + "sibling_size": 4844850304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179264, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "sibling_size": 5465179264, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "sibling_size": 5465179264, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "size": 5739775104, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "sibling_size": 5739775104, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "sibling_size": 5739775104, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467264, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "sibling_size": 5477467264, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "sibling_size": 5477467264, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008603776, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "sibling_size": 6008603776, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "sibling_size": 6008603776, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578304, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "sibling_size": 6166578304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "sibling_size": 6166578304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758485632, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "sibling_size": 5758485632, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "sibling_size": 5758485632, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "size": 18811585376, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "sibling_size": 18811585376, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "sibling_size": 18811585376, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179744, + "publisher_relative_path": "GLM-4.6V-Flash-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-IQ4_NL.gguf", + "sibling_size": 5465179744, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-IQ4_NL.gguf", + "sibling_size": 5465179744, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467744, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_0.gguf", + "sibling_size": 5477467744, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_0.gguf", + "sibling_size": 5477467744, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008604256, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_1.gguf", + "sibling_size": 6008604256, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_1.gguf", + "sibling_size": 6008604256, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578784, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_K_M.gguf", + "sibling_size": 6166578784, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_K_M.gguf", + "sibling_size": 6166578784, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758486112, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_K_S.gguf", + "sibling_size": 5758486112, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_K_S.gguf", + "sibling_size": 5758486112, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515" + } + ] + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "size": 6187353696, + "publisher_relative_path": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "sibling_size": 6187353696, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "sibling_size": 6187353696, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "size": 14855269280, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "sibling_size": 14855269280, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "sibling_size": 14855269280, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "size": 17631642528, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "sibling_size": 17631642528, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "sibling_size": 17631642528, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "size": 19214517152, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "sibling_size": 19214517152, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "sibling_size": 19214517152, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "size": 18632180640, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "sibling_size": 18632180640, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "sibling_size": 18632180640, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "size": 17984488352, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "sibling_size": 17984488352, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "sibling_size": 17984488352, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "size": 39717427296, + "publisher_relative_path": "bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "sibling_size": 39717427296, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "37ab465cd0c2b47b6b68e17f6e1f3ffd48701a27518c71ad7ac21b7f5a8d9f24" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "sibling_size": 39717427296, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "37ab465cd0c2b47b6b68e17f6e1f3ffd48701a27518c71ad7ac21b7f5a8d9f24" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "size": 21378372352, + "publisher_relative_path": "bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "sibling_size": 21378372352, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "469c362f36f7ad24dec0da0c75b2ebc681f60b160cee303421388b8375fc2161" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "sibling_size": 21378372352, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "469c362f36f7ad24dec0da0c75b2ebc681f60b160cee303421388b8375fc2161" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "size": 18556683552, + "publisher_relative_path": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "sibling_size": 18556683552, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "sibling_size": 18556683552, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "size": 17456006432, + "publisher_relative_path": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "sibling_size": 17456006432, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "sibling_size": 17456006432, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "size": 17379984928, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "sibling_size": 17379984928, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "sibling_size": 17379984928, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "size": 19192497696, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "sibling_size": 19192497696, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "sibling_size": 19192497696, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "size": 18556683808, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "sibling_size": 18556683808, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "sibling_size": 18556683808, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80" + } + ] + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "size": 17456006688, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "sibling_size": 17456006688, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "sibling_size": 17456006688, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a" + } + ] + }, + { + "local_path": "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "family": "kimi-vl-a3b-separate", + "publisher": "ggml-org", + "basename": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "size": 31934229408, + "publisher_relative_path": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF", + "commit_sha": "e7dcd093335f922a057772febc7ab27eda985b40", + "gguf_total": 15960110208, + "sibling_path": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "sibling_size": 31934229408, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "952f3faa372910984089d16db89927548c0f11dab36ee21f57ea79df23b32378" + }, + "candidates": [ + { + "repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF", + "commit_sha": "e7dcd093335f922a057772febc7ab27eda985b40", + "gguf_total": 15960110208, + "sibling_path": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "sibling_size": 31934229408, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "952f3faa372910984089d16db89927548c0f11dab36ee21f57ea79df23b32378" + } + ] + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_0.gguf", + "size": 16265565216, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_0.gguf", + "sibling_size": 16265565216, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_0.gguf", + "sibling_size": 16265565216, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999" + } + ] + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_1.gguf", + "size": 17828207648, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_1.gguf", + "sibling_size": 17828207648, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_1.gguf", + "sibling_size": 17828207648, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4" + } + ] + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_K_M.gguf", + "size": 17306324000, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_K_M.gguf", + "sibling_size": 17306324000, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_K_M.gguf", + "sibling_size": 17306324000, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384" + } + ] + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_K_S.gguf", + "size": 16320943136, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_K_S.gguf", + "sibling_size": 16320943136, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_K_S.gguf", + "sibling_size": 16320943136, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde" + } + ] + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "size": 39750446272, + "publisher_relative_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "sibling_size": 39750446272, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "sibling_size": 39750446272, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860" + } + ] + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "size": 15975065088, + "publisher_relative_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "sibling_size": 15975065088, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "sibling_size": 15975065088, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "size": 2776033248, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2776033248, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2776033248, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "size": 2979850208, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2979850208, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2979850208, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "size": 3013027808, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 3013027808, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 3013027808, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "size": 2846156768, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2846156768, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2846156768, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-bf16.gguf", + "size": 8665620192, + "publisher_relative_path": "Qwen_Qwen3.5-4B-bf16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-bf16.gguf", + "sibling_size": 8665620192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-bf16.gguf", + "sibling_size": 8665620192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-BF16.gguf", + "size": 8424393632, + "publisher_relative_path": "Qwen3.5-4B-BF16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-BF16.gguf", + "sibling_size": 8424393632, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-BF16.gguf", + "sibling_size": 8424393632, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-BF16.gguf", + "sibling_size": 8665620544, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "65c0fa68c10d6d8f2bb90e4e26d83c1421c7dde6ce98b9f93624a411f7eb0113" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-IQ4_NL.gguf", + "size": 2579944608, + "publisher_relative_path": "Qwen3.5-4B-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-IQ4_NL.gguf", + "sibling_size": 2579944608, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-IQ4_NL.gguf", + "sibling_size": 2579944608, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-IQ4_NL.gguf", + "sibling_size": 2729175360, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "f696836adb2f2287036620dfd154cf83e741bb87d3106ccd3596130f6f75b382" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_0.gguf", + "size": 2583221408, + "publisher_relative_path": "Qwen3.5-4B-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2583221408, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2583221408, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2669209920, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "14e6ef39302330c63c2c1a1ab548c7f6f1b7e36b3150ca8b42cab7193b0c3669" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_1.gguf", + "size": 2784416928, + "publisher_relative_path": "Qwen3.5-4B-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2784416928, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2784416928, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2877122880, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "ce904a58d18bcc3db92e8d43a35aee53ef5b1982a0a07d72ee82e7abfa149ed1" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_K_M.gguf", + "size": 2740937888, + "publisher_relative_path": "Qwen3.5-4B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 2740937888, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 2740937888, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 2834975040, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "3874209241c9a397e2f62cd3f70f80fd2dfbf0dfccb6838416bdb48a714e8630" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_K_S.gguf", + "size": 2590430368, + "publisher_relative_path": "Qwen3.5-4B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2590430368, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2590430368, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2683300160, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "ad89d1b4281574b0ebd110b579370ac23da4d5505f4ce3b5134e4e0d8b1df457" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "size": 19699553920, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "sibling_size": 19699553920, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "sibling_size": 19699553920, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "size": 22662526592, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "sibling_size": 22662526592, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "sibling_size": 22662526592, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "size": 22285080192, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "sibling_size": 22285080192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "sibling_size": 22285080192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "size": 21486360192, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "sibling_size": 21486360192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "sibling_size": 21486360192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "size": 39753375712, + "publisher_relative_path": "BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "sibling_size": 39753375712, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "sibling_size": 39753375712, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "size": 31312565824, + "publisher_relative_path": "BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "sibling_size": 31312565824, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "sibling_size": 31312565824, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "size": 16845511648, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "sibling_size": 16845511648, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a832b9689925f1bd335bbe985cdfb06c36bf2cf268f4f8f6eceafa3ceb515617" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "sibling_size": 16845511648, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a832b9689925f1bd335bbe985cdfb06c36bf2cf268f4f8f6eceafa3ceb515617" + }, + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF", + "commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d", + "gguf_total": 35505251456, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "sibling_size": 17227569440, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "3fba9ab57290b34726837521335bf9268397174f3dd662880e2d0c5264d17b81" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "size": 22134528992, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "sibling_size": 22134528992, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "sibling_size": 22134528992, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61" + }, + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF", + "commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d", + "gguf_total": 35505251456, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "sibling_size": 22663387424, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "size": 20893015008, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "sibling_size": 20893015008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "sibling_size": 20893015008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c" + }, + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF", + "commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d", + "gguf_total": 35505251456, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "sibling_size": 21388319008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "2bee952b218e4a481430c59d8d3bdc7bae20bed0eb501326340c5fca7ae95d42" + } + ] + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "size": 22360456160, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "sibling_size": 22360456160, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "sibling_size": 22360456160, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450" + }, + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF", + "commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d", + "gguf_total": 35505251456, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "sibling_size": 22853663008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "55983c5a75a1ab969824077b3bb3de4146e82a9234072b48ad4e8f92ad3fe9f1" + } + ] + } +] diff --git a/bpw/hf/hf-bpw-estimates.csv b/bpw/hf/hf-bpw-estimates.csv new file mode 100644 index 0000000000000000000000000000000000000000..3b7b4ffcab90ad4f1556bb9b1f7e3b67f6b330d3 --- /dev/null +++ b/bpw/hf/hf-bpw-estimates.csv @@ -0,0 +1,71 @@ +family,publisher,variant,local_parent,status,local_shards,expected_shards,local_bytes,hf_sibling_bytes,repo_id,repo_commit_sha,hf_gguf_total,hf_file_size_bpw_estimate,local_paths,hf_sibling_paths +gemma-4-31b-it,bartowski,google_gemma-4-31B-it-IQ4_XS.gguf,gemma-4-31b-it/bartowski,comparable,1,1,17155893600,17155893600,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,4.470977738801101,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf""]","[""google_gemma-4-31B-it-IQ4_XS.gguf""]" +gemma-4-31b-it,bartowski,google_gemma-4-31B-it-Q3_K_XL.gguf,gemma-4-31b-it/bartowski,comparable,1,1,17151936864,17151936864,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,4.4699465783738574,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf""]","[""google_gemma-4-31B-it-Q3_K_XL.gguf""]" +gemma-4-31b-it,bartowski,google_gemma-4-31B-it-Q4_K_M.gguf,gemma-4-31b-it/bartowski,comparable,1,1,19598489952,19598489952,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,5.107539970375489,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf""]","[""google_gemma-4-31B-it-Q4_K_M.gguf""]" +gemma-4-31b-it,bartowski,google_gemma-4-31B-it-Q4_K_S.gguf,gemma-4-31b-it/bartowski,comparable,1,1,18195655008,18195655008,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,4.741948765855762,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf""]","[""google_gemma-4-31B-it-Q4_K_S.gguf""]" +gemma-4-31b-it,bartowski,google_gemma-4-31B-it-bf16.gguf,gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16,comparable,2,2,61413189920,61413189920,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,16.00482093227042,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf"", ""/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf""]","[""google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf"", ""google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf""]" +gemma-4-31b-it,unsloth,gemma-4-31B-it-IQ4_NL.gguf,gemma-4-31b-it/unsloth,comparable,1,1,17287670720,17287670720,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.505320022784683,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf""]","[""gemma-4-31B-it-IQ4_NL.gguf""]" +gemma-4-31b-it,unsloth,gemma-4-31B-it-Q4_1.gguf,gemma-4-31b-it/unsloth,comparable,1,1,19118091200,19118091200,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.982343803039745,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf""]","[""gemma-4-31B-it-Q4_1.gguf""]" +gemma-4-31b-it,unsloth,gemma-4-31B-it-Q4_K_M.gguf,gemma-4-31b-it/unsloth,comparable,1,1,18323733440,18323733440,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.7753271390051815,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf""]","[""gemma-4-31B-it-Q4_K_M.gguf""]" +gemma-4-31b-it,unsloth,gemma-4-31B-it-Q4_K_S.gguf,gemma-4-31b-it/unsloth,comparable,1,1,17399835584,17399835584,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.5345511792439215,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf""]","[""gemma-4-31B-it-Q4_K_S.gguf""]" +gemma-4-31b-it,unsloth,gemma-4-31B-it-UD-Q3_K_XL.gguf,gemma-4-31b-it/unsloth,comparable,1,1,15380222912,15380222912,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.008222238994921,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf""]","[""gemma-4-31B-it-UD-Q3_K_XL.gguf""]" +gemma-4-31b-it,unsloth,gemma-4-31B-it-UD-Q4_K_XL.gguf,gemma-4-31b-it/unsloth,comparable,1,1,18822970304,18822970304,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.905432685086026,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf""]","[""gemma-4-31B-it-UD-Q4_K_XL.gguf""]" +gemma-4-e4b-it,bartowski,google_gemma-4-E4B-it-Q4_0.gguf,gemma-4-e4b-it/bartowski,comparable,1,1,5223860704,5223860704,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66,7518069290,5.558725787162837,"[""/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf""]","[""google_gemma-4-E4B-it-Q4_0.gguf""]" +gemma-4-e4b-it,bartowski,google_gemma-4-E4B-it-Q4_1.gguf,gemma-4-e4b-it/bartowski,comparable,1,1,5458479584,5458479584,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66,7518069290,5.808384438553106,"[""/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf""]","[""google_gemma-4-E4B-it-Q4_1.gguf""]" +gemma-4-e4b-it,bartowski,google_gemma-4-E4B-it-Q4_K_M.gguf,gemma-4-e4b-it/bartowski,comparable,1,1,5405170144,5405170144,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66,7518069290,5.75165770412845,"[""/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf""]","[""google_gemma-4-E4B-it-Q4_K_M.gguf""]" +gemma-4-e4b-it,bartowski,google_gemma-4-E4B-it-bf16.gguf,gemma-4-e4b-it/bartowski,comparable,1,1,15053097184,15053097184,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66,7518069290,16.018045701198904,"[""/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf""]","[""google_gemma-4-E4B-it-bf16.gguf""]" +gemma-4-e4b-it,unsloth,gemma-4-E4B-it-BF16.gguf,gemma-4-e4b-it/unsloth,comparable,1,1,15053097856,15053097856,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3,7518069290,16.018046416276114,"[""/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf""]","[""gemma-4-E4B-it-BF16.gguf""]" +gemma-4-e4b-it,unsloth,gemma-4-E4B-it-IQ4_NL.gguf,gemma-4-e4b-it/unsloth,comparable,1,1,4835839104,4835839104,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3,7518069290,5.145830842961012,"[""/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf""]","[""gemma-4-E4B-it-IQ4_NL.gguf""]" +gemma-4-e4b-it,unsloth,gemma-4-E4B-it-Q4_K_M.gguf,gemma-4-e4b-it/unsloth,comparable,1,1,4977171584,4977171584,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3,7518069290,5.296223157315434,"[""/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf""]","[""gemma-4-E4B-it-Q4_K_M.gguf""]" +gemma-4-e4b-it,unsloth,gemma-4-E4B-it-Q4_K_S.gguf,gemma-4-e4b-it/unsloth,comparable,1,1,4844850304,4844850304,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3,7518069290,5.155419687811896,"[""/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf""]","[""gemma-4-E4B-it-Q4_K_S.gguf""]" +glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-IQ4_NL.gguf,glm-4.6v-flash/bartowski,comparable,1,1,5465179264,5465179264,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,4.651078327138681,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf""]","[""zai-org_GLM-4.6V-Flash-IQ4_NL.gguf""]" +glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf,glm-4.6v-flash/bartowski,comparable,1,1,5739775104,5739775104,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,4.88476997721123,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf""]","[""zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf""]" +glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q4_0.gguf,glm-4.6v-flash/bartowski,comparable,1,1,5477467264,5477467264,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,4.661535889045268,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf""]","[""zai-org_GLM-4.6V-Flash-Q4_0.gguf""]" +glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q4_1.gguf,glm-4.6v-flash/bartowski,comparable,1,1,6008603776,6008603776,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,5.113553544895621,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf""]","[""zai-org_GLM-4.6V-Flash-Q4_1.gguf""]" +glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q4_K_M.gguf,glm-4.6v-flash/bartowski,comparable,1,1,6166578304,6166578304,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,5.247995960766714,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf""]","[""zai-org_GLM-4.6V-Flash-Q4_K_M.gguf""]" +glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q4_K_S.gguf,glm-4.6v-flash/bartowski,comparable,1,1,5758485632,5758485632,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,4.900693358140994,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf""]","[""zai-org_GLM-4.6V-Flash-Q4_K_S.gguf""]" +glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-bf16.gguf,glm-4.6v-flash/bartowski,comparable,1,1,18811585376,18811585376,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,16.0093846541815,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf""]","[""zai-org_GLM-4.6V-Flash-bf16.gguf""]" +glm-4.6v-flash,unsloth,GLM-4.6V-Flash-IQ4_NL.gguf,glm-4.6v-flash/unsloth,comparable,1,1,5465179744,5465179744,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,4.651078735637192,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf""]","[""GLM-4.6V-Flash-IQ4_NL.gguf""]" +glm-4.6v-flash,unsloth,GLM-4.6V-Flash-Q4_0.gguf,glm-4.6v-flash/unsloth,comparable,1,1,5477467744,5477467744,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,4.66153629754378,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf""]","[""GLM-4.6V-Flash-Q4_0.gguf""]" +glm-4.6v-flash,unsloth,GLM-4.6V-Flash-Q4_1.gguf,glm-4.6v-flash/unsloth,comparable,1,1,6008604256,6008604256,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,5.113553953394132,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf""]","[""GLM-4.6V-Flash-Q4_1.gguf""]" +glm-4.6v-flash,unsloth,GLM-4.6V-Flash-Q4_K_M.gguf,glm-4.6v-flash/unsloth,comparable,1,1,6166578784,6166578784,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,5.247996369265225,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf""]","[""GLM-4.6V-Flash-Q4_K_M.gguf""]" +glm-4.6v-flash,unsloth,GLM-4.6V-Flash-Q4_K_S.gguf,glm-4.6v-flash/unsloth,comparable,1,1,5758486112,5758486112,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,4.900693766639506,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf""]","[""GLM-4.6V-Flash-Q4_K_S.gguf""]" +glm-4.6v-flash,unsloth,GLM-4.6V-Flash-UD-Q4_K_XL.gguf,glm-4.6v-flash/unsloth,comparable,1,1,6187353696,6187353696,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,5.265676620595297,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf""]","[""GLM-4.6V-Flash-UD-Q4_K_XL.gguf""]" +internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,14855269280,14855269280,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,3.8923646319494094,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf""]" +internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,17631642528,17631642528,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,4.619827516123106,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf""]" +internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,19214517152,19214517152,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,5.034570937271498,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf""]" +internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,18632180640,18632180640,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,4.881987634977999,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf""]" +internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,17984488352,17984488352,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,4.712279869559586,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf""]" +internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf,internvl3.5-30b-a3b/bartowski/bf16,comparable,2,2,61095799648,61095799648,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,16.008267856221746,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf"", ""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf"", ""OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf""]" +internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.Q4_K_M.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,18556683552,18556683552,mradermacher/InternVL3_5-30B-A3B-GGUF,21b0a0caee18e68b38b257a60ac86f883cd65059,30532122624,4.862205954174541,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf""]","[""InternVL3_5-30B-A3B.Q4_K_M.gguf""]" +internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.Q4_K_S.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,17456006432,17456006432,mradermacher/InternVL3_5-30B-A3B-GGUF,21b0a0caee18e68b38b257a60ac86f883cd65059,30532122624,4.573807500243322,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf""]","[""InternVL3_5-30B-A3B.Q4_K_S.gguf""]" +internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.i1-Q4_0.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,17379984928,17379984928,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95,30532122624,4.553888412419341,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf""]","[""InternVL3_5-30B-A3B.i1-Q4_0.gguf""]" +internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.i1-Q4_1.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,19192497696,19192497696,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95,30532122624,5.028801418716587,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf""]","[""InternVL3_5-30B-A3B.i1-Q4_1.gguf""]" +internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.i1-Q4_K_M.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,18556683808,18556683808,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95,30532122624,4.862206021251437,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf""]","[""InternVL3_5-30B-A3B.i1-Q4_K_M.gguf""]" +internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.i1-Q4_K_S.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,17456006688,17456006688,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95,30532122624,4.573807567320217,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf""]","[""InternVL3_5-30B-A3B.i1-Q4_K_S.gguf""]" +kimi-vl-a3b-separate,ggml-org,Kimi-VL-A3B-Thinking-2506-bf16.gguf,kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org,comparable,1,1,31934229408,31934229408,ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF,e7dcd093335f922a057772febc7ab27eda985b40,15960110208,16.007022002639044,"[""/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf""]","[""Kimi-VL-A3B-Thinking-2506-bf16.gguf""]" +muse-glimmer-30b,bartowski,Muse-Glimmer-30B-Q4_0.gguf,muse-glimmer-30b/bartowski,comparable,1,1,16265565216,16265565216,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,4.671530531040103,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf""]","[""Muse-Glimmer-30B-Q4_0.gguf""]" +muse-glimmer-30b,bartowski,Muse-Glimmer-30B-Q4_1.gguf,muse-glimmer-30b/bartowski,comparable,1,1,17828207648,17828207648,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,5.120327221056507,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf""]","[""Muse-Glimmer-30B-Q4_1.gguf""]" +muse-glimmer-30b,bartowski,Muse-Glimmer-30B-Q4_K_M.gguf,muse-glimmer-30b/bartowski,comparable,1,1,17306324000,17306324000,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,4.970440305790605,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf""]","[""Muse-Glimmer-30B-Q4_K_M.gguf""]" +muse-glimmer-30b,bartowski,Muse-Glimmer-30B-Q4_K_S.gguf,muse-glimmer-30b/bartowski,comparable,1,1,16320943136,16320943136,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,4.6874352746250985,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf""]","[""Muse-Glimmer-30B-Q4_K_S.gguf""]" +muse-glimmer-30b,bartowski,Muse-Glimmer-30B-bf16.gguf,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16,comparable,2,2,55725511360,55725511360,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,16.00457311006868,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf"", ""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf""]","[""Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf"", ""Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf""]" +qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-Q4_0.gguf,qwen3.5-4b/bartowski,comparable,1,1,2776033248,2776033248,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,5.1332558926113245,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf""]","[""Qwen_Qwen3.5-4B-Q4_0.gguf""]" +qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-Q4_1.gguf,qwen3.5-4b/bartowski,comparable,1,1,2979850208,2979850208,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,5.510140647751737,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf""]","[""Qwen_Qwen3.5-4B-Q4_1.gguf""]" +qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-Q4_K_M.gguf,qwen3.5-4b/bartowski,comparable,1,1,3013027808,3013027808,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,5.571490457169691,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf""]","[""Qwen_Qwen3.5-4B-Q4_K_M.gguf""]" +qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-Q4_K_S.gguf,qwen3.5-4b/bartowski,comparable,1,1,2846156768,2846156768,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,5.262923637949023,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf""]","[""Qwen_Qwen3.5-4B-Q4_K_S.gguf""]" +qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-bf16.gguf,qwen3.5-4b/bartowski,comparable,1,1,8665620192,8665620192,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,16.023888022869844,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf""]","[""Qwen_Qwen3.5-4B-bf16.gguf""]" +qwen3.5-4b,unsloth,Qwen3.5-4B-BF16.gguf,qwen3.5-4b/unsloth,comparable,1,1,8424393632,8424393632,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,16.0245207842171,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf""]","[""Qwen3.5-4B-BF16.gguf""]" +qwen3.5-4b,unsloth,Qwen3.5-4B-IQ4_NL.gguf,qwen3.5-4b/unsloth,comparable,1,1,2579944608,2579944608,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,4.907460144785508,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf""]","[""Qwen3.5-4B-IQ4_NL.gguf""]" +qwen3.5-4b,unsloth,Qwen3.5-4B-Q4_0.gguf,qwen3.5-4b/unsloth,comparable,1,1,2583221408,2583221408,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,4.913693133413469,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf""]","[""Qwen3.5-4B-Q4_0.gguf""]" +qwen3.5-4b,unsloth,Qwen3.5-4B-Q4_1.gguf,qwen3.5-4b/unsloth,comparable,1,1,2784416928,2784416928,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,5.296398635170271,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf""]","[""Qwen3.5-4B-Q4_1.gguf""]" +qwen3.5-4b,unsloth,Qwen3.5-4B-Q4_K_M.gguf,qwen3.5-4b/unsloth,comparable,1,1,2740937888,2740937888,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,5.213694667313015,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf""]","[""Qwen3.5-4B-Q4_K_M.gguf""]" +qwen3.5-4b,unsloth,Qwen3.5-4B-Q4_K_S.gguf,qwen3.5-4b/unsloth,comparable,1,1,2590430368,2590430368,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,4.927405708394984,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf""]","[""Qwen3.5-4B-Q4_K_S.gguf""]" +qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf,qwen3.6-35b-a3b/bartowski,comparable,1,1,19699553920,19699553920,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,4.438679488168163,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf""]","[""Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf""]" +qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf,qwen3.6-35b-a3b/bartowski,comparable,1,1,22662526592,22662526592,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,5.106292880665185,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf""]","[""Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf""]" +qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf,qwen3.6-35b-a3b/bartowski,comparable,1,1,22285080192,22285080192,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,5.021247117681588,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf""]","[""Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf""]" +qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf,qwen3.6-35b-a3b/bartowski,comparable,1,1,21486360192,21486360192,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,4.841280500407562,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf""]","[""Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf""]" +qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-bf16.gguf,qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16,comparable,2,2,71065941536,71065941536,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,16.012491363215652,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf"", ""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf""]","[""Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf"", ""Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf""]" +qwen3.6-35b-a3b,unsloth,Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf,qwen3.6-35b-a3b/unsloth,comparable,1,1,16845511648,16845511648,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c,34660610688,3.8881049845627,"[""/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf""]","[""Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf""]" +qwen3.6-35b-a3b,unsloth,Qwen3.6-35B-A3B-UD-Q4_K_M.gguf,qwen3.6-35b-a3b/unsloth,comparable,1,1,22134528992,22134528992,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c,34660610688,5.108860704445301,"[""/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf""]","[""Qwen3.6-35B-A3B-UD-Q4_K_M.gguf""]" +qwen3.6-35b-a3b,unsloth,Qwen3.6-35B-A3B-UD-Q4_K_S.gguf,qwen3.6-35b-a3b/unsloth,comparable,1,1,20893015008,20893015008,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c,34660610688,4.822307418889988,"[""/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf""]","[""Qwen3.6-35B-A3B-UD-Q4_K_S.gguf""]" +qwen3.6-35b-a3b,unsloth,Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf,qwen3.6-35b-a3b/unsloth,comparable,1,1,22360456160,22360456160,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c,34660610688,5.161006852713419,"[""/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf""]","[""Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf""]" diff --git a/bpw/hf/hf-bpw-estimates.json b/bpw/hf/hf-bpw-estimates.json new file mode 100644 index 0000000000000000000000000000000000000000..4945554fd906a7b258cb38570a77966e64976f6a --- /dev/null +++ b/bpw/hf/hf-bpw-estimates.json @@ -0,0 +1,4394 @@ +[ + { + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-31B-it-IQ4_XS.gguf", + "local_parent": "gemma-4-31b-it/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17155893600, + "hf_sibling_bytes": 17155893600, + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "repo_commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.470977738801101, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-31B-it-IQ4_XS.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-IQ4_XS.gguf", + "size": 17155893600, + "publisher_relative_path": "google_gemma-4-31B-it-IQ4_XS.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-IQ4_XS.gguf", + "sibling_size": 17155893600, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-IQ4_XS.gguf", + "sibling_size": 17155893600, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "local_parent": "gemma-4-31b-it/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17151936864, + "hf_sibling_bytes": 17151936864, + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "repo_commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.4699465783738574, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-31B-it-Q3_K_XL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "size": 17151936864, + "publisher_relative_path": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "sibling_size": 17151936864, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "sibling_size": 17151936864, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-31B-it-Q4_K_M.gguf", + "local_parent": "gemma-4-31b-it/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 19598489952, + "hf_sibling_bytes": 19598489952, + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "repo_commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 5.107539970375489, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-31B-it-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q4_K_M.gguf", + "size": 19598489952, + "publisher_relative_path": "google_gemma-4-31B-it-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q4_K_M.gguf", + "sibling_size": 19598489952, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q4_K_M.gguf", + "sibling_size": 19598489952, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-31B-it-Q4_K_S.gguf", + "local_parent": "gemma-4-31b-it/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 18195655008, + "hf_sibling_bytes": 18195655008, + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "repo_commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.741948765855762, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-31B-it-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q4_K_S.gguf", + "size": 18195655008, + "publisher_relative_path": "google_gemma-4-31B-it-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q4_K_S.gguf", + "sibling_size": 18195655008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-Q4_K_S.gguf", + "sibling_size": 18195655008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-31B-it-bf16.gguf", + "local_parent": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16", + "status": "comparable", + "local_shards": 2, + "expected_shards": 2, + "local_bytes": 61413189920, + "hf_sibling_bytes": 61413189920, + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "repo_commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 16.00482093227042, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "size": 39996137216, + "publisher_relative_path": "bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "sibling_size": 39996137216, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "sibling_size": 39996137216, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a" + } + ], + "shard_index": 1, + "shard_count": 2 + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "size": 21417052704, + "publisher_relative_path": "bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "sibling_size": 21417052704, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf_total": 30697345596, + "sibling_path": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "sibling_size": 21417052704, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29" + } + ], + "shard_index": 2, + "shard_count": 2 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "variant": "gemma-4-31B-it-IQ4_NL.gguf", + "local_parent": "gemma-4-31b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17287670720, + "hf_sibling_bytes": 17287670720, + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "repo_commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.505320022784683, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-31B-it-IQ4_NL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-IQ4_NL.gguf", + "size": 17287670720, + "publisher_relative_path": "gemma-4-31B-it-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-IQ4_NL.gguf", + "sibling_size": 17287670720, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-IQ4_NL.gguf", + "sibling_size": 17287670720, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "variant": "gemma-4-31B-it-Q4_1.gguf", + "local_parent": "gemma-4-31b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 19118091200, + "hf_sibling_bytes": 19118091200, + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "repo_commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.982343803039745, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-31B-it-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_1.gguf", + "size": 19118091200, + "publisher_relative_path": "gemma-4-31B-it-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_1.gguf", + "sibling_size": 19118091200, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_1.gguf", + "sibling_size": 19118091200, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "variant": "gemma-4-31B-it-Q4_K_M.gguf", + "local_parent": "gemma-4-31b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 18323733440, + "hf_sibling_bytes": 18323733440, + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "repo_commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.7753271390051815, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-31B-it-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_K_M.gguf", + "size": 18323733440, + "publisher_relative_path": "gemma-4-31B-it-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_K_M.gguf", + "sibling_size": 18323733440, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_K_M.gguf", + "sibling_size": 18323733440, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "variant": "gemma-4-31B-it-Q4_K_S.gguf", + "local_parent": "gemma-4-31b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17399835584, + "hf_sibling_bytes": 17399835584, + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "repo_commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.5345511792439215, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-31B-it-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_K_S.gguf", + "size": 17399835584, + "publisher_relative_path": "gemma-4-31B-it-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_K_S.gguf", + "sibling_size": 17399835584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-Q4_K_S.gguf", + "sibling_size": 17399835584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "variant": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "local_parent": "gemma-4-31b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 15380222912, + "hf_sibling_bytes": 15380222912, + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "repo_commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.008222238994921, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-31B-it-UD-Q3_K_XL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "size": 15380222912, + "publisher_relative_path": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "sibling_size": 15380222912, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "sibling_size": 15380222912, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "variant": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "local_parent": "gemma-4-31b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 18822970304, + "hf_sibling_bytes": 18822970304, + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "repo_commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "hf_gguf_total": 30697345596, + "hf_file_size_bpw_estimate": 4.905432685086026, + "local_paths": [ + "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-31B-it-UD-Q4_K_XL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "size": 18822970304, + "publisher_relative_path": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "sibling_size": 18822970304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-31B-it-GGUF", + "commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec", + "gguf_total": 30697345596, + "sibling_path": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "sibling_size": 18822970304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-E4B-it-Q4_0.gguf", + "local_parent": "gemma-4-e4b-it/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5223860704, + "hf_sibling_bytes": 5223860704, + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "repo_commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "hf_gguf_total": 7518069290, + "hf_file_size_bpw_estimate": 5.558725787162837, + "local_paths": [ + "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-E4B-it-Q4_0.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_0.gguf", + "size": 5223860704, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_0.gguf", + "sibling_size": 5223860704, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_0.gguf", + "sibling_size": 5223860704, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-E4B-it-Q4_1.gguf", + "local_parent": "gemma-4-e4b-it/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5458479584, + "hf_sibling_bytes": 5458479584, + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "repo_commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "hf_gguf_total": 7518069290, + "hf_file_size_bpw_estimate": 5.808384438553106, + "local_paths": [ + "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-E4B-it-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_1.gguf", + "size": 5458479584, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_1.gguf", + "sibling_size": 5458479584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_1.gguf", + "sibling_size": 5458479584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "local_parent": "gemma-4-e4b-it/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5405170144, + "hf_sibling_bytes": 5405170144, + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "repo_commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "hf_gguf_total": 7518069290, + "hf_file_size_bpw_estimate": 5.75165770412845, + "local_paths": [ + "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-E4B-it-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "size": 5405170144, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "sibling_size": 5405170144, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "sibling_size": 5405170144, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "variant": "google_gemma-4-E4B-it-bf16.gguf", + "local_parent": "gemma-4-e4b-it/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 15053097184, + "hf_sibling_bytes": 15053097184, + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "repo_commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "hf_gguf_total": 7518069290, + "hf_file_size_bpw_estimate": 16.018045701198904, + "local_paths": [ + "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf" + ], + "hf_sibling_paths": [ + "google_gemma-4-E4B-it-bf16.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-bf16.gguf", + "size": 15053097184, + "publisher_relative_path": "google_gemma-4-E4B-it-bf16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-bf16.gguf", + "sibling_size": 15053097184, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac" + }, + "candidates": [ + { + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf_total": 7518069290, + "sibling_path": "google_gemma-4-E4B-it-bf16.gguf", + "sibling_size": 15053097184, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "variant": "gemma-4-E4B-it-BF16.gguf", + "local_parent": "gemma-4-e4b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 15053097856, + "hf_sibling_bytes": 15053097856, + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "repo_commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "hf_gguf_total": 7518069290, + "hf_file_size_bpw_estimate": 16.018046416276114, + "local_paths": [ + "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-E4B-it-BF16.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-BF16.gguf", + "size": 15053097856, + "publisher_relative_path": "gemma-4-E4B-it-BF16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-BF16.gguf", + "sibling_size": 15053097856, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "38e0dba6818d18e2b41062c7b3b9083dcfddc44767078c415ff7e13661911ba5" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-BF16.gguf", + "sibling_size": 15053097856, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "38e0dba6818d18e2b41062c7b3b9083dcfddc44767078c415ff7e13661911ba5" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "variant": "gemma-4-E4B-it-IQ4_NL.gguf", + "local_parent": "gemma-4-e4b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 4835839104, + "hf_sibling_bytes": 4835839104, + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "repo_commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "hf_gguf_total": 7518069290, + "hf_file_size_bpw_estimate": 5.145830842961012, + "local_paths": [ + "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-E4B-it-IQ4_NL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-IQ4_NL.gguf", + "size": 4835839104, + "publisher_relative_path": "gemma-4-E4B-it-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-IQ4_NL.gguf", + "sibling_size": 4835839104, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-IQ4_NL.gguf", + "sibling_size": 4835839104, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "variant": "gemma-4-E4B-it-Q4_K_M.gguf", + "local_parent": "gemma-4-e4b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 4977171584, + "hf_sibling_bytes": 4977171584, + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "repo_commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "hf_gguf_total": 7518069290, + "hf_file_size_bpw_estimate": 5.296223157315434, + "local_paths": [ + "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-E4B-it-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-Q4_K_M.gguf", + "size": 4977171584, + "publisher_relative_path": "gemma-4-E4B-it-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-Q4_K_M.gguf", + "sibling_size": 4977171584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-Q4_K_M.gguf", + "sibling_size": 4977171584, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "variant": "gemma-4-E4B-it-Q4_K_S.gguf", + "local_parent": "gemma-4-e4b-it/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 4844850304, + "hf_sibling_bytes": 4844850304, + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "repo_commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "hf_gguf_total": 7518069290, + "hf_file_size_bpw_estimate": 5.155419687811896, + "local_paths": [ + "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "gemma-4-E4B-it-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-Q4_K_S.gguf", + "size": 4844850304, + "publisher_relative_path": "gemma-4-E4B-it-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-Q4_K_S.gguf", + "sibling_size": 4844850304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00" + }, + "candidates": [ + { + "repo_id": "unsloth/gemma-4-E4B-it-GGUF", + "commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3", + "gguf_total": 7518069290, + "sibling_path": "gemma-4-E4B-it-Q4_K_S.gguf", + "sibling_size": 4844850304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "variant": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "local_parent": "glm-4.6v-flash/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5465179264, + "hf_sibling_bytes": 5465179264, + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 4.651078327138681, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf" + ], + "hf_sibling_paths": [ + "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179264, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "sibling_size": 5465179264, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "sibling_size": 5465179264, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "variant": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "local_parent": "glm-4.6v-flash/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5739775104, + "hf_sibling_bytes": 5739775104, + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 4.88476997721123, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf" + ], + "hf_sibling_paths": [ + "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "size": 5739775104, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "sibling_size": 5739775104, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "sibling_size": 5739775104, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "variant": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "local_parent": "glm-4.6v-flash/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5477467264, + "hf_sibling_bytes": 5477467264, + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 4.661535889045268, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf" + ], + "hf_sibling_paths": [ + "zai-org_GLM-4.6V-Flash-Q4_0.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467264, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "sibling_size": 5477467264, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "sibling_size": 5477467264, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "variant": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "local_parent": "glm-4.6v-flash/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 6008603776, + "hf_sibling_bytes": 6008603776, + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 5.113553544895621, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "zai-org_GLM-4.6V-Flash-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008603776, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "sibling_size": 6008603776, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "sibling_size": 6008603776, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "variant": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "local_parent": "glm-4.6v-flash/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 6166578304, + "hf_sibling_bytes": 6166578304, + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 5.247995960766714, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578304, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "sibling_size": 6166578304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "sibling_size": 6166578304, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "variant": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "local_parent": "glm-4.6v-flash/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5758485632, + "hf_sibling_bytes": 5758485632, + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 4.900693358140994, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758485632, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "sibling_size": 5758485632, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "sibling_size": 5758485632, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "variant": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "local_parent": "glm-4.6v-flash/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 18811585376, + "hf_sibling_bytes": 18811585376, + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 16.0093846541815, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf" + ], + "hf_sibling_paths": [ + "zai-org_GLM-4.6V-Flash-bf16.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "size": 18811585376, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "sibling_size": 18811585376, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f" + }, + "candidates": [ + { + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf_total": 9400279040, + "sibling_path": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "sibling_size": 18811585376, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "variant": "GLM-4.6V-Flash-IQ4_NL.gguf", + "local_parent": "glm-4.6v-flash/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5465179744, + "hf_sibling_bytes": 5465179744, + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 4.651078735637192, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf" + ], + "hf_sibling_paths": [ + "GLM-4.6V-Flash-IQ4_NL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179744, + "publisher_relative_path": "GLM-4.6V-Flash-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-IQ4_NL.gguf", + "sibling_size": 5465179744, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-IQ4_NL.gguf", + "sibling_size": 5465179744, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "variant": "GLM-4.6V-Flash-Q4_0.gguf", + "local_parent": "glm-4.6v-flash/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5477467744, + "hf_sibling_bytes": 5477467744, + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 4.66153629754378, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf" + ], + "hf_sibling_paths": [ + "GLM-4.6V-Flash-Q4_0.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467744, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_0.gguf", + "sibling_size": 5477467744, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_0.gguf", + "sibling_size": 5477467744, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "variant": "GLM-4.6V-Flash-Q4_1.gguf", + "local_parent": "glm-4.6v-flash/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 6008604256, + "hf_sibling_bytes": 6008604256, + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 5.113553953394132, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "GLM-4.6V-Flash-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008604256, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_1.gguf", + "sibling_size": 6008604256, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_1.gguf", + "sibling_size": 6008604256, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "variant": "GLM-4.6V-Flash-Q4_K_M.gguf", + "local_parent": "glm-4.6v-flash/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 6166578784, + "hf_sibling_bytes": 6166578784, + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 5.247996369265225, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "GLM-4.6V-Flash-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578784, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_K_M.gguf", + "sibling_size": 6166578784, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_K_M.gguf", + "sibling_size": 6166578784, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "variant": "GLM-4.6V-Flash-Q4_K_S.gguf", + "local_parent": "glm-4.6v-flash/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 5758486112, + "hf_sibling_bytes": 5758486112, + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 4.900693766639506, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "GLM-4.6V-Flash-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758486112, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_K_S.gguf", + "sibling_size": 5758486112, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-Q4_K_S.gguf", + "sibling_size": 5758486112, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "variant": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "local_parent": "glm-4.6v-flash/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 6187353696, + "hf_sibling_bytes": 6187353696, + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "repo_commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "hf_gguf_total": 9400279040, + "hf_file_size_bpw_estimate": 5.265676620595297, + "local_paths": [ + "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf" + ], + "hf_sibling_paths": [ + "GLM-4.6V-Flash-UD-Q4_K_XL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "size": 6187353696, + "publisher_relative_path": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "sibling_size": 6187353696, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628" + }, + "candidates": [ + { + "repo_id": "unsloth/GLM-4.6V-Flash-GGUF", + "commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8", + "gguf_total": 9400279040, + "sibling_path": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "sibling_size": 6187353696, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "variant": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "local_parent": "internvl3.5-30b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 14855269280, + "hf_sibling_bytes": 14855269280, + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "repo_commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 3.8923646319494094, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf" + ], + "hf_sibling_paths": [ + "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "size": 14855269280, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "sibling_size": 14855269280, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "sibling_size": 14855269280, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "variant": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "local_parent": "internvl3.5-30b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17631642528, + "hf_sibling_bytes": 17631642528, + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "repo_commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 4.619827516123106, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf" + ], + "hf_sibling_paths": [ + "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "size": 17631642528, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "sibling_size": 17631642528, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "sibling_size": 17631642528, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "variant": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "local_parent": "internvl3.5-30b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 19214517152, + "hf_sibling_bytes": 19214517152, + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "repo_commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 5.034570937271498, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "size": 19214517152, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "sibling_size": 19214517152, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "sibling_size": 19214517152, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "variant": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "local_parent": "internvl3.5-30b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 18632180640, + "hf_sibling_bytes": 18632180640, + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "repo_commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 4.881987634977999, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "size": 18632180640, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "sibling_size": 18632180640, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "sibling_size": 18632180640, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "variant": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "local_parent": "internvl3.5-30b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17984488352, + "hf_sibling_bytes": 17984488352, + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "repo_commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 4.712279869559586, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "size": 17984488352, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "sibling_size": 17984488352, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "sibling_size": 17984488352, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "variant": "OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf", + "local_parent": "internvl3.5-30b-a3b/bartowski/bf16", + "status": "comparable", + "local_shards": 2, + "expected_shards": 2, + "local_bytes": 61095799648, + "hf_sibling_bytes": 61095799648, + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "repo_commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 16.008267856221746, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf" + ], + "hf_sibling_paths": [ + "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "size": 39717427296, + "publisher_relative_path": "bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "sibling_size": 39717427296, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "37ab465cd0c2b47b6b68e17f6e1f3ffd48701a27518c71ad7ac21b7f5a8d9f24" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "sibling_size": 39717427296, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "37ab465cd0c2b47b6b68e17f6e1f3ffd48701a27518c71ad7ac21b7f5a8d9f24" + } + ], + "shard_index": 1, + "shard_count": 2 + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "size": 21378372352, + "publisher_relative_path": "bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "sibling_size": 21378372352, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "469c362f36f7ad24dec0da0c75b2ebc681f60b160cee303421388b8375fc2161" + }, + "candidates": [ + { + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf_total": 30532122624, + "sibling_path": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "sibling_size": 21378372352, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "469c362f36f7ad24dec0da0c75b2ebc681f60b160cee303421388b8375fc2161" + } + ], + "shard_index": 2, + "shard_count": 2 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "variant": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "local_parent": "internvl3.5-30b-a3b/mradermacher", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 18556683552, + "hf_sibling_bytes": 18556683552, + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "repo_commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 4.862205954174541, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "InternVL3_5-30B-A3B.Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "size": 18556683552, + "publisher_relative_path": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "sibling_size": 18556683552, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "sibling_size": 18556683552, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "variant": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "local_parent": "internvl3.5-30b-a3b/mradermacher", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17456006432, + "hf_sibling_bytes": 17456006432, + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "repo_commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 4.573807500243322, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "InternVL3_5-30B-A3B.Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "size": 17456006432, + "publisher_relative_path": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "sibling_size": 17456006432, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "sibling_size": 17456006432, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "variant": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "local_parent": "internvl3.5-30b-a3b/mradermacher", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17379984928, + "hf_sibling_bytes": 17379984928, + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "repo_commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 4.553888412419341, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf" + ], + "hf_sibling_paths": [ + "InternVL3_5-30B-A3B.i1-Q4_0.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "size": 17379984928, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "sibling_size": 17379984928, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "sibling_size": 17379984928, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "variant": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "local_parent": "internvl3.5-30b-a3b/mradermacher", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 19192497696, + "hf_sibling_bytes": 19192497696, + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "repo_commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 5.028801418716587, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "InternVL3_5-30B-A3B.i1-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "size": 19192497696, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "sibling_size": 19192497696, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "sibling_size": 19192497696, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "variant": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "local_parent": "internvl3.5-30b-a3b/mradermacher", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 18556683808, + "hf_sibling_bytes": 18556683808, + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "repo_commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 4.862206021251437, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "size": 18556683808, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "sibling_size": 18556683808, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "sibling_size": 18556683808, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "variant": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "local_parent": "internvl3.5-30b-a3b/mradermacher", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17456006688, + "hf_sibling_bytes": 17456006688, + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "repo_commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "hf_gguf_total": 30532122624, + "hf_file_size_bpw_estimate": 4.573807567320217, + "local_paths": [ + "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "size": 17456006688, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "sibling_size": 17456006688, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a" + }, + "candidates": [ + { + "repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF", + "commit_sha": "120d600e464788a15e2140e1c9650c543d575d95", + "gguf_total": 30532122624, + "sibling_path": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "sibling_size": 17456006688, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "kimi-vl-a3b-separate", + "publisher": "ggml-org", + "variant": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "local_parent": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 31934229408, + "hf_sibling_bytes": 31934229408, + "repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF", + "repo_commit_sha": "e7dcd093335f922a057772febc7ab27eda985b40", + "hf_gguf_total": 15960110208, + "hf_file_size_bpw_estimate": 16.007022002639044, + "local_paths": [ + "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf" + ], + "hf_sibling_paths": [ + "Kimi-VL-A3B-Thinking-2506-bf16.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "family": "kimi-vl-a3b-separate", + "publisher": "ggml-org", + "basename": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "size": 31934229408, + "publisher_relative_path": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF", + "commit_sha": "e7dcd093335f922a057772febc7ab27eda985b40", + "gguf_total": 15960110208, + "sibling_path": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "sibling_size": 31934229408, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "952f3faa372910984089d16db89927548c0f11dab36ee21f57ea79df23b32378" + }, + "candidates": [ + { + "repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF", + "commit_sha": "e7dcd093335f922a057772febc7ab27eda985b40", + "gguf_total": 15960110208, + "sibling_path": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "sibling_size": 31934229408, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "952f3faa372910984089d16db89927548c0f11dab36ee21f57ea79df23b32378" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "variant": "Muse-Glimmer-30B-Q4_0.gguf", + "local_parent": "muse-glimmer-30b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 16265565216, + "hf_sibling_bytes": 16265565216, + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "repo_commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_file_size_bpw_estimate": 4.671530531040103, + "local_paths": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf" + ], + "hf_sibling_paths": [ + "Muse-Glimmer-30B-Q4_0.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_0.gguf", + "size": 16265565216, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_0.gguf", + "sibling_size": 16265565216, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_0.gguf", + "sibling_size": 16265565216, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "variant": "Muse-Glimmer-30B-Q4_1.gguf", + "local_parent": "muse-glimmer-30b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17828207648, + "hf_sibling_bytes": 17828207648, + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "repo_commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_file_size_bpw_estimate": 5.120327221056507, + "local_paths": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "Muse-Glimmer-30B-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_1.gguf", + "size": 17828207648, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_1.gguf", + "sibling_size": 17828207648, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_1.gguf", + "sibling_size": 17828207648, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "variant": "Muse-Glimmer-30B-Q4_K_M.gguf", + "local_parent": "muse-glimmer-30b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 17306324000, + "hf_sibling_bytes": 17306324000, + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "repo_commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_file_size_bpw_estimate": 4.970440305790605, + "local_paths": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "Muse-Glimmer-30B-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_K_M.gguf", + "size": 17306324000, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_K_M.gguf", + "sibling_size": 17306324000, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_K_M.gguf", + "sibling_size": 17306324000, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "variant": "Muse-Glimmer-30B-Q4_K_S.gguf", + "local_parent": "muse-glimmer-30b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 16320943136, + "hf_sibling_bytes": 16320943136, + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "repo_commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_file_size_bpw_estimate": 4.6874352746250985, + "local_paths": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "Muse-Glimmer-30B-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_K_S.gguf", + "size": 16320943136, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_K_S.gguf", + "sibling_size": 16320943136, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-Q4_K_S.gguf", + "sibling_size": 16320943136, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "variant": "Muse-Glimmer-30B-bf16.gguf", + "local_parent": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16", + "status": "comparable", + "local_shards": 2, + "expected_shards": 2, + "local_bytes": 55725511360, + "hf_sibling_bytes": 55725511360, + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "repo_commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "hf_gguf_total": 27854794240, + "hf_file_size_bpw_estimate": 16.00457311006868, + "local_paths": [ + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf" + ], + "hf_sibling_paths": [ + "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "size": 39750446272, + "publisher_relative_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "sibling_size": 39750446272, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "sibling_size": 39750446272, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860" + } + ], + "shard_index": 1, + "shard_count": 2 + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "size": 15975065088, + "publisher_relative_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "sibling_size": 15975065088, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16" + }, + "candidates": [ + { + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf_total": 27854794240, + "sibling_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "sibling_size": 15975065088, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16" + } + ], + "shard_index": 2, + "shard_count": 2 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "local_parent": "qwen3.5-4b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 2776033248, + "hf_sibling_bytes": 2776033248, + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "repo_commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_file_size_bpw_estimate": 5.1332558926113245, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.5-4B-Q4_0.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "size": 2776033248, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2776033248, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2776033248, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "local_parent": "qwen3.5-4b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 2979850208, + "hf_sibling_bytes": 2979850208, + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "repo_commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_file_size_bpw_estimate": 5.510140647751737, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.5-4B-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "size": 2979850208, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2979850208, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2979850208, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "local_parent": "qwen3.5-4b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 3013027808, + "hf_sibling_bytes": 3013027808, + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "repo_commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_file_size_bpw_estimate": 5.571490457169691, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.5-4B-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "size": 3013027808, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 3013027808, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 3013027808, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "local_parent": "qwen3.5-4b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 2846156768, + "hf_sibling_bytes": 2846156768, + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "repo_commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_file_size_bpw_estimate": 5.262923637949023, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.5-4B-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "size": 2846156768, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2846156768, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2846156768, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.5-4B-bf16.gguf", + "local_parent": "qwen3.5-4b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 8665620192, + "hf_sibling_bytes": 8665620192, + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "repo_commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "hf_gguf_total": 4326350848, + "hf_file_size_bpw_estimate": 16.023888022869844, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.5-4B-bf16.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-bf16.gguf", + "size": 8665620192, + "publisher_relative_path": "Qwen_Qwen3.5-4B-bf16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-bf16.gguf", + "sibling_size": 8665620192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF", + "commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6", + "gguf_total": 4326350848, + "sibling_path": "Qwen_Qwen3.5-4B-bf16.gguf", + "sibling_size": 8665620192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "unsloth", + "variant": "Qwen3.5-4B-BF16.gguf", + "local_parent": "qwen3.5-4b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 8424393632, + "hf_sibling_bytes": 8424393632, + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "repo_commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_file_size_bpw_estimate": 16.0245207842171, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.5-4B-BF16.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-BF16.gguf", + "size": 8424393632, + "publisher_relative_path": "Qwen3.5-4B-BF16.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-BF16.gguf", + "sibling_size": 8424393632, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-BF16.gguf", + "sibling_size": 8424393632, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-BF16.gguf", + "sibling_size": 8665620544, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "65c0fa68c10d6d8f2bb90e4e26d83c1421c7dde6ce98b9f93624a411f7eb0113" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "unsloth", + "variant": "Qwen3.5-4B-IQ4_NL.gguf", + "local_parent": "qwen3.5-4b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 2579944608, + "hf_sibling_bytes": 2579944608, + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "repo_commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_file_size_bpw_estimate": 4.907460144785508, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.5-4B-IQ4_NL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-IQ4_NL.gguf", + "size": 2579944608, + "publisher_relative_path": "Qwen3.5-4B-IQ4_NL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-IQ4_NL.gguf", + "sibling_size": 2579944608, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-IQ4_NL.gguf", + "sibling_size": 2579944608, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-IQ4_NL.gguf", + "sibling_size": 2729175360, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "f696836adb2f2287036620dfd154cf83e741bb87d3106ccd3596130f6f75b382" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "unsloth", + "variant": "Qwen3.5-4B-Q4_0.gguf", + "local_parent": "qwen3.5-4b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 2583221408, + "hf_sibling_bytes": 2583221408, + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "repo_commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_file_size_bpw_estimate": 4.913693133413469, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.5-4B-Q4_0.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_0.gguf", + "size": 2583221408, + "publisher_relative_path": "Qwen3.5-4B-Q4_0.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2583221408, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2583221408, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-Q4_0.gguf", + "sibling_size": 2669209920, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "14e6ef39302330c63c2c1a1ab548c7f6f1b7e36b3150ca8b42cab7193b0c3669" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "unsloth", + "variant": "Qwen3.5-4B-Q4_1.gguf", + "local_parent": "qwen3.5-4b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 2784416928, + "hf_sibling_bytes": 2784416928, + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "repo_commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_file_size_bpw_estimate": 5.296398635170271, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.5-4B-Q4_1.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_1.gguf", + "size": 2784416928, + "publisher_relative_path": "Qwen3.5-4B-Q4_1.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2784416928, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2784416928, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-Q4_1.gguf", + "sibling_size": 2877122880, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "ce904a58d18bcc3db92e8d43a35aee53ef5b1982a0a07d72ee82e7abfa149ed1" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "unsloth", + "variant": "Qwen3.5-4B-Q4_K_M.gguf", + "local_parent": "qwen3.5-4b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 2740937888, + "hf_sibling_bytes": 2740937888, + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "repo_commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_file_size_bpw_estimate": 5.213694667313015, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.5-4B-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_K_M.gguf", + "size": 2740937888, + "publisher_relative_path": "Qwen3.5-4B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 2740937888, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 2740937888, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-Q4_K_M.gguf", + "sibling_size": 2834975040, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "3874209241c9a397e2f62cd3f70f80fd2dfbf0dfccb6838416bdb48a714e8630" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.5-4b", + "publisher": "unsloth", + "variant": "Qwen3.5-4B-Q4_K_S.gguf", + "local_parent": "qwen3.5-4b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 2590430368, + "hf_sibling_bytes": 2590430368, + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "repo_commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "hf_gguf_total": 4205751296, + "hf_file_size_bpw_estimate": 4.927405708394984, + "local_paths": [ + "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.5-4B-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_K_S.gguf", + "size": 2590430368, + "publisher_relative_path": "Qwen3.5-4B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2590430368, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.5-4B-GGUF", + "commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523", + "gguf_total": 4205751296, + "sibling_path": "Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2590430368, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77" + }, + { + "repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF", + "commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9", + "gguf_total": 4326350848, + "sibling_path": "Qwen3.5-4B-Q4_K_S.gguf", + "sibling_size": 2683300160, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "ad89d1b4281574b0ebd110b579370ac23da4d5505f4ce3b5134e4e0d8b1df457" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "local_parent": "qwen3.6-35b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 19699553920, + "hf_sibling_bytes": 19699553920, + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_file_size_bpw_estimate": 4.438679488168163, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "size": 19699553920, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "sibling_size": 19699553920, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "sibling_size": 19699553920, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "local_parent": "qwen3.6-35b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 22662526592, + "hf_sibling_bytes": 22662526592, + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_file_size_bpw_estimate": 5.106292880665185, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "size": 22662526592, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "sibling_size": 22662526592, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "sibling_size": 22662526592, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "local_parent": "qwen3.6-35b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 22285080192, + "hf_sibling_bytes": 22285080192, + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_file_size_bpw_estimate": 5.021247117681588, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "size": 22285080192, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "sibling_size": 22285080192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "sibling_size": 22285080192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "local_parent": "qwen3.6-35b-a3b/bartowski", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 21486360192, + "hf_sibling_bytes": 21486360192, + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_file_size_bpw_estimate": 4.841280500407562, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "size": 21486360192, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "sibling_size": 21486360192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "sibling_size": 21486360192, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "variant": "Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "local_parent": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16", + "status": "comparable", + "local_shards": 2, + "expected_shards": 2, + "local_bytes": 71065941536, + "hf_sibling_bytes": 71065941536, + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "hf_gguf_total": 35505251456, + "hf_file_size_bpw_estimate": 16.012491363215652, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf" + ], + "hf_sibling_paths": [ + "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "size": 39753375712, + "publisher_relative_path": "BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "sibling_size": 39753375712, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "sibling_size": 39753375712, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b" + } + ], + "shard_index": 1, + "shard_count": 2 + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "size": 31312565824, + "publisher_relative_path": "BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "match_status": "matched", + "selected": { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "sibling_size": 31312565824, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9" + }, + "candidates": [ + { + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf_total": 35505251456, + "sibling_path": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "sibling_size": 31312565824, + "basename_unique_in_repo": true, + "local_relative_path_exact": false, + "size_equal": true, + "lfs_sha256": "c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9" + } + ], + "shard_index": 2, + "shard_count": 2 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "variant": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "local_parent": "qwen3.6-35b-a3b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 16845511648, + "hf_sibling_bytes": 16845511648, + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "hf_gguf_total": 34660610688, + "hf_file_size_bpw_estimate": 3.8881049845627, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "size": 16845511648, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "sibling_size": 16845511648, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a832b9689925f1bd335bbe985cdfb06c36bf2cf268f4f8f6eceafa3ceb515617" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "sibling_size": 16845511648, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a832b9689925f1bd335bbe985cdfb06c36bf2cf268f4f8f6eceafa3ceb515617" + }, + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF", + "commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d", + "gguf_total": 35505251456, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "sibling_size": 17227569440, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "3fba9ab57290b34726837521335bf9268397174f3dd662880e2d0c5264d17b81" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "variant": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "local_parent": "qwen3.6-35b-a3b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 22134528992, + "hf_sibling_bytes": 22134528992, + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "hf_gguf_total": 34660610688, + "hf_file_size_bpw_estimate": 5.108860704445301, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "size": 22134528992, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "sibling_size": 22134528992, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "sibling_size": 22134528992, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61" + }, + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF", + "commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d", + "gguf_total": 35505251456, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "sibling_size": 22663387424, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "variant": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "local_parent": "qwen3.6-35b-a3b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 20893015008, + "hf_sibling_bytes": 20893015008, + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "hf_gguf_total": 34660610688, + "hf_file_size_bpw_estimate": 4.822307418889988, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "size": 20893015008, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "sibling_size": 20893015008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "sibling_size": 20893015008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c" + }, + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF", + "commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d", + "gguf_total": 35505251456, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "sibling_size": 21388319008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "2bee952b218e4a481430c59d8d3bdc7bae20bed0eb501326340c5fca7ae95d42" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + }, + { + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "variant": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "local_parent": "qwen3.6-35b-a3b/unsloth", + "status": "comparable", + "local_shards": 1, + "expected_shards": 1, + "local_bytes": 22360456160, + "hf_sibling_bytes": 22360456160, + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "repo_commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "hf_gguf_total": 34660610688, + "hf_file_size_bpw_estimate": 5.161006852713419, + "local_paths": [ + "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf" + ], + "hf_sibling_paths": [ + "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf" + ], + "file_matches": [ + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "size": 22360456160, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "match_status": "matched", + "selected": { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "sibling_size": 22360456160, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450" + }, + "candidates": [ + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF", + "commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c", + "gguf_total": 34660610688, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "sibling_size": 22360456160, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": true, + "lfs_sha256": "707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450" + }, + { + "repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF", + "commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d", + "gguf_total": 35505251456, + "sibling_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "sibling_size": 22853663008, + "basename_unique_in_repo": true, + "local_relative_path_exact": true, + "size_equal": false, + "lfs_sha256": "55983c5a75a1ab969824077b3bb3de4146e82a9234072b48ad4e8f92ad3fe9f1" + } + ], + "shard_index": 1, + "shard_count": 1 + } + ] + } +] diff --git a/bpw/hf/inventory.json b/bpw/hf/inventory.json new file mode 100644 index 0000000000000000000000000000000000000000..47b37827ddaf7012b98f9481fecdbea84fef830a --- /dev/null +++ b/bpw/hf/inventory.json @@ -0,0 +1,668 @@ +[ + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-IQ4_XS.gguf", + "size": 17155893600, + "publisher_relative_path": "google_gemma-4-31B-it-IQ4_XS.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "size": 17151936864, + "publisher_relative_path": "google_gemma-4-31B-it-Q3_K_XL.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q4_K_M.gguf", + "size": 19598489952, + "publisher_relative_path": "google_gemma-4-31B-it-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-Q4_K_S.gguf", + "size": 18195655008, + "publisher_relative_path": "google_gemma-4-31B-it-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "size": 39996137216, + "publisher_relative_path": "bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "family": "gemma-4-31b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "size": 21417052704, + "publisher_relative_path": "bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-IQ4_NL.gguf", + "size": 17287670720, + "publisher_relative_path": "gemma-4-31B-it-IQ4_NL.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_1.gguf", + "size": 19118091200, + "publisher_relative_path": "gemma-4-31B-it-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_K_M.gguf", + "size": 18323733440, + "publisher_relative_path": "gemma-4-31B-it-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-Q4_K_S.gguf", + "size": 17399835584, + "publisher_relative_path": "gemma-4-31B-it-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-UD-Q3_K_XL.gguf", + "size": 15380222912, + "publisher_relative_path": "gemma-4-31B-it-UD-Q3_K_XL.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf", + "family": "gemma-4-31b-it", + "publisher": "unsloth", + "basename": "gemma-4-31B-it-UD-Q4_K_XL.gguf", + "size": 18822970304, + "publisher_relative_path": "gemma-4-31B-it-UD-Q4_K_XL.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_0.gguf", + "size": 5223860704, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_0.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_1.gguf", + "size": 5458479584, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "size": 5405170144, + "publisher_relative_path": "google_gemma-4-E4B-it-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf", + "relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf", + "family": "gemma-4-e4b-it", + "publisher": "bartowski", + "basename": "google_gemma-4-E4B-it-bf16.gguf", + "size": 15053097184, + "publisher_relative_path": "google_gemma-4-E4B-it-bf16.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-BF16.gguf", + "size": 15053097856, + "publisher_relative_path": "gemma-4-E4B-it-BF16.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-IQ4_NL.gguf", + "size": 4835839104, + "publisher_relative_path": "gemma-4-E4B-it-IQ4_NL.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-Q4_K_M.gguf", + "size": 4977171584, + "publisher_relative_path": "gemma-4-E4B-it-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf", + "family": "gemma-4-e4b-it", + "publisher": "unsloth", + "basename": "gemma-4-E4B-it-Q4_K_S.gguf", + "size": 4844850304, + "publisher_relative_path": "gemma-4-E4B-it-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179264, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "size": 5739775104, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467264, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_0.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008603776, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578304, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758485632, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf", + "relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf", + "family": "glm-4.6v-flash", + "publisher": "bartowski", + "basename": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "size": 18811585376, + "publisher_relative_path": "zai-org_GLM-4.6V-Flash-bf16.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179744, + "publisher_relative_path": "GLM-4.6V-Flash-IQ4_NL.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467744, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_0.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008604256, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578784, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758486112, + "publisher_relative_path": "GLM-4.6V-Flash-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "family": "glm-4.6v-flash", + "publisher": "unsloth", + "basename": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf", + "size": 6187353696, + "publisher_relative_path": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf", + "size": 14855269280, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf", + "size": 17631642528, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf", + "size": 19214517152, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf", + "size": 18632180640, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf", + "size": 17984488352, + "publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf", + "size": 39717427296, + "publisher_relative_path": "bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "bartowski", + "basename": "OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf", + "size": 21378372352, + "publisher_relative_path": "bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.Q4_K_M.gguf", + "size": 18556683552, + "publisher_relative_path": "InternVL3_5-30B-A3B.Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.Q4_K_S.gguf", + "size": 17456006432, + "publisher_relative_path": "InternVL3_5-30B-A3B.Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_0.gguf", + "size": 17379984928, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_0.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_1.gguf", + "size": 19192497696, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf", + "size": 18556683808, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "family": "internvl3.5-30b-a3b", + "publisher": "mradermacher", + "basename": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf", + "size": 17456006688, + "publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "family": "kimi-vl-a3b-separate", + "publisher": "ggml-org", + "basename": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "size": 31934229408, + "publisher_relative_path": "Kimi-VL-A3B-Thinking-2506-bf16.gguf" + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_0.gguf", + "size": 16265565216, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_0.gguf" + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_1.gguf", + "size": 17828207648, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_K_M.gguf", + "size": 17306324000, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-Q4_K_S.gguf", + "size": 16320943136, + "publisher_relative_path": "Muse-Glimmer-30B-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "size": 39750446272, + "publisher_relative_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf" + }, + { + "local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "family": "muse-glimmer-30b", + "publisher": "bartowski", + "basename": "Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "size": 15975065088, + "publisher_relative_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "size": 2776033248, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_0.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "size": 2979850208, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "size": 3013027808, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "size": 2846156768, + "publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf", + "relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf", + "family": "qwen3.5-4b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.5-4B-bf16.gguf", + "size": 8665620192, + "publisher_relative_path": "Qwen_Qwen3.5-4B-bf16.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-BF16.gguf", + "size": 8424393632, + "publisher_relative_path": "Qwen3.5-4B-BF16.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-IQ4_NL.gguf", + "size": 2579944608, + "publisher_relative_path": "Qwen3.5-4B-IQ4_NL.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_0.gguf", + "size": 2583221408, + "publisher_relative_path": "Qwen3.5-4B-Q4_0.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_1.gguf", + "size": 2784416928, + "publisher_relative_path": "Qwen3.5-4B-Q4_1.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_K_M.gguf", + "size": 2740937888, + "publisher_relative_path": "Qwen3.5-4B-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf", + "family": "qwen3.5-4b", + "publisher": "unsloth", + "basename": "Qwen3.5-4B-Q4_K_S.gguf", + "size": 2590430368, + "publisher_relative_path": "Qwen3.5-4B-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "size": 19699553920, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "size": 22662526592, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "size": 22285080192, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "size": 21486360192, + "publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "size": 39753375712, + "publisher_relative_path": "BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "bartowski", + "basename": "Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "size": 31312565824, + "publisher_relative_path": "BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf", + "size": 16845511648, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf", + "size": 22134528992, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf", + "size": 20893015008, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf" + }, + { + "local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "family": "qwen3.6-35b-a3b", + "publisher": "unsloth", + "basename": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf", + "size": 22360456160, + "publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf" + } +] diff --git a/bpw/hf/repo-metadata/bartowski__Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF.json b/bpw/hf/repo-metadata/bartowski__Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..225167397a69f910f459dd1517ad553e6aca6423 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF.json @@ -0,0 +1,192 @@ +{ + "repo_id": "bartowski/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF", + "requested_repo_id": "bartowski/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF", + "commit_sha": "b640dc2edd797ba606aa37481e9e0a94d248234a", + "gguf": { + "total": 30697345596, + "architecture": "gemma4", + "context_length": 262144, + "quantize_imatrix_file": "/models_out/gemma-4-31B-it-SDFT-Heretic-RP-GGUF/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-imatrix.gguf", + "chat_template": "{%- macro format_parameters(properties, required) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'OBJECT' -%}\n ,properties:{\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n {%- elif value is mapping -%}\n {{- format_parameters(value, value['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- if value['required'] -%}\n ,required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n ,items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- set ns = namespace(prev_message_type=None) -%}\n{%- set loop_messages = messages -%}\n{{ bos_token }}\n{#- Handle System/Tool Definitions Block -#}\n{%- if (enable_thinking is defined and enable_thinking) or tools or messages[0]['role'] in ['system', 'developer'] -%}\n {{- '<|turn>system\\n' -}}\n\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking is defined and enable_thinking -%}\n {{- '<|think|>' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n\n {%- if messages[0]['role'] in ['system', 'developer'] -%}\n {{- messages[0]['content'] | trim -}}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n\n {{- '\\n' -}}\n{%- endif %}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {{- '<|turn>' + role + '\\n' }}\n\n {%- if message['tool_calls'] -%}\n {%- for tool_call in message['tool_calls'] -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is string -%}\n {{- function['arguments'] -}}\n {%- endif -%}\n {{- '}' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- if message['tool_responses'] -%}\n {#- Tool Response handling -#}\n {%- for tool_response in message['tool_responses'] -%}\n {{- '<|tool_response>' -}}\n {%- if tool_response['response'] is mapping -%}\n {{- 'response:' + tool_response['name'] | default('unknown') + '{' -}}\n {%- for key, value in tool_response['response'] | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_response['name'] | default('unknown') + '{value:' + format_argument(tool_response['response'], escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n\n {%- if message['content'] is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message['content'] is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item['type'] == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item['type'] == 'image' -%}\n {{- '\\n\\n<|image|>\\n\\n' -}}\n {%- set ns.prev_message_type = 'image' -%}\n {%- elif item['type'] == 'audio' -%}\n {{- '<|audio|>' -}}\n {%- set ns.prev_message_type = 'audio' -%}\n {%- elif item['type'] == 'video' -%}\n {{- '\\n\\n<|video|>\\n\\n' -}}\n {%- set ns.prev_message_type = 'video' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- if not (message['tool_responses'] and not message['content']) -%}\n {{- '\\n' -}}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' -%}\n {{- '<|turn>model\\n' -}}\n {%- endif -%}\n {%- if not enable_thinking | default(false) -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n", + "bos_token": "", + "eos_token": "", + "totalFileSize": 12649767072 + }, + "fetched_at_utc": "2026-09-06T11:32:08.239945+00:00", + "siblings": [ + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ2_M.gguf", + "size": 12649767072, + "blob_id": "14ecb00e7292addfc4639bb58921d0105ce46ab8", + "lfs_sha256": "55a49b11f26673fde09ab5cfd8a4ae885fb50885a05123aceaa68e2a3baab8c0" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ2_S.gguf", + "size": 12075352224, + "blob_id": "af09c79fca1bbbbee9613f78e32acfba92653183", + "lfs_sha256": "3765c4379801ad4e62f07a457647a265eee7d490e73b9bebe868402b9f41fca8" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ2_XS.gguf", + "size": 11500937376, + "blob_id": "1916fd6d3d623c030383847fb3c503ef82b8fef5", + "lfs_sha256": "6c8975f7f1af3dde6ad4d62914884a6e6ab89f28379ebde8ae321acce7a0d4e5" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ2_XXS.gguf", + "size": 10830184608, + "blob_id": "6642c7aeaf4d9ece530ae8d835b8144428faad75", + "lfs_sha256": "c4065eadd5fd373bca8490c0940c79e3b2a007bc46ef98bdd4fbdc147a43855a" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ3_M.gguf", + "size": 15129823392, + "blob_id": "a90b39f46dd1faea9024b8fd2b6b845d86814dd6", + "lfs_sha256": "b3cc388a8b4bdf9e47b9da7e04449f2c63d9f6a49c39bd6168f3fd412b703ee2" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ3_XS.gguf", + "size": 13841346720, + "blob_id": "03defdf602713df7a7e200cd45ea0a2b1a0c52fd", + "lfs_sha256": "1ae7144f8c1ff2bcf0f370ac0d9718cdcfdbdd4353b2a2eae8ab4b4b3ed1f760" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ3_XXS.gguf", + "size": 12981702816, + "blob_id": "45682e85bec9f5e36ffb90d039b5929cb270709d", + "lfs_sha256": "d995def263dd44ee743bad7649d322d60ca518927c6cb28db25a648c302495b8" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ4_NL.gguf", + "size": 18025681056, + "blob_id": "2c2fb842216654a285c56e0cd327500c550e57aa", + "lfs_sha256": "44b07662209a93e5157eb12047a7e33886bdefc31666d3a839dcfac43e3d74f6" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ4_XS.gguf", + "size": 17155887264, + "blob_id": "4fbe4a3219c65bd0ad064c6eb06d79426ce4754a", + "lfs_sha256": "52ca836c369ce8f2ff037d721f3efc396e46209653cb98a3cba1113273b082cf" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q2_K.gguf", + "size": 12631617696, + "blob_id": "a47c0aab70a50ccc52a734ae8d459e46827e671b", + "lfs_sha256": "7e42e1787a73698d6760c6a5cc4153a2e89f756ba3ac9583e6ccd8e10a5d0b1a" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q2_K_L.gguf", + "size": 12972929184, + "blob_id": "156e7627cb43393ad40e9470b86b14b55ec3ce73", + "lfs_sha256": "f50f3d90fd26571688e49499584419f8be4c20335d652f25b4b9624e1bf6755c" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q3_K_L.gguf", + "size": 16810619040, + "blob_id": "71cf43704a821450f4649c441dd5c18d990cb090", + "lfs_sha256": "195e51bc44a9dcd2a5b6ced3b2a9adedb959e376ca28caee196e781c4800240e" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q3_K_M.gguf", + "size": 15918117024, + "blob_id": "edaebfb9910975fc92d6be4c4cfe13a02cf84560", + "lfs_sha256": "380de2521a640ec2317cb4125c4aeb12f7b97a49544ec2390dd6dd5cf5ff1cba" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q3_K_S.gguf", + "size": 14329057440, + "blob_id": "541d7d80150d3aa34fa20c17a091e00e89853582", + "lfs_sha256": "688864d2e287f429df504dab117c5d251ecf36a3c9834da2507ea02f1a6f9062" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q3_K_XL.gguf", + "size": 17151930528, + "blob_id": "c36ba28cafd7d2d09cc5e0f6727602953b2fed6f", + "lfs_sha256": "736a4cab5116a8624ec5885cf720967df9b39a0b7e09951338da3b4c907a9d20" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_0.gguf", + "size": 18076258464, + "blob_id": "15dd22bfc3612c7b0ac3c43f50640efa3004ea95", + "lfs_sha256": "666b7d150f1702d6339df32d7823cc4a1988408dc70ff5626bf28bfd356e6734" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_1.gguf", + "size": 19765268640, + "blob_id": "5d48a4e3f4e3c4433deefa477941a80d6f1d633e", + "lfs_sha256": "ff60c0ea65e48c8eb18833d1eb76650a73a1c26e537b879d265934e669068287" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_K_L.gguf", + "size": 19939795104, + "blob_id": "e546742e1986f8a924bbf3265d8fd30a4a839dc8", + "lfs_sha256": "95bd84cd967a480401108505fbc9a0b4769e8077d6c25654c06655ae6dce491b" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_K_M.gguf", + "size": 19598483616, + "blob_id": "2cbeb2af13ed3befb9402d43453ad28cac5fb068", + "lfs_sha256": "2666824f3cb8fd4225a1403f556e3aea8054cbe41edc0da28258a04204247d1b" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_K_S.gguf", + "size": 18195648672, + "blob_id": "31c5826b2b8d59fbbaf74c64f1084b458fe07712", + "lfs_sha256": "90f5d39c94f6c95e1abdf2c4d7b7796844096a4ec5b488c7c22272b5132735bd" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q5_K_L.gguf", + "size": 22950183072, + "blob_id": "b1c21812ebc03b15b8ae949afec7dd0b329a3020", + "lfs_sha256": "3b2dfdb09868e48c7ce93fd5c93859fb1a80f763aad9e09557f25585b5dc69e2" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q5_K_M.gguf", + "size": 22608871584, + "blob_id": "d6c6aec87ce7d70d93336a72c94ec4793a824c94", + "lfs_sha256": "4a5ba66b05f63e7426f5e42964efdad17925777a25169df488d109eef165b8e6" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q5_K_S.gguf", + "size": 21504856224, + "blob_id": "a7d931e6d3b00bdc6bfce5ee5ad560f07b2bcd79", + "lfs_sha256": "0323792fd9c31edfd7eb1bfb2a7ce23e2d04b5b2916650e37441dd31410f2134" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q6_K.gguf", + "size": 26726715552, + "blob_id": "1843864bb54620d2ddcd5af5972791a966557d26", + "lfs_sha256": "371c22ab732e88e6c3de86f4760c5f014fa64ab11954f010c89edc0d452b517b" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q6_K_L.gguf", + "size": 27068027040, + "blob_id": "b8ba05bbd5a7bf9dbf1f2ceb6b8b43993b03fcd4", + "lfs_sha256": "c110254f1c0be37abbbc8df21f478ce361f08185b92c0842389b89d24bec1803" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q8_0.gguf", + "size": 32635670688, + "blob_id": "0175c8d50952a61977c8ebfb95ecac3cdaaa437c", + "lfs_sha256": "f1f6b0b8e60f0cd42334a034086b902f6bf46dd9188d27c9264875da66d7883f" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-bf16/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-bf16-00001-of-00002.gguf", + "size": 39897585184, + "blob_id": "522d0fdb7a7e46c852c8c883c6ce04e4f9a5c501", + "lfs_sha256": "e890a0ba36451fb3ad546c10b156f57eb7daaa27c8b58a58c20b6d86e762c461" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-bf16/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-bf16-00002-of-00002.gguf", + "size": 21515598368, + "blob_id": "d16c511ad1eb2b3d73f37d4088af6ec9fb42a567", + "lfs_sha256": "afcde166963c04e07308c40040384679dd56d4bb16793c88c839ef6a697844ed" + }, + { + "rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-imatrix.gguf", + "size": 13753952, + "blob_id": "aab5ddeb89e9dc1af94e85cdbf41906494387dc6", + "lfs_sha256": "58e6b4df839e2b61c6d1f60f4ddf5e067e3dc2bd15794ffe2bd050377c16b1d1" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__Jackrong_Qwen3.5-4B-Neo-GGUF.json b/bpw/hf/repo-metadata/bartowski__Jackrong_Qwen3.5-4B-Neo-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..601c94fafebd86605cb760d45c5026ff14d12ff1 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__Jackrong_Qwen3.5-4B-Neo-GGUF.json @@ -0,0 +1,178 @@ +{ + "repo_id": "bartowski/Jackrong_Qwen3.5-4B-Neo-GGUF", + "requested_repo_id": "bartowski/Jackrong_Qwen3.5-4B-Neo-GGUF", + "commit_sha": "f4e97623ade9e56f8b2b2638c2ca6b3dac79d420", + "gguf": { + "total": 4205751296, + "architecture": "qwen35", + "context_length": 262144, + "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {{- messages[0].content + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within XML tags:\\n\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n\\n\\nFor each function call, return a json object with function name and arguments within XML tags:\\n\\n{\\\"name\\\": , \\\"arguments\\\": }\\n<|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0].content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" and message.content is string and not(message.content.startswith('') and message.content.endswith('')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if message.content is string %}\n {%- set content = message.content %}\n {%- else %}\n {%- set content = '' %}\n {%- endif %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '' in content %}\n {%- set reasoning_content = content.split('')[0].rstrip('\\n').split('')[-1].lstrip('\\n') %}\n {%- set content = content.split('')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- if loop.index0 > ns.last_query_index %}\n {%- if loop.last or (not loop.last and reasoning_content) %}\n {{- '<|im_start|>' + message.role + '\\n\\n' + reasoning_content.strip('\\n') + '\\n\\n\\n' + content.lstrip('\\n') }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n\\n' }}\n {{- content }}\n {{- '\\n' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\n\n' }}\n{%- endif %}", + "eos_token": "<|im_end|>", + "totalFileSize": 8424390400 + }, + "fetched_at_utc": "2026-09-06T11:32:08.134311+00:00", + "siblings": [ + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ2_M.gguf", + "size": 1825570816, + "blob_id": "d874590d2b5fb87166dc70f932e0f5175195b478", + "lfs_sha256": "df4a00d5464ce73f61d40349f003d4704e2403932856b04632b5df5a3041a0ee" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ3_M.gguf", + "size": 2355152896, + "blob_id": "1a9bf2f1a74b00e0a4cd5cff858df10f126adc2c", + "lfs_sha256": "3b4b7c2f874f494ef4ec7f3815fd95477561484f836bf29b3bc5897ed32b686d" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ3_XS.gguf", + "size": 2275772416, + "blob_id": "dacf2f63cc9691d76854efb52ffbc65d80c4fe92", + "lfs_sha256": "85531556f84e0f4272a8a04c051248784fa4a5ee91f88e61248de6edf4c8d2df" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ3_XXS.gguf", + "size": 2115649536, + "blob_id": "07846c81c25678cbb04b21c9fe59d784ee0205c3", + "lfs_sha256": "e6bd7340e26cf0d5a05da484821b23fd83f279042106ba82fc67adf304340359" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ4_NL.gguf", + "size": 2647361536, + "blob_id": "08fba606f76f2b37ae4ddd7c3b3d0f691548ecc2", + "lfs_sha256": "7571e623dafdfb08e8d3df7e12cc782e7675d2426b7f98dde537e18f495e595c" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ4_XS.gguf", + "size": 2543159296, + "blob_id": "7bdf114601260391fbec6f562cf79a6dc77907d5", + "lfs_sha256": "e18e64e83f03c678101246757f8265e7008b588a5c3b4521b0f77789430ff328" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q2_K.gguf", + "size": 2063599616, + "blob_id": "5ecbd521d9c2b10f0c926004bc0ce8ea1ed50608", + "lfs_sha256": "ae669306da9c337a93812b187db841d71052bc1f78910c178f7b1338f2315756" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q2_K_L.gguf", + "size": 2217558016, + "blob_id": "d8410777d0efe889100a68583087d06dd8183a12", + "lfs_sha256": "54a00a30f18ff3790b0767e6e12700cdd5f500c53820a847f62b61d39bc3ef43" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q3_K_L.gguf", + "size": 2537261056, + "blob_id": "81ddc81ea1cd6ff28c0905b20f445cde9d07ef49", + "lfs_sha256": "b50ee50b21cd65b63480d9e31211fc7465803e05447f5cee37c47bf6af572c9a" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q3_K_M.gguf", + "size": 2447476736, + "blob_id": "4151f683f7ca190eb3f306264af8088e5c24a41b", + "lfs_sha256": "8e9286b1c28634afe4e3b4b0ae941c2568254b3d94562d8f4ce4faa3f92de24d" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q3_K_S.gguf", + "size": 2326071296, + "blob_id": "b95bfd829b4c1c17282c2cfc446ccb5e0ea6370b", + "lfs_sha256": "187c8988b0d2d9c6993af06b2eb7f09fe9511979d388aa7108ce25bde9300e2f" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q3_K_XL.gguf", + "size": 2691219456, + "blob_id": "c38f3f1d4486fff85f55c2fe08c421412146a23a", + "lfs_sha256": "8dba7a54a6d50297dea858d48e43157d740b154d25b4ff6f0b8333e4ce530ea2" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_0.gguf", + "size": 2647853056, + "blob_id": "257cacb9f975b3791d20425cdbd996fb55069e95", + "lfs_sha256": "f7e2446e4182b0b9074d4a22cf1e46a83cd950f26d0db38590017543bd23fe9f" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_1.gguf", + "size": 2851670016, + "blob_id": "c195f8e8c14920db79c5d97afb22fdd88f91e590", + "lfs_sha256": "71d1fedca2d4f558cfe879d903988fee42baa9c0463c3473a85756d5b74e304d" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_K_L.gguf", + "size": 3038806016, + "blob_id": "dc74561ff4675df02316d1d216f9f16e6862120a", + "lfs_sha256": "63b209a71ac4c2a23f1ef68e8e7ce71b03fa8d8b10f26deb9adaf73ca2275b02" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_K_M.gguf", + "size": 2884847616, + "blob_id": "00f5a7a90b85707aa2e310067c0a2f35569df128", + "lfs_sha256": "b18d3aa8f3ca8239515838e80d815cd6d2d4221255c4f1db13d804d5a0cf3a2a" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_K_S.gguf", + "size": 2717976576, + "blob_id": "2130c938471ca660370fcdbe7b5c0cddc674dcbe", + "lfs_sha256": "c1a2a9d5ff82135a9699f57f3bf0c84d1996bb1eff4268373fe16cb4a256b7de" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q5_K_L.gguf", + "size": 3469541376, + "blob_id": "b0af7dfa024ba1bc3c1e49c88d23c2c6188847d7", + "lfs_sha256": "36d439943ddfd2242491d5b763b2d7a01cfdad4c06a015c69784a680d54e56ab" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q5_K_M.gguf", + "size": 3315582976, + "blob_id": "cf4cb9ea707065a8ce67ba61cc509a2804035747", + "lfs_sha256": "9cc15cb014245cd19273d766a5745f87a9087f54e78f57ecdc7e92b8bf1487af" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q5_K_S.gguf", + "size": 3128231936, + "blob_id": "c065ee95c6ae4b94fd2e96511fa7efa26742a77b", + "lfs_sha256": "95543271ffa2ed21298183b8b493f3814bd95b6ee9de58cee6fbe185bfd4c58c" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q6_K.gguf", + "size": 3677177856, + "blob_id": "d203a117f7c800ae7b923a425d1b61a38c44892d", + "lfs_sha256": "247c8d61f01c82f5468169f9f3bb832121626351f954d65cc76f146893745606" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q6_K_L.gguf", + "size": 3831136256, + "blob_id": "595a70660f7b7ce5940d49cd5c137741d91f8699", + "lfs_sha256": "809f2465c330d44b6c9fd609ea63aa7a683c4782893a41b6feda760e68e78f60" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-Q8_0.gguf", + "size": 4493950976, + "blob_id": "13f084bd493017558f5755c8cb2ca56823c371d2", + "lfs_sha256": "6283a7041646eab8cddec26ead89f84ef7badb34cdcecb02299ea27d59ad7a85" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-bf16.gguf", + "size": 8424390400, + "blob_id": "eb8755f41b8cb129505b6646ebc08afa7708502e", + "lfs_sha256": "ec1f125483930cde203cfe318297d40ad9512c52491932a7c0d64557be948f29" + }, + { + "rfilename": "Jackrong_Qwen3.5-4B-Neo-imatrix.gguf", + "size": 3626496, + "blob_id": "4839210600cefeb7a177bdb048b143baed68db23", + "lfs_sha256": "eef6a861b82a29fe0fa686c0bae29917dc96f30e6a3f28ec8db436d457169a55" + }, + { + "rfilename": "mmproj-Jackrong_Qwen3.5-4B-Neo-bf16.gguf", + "size": 675569824, + "blob_id": "ae2b2903be94c04679a3377fd0ff86b73c64f447", + "lfs_sha256": "b20af89d1fecfa4301989b33b8b5abd38ffb5003fc5b0e5b31e89313eced58bd" + }, + { + "rfilename": "mmproj-Jackrong_Qwen3.5-4B-Neo-f16.gguf", + "size": 672424096, + "blob_id": "3d9a8a9b5cfa13c1abcf84ad66cd651d179f6c8f", + "lfs_sha256": "19a8f418c003b9ab141d09bb2e0479f0f6a98a152970297d5dfaa18a1cbe771c" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__Muse-Glimmer-30B-GGUF.json b/bpw/hf/repo-metadata/bartowski__Muse-Glimmer-30B-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..07e2e94d19e19663f4045f4bbf2bdccfdc8a2ed8 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__Muse-Glimmer-30B-GGUF.json @@ -0,0 +1,216 @@ +{ + "repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "requested_repo_id": "bartowski/Muse-Glimmer-30B-GGUF", + "commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857", + "gguf": { + "total": 27854794240, + "architecture": "muse-glimmer", + "context_length": 131072, + "quantize_imatrix_file": "/models_out/Muse-Glimmer-30B-GGUF/Muse-Glimmer-30B-imatrix.gguf", + "chat_template": "{%- macro render_content(content) -%}{%- if content is string -%}{{- content -}}{%- elif content is not none -%}{%- for part in content -%}{%- if part['type'] == 'image' -%}{{- '<|patch|>' -}}{%- elif part['type'] == 'video' -%}{{- '<|video|>' -}}{%- elif part['type'] == 'text' -%}{{- part['text'] -}}{%- endif -%}{%- endfor -%}{%- endif -%}{%- endmacro -%}{%- macro render_atem(tc) -%}{%- set args = tc.function.arguments -%}{%- if args is not mapping -%}{{- raise_exception('Onyx ATEM chat template requires tool_call.function.arguments to be a dict (mapping); a JSON string cannot be parsed in the HF jinja sandbox.') -}}{%- endif -%}{{- '\\n\\n' -}}{%- for k, v in args.items() -%}{{- '' -}}{%- if v is boolean -%}{%- if v -%}true{%- else -%}false{%- endif -%}{%- elif v is none -%}null{%- elif v is mapping or (v is iterable and v is not string) -%}{{- v | tojson -}}{%- else -%}{{- v -}}{%- endif -%}{{- '\\n' -}}{%- endfor -%}{{- '\\n' -}}{%- endmacro -%}{%- macro render_tool_defs(tools) -%}{{- 'In this environment you have access to a set of tools you can use to answer the user\\'s question.\\n\\n' -}}{{- 'You can invoke a function by writing a \"\" block like the following:\\n' -}}{{- '\\n\\n$PARAMETER_VALUE\\n...\\n\\n\\n\\n' -}}{{- 'String and scalar parameters should be specified as is, while lists and objects should use JSON format. Note that spaces for string values are not stripped. The output is not expected to be valid XML and is parsed with regular expressions.\\n' -}}{{- 'Here are the functions available in JSONSchema format:\\n' -}}{{- '// Tool metadata\\n' -}}{%- set nsns = namespace(seen=[]) -%}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{%- set tns = fn.name.split('.')[0] -%}{%- if tns not in nsns.seen -%}{%- set nsns.seen = nsns.seen + [tns] -%}{%- endif -%}{%- endfor -%}{%- set nd = tool_namespace_descriptions if tool_namespace_descriptions is defined else {} -%}{%- for tns in nsns.seen -%}{{- '{\"name\": ' + (tns | tojson) + ', \"description\": ' + ((nd[tns] if tns in nd else '') | tojson) + '}\\n' -}}{%- endfor -%}{{- '// Function schemas' -}}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{{- '\\n{\"name\": ' + (fn.name | tojson) + ', \"description\": ' + (fn.description | tojson) + ', \"parameters\": ' + (fn.parameters | tojson) + '}' -}}{%- endfor -%}{{- '\\n\\nHere\\'s an example of how to call a function in the tool set:\\n' -}}{{- '(If the tool namespace is not specified, invoke the function directly as `example_function_name` rather than `example_tool_name.example_function_name`)\\n\\n' -}}{{- 'to=example_tool_name.example_function_name\\n\\n' -}}{{- '\\n\\n' -}}{{- 'value_1\\n' -}}{{- 'This is the value for the second parameter\\nthat can span\\n\"multiple\" lines\\n\\n' -}}{{- '\\n' -}}{%- endmacro -%}{%- macro render_reasoning() -%}{%- set rs = reasoning_strength if reasoning_strength is defined and reasoning_strength else 'high' -%}{{- 'Reasoning strength: ' + rs + '.' -}}{%- endmacro -%}{%- macro render_system_meta(tools) -%}{%- set rns = namespace(recipients=['\"self\"'], nslist=[]) -%}{%- if tools -%}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{%- set tns = fn.name.split('.')[0] -%}{%- if tns not in rns.nslist -%}{%- set rns.nslist = rns.nslist + [tns] -%}{%- endif -%}{%- endfor -%}{%- for tns in rns.nslist -%}{%- set rns.recipients = rns.recipients + ['\"' + tns + '.*\"'] -%}{%- endfor -%}{%- endif -%}{%- set rns.recipients = rns.recipients + ['\"user\"'] -%}{{- '# Valid recipients: ' + rns.recipients | join(', ') + '.' -}}{%- endmacro -%}{{- bos_token -}}{%- set ns = namespace(has_system=false) -%}{%- for m in messages -%}{%- if m['role'] == 'system' -%}{%- set ns.has_system = true -%}{%- endif -%}{%- endfor -%}{%- if not ns.has_system -%}{{- '<|start|>system<|message|>You are a helpful AI assistant.' -}}{%- set kc = knowledge_cutoff if knowledge_cutoff is defined and knowledge_cutoff else '2026-01-04' -%}{{- '\\nKnowledge cutoff: ' + kc + '.' -}}{%- if current_date is defined and current_date -%}{{- '\\nCurrent date: ' + current_date + '.' -}}{%- elif strftime_now is defined -%}{{- '\\nCurrent date: ' + strftime_now('%Y-%m-%d') + '.' -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_reasoning() -}}{%- if tools -%}{{- '\\n\\n' -}}{{- render_tool_defs(tools) -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_system_meta(tools) -}}{{- '<|eot|>' -}}{%- endif -%}{%- for message in messages -%}{%- set role = message['role'] -%}{%- set end_token = '<|eom|>' if (not loop.last and messages[loop.index0 + 1]['role'] == role) else '<|eot|>' -%}{%- if role == 'system' -%}{{- '<|start|>system<|message|>' -}}{{- render_content(message['content']) -}}{{- '\\n\\n' -}}{{- render_reasoning() -}}{%- if tools -%}{{- '\\n\\n' -}}{{- render_tool_defs(tools) -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_system_meta(tools) -}}{{- '<|eot|>' -}}{%- elif role == 'user' -%}{{- '<|start|>user<|message|>' -}}{{- render_content(message['content']) -}}{{- '<|eot|>' -}}{%- elif role == 'tool' -%}{%- set tname = message.get('name') -%}{%- if not tname -%}{%- set tcid = message.get('tool_call_id') -%}{%- set rns = namespace(name=tcid if tcid else '') -%}{%- for m in messages -%}{%- if m.get('tool_calls') -%}{%- for tc in m['tool_calls'] -%}{%- if tcid is not none and tc.id is defined and tc.id == tcid -%}{%- set rns.name = tc.function.name -%}{%- endif -%}{%- endfor -%}{%- endif -%}{%- endfor -%}{%- set tname = rns.name -%}{%- endif -%}{{- '<|start|>tool ' + tname + '<|message|>\\n' -}}{{- render_content(message['content']) -}}{{- '\\n<|eot|>' -}}{%- elif role == 'assistant' -%}{%- if message.get('reasoning_content') -%}{{- '<|start|>assistant to=self<|message|>' + message['reasoning_content'] + '<|eom|>' -}}{%- endif -%}{%- if message.get('tool_calls') -%}{%- for tc in message['tool_calls'] -%}{{- '<|start|>assistant to=' + tc.function.name + '<|message|>' -}}{{- render_atem(tc) -}}{%- if loop.last -%}{{- end_token -}}{%- else -%}{{- '<|eom|>' -}}{%- endif -%}{%- endfor -%}{%- else -%}{%- set recipient = message.get('recipient') or 'user' -%}{%- set end_turn = message.get('end_turn') -%}{%- if end_turn is none -%}{%- set end_turn = not (recipient and recipient != 'user') -%}{%- endif -%}{{- '<|start|>assistant' -}}{%- if recipient -%}{{- ' to=' + recipient -}}{%- endif -%}{{- '<|message|>' -}}{{- render_content(message['content']) -}}{{- ('<|eot|>' if end_turn else '<|eom|>') -}}{%- endif -%}{%- endif -%}{%- endfor -%}{%- if add_generation_prompt -%}{{- '<|start|>assistant' -}}{%- endif -%}", + "bos_token": "<|begin_of_text|>", + "eos_token": "<|end_of_text|>", + "totalFileSize": 10657479200 + }, + "fetched_at_utc": "2026-09-06T11:32:08.050208+00:00", + "siblings": [ + { + "rfilename": "Muse-Glimmer-30B-IQ2_M.gguf", + "size": 10657479200, + "blob_id": "c72e654763800ac1bfd1bec4d6ecf153c18bce75", + "lfs_sha256": "67a24245fb600a01668163b7afb5287c0413eff21f326b482da45b8fa0727e7d" + }, + { + "rfilename": "Muse-Glimmer-30B-IQ2_S.gguf", + "size": 10040015392, + "blob_id": "457a940e88218e0d5a74c9d56ee2ab353176d2cb", + "lfs_sha256": "0b90658c21b28cecc6ae636e605e63f0128c0d9767d8f6fc6a38e30263d8b50b" + }, + { + "rfilename": "Muse-Glimmer-30B-IQ2_XS.gguf", + "size": 9582585120, + "blob_id": "426f81c4b90f2c6ad4cddbc8c669f9e2cbdeef74", + "lfs_sha256": "8091b165a8b55a1480ba1bf28488046d9de09e774c6a8a5c538773a073f64eaf" + }, + { + "rfilename": "Muse-Glimmer-30B-IQ2_XXS.gguf", + "size": 8920818976, + "blob_id": "900492424729b378904c4864b08b0233a061b54e", + "lfs_sha256": "88c81796351de47a21c67c8089c2a2111e160a96da8266b413d4fc8afbad89d8" + }, + { + "rfilename": "Muse-Glimmer-30B-IQ3_M.gguf", + "size": 13106238240, + "blob_id": "6c6eaaccd3f8ae7554d70225860d1cb0d1911fb5", + "lfs_sha256": "bc867ee4fc139be474cc4e6c1794ac584507ec510bcfdefe9772a61779181b6f" + }, + { + "rfilename": "Muse-Glimmer-30B-IQ3_XS.gguf", + "size": 12315026208, + "blob_id": "7af768df430987f39299c8cb0929c54f3f884cbb", + "lfs_sha256": "35b02cd38f9b34ec6f8caa0f7e0b78ba6f58c876276bfeceebef84fb2d460b87" + }, + { + "rfilename": "Muse-Glimmer-30B-IQ3_XXS.gguf", + "size": 11546640928, + "blob_id": "4a57b788f53d158ef650dc6502cadd145918393f", + "lfs_sha256": "bc489d8df5a3bdf85ef200bd1dcec9a436290502354810163549cac328dac90a" + }, + { + "rfilename": "Muse-Glimmer-30B-IQ4_NL.gguf", + "size": 16238568480, + "blob_id": "004cc26a3f95b102410e68e9f3bd3614200b9840", + "lfs_sha256": "8ccfdf140472a18928bb867e05f69c215fb7eb6e9c16a212b0ffa76f2eb023e0" + }, + { + "rfilename": "Muse-Glimmer-30B-IQ4_XS.gguf", + "size": 15435096096, + "blob_id": "44059ee0d61eb3548930e61fdaa6d4e4dc72b64e", + "lfs_sha256": "b3c03d94c007ae487fd5259b340ad23286190b62b0d4d452f06bc1cf8840a7da" + }, + { + "rfilename": "Muse-Glimmer-30B-Q2_K.gguf", + "size": 11035579936, + "blob_id": "667837639e93746fb13a21ac5a507498de31debd", + "lfs_sha256": "af4b15f0f3268d23e0f48f796a4ab563454b9cf8bab60d2bbe251b314b342fb5" + }, + { + "rfilename": "Muse-Glimmer-30B-Q2_K_L.gguf", + "size": 12348891936, + "blob_id": "f272bd029b2779d4f50defa0c7b8725d723683c1", + "lfs_sha256": "b4abbaaa9d582bc1a75f63b73c04ce51db03a9016c22ddc7b1402350c44e1f55" + }, + { + "rfilename": "Muse-Glimmer-30B-Q3_K_L.gguf", + "size": 14782112544, + "blob_id": "8792888b4b7699c268bf404fb8b77b8840c8f706", + "lfs_sha256": "43a26da94c1df72d5fd2f6edf9136c06b0acdc43a86fa5acfaf2b220c45c9916" + }, + { + "rfilename": "Muse-Glimmer-30B-Q3_K_M.gguf", + "size": 13962519328, + "blob_id": "c0cde285705e9ef9a574224933ed558ad443763b", + "lfs_sha256": "de551709c7977735a4012323b82ba34a5756127c6b03a730753a37a318f02872" + }, + { + "rfilename": "Muse-Glimmer-30B-Q3_K_S.gguf", + "size": 12789199648, + "blob_id": "4850823591d759ff48e07ff79a91ae5a7899269d", + "lfs_sha256": "1466205e255af9f7d13eecc4a9d392e7a674d03ee19f60640d56dee76e2460e7" + }, + { + "rfilename": "Muse-Glimmer-30B-Q3_K_XL.gguf", + "size": 15958840096, + "blob_id": "ad7d98a834ee8d105ffb123b5e7a41bf2cb2162f", + "lfs_sha256": "b747e9b261591bc2e4dfef216c9c27333d730e8cf58902f45362934fff1bf12d" + }, + { + "rfilename": "Muse-Glimmer-30B-Q4_0.gguf", + "size": 16265565216, + "blob_id": "bc9a7c091e24d8c749d16fb865d3b9975c42ab08", + "lfs_sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999" + }, + { + "rfilename": "Muse-Glimmer-30B-Q4_1.gguf", + "size": 17828207648, + "blob_id": "3e7362eaec8b4f850e870d57d74bf15033e9d335", + "lfs_sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4" + }, + { + "rfilename": "Muse-Glimmer-30B-Q4_K_L.gguf", + "size": 18304441120, + "blob_id": "5c6a20ca176190ab4d6c95382d62aabd5ec212c0", + "lfs_sha256": "c4f08081d05e0fabc5e48b3309998a73b0dfb811765d960b540926e3ab411f4b" + }, + { + "rfilename": "Muse-Glimmer-30B-Q4_K_M.gguf", + "size": 17306324000, + "blob_id": "e1a6606b0213fddd4469cf461e9e404ae4b8c608", + "lfs_sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384" + }, + { + "rfilename": "Muse-Glimmer-30B-Q4_K_S.gguf", + "size": 16320943136, + "blob_id": "6104f8008f85a28c64e7a9e411c62e6e4289c1fb", + "lfs_sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde" + }, + { + "rfilename": "Muse-Glimmer-30B-Q5_K_L.gguf", + "size": 20935584544, + "blob_id": "5bfdfcaff7c52e320b1d5c410052f3c415602894", + "lfs_sha256": "9c46396848f82de76cd5b45ca052d218d20e0c56fb1e47db8243e58bf38d20f1" + }, + { + "rfilename": "Muse-Glimmer-30B-Q5_K_M.gguf", + "size": 20105571360, + "blob_id": "81ee88014a21df961d903a96a1619d1f361c4abb", + "lfs_sha256": "ab27b43f9c6af4a0fbb3359aba06b030837526a3e24fd24a64468040e196ecb2" + }, + { + "rfilename": "Muse-Glimmer-30B-Q5_K_S.gguf", + "size": 19440690208, + "blob_id": "d66f9e5ea42c0c9203c926240bb92d11b58ca35a", + "lfs_sha256": "0c89eb14e704832ae8ce9e992e563de794f0700de3a2c8a50d2918a851581452" + }, + { + "rfilename": "Muse-Glimmer-30B-Q6_K.gguf", + "size": 23414418720, + "blob_id": "fdac8ae400ea37aad405f5e47b55d0f3a54bdc8b", + "lfs_sha256": "7746e3dafcece07236a3826c8c3ee149a682d6f7fc9f0da9e24a4e481ccdb0bc" + }, + { + "rfilename": "Muse-Glimmer-30B-Q6_K_L.gguf", + "size": 24065821472, + "blob_id": "5c98b76678b4c13f9c9994ee35922cc2bda14cb1", + "lfs_sha256": "7e799aa9fec19af01161bb06bd7907db54d11f482ca1ab7f72a2d022cf3ccf87" + }, + { + "rfilename": "Muse-Glimmer-30B-Q8_0.gguf", + "size": 29612958496, + "blob_id": "957a65cf104f13e3505f3508c70ed5dcaf8da69f", + "lfs_sha256": "5425d1755c977c103c9134dc182f63e2eaa12365d90f59bc7f1c12f9d7e7307d" + }, + { + "rfilename": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf", + "size": 39750446272, + "blob_id": "4490005af495ff3d816b93c401c12d8339d0d4d7", + "lfs_sha256": "bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860" + }, + { + "rfilename": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf", + "size": 15975065088, + "blob_id": "ed596016d8debaaa1bda34b640b3d36d6e105915", + "lfs_sha256": "e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16" + }, + { + "rfilename": "Muse-Glimmer-30B-imatrix.gguf", + "size": 13376128, + "blob_id": "14467ee380f945134da3192e098f9aae2bc8e356", + "lfs_sha256": "31c5d105b701a3c4db9ac1f597a9aa93d58107184df6d3a2f9d369e054ff7dfd" + }, + { + "rfilename": "dflash-Muse-Glimmer-30B-Q4_0.gguf", + "size": 1451094176, + "blob_id": "d64aa9f86c81b79a198419dcdb27a5cb575e0494", + "lfs_sha256": "5815f3918ba4ef81f0c32cdd49fea04c141919245eac22ba028bec57ed198ba3" + }, + { + "rfilename": "dflash-Muse-Glimmer-30B-Q8_0.gguf", + "size": 2729046176, + "blob_id": "413c70ecaef4cb993c7bf91c3720293402fb1804", + "lfs_sha256": "787e0708e439f0caa8e6caaafa5f0fec38e112766c150f313ac074e5cab087fc" + }, + { + "rfilename": "mmproj-Muse-Glimmer-30B-bf16.gguf", + "size": 3849173920, + "blob_id": "2f6540ba0c2190e920357267b1f96e0fd0be1b22", + "lfs_sha256": "3727a47650ae65be12e91aae49f9b9f4bef09dc6c401a54ca1bd3d1a6160f35a" + }, + { + "rfilename": "mmproj-Muse-Glimmer-30B-f16.gguf", + "size": 3847367584, + "blob_id": "bd107f5c5bb65701e4c35bde87620702efaf5a69", + "lfs_sha256": "b94be96afc13120bf0636728b75ad568bb4eba5b2096438b009ed032d8cef4ea" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__OpenGVLab_InternVL3_5-30B-A3B-GGUF.json b/bpw/hf/repo-metadata/bartowski__OpenGVLab_InternVL3_5-30B-A3B-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..f36d6a3b7e00b2615e4955e4c6c15589c4d17d27 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__OpenGVLab_InternVL3_5-30B-A3B-GGUF.json @@ -0,0 +1,203 @@ +{ + "repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "requested_repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF", + "commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9", + "gguf": { + "total": 30532122624, + "architecture": "qwen3moe", + "context_length": 40960, + "quantize_imatrix_file": "/models_out/InternVL3_5-30B-A3B-GGUF/OpenGVLab_InternVL3_5-30B-A3B-imatrix.gguf", + "chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n'}}{% if message['content'] is string %}{{ message['content'] }}{% else %}{% for content in message['content'] %}{% if content['type'] == 'image' %}{{ '\n' }}{% elif content['type'] == 'video' %}{{ '' in content %}\n {%- set reasoning_content = content.split('')[0].rstrip('\\n').split('')[-1].lstrip('\\n') %}\n {%- set content = content.split('')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if loop.index0 > ns.last_query_index %}\n {{- '<|im_start|>' + message.role + '\\n\\n' + reasoning_content + '\\n\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n\\n\\n' }}\n {%- else %}\n {{- '\\n\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n\\n\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '\\n' }}\n {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}\n {{- args_value }}\n {{- '\\n\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n\\n' }}\n {{- content }}\n {{- '\\n' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '\\n\\n\\n\\n' }}\n {%- else %}\n {{- '\\n' }}\n {%- endif %}\n{%- endif %}", + "eos_token": "<|im_end|>", + "totalFileSize": 8665620192 + }, + "fetched_at_utc": "2026-09-06T11:32:08.101620+00:00", + "siblings": [ + { + "rfilename": "Qwen_Qwen3.5-4B-IQ2_M.gguf", + "size": 1953751008, + "blob_id": "5ac8b231fc2e229598023aac244c7d8004780251", + "lfs_sha256": "fd6c12b5d4f76be174edbf4769d2a27b0384da020f5cf1241463679798a9f4ec" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-IQ3_M.gguf", + "size": 2483333088, + "blob_id": "b6a045aa6bb1775aee9d0e3418e8ba10b6596d0a", + "lfs_sha256": "5ad76abae6b7a27d1463d90e6d86886850769e34906a88cfa4347cae72c91502" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-IQ3_XS.gguf", + "size": 2403952608, + "blob_id": "fff451e8c441278493bdf2e3c76f8146e7bdfa71", + "lfs_sha256": "ecb30836d260d1e44f09edd2d814c473637ba12345ab474c6cde07af3b84b9be" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-IQ3_XXS.gguf", + "size": 2243829728, + "blob_id": "73c0e5bc86f45870ca63eff6b2ce9d7b0e662309", + "lfs_sha256": "37046243577d6b44e98137680623b807ae92b147982a91d5726e4c0c64e7508e" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-IQ4_NL.gguf", + "size": 2775541728, + "blob_id": "9285a1a5c8d67ec0cf441eca566849fb2a015a7d", + "lfs_sha256": "f007c3dbf67df668354d37ae13d87fd5789059704977959187e8342aec03b66f" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-IQ4_XS.gguf", + "size": 2671339488, + "blob_id": "4031fca06038aa3d7e413f687754e81bdf101ee2", + "lfs_sha256": "628124c61a806897d3f28dcd416be6daff94f62f731eb900d4381875eac9e412" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q2_K.gguf", + "size": 2191779808, + "blob_id": "c2be0339e3fc0da3594849d18ecfa4d62ccc701f", + "lfs_sha256": "8875934081d3b9b51b41de628e34d964a15d3fac5b5592baf2c01c5a04460c9a" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q2_K_L.gguf", + "size": 2345738208, + "blob_id": "7531f8e7fbbbe4b104f88e26f645a2edc0bcd128", + "lfs_sha256": "63d3cbc85cb8531175566c006970974d992943888da55a1c83aa76c05137d93d" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q3_K_L.gguf", + "size": 2665441248, + "blob_id": "0dcc41bcdd29c05efa9b9c7401a5b466606cf7c9", + "lfs_sha256": "41c3f1bf47e477693dab332e73347c7138d5e9fbfe74c6d2eaba590be1f3d20a" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q3_K_M.gguf", + "size": 2575656928, + "blob_id": "56b374ea519cfe45918a6a47685e09b1c47ab156", + "lfs_sha256": "049c71be191fb980a2851ee4d141f437feb50f001191e9b51bd4f6ab2b04146a" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q3_K_S.gguf", + "size": 2454251488, + "blob_id": "4fdb07fac2d7b827ecf326c1f2bed5995b20f6b3", + "lfs_sha256": "b4fd1933335ebefeb0cc3fde07a439485f3d5b16a21c25e1b9afdaa165492017" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q3_K_XL.gguf", + "size": 2819399648, + "blob_id": "067dfd358da779b20f7695f9af8b13cbacc9bc93", + "lfs_sha256": "f124b26768806bdfda0ff97d0f6c27c3fa489e0fcedc439927256baf74d40a33" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q4_0.gguf", + "size": 2776033248, + "blob_id": "d99923baae4377dfacde1835903f5f6a030758a3", + "lfs_sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q4_1.gguf", + "size": 2979850208, + "blob_id": "257cc1a56f0656265b91426b76c885181ad1ddfd", + "lfs_sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q4_K_L.gguf", + "size": 3166986208, + "blob_id": "57fef4c809f96737105a2b658d81eac27db8ebf6", + "lfs_sha256": "2986654fa857ff6c7a0ebe8957e11c1a376b43be9d3bd905285d778342da22b8" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q4_K_M.gguf", + "size": 3013027808, + "blob_id": "a859bab891c07bf7d86a7833bfe00db732b8e44e", + "lfs_sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q4_K_S.gguf", + "size": 2846156768, + "blob_id": "465792bff758fc83c337bc828cdcc830a7e5de5a", + "lfs_sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q5_K_L.gguf", + "size": 3597721568, + "blob_id": "09706ab4ae39d49041eebf966862fcf2b1070888", + "lfs_sha256": "4e10523c570b7f5c680a7e74c61a19b82c7546c88bb3ec5fcc525d03bc345551" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q5_K_M.gguf", + "size": 3443763168, + "blob_id": "0a9c2c4f528e512dd29ad5fb17de606d6bb7a19c", + "lfs_sha256": "21c4643259ce62ffd979848e5819ce03823fd9e9902279ab54cc0d572d83d33e" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q5_K_S.gguf", + "size": 3256412128, + "blob_id": "e6d75ff3839ae44aa2d1ca46362f5aa835546007", + "lfs_sha256": "e4b59fdb8cd1dedb2591dc4eb368b63cb8c321447ff9512e33b7d42fd3f35e12" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q6_K.gguf", + "size": 3805358048, + "blob_id": "0086804cdf3afbd8d28ba7f2be6e425d99d55ead", + "lfs_sha256": "5a5bc7a3f9375b395e9f81fb69109038cf160c84606b8192f13cbb8355ca59f2" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q6_K_L.gguf", + "size": 3959316448, + "blob_id": "6e6e2c33cae01f898a6ca758aee7ad1816389f79", + "lfs_sha256": "0d7931a7f143ccfdf675c0d84d542c387cd9255af94ee9c8fb5fa6f6df7c08a0" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-Q8_0.gguf", + "size": 4622131168, + "blob_id": "9136ee39b0abc864657ec4269e8708cb6840f47a", + "lfs_sha256": "5c74c0ede371924357dff0cb6ba145bd67208b9b2389ded681adfff3f7608db7" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-bf16.gguf", + "size": 8665620192, + "blob_id": "27404ded60603d64482251716890d3ab148c425c", + "lfs_sha256": "714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5" + }, + { + "rfilename": "Qwen_Qwen3.5-4B-imatrix.gguf", + "size": 3626496, + "blob_id": "2dde414d2c7c8fe214e9952c5dc74f6757e325e2", + "lfs_sha256": "f1dba8ed29370cd5a8c0ba9438edb130f9895599a0b1a657c939d27a12c41b6b" + }, + { + "rfilename": "mmproj-Qwen_Qwen3.5-4B-bf16.gguf", + "size": 675569216, + "blob_id": "9b2d24bf8b97401ca4e63ef46fe52c59dac727ce", + "lfs_sha256": "463f39bd1c291c1186c319a8c90ff8640aafa678b14cbee2232d695113dfbb66" + }, + { + "rfilename": "mmproj-Qwen_Qwen3.5-4B-f16.gguf", + "size": 672423488, + "blob_id": "dd8cfac5ccb0ad91bdc09b9fa2fbf7d1566757c1", + "lfs_sha256": "659b59dd44b73b1cd34af6cc424669484b06dc80f4340adf8ea84ad776eef813" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.6-35B-A3B-GGUF.json b/bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.6-35B-A3B-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..bdcc1d3e055664b8852a0608c40fe078d9c22965 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.6-35B-A3B-GGUF.json @@ -0,0 +1,222 @@ +{ + "repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "requested_repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF", + "commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f", + "gguf": { + "total": 35505251456, + "architecture": "qwen35moe", + "context_length": 262144, + "quantize_imatrix_file": "/models_out/Qwen3.6-35B-A3B-GGUF/Qwen_Qwen3.6-35B-A3B-imatrix.gguf", + "chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n\\n\\n\\nvalue_1\\n\\n\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n\\n\\n\\n\\n\\nReminder:\\n- Function calls MUST follow the specified format: an inner block must be nested within XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {{- '<|im_start|>system\\n' + content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('') and content.endswith('')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '' in content %}\n {%- set reasoning_content = content.split('')[0].rstrip('\\n').split('')[-1].lstrip('\\n') %}\n {%- set content = content.split('')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if (preserve_thinking is defined and preserve_thinking is true) or (loop.index0 > ns.last_query_index) %}\n {{- '<|im_start|>' + message.role + '\\n\\n' + reasoning_content + '\\n\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n\\n\\n' }}\n {%- else %}\n {{- '\\n\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n\\n\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '\\n' }}\n {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n {{- args_value }}\n {{- '\\n\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n\\n' }}\n {{- content }}\n {{- '\\n' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '\\n\\n\\n\\n' }}\n {%- else %}\n {{- '\\n' }}\n {%- endif %}\n{%- endif %}", + "bos_token": "<|endoftext|>", + "eos_token": "<|im_end|>", + "totalFileSize": 9421649536 + }, + "fetched_at_utc": "2026-09-06T11:32:08.141765+00:00", + "siblings": [ + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ1_M.gguf", + "size": 9421649536, + "blob_id": "df06a2b9b24ea318ce320f6a196f4e1523e51bb1", + "lfs_sha256": "d291e12a0f693b5f14c11bb1278ba43b432b2b6f6c33c7fdaf750c214ff83f28" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ2_M.gguf", + "size": 12964402816, + "blob_id": "dcf94ea0bdc1654154e52cf1e4aa77ca74c9df95", + "lfs_sha256": "faae766ad5d1e09551a0f4deff9a3e8aa49618515d10e9fcae79f4e96ad4c178" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ2_S.gguf", + "size": 11907962496, + "blob_id": "0e987b392608afe82ad2776e6db3f63febb832ec", + "lfs_sha256": "52ac86b61423aff6721d59586ddc16f87983c5b3719c2a26c3bdbf403544f775" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ2_XS.gguf", + "size": 11694831232, + "blob_id": "3270834343c29a419aabf1a769c77cc188be78b2", + "lfs_sha256": "a873df6cd354f49c87d4ab0382d5301b3fe9bb16ba68577a70efe6a57a2bd23d" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ2_XXS.gguf", + "size": 10676139648, + "blob_id": "2e0031e3ffe1a02da28634a9b560c861bf57a4d0", + "lfs_sha256": "aa4a46af613699d81841505974c91c877139c713e9e1f25b7708471e0542e85b" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ3_M.gguf", + "size": 17791661696, + "blob_id": "edc3527243babea8d9f3ba5260bf66841cd05bcc", + "lfs_sha256": "aedaa7010e09065d3a4129a624e45804ccfa1950838e67ee935b87d1e71a3d1f" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ3_XS.gguf", + "size": 17110087296, + "blob_id": "3e3af5d1498870eb990190848db2228b7fe8ff5d", + "lfs_sha256": "815607fc5ce720f30552d6aa901633629560daaeb76dc14ddaab3c14628559e7" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ3_XXS.gguf", + "size": 15761446528, + "blob_id": "9c4723661ce00454cc73ba2149769f1612398a9e", + "lfs_sha256": "4eb30af2df0dde76fe8d0a60f0e88f285ee668dcb1b8da892ee5c13dd6b00399" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ4_NL.gguf", + "size": 20754978432, + "blob_id": "918483ba768e3828b6c5132051b523dd0f683922", + "lfs_sha256": "41e9f836690bde9619928538cb4dd170472d2e851243637f7092937a151297ad" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf", + "size": 19699553920, + "blob_id": "d9bd471618a7e5ab71afbb724ade44d3c13b5c10", + "lfs_sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q2_K.gguf", + "size": 13506778752, + "blob_id": "748b7939129a30f2954e584ff1db280c345b631f", + "lfs_sha256": "673142cca6255bbb19774c8d438220d9ecfc3c8b215bc619d5e801bc37a35405" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q2_K_L.gguf", + "size": 14003418752, + "blob_id": "6fe6b88185ec167be8076012d4c11374e10e35d6", + "lfs_sha256": "bcecb058c4b349b2df86353ae16538b0787a5704cafe412a79600696ea9234ef" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q3_K_L.gguf", + "size": 17777899136, + "blob_id": "06f5c051fa5141dd6ca1ff455a35bbb58eff21c5", + "lfs_sha256": "8fecfc2c33a3f78f37cab7c1d1684c0ee28fa983058d68a8b3f36a440a0e9909" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q3_K_M.gguf", + "size": 17117951616, + "blob_id": "cc16fabf27b211a1071fc22ced86cb015fca9699", + "lfs_sha256": "17350b1355d32397cffe7d4b446fd9361dbb01aa26bbf41fc950aa595033794f" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q3_K_S.gguf", + "size": 16404919936, + "blob_id": "c63fa4616293414bfdfb74bdaa593240cf04c5ae", + "lfs_sha256": "699b1e56ee8e0975facc98c2a947c6a5a8c2874695e6fb8df8780dac19077417" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q3_K_XL.gguf", + "size": 18222888576, + "blob_id": "a838400391fb8fb833af0c408a222c56e80d30ff", + "lfs_sha256": "1451710903a99bfe99edb7b4de3f12ae80e0ef4d90cd6c64c774a4bde8b7f8ad" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_0.gguf", + "size": 20836243072, + "blob_id": "d6bb9941e090b86f70c9ed4454dfd0bd5d0dbf6f", + "lfs_sha256": "52312daa5b2190c1f5723d33c3315c01c55af4206f6c6e6eb63f3d8dd52bb85e" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_1.gguf", + "size": 22868448896, + "blob_id": "8ccb5cfedd72033119ed412a225b07739bc2b7c6", + "lfs_sha256": "8babe2c6f46b43815cae7ec2b970be8508d6867234ebf16c376bd9cc79477354" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf", + "size": 22662526592, + "blob_id": "a104ff60c09688ebc136afe3333cc718ef3f2ac6", + "lfs_sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf", + "size": 22285080192, + "blob_id": "575cec93b791a88843798d81530b0de25857dc33", + "lfs_sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf", + "size": 21486360192, + "blob_id": "77b8190905b0f4942290d9e29e59c159f98a1b54", + "lfs_sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q5_K_L.gguf", + "size": 26227062400, + "blob_id": "76db8b244e1ddbc5132d13b9eb9334ebf5199040", + "lfs_sha256": "8b062b51562496de4b228961afa8004850d30c80507e53ff48f91be318784526" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q5_K_M.gguf", + "size": 25913185920, + "blob_id": "42b5a8ef72dc5f03e4a42ca2f68ab9ebc4cdc808", + "lfs_sha256": "ec438d1326eb11d8bb94785c54739cd4b60b01ae32bd8532e232a046b19d296d" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q5_K_S.gguf", + "size": 25051879040, + "blob_id": "846a8b9ce9aa18c2ae2ec80b67e824da4eaa9769", + "lfs_sha256": "c2c80fca38e0a91709ac2365b77c69936f03d6305ad188ac206583db5826f3d0" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q6_K.gguf", + "size": 30947309184, + "blob_id": "65220376fbd5f713df654917e416589472cbb019", + "lfs_sha256": "a97ef79439194d8ec722bc0b6c316f0c41c0b477b35bbae8177c772ecbb0eb91" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q6_K_L.gguf", + "size": 31193642624, + "blob_id": "50b91c31cad31775a4c86d0942445011aa5d1961", + "lfs_sha256": "51c8ecf2867186ddba4e0441a5925663688c84539a0b3be04ba8131da888fec7" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-Q8_0.gguf", + "size": 37812647552, + "blob_id": "41cd2dfe70d9a74414589772f859b74484258e19", + "lfs_sha256": "bc57de096ec30e45773aa86103f35a8a32cea01f2193a53a3c636d618e4434e9" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf", + "size": 39753375712, + "blob_id": "404ec955102e16f240dbc43fab222e216e1da403", + "lfs_sha256": "dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf", + "size": 31312565824, + "blob_id": "7a1cfdb41ac0b7fc48d0e555625d215da31cfe74", + "lfs_sha256": "c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9" + }, + { + "rfilename": "Qwen_Qwen3.6-35B-A3B-imatrix.gguf", + "size": 192223904, + "blob_id": "8aa868be9ae936edefb10ece3ff2b54d54e23f0f", + "lfs_sha256": "e860d71bd40c83378a06da0407cd5cbfe61b9330784781a047f07a5348d8fd8c" + }, + { + "rfilename": "mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf", + "size": 902822240, + "blob_id": "d660b6c510a19e2f3aedfcebaae500fd48e08e49", + "lfs_sha256": "1c625f05cd52e90abc76a5f756226c3a5fe279593379c22f6c6846c970a0cd18" + }, + { + "rfilename": "mmproj-Qwen_Qwen3.6-35B-A3B-f16.gguf", + "size": 899283296, + "blob_id": "50314fc4bc2cd4ac50fb7b3220461794baf69f51", + "lfs_sha256": "67924785ff1885c2b34c15d0e52979e991acca64221694ba2cc3a6474a053fb4" + }, + { + "rfilename": "mtp-Qwen_Qwen3.6-35B-A3B-Q4_0.gguf", + "size": 1190098816, + "blob_id": "f1d75dd3206e780714c12ae1f21ad9ea0c31983a", + "lfs_sha256": "623351aeccfb9a26991ea6a7f0d24ef993a975fb2a508e4d95d3be1f72bf58da" + }, + { + "rfilename": "mtp-Qwen_Qwen3.6-35B-A3B-Q8_0.gguf", + "size": 1989597056, + "blob_id": "099483ad8d95dd187dd8550448008c32d3b537e5", + "lfs_sha256": "7f72d7cc4a9ff28cf0bd98a4e6e95e6869efa3b70c7244075376335f38109330" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__ReadyArt_gemma-4-31B-it-scotoma-2-GGUF.json b/bpw/hf/repo-metadata/bartowski__ReadyArt_gemma-4-31B-it-scotoma-2-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..cc9859c27f5b82364db1e6ca64098db934aadb89 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__ReadyArt_gemma-4-31B-it-scotoma-2-GGUF.json @@ -0,0 +1,204 @@ +{ + "repo_id": "bartowski/ReadyArt_gemma-4-31B-it-scotoma-2-GGUF", + "requested_repo_id": "bartowski/ReadyArt_gemma-4-31B-it-scotoma-2-GGUF", + "commit_sha": "1bd76301df1928dd66c7a97631f8c66ccf32238c", + "gguf": { + "total": 30697345596, + "architecture": "gemma4", + "context_length": 262144, + "quantize_imatrix_file": "/models_out/gemma-4-31B-it-scotoma-2-GGUF/ReadyArt_gemma-4-31B-it-scotoma-2-imatrix.gguf", + "chat_template": "{#\n Template: Google Gemma 4 Canonical Chat Template\n Author: Google Gemma Engineering Team\n Published: 2026-07-09\n Context: Fixed tool-calling loops, turn closures, and thinking content-ordering.\n#}\n{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- else -%}\n {{- raise_exception(\n \"chat_template: tool_calls[].function.arguments must be a \"\n \"JSON object (mapping), not a string. Deserialize arguments \"\n \"before passing to the template.\"\n ) -}}\n {%- endif -%}\n {{- '}' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- if not enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n", + "bos_token": "", + "eos_token": "", + "totalFileSize": 12649773728 + }, + "fetched_at_utc": "2026-09-06T11:32:08.147566+00:00", + "siblings": [ + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ2_M.gguf", + "size": 12649773728, + "blob_id": "d9bbd0d6b85629c8946329d1ac6c78a70462e105", + "lfs_sha256": "31915f04e69a374fbc2f1d42141cade4c088583f9d002125b298828e5d5718e5" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ2_S.gguf", + "size": 12075358880, + "blob_id": "67411fe453eb30b19390d9a404046658cb1848dc", + "lfs_sha256": "41b93854a1d55bf8bac9508eda31a70c3c66bcc1fda876d7172351f6a746efba" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ2_XS.gguf", + "size": 11500944032, + "blob_id": "d6bde02072814e4f44dc98561e7e7d6e07576946", + "lfs_sha256": "ba3f9880cc4201d0b3ba1abe55810c44d27a8bd8f4c3c54dec2e86eef7fc9d8d" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ2_XXS.gguf", + "size": 10830191264, + "blob_id": "2f496a2ac4c0542270ae1a49d805fe3789d1f73f", + "lfs_sha256": "a2db744d4d07860ea92e4bb1dd11fdac013f51c3f7f76bec431d7d5864269eed" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ3_M.gguf", + "size": 15129830048, + "blob_id": "400046813465603023eb69f3ce7069764f24b71b", + "lfs_sha256": "ca770223875f3586e9c9807195b665d05bfd67b932ef7a0d4d4b65b885a62bbf" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ3_XS.gguf", + "size": 13841353376, + "blob_id": "4dea4906068f6525ecf1a5fb9449d08b6e0d8624", + "lfs_sha256": "4c53708310445cccf3726cc5a89db69cbc985c0f105522a5892496057ff231f0" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ3_XXS.gguf", + "size": 12981709472, + "blob_id": "6187b59cdbca1085a22d922cb72202d211318a15", + "lfs_sha256": "a7070d2b2d0a765d51b48e3e5cc7cf4db3c4b0f3379f70e78883a935fb2a5ae5" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ4_NL.gguf", + "size": 18025687712, + "blob_id": "58b4ca9b7078940163b6d05eda31929f6cde0d02", + "lfs_sha256": "341633b99bfb4fc6d08e078f60258856c2599eac6ac15a01119590d4361c5fa0" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ4_XS.gguf", + "size": 17155893920, + "blob_id": "befc7758423296a8dab464f1cea3bb6668449f90", + "lfs_sha256": "0913e4cbe8f33f6ae7fd5a3480fff0dd3bc52575e7cb478a5f82f4cb28558c3d" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q2_K.gguf", + "size": 12631624352, + "blob_id": "57f6c8dfe577c2bfd0ef46e7e5040313e41c1319", + "lfs_sha256": "68715d70f65a27adae9bb319ab48d065e28c927bf010f5f990c780d94fc39b7f" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q2_K_L.gguf", + "size": 12972935840, + "blob_id": "d918b37418ab25d1988a65dd36f0b84551852001", + "lfs_sha256": "e7100faea89c242ed5885f0635559d3539bb16b324f033101bedda491c8f1a3f" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q3_K_L.gguf", + "size": 16810625696, + "blob_id": "f1f9bf55ac5603e91f8ddd4c7948ec28c96bd049", + "lfs_sha256": "610372b82c3c1069415f53f45ac2c24456ca52eaa01877b251c9887f7fb0783b" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q3_K_M.gguf", + "size": 15918123680, + "blob_id": "b68697beb54c83b3582763b478c0f5c55eecc5c2", + "lfs_sha256": "d62529e606c9ae056908436ba6f5a97a47bde5df87ecd182ae46fd0b69c5957e" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q3_K_S.gguf", + "size": 14329064096, + "blob_id": "43eab5baf5c1c70fa835f8a176c42774d5891f7e", + "lfs_sha256": "8a6e3e1d1bbfebe2200cf7572c04d46ed96035d8fc73f95fbba8a15a32e61866" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q3_K_XL.gguf", + "size": 17151937184, + "blob_id": "0f69c43433835ee458c14cdd5588eebc7f84180a", + "lfs_sha256": "ec20d29c4ac90aa1f9d923dca103f1a193bad2fd0fede9c433e8913e05a05bb1" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_0.gguf", + "size": 18076265120, + "blob_id": "14093de9a28195a40141c383f1a4eb6f44d66962", + "lfs_sha256": "b070189768c7c2d22f8b0204d59ed262845bf6deff59a36c84e80a7a0957f866" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_1.gguf", + "size": 19765275296, + "blob_id": "47535c0e2cf4fe90737d97c33c71b0bae8f0b5f2", + "lfs_sha256": "76b6e84d172b6b9e79210af7afa21d4cda5b95de3a29ea6f36f75f5395e01bc7" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_K_L.gguf", + "size": 19939801760, + "blob_id": "baf3c4f007bf190e4f6191c91a9bbe83371bbf01", + "lfs_sha256": "4506db57f0ec642455170c93d7ea48db9f8e2ff8b41856211594129e17bd7e52" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_K_M.gguf", + "size": 19598490272, + "blob_id": "a8c8b13c7363828741927268db87840aa514606d", + "lfs_sha256": "48415d6be6a28393ff2dfac18c01384de119201cedf2f0738b2b5cb2db9c8665" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_K_S.gguf", + "size": 18195655328, + "blob_id": "638c0fa1f0935ba34a609c5b67d64abbefc98b5f", + "lfs_sha256": "598b39db075ceddb28dd909efebd56ef7573171fc115ca18cb67e7521dcbcd31" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q5_K_L.gguf", + "size": 22950189728, + "blob_id": "adec58358fc5608bd3cd55818a1dac7ddad4aab6", + "lfs_sha256": "83b2303490feb8ed92a721e27583c0ca196063262a56ce6ab6715387e39bfbbb" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q5_K_M.gguf", + "size": 22608878240, + "blob_id": "5ff0ebc87f19667657ba26d822d2bd9b851de494", + "lfs_sha256": "881a34a7f209715eb5c97920fe70f528b21b0ef604e7df4748638038b629e0c0" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q5_K_S.gguf", + "size": 21504862880, + "blob_id": "7e349a84a2d8ec142c5574ececbb46a942d74bb5", + "lfs_sha256": "af1150bc86d6539ac894602ac4b380159750571b124b63b5b6f07262a5511ecc" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q6_K.gguf", + "size": 26726722208, + "blob_id": "ddcf6526670465bbf0600b15eb97f08e6f071ce0", + "lfs_sha256": "fa972ac60bcb40c215abccdcaa1cec121b71686a4d890a2e1fb77caec4ff59b4" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q6_K_L.gguf", + "size": 27068033696, + "blob_id": "5181b409cdfaf6e60c6b9eac6a8b5199a59d8f5d", + "lfs_sha256": "5a8b4e9b8c9102c7afd0dd903b451b18c3203c28049658de76920bdd71a35485" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q8_0.gguf", + "size": 32635677344, + "blob_id": "ae35114a661511646c8a8260e5ebda7cbe4ae2f5", + "lfs_sha256": "41887a4b71f47df9f56c9fe9f154626edb0fa92e3e6949ae3e389f15fff6248f" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-bf16/ReadyArt_gemma-4-31B-it-scotoma-2-bf16-00001-of-00002.gguf", + "size": 39897591936, + "blob_id": "2ddc16d2301f74a0b2ff4a243927bc5de8398c07", + "lfs_sha256": "d305b95ef3602b2ee3902f3676c183a27f02691fee82982c466124adef76985f" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-bf16/ReadyArt_gemma-4-31B-it-scotoma-2-bf16-00002-of-00002.gguf", + "size": 21515598272, + "blob_id": "69dc4ee214d1c36975851b51b6857b636bfa6524", + "lfs_sha256": "450fb7c9f38bf803843a2987325746ba307cf45fb118d9bd719d7ce9f5567c88" + }, + { + "rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-imatrix.gguf", + "size": 13753952, + "blob_id": "4e432f0e1d6e3c830b9f7eb25e584e23e88d23e5", + "lfs_sha256": "68cf452e31a7880e66149f16f099a9bef6835675b8a686cf605744490e832b6e" + }, + { + "rfilename": "mmproj-ReadyArt_gemma-4-31B-it-scotoma-2-bf16.gguf", + "size": 1200726528, + "blob_id": "d6f209ddd6ee7d02935cc4fa87b672e08b700d14", + "lfs_sha256": "31c7be59edf33a19a3fad53e738a059b8830cf1c9de70c7ad8e76c05b2f2f32e" + }, + { + "rfilename": "mmproj-ReadyArt_gemma-4-31B-it-scotoma-2-f16.gguf", + "size": 1198957056, + "blob_id": "5e15f945474fd8755d6bbe53def99d576f459c54", + "lfs_sha256": "0c0a14f977e392a8f148bddf6986ccf7f18a7f1a4e6e8d9f2b354eaac4010e67" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF.json b/bpw/hf/repo-metadata/bartowski__ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..26f7340804173ee214005bbe8c2a7077d8efa4a2 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF.json @@ -0,0 +1,204 @@ +{ + "repo_id": "bartowski/ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF", + "requested_repo_id": "bartowski/ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF", + "commit_sha": "5e3faf47c4ca462d35d351c53d0f7e8731e1b829", + "gguf": { + "total": 27854794240, + "architecture": "muse-glimmer", + "context_length": 131072, + "quantize_imatrix_file": "/models_out/Muse-Glimmer-30B-Esper4-GGUF/ValiantLabs_Muse-Glimmer-30B-Esper4-imatrix.gguf", + "chat_template": "{#\n Template: Muse Glimmer ATEM Chat Template\n Renders the ATEM tool-calling protocol: reasoning channel (to=self), tool\n channels (to=), and the user channel, plus tool definitions and the\n valid-recipient list in the system block.\n\n Whitespace note: every tag uses the {%- -%} / {{- -}} stripping markers, so\n the indentation below is purely for readability and contributes nothing to\n the rendered output.\n#}\n{%- macro render_content(content) -%}\n {%- if content is string -%}\n {{- content -}}\n {%- elif content is not none -%}\n {%- for part in content -%}\n {%- if part['type'] == 'image' -%}\n {{- '<|patch|>' -}}\n {%- elif part['type'] == 'video' -%}\n {{- '<|video|>' -}}\n {%- elif part['type'] == 'text' -%}\n {{- part['text'] -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro render_atem(tc) -%}\n {%- set args = tc.function.arguments -%}\n {%- if args is not mapping -%}\n {{- raise_exception('Muse Glimmer ATEM chat template requires tool_call.function.arguments to be a dict (mapping); a JSON string cannot be parsed in the HF jinja sandbox.') -}}\n {%- endif -%}\n {{- '\\n\\n' -}}\n {%- for k, v in args.items() -%}\n {{- '' -}}\n {%- if v is boolean -%}\n {%- if v -%}\n true\n {%- else -%}\n false\n {%- endif -%}\n {%- elif v is none -%}\n null\n {%- elif v is mapping or (v is iterable and v is not string) -%}\n {{- v | tojson -}}\n {%- else -%}\n {{- v -}}\n {%- endif -%}\n {{- '\\n' -}}\n {%- endfor -%}\n {{- '\\n' -}}\n{%- endmacro -%}\n{%- macro render_tool_defs(tools) -%}\n {{- 'In this environment you have access to a set of tools you can use to answer the user\\'s question.\\n\\n' -}}\n {{- 'You can invoke a function by writing a \"\" block like the following:\\n' -}}\n {{- '\\n\\n$PARAMETER_VALUE\\n...\\n\\n\\n\\n' -}}\n {{- 'String and scalar parameters should be specified as is, while lists and objects should use JSON format. Note that spaces for string values are not stripped. The output is not expected to be valid XML and is parsed with regular expressions.\\n' -}}\n {{- 'Here are the functions available in JSONSchema format:\\n' -}}\n {{- '// Tool metadata\\n' -}}\n {%- set nsns = namespace(seen=[]) -%}\n {%- for tool in tools -%}\n {%- set fn = tool.function if tool.function is defined else tool -%}\n {%- set tns = fn.name.split('.')[0] -%}\n {%- if tns not in nsns.seen -%}\n {%- set nsns.seen = nsns.seen + [tns] -%}\n {%- endif -%}\n {%- endfor -%}\n {%- set nd = tool_namespace_descriptions if tool_namespace_descriptions is defined else {} -%}\n {%- for tns in nsns.seen -%}\n {{- '{\"name\": ' + (tns | tojson) + ', \"description\": ' + ((nd[tns] if tns in nd else '') | tojson) + '}\\n' -}}\n {%- endfor -%}\n {{- '// Function schemas' -}}\n {%- for tool in tools -%}\n {%- set fn = tool.function if tool.function is defined else tool -%}\n {{- '\\n{\"name\": ' + (fn.name | tojson) + ', \"description\": ' + (fn.description | tojson) + ', \"parameters\": ' + (fn.parameters | tojson) + '}' -}}\n {%- endfor -%}\n {{- '\\n\\nHere\\'s an example of how to call a function in the tool set:\\n' -}}\n {{- '(If the tool namespace is not specified, invoke the function directly as `example_function_name` rather than `example_tool_name.example_function_name`)\\n\\n' -}}\n {{- 'to=example_tool_name.example_function_name\\n\\n' -}}\n {{- '\\n\\n' -}}\n {{- 'value_1\\n' -}}\n {{- 'This is the value for the second parameter\\nthat can span\\n\"multiple\" lines\\n\\n' -}}\n {{- '\\n' -}}\n{%- endmacro -%}\n{%- macro render_reasoning() -%}\n {%- set rs = reasoning_strength if reasoning_strength is defined and reasoning_strength else 'high' -%}\n {{- 'Reasoning strength: ' + rs + '.' -}}\n{%- endmacro -%}\n{%- macro render_system_meta(tools) -%}\n {%- set rns = namespace(recipients=['\"self\"'], nslist=[]) -%}\n {%- if tools -%}\n {%- for tool in tools -%}\n {%- set fn = tool.function if tool.function is defined else tool -%}\n {%- set tns = fn.name.split('.')[0] -%}\n {%- if tns not in rns.nslist -%}\n {%- set rns.nslist = rns.nslist + [tns] -%}\n {%- endif -%}\n {%- endfor -%}\n {%- for tns in rns.nslist -%}\n {%- set rns.recipients = rns.recipients + ['\"' + tns + '.*\"'] -%}\n {%- endfor -%}\n {%- endif -%}\n {%- set rns.recipients = rns.recipients + ['\"user\"'] -%}\n {{- '# Valid recipients: ' + rns.recipients | join(', ') + '.' -}}\n{%- endmacro -%}\n{{- bos_token -}}\n{%- set ns = namespace(has_system=false) -%}\n{%- for m in messages -%}\n {%- if m['role'] == 'system' -%}\n {%- set ns.has_system = true -%}\n {%- endif -%}\n{%- endfor -%}\n{%- if not ns.has_system -%}\n {{- '<|start|>system<|message|>You are a helpful AI assistant.' -}}\n {%- set kc = knowledge_cutoff if knowledge_cutoff is defined and knowledge_cutoff else '2026-01-04' -%}\n {{- '\\nKnowledge cutoff: ' + kc + '.' -}}\n {%- if current_date is defined and current_date -%}\n {{- '\\nCurrent date: ' + current_date + '.' -}}\n {%- elif strftime_now is defined -%}\n {{- '\\nCurrent date: ' + strftime_now('%Y-%m-%d') + '.' -}}\n {%- endif -%}\n {{- '\\n\\n' -}}\n {{- render_reasoning() -}}\n {%- if tools -%}\n {{- '\\n\\n' -}}\n {{- render_tool_defs(tools) -}}\n {%- endif -%}\n {{- '\\n\\n' -}}\n {{- render_system_meta(tools) -}}\n {{- '<|eot|>' -}}\n{%- endif -%}\n{%- for message in messages -%}\n {%- set role = message['role'] -%}\n {%- set end_token = '<|eom|>' if (not loop.last and messages[loop.index0 + 1]['role'] == role) else '<|eot|>' -%}\n {%- if role == 'system' -%}\n {#- Callers sometimes write the directive into the system prompt themselves.\n Normalise \"Reasoning effort\" to \"Reasoning strength\" (jinja has no\n case-insensitive replace, hence the four realistic casings), then skip\n the kwarg-driven line below if the prompt already carries one. -#}\n {%- set sys_text = render_content(message['content'])\n | replace('Reasoning effort', 'Reasoning strength')\n | replace('Reasoning Effort', 'Reasoning Strength')\n | replace('reasoning effort', 'reasoning strength')\n | replace('REASONING EFFORT', 'REASONING STRENGTH') -%}\n {{- '<|start|>system<|message|>' -}}\n {{- sys_text -}}\n {%- if 'reasoning strength' not in (sys_text | lower) -%}\n {{- '\\n\\n' -}}\n {{- render_reasoning() -}}\n {%- endif -%}\n {%- if tools -%}\n {{- '\\n\\n' -}}\n {{- render_tool_defs(tools) -}}\n {%- endif -%}\n {{- '\\n\\n' -}}\n {{- render_system_meta(tools) -}}\n {{- '<|eot|>' -}}\n {%- elif role == 'user' -%}\n {{- '<|start|>user<|message|>' -}}\n {{- render_content(message['content']) -}}\n {{- '<|eot|>' -}}\n {%- elif role == 'tool' -%}\n {%- set tname = message.get('name') -%}\n {%- if not tname -%}\n {%- set tcid = message.get('tool_call_id') -%}\n {%- set rns = namespace(name=tcid if tcid else '') -%}\n {%- for m in messages -%}\n {%- if m.get('tool_calls') -%}\n {%- for tc in m['tool_calls'] -%}\n {%- if tcid is not none and tc.id is defined and tc.id == tcid -%}\n {%- set rns.name = tc.function.name -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endfor -%}\n {%- set tname = rns.name -%}\n {%- endif -%}\n {{- '<|start|>tool ' + tname + '<|message|>\\n' -}}\n {{- render_content(message['content']) -}}\n {{- '\\n<|eot|>' -}}\n {%- elif role == 'assistant' -%}\n {%- if message.get('reasoning_content') -%}\n {{- '<|start|>assistant to=self<|message|>' + message['reasoning_content'] + '<|eom|>' -}}\n {%- endif -%}\n {%- if message.get('tool_calls') -%}\n {%- for tc in message['tool_calls'] -%}\n {{- '<|start|>assistant to=' + tc.function.name + '<|message|>' -}}\n {{- render_atem(tc) -}}\n {%- if loop.last -%}\n {{- end_token -}}\n {%- else -%}\n {{- '<|eom|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {%- set recipient = message.get('recipient') or 'user' -%}\n {%- set end_turn = message.get('end_turn') -%}\n {%- if end_turn is none -%}\n {%- set end_turn = not (recipient and recipient != 'user') -%}\n {%- endif -%}\n {{- '<|start|>assistant' -}}\n {%- if recipient -%}\n {{- ' to=' + recipient -}}\n {%- endif -%}\n {{- '<|message|>' -}}\n {{- render_content(message['content']) -}}\n {{- ('<|eot|>' if end_turn else '<|eom|>') -}}\n {%- endif -%}\n {%- endif -%}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n {{- '<|start|>assistant' -}}\n{%- endif -%}\n", + "bos_token": "<|begin_of_text|>", + "eos_token": "<|end_of_text|>", + "totalFileSize": 10657484064 + }, + "fetched_at_utc": "2026-09-06T11:32:08.215584+00:00", + "siblings": [ + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ2_M.gguf", + "size": 10657484064, + "blob_id": "f5c75f96168d6a556caafef56e4259227e15210f", + "lfs_sha256": "428e2799d21f69980eaf5984879339d291eb0fe0d839a98f45e2a51cc185f459" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ2_S.gguf", + "size": 10040020256, + "blob_id": "ab9102ea9c02b7e48b2864fec8d02cc5a19c55ee", + "lfs_sha256": "086f43a6d786e3140e527100ab5091feeb6af3822a777377b95b6794be27a28c" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ2_XS.gguf", + "size": 9582589984, + "blob_id": "3b005e09303a0b26cf572df0c80d2505d490cdee", + "lfs_sha256": "1591f28a013bf6ed9307f1426342c7b6d13f3d540360c2f8b4fb9c27782aa9f0" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ2_XXS.gguf", + "size": 8920823840, + "blob_id": "8ac18981fbf00ba039f4e71b5eb6000f9be83ba4", + "lfs_sha256": "16bd7df0a27548ccd14d8d85007822f36363f17ff3656ff5a9bca684369d9eff" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ3_M.gguf", + "size": 13106243104, + "blob_id": "2fe17bf6c95c3b5c8a40ea33d590ae1f58761cb4", + "lfs_sha256": "81a879c1c9b0bbd168ed56273209f1efb205362a1fb5e96ec306bab3683c401f" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ3_XS.gguf", + "size": 12315031072, + "blob_id": "ef088e2c2070188b5ec8163c1c5128a1b3dd0097", + "lfs_sha256": "000fcd60618664745578c82a5129bdd6dbe656c764398e2e1a6c272b008b50e8" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ3_XXS.gguf", + "size": 11546645792, + "blob_id": "384f8ccb854f16dbada9883a6ad86e5734eb46ee", + "lfs_sha256": "4886c586e9146cb0df458445e2fa9bd4f0d270b3aff80bfb22542411515bf5a6" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ4_NL.gguf", + "size": 16238573344, + "blob_id": "3cc635f68c99aa5bf82c54abf2bcfcac9e6974da", + "lfs_sha256": "04b60fcecca94b61552196ad20df82d51272791b2d811786df33b56257b0b426" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ4_XS.gguf", + "size": 15435100960, + "blob_id": "06c1a4045896de30c979a63174ccc3287c7a7686", + "lfs_sha256": "0eab4c6e57f88423f8dc2e9bcc94f2c76ad16d4eb340c66fbce83b636716d8fa" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q2_K.gguf", + "size": 11035584800, + "blob_id": "e3706d541b62fb157abdae411ad0c9aff0400a33", + "lfs_sha256": "b394f4961d631b9be48557f8df3fc9b2b2e5e80b9d15daa24c09c73620096f8c" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q2_K_L.gguf", + "size": 12348896800, + "blob_id": "3e77a43046269ab22d3c2e109dc9dc6189f8cd51", + "lfs_sha256": "d6796f64d1d324f30f22dea612beb7534566d76498deef84b59cc6c87a6ac33f" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q3_K_L.gguf", + "size": 14782117408, + "blob_id": "022aca959722087a90c0754444c8e982c89ec1a6", + "lfs_sha256": "047ff64d7f3af9e624382ceefe519f2a435bc980095893fa7d29d786da72221d" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q3_K_M.gguf", + "size": 13962524192, + "blob_id": "86a495a411ae1394c21c6883bc0edef11369b45e", + "lfs_sha256": "61451c59c0750467057d3ebf6fa8ab97f16abece428e6108dda8169acfe8a0d9" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q3_K_S.gguf", + "size": 12789204512, + "blob_id": "bba92e97abcf7ce6eafe3eaf8774efcfbc71b9ef", + "lfs_sha256": "396cf4c38a71b0f4a667e0d2d6cbaf3d8d0d0c819a42f446a306ab442d7007a7" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q3_K_XL.gguf", + "size": 15958844960, + "blob_id": "536cde238e865bb17beddb40ac327936054d3916", + "lfs_sha256": "04eedf4ee0244f3ef3871d8254c8ce992534d5c18306f88c8dc2b039d7d41121" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_0.gguf", + "size": 16265570080, + "blob_id": "5d082764c35447c019ab6cd64e51e4f218d2f930", + "lfs_sha256": "2fb7e9632e29dbe4c97c0f18913bb11ccb55028afd613b1f68550cd6a2ac81a8" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_1.gguf", + "size": 17828212512, + "blob_id": "ec1219ab32e395e37bf7c2cfd50a82d17b44db91", + "lfs_sha256": "45e3439468087fca8dd9a8ef1831a2662ffbc8a1197bfaa9b0287a79eba18315" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_K_L.gguf", + "size": 18304445984, + "blob_id": "44f224be01311d80f7ebe74507cdfc7faa7b2807", + "lfs_sha256": "edf9c88e5d7f12cdbd0067f9b4a9cd39b03557ffa152fa61e7eced3e1a7b9cc9" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_K_M.gguf", + "size": 17306328864, + "blob_id": "dd2d0487aabc2bbcf130878a23604da4c4156dc9", + "lfs_sha256": "6a9e5b7ccd7eb0a624808f1457f0e9d94500c688cd488f538ad8a1439f50c46f" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_K_S.gguf", + "size": 16320948000, + "blob_id": "21825ee09c31dfd4a0cdaccd3f398230f953ce8f", + "lfs_sha256": "d95a5e8bff048b2e3cb4e9b78644d5cbfe41c574e46d032170116568049c9f03" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q5_K_L.gguf", + "size": 20935589408, + "blob_id": "e58a69dfaf86100619605017d620dc5708bb84e5", + "lfs_sha256": "954c9690ada12da5e42b54af6cb952a04b8e43e9cdc90b21a1d14ac72709bc2a" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q5_K_M.gguf", + "size": 20105576224, + "blob_id": "0884093979a35db9eb2d3ad4046767162691d5ae", + "lfs_sha256": "68d65f6f6bc7b1265b3ae4a9aaea18d6d9814bea2f4a0389921719cbe9458c08" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q5_K_S.gguf", + "size": 19440695072, + "blob_id": "45bae62a1a1b658dd120f1a7f04252b14ad62626", + "lfs_sha256": "f193c69818d11c4d0888037636059e7253bcc0575014c8de73cc4c059595c158" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q6_K.gguf", + "size": 23414423584, + "blob_id": "1be4dfccb4968f7d0f589df2456ff27cb27f7257", + "lfs_sha256": "3f191c7940aa8d95f472576ece05ca365b7f24fdf2cbc00a4bd75e0bb7c07d56" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q6_K_L.gguf", + "size": 24065826336, + "blob_id": "4005b6cce59cf46af19dffb1b140a01b33a86c47", + "lfs_sha256": "85c72518f9187ae5a3e7082a9b8d7ac06aba3c36bde5629e1a186da15e10c92d" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q8_0.gguf", + "size": 29612963360, + "blob_id": "72c489fcc60104d4696e9da7b750346ff77a1658", + "lfs_sha256": "156ad787c0b35a448aa0640c60a607322ef80f25f8e617010392a667add46b42" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-bf16/ValiantLabs_Muse-Glimmer-30B-Esper4-bf16-00001-of-00002.gguf", + "size": 39750451040, + "blob_id": "31cdb7f3a9edef4063c739e106ca51e30c3a208d", + "lfs_sha256": "4b17e0f2d1dd6cdfdbd948935dc03837ad73ba881e6d55f1b1d2907b06b357d2" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-bf16/ValiantLabs_Muse-Glimmer-30B-Esper4-bf16-00002-of-00002.gguf", + "size": 15975065152, + "blob_id": "a24564e91b97893a7b6d94479d1c14035814584d", + "lfs_sha256": "7861ca53f47228f3e37f6b67ff56907e29e81a3bd907f43d5d47f62b44b7a322" + }, + { + "rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-imatrix.gguf", + "size": 13376128, + "blob_id": "088a2b9bd35a3c857e809a31dbfb8deced372747", + "lfs_sha256": "11e27f33d3f97254162d4415bbec1b452da2f02f6e92691e14b69d147e1646c3" + }, + { + "rfilename": "mmproj-ValiantLabs_Muse-Glimmer-30B-Esper4-bf16.gguf", + "size": 3849175904, + "blob_id": "4ad503eec1a4b924fa817edccb149aee136e137f", + "lfs_sha256": "41b998dc6080e98e53ea1da0972cfe600dcc47bf4d47f4e239ade8636469d7b0" + }, + { + "rfilename": "mmproj-ValiantLabs_Muse-Glimmer-30B-Esper4-f16.gguf", + "size": 3847369568, + "blob_id": "6976e19c7e182f17c00928e4f19d91c107925b58", + "lfs_sha256": "7269444a0139bdabba4719566617462d965991e3d36f45e22a28baf6e9ff5670" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__allura-org_Qwen3.6-35B-A3B-Anko-GGUF.json b/bpw/hf/repo-metadata/bartowski__allura-org_Qwen3.6-35B-A3B-Anko-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..b9656349409a21cb0eeedaeac9f70ba95843aa75 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__allura-org_Qwen3.6-35B-A3B-Anko-GGUF.json @@ -0,0 +1,204 @@ +{ + "repo_id": "bartowski/allura-org_Qwen3.6-35B-A3B-Anko-GGUF", + "requested_repo_id": "bartowski/allura-org_Qwen3.6-35B-A3B-Anko-GGUF", + "commit_sha": "13f18e6d67716b2702480449bd8b4b55f6677c38", + "gguf": { + "total": 34660610688, + "architecture": "qwen35moe", + "context_length": 262144, + "quantize_imatrix_file": "/models_out/Qwen3.6-35B-A3B-Anko-GGUF/allura-org_Qwen3.6-35B-A3B-Anko-imatrix.gguf", + "chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n\\n\\n\\nvalue_1\\n\\n\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n\\n\\n\\n\\n\\nReminder:\\n- Function calls MUST follow the specified format: an inner block must be nested within XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {{- '<|im_start|>system\\n' + content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('') and content.endswith('')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '' in content %}\n {%- set reasoning_content = content.split('')[0].rstrip('\\n').split('')[-1].lstrip('\\n') %}\n {%- set content = content.split('')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if (preserve_thinking is defined and preserve_thinking is true) or (loop.index0 > ns.last_query_index) %}\n {{- '<|im_start|>' + message.role + '\\n\\n' + reasoning_content + '\\n\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n\\n\\n' }}\n {%- else %}\n {{- '\\n\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n\\n\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '\\n' }}\n {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n {{- args_value }}\n {{- '\\n\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n\\n' }}\n {{- content }}\n {{- '\\n' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '\\n\\n\\n\\n' }}\n {%- else %}\n {{- '\\n' }}\n {%- endif %}\n{%- endif %}", + "bos_token": "<|endoftext|>", + "eos_token": "<|im_end|>", + "totalFileSize": 12066716128 + }, + "fetched_at_utc": "2026-09-06T11:32:08.196082+00:00", + "siblings": [ + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ2_M.gguf", + "size": 12066716128, + "blob_id": "759ca68b0c4c1500a0757680f6ec99724bb8ca08", + "lfs_sha256": "23fde034ea14f9515f6d3984c30b01eb8def725465156549079b11910851836c" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ2_S.gguf", + "size": 11010275808, + "blob_id": "213d5e955691e545e65e498414ee9ec232e1ad31", + "lfs_sha256": "92a54bb08352f63794803c9af69825e3b4ef4918ac0cace790ad989db5c9b594" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ2_XS.gguf", + "size": 10797144544, + "blob_id": "5629583b7c9782c7ebea1b73aac76b138a6379c0", + "lfs_sha256": "d1d4742613156bb7d92db983329dfeaba4b111545801483931b8080d6331ddd3" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ2_XXS.gguf", + "size": 9778452960, + "blob_id": "b91be0596ed7473d258727f8a51c1e62cd12fbe4", + "lfs_sha256": "3b158f25403208857cbe43faabb80314453e43fe6e70324a702996cea28f220c" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ3_M.gguf", + "size": 16900258272, + "blob_id": "4475ea6bb847420eed621209ad5310a5d766a720", + "lfs_sha256": "f5fc9e7582f272803e949c56737250c96584f630a155b02ee5a4d63c68e9c7ae" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ3_XS.gguf", + "size": 16218683872, + "blob_id": "74959804dc3b371a448f310091acd97990d13e0e", + "lfs_sha256": "c639687a4db6a7bc015c13e09c30a0628988388ab621cb30060c2bba5d718c0a" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ3_XXS.gguf", + "size": 14870829536, + "blob_id": "b221d1fcb47bcca493c7ed83b803db2efd06b73d", + "lfs_sha256": "71eb418de48b7216d1d8a3ec85da3c1293f385619ed9c5039b87fc3c185bf8e6" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ4_NL.gguf", + "size": 19861346784, + "blob_id": "1a0c9af90426ca6cf3481986bc58fe6b547d1304", + "lfs_sha256": "e063998ed01c6dfcab8c74810b0754f057010d77832064fe20259e8b8a1d2d87" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ4_XS.gguf", + "size": 18806446560, + "blob_id": "582c5e9fcef4782af72bd0289e84868b30403050", + "lfs_sha256": "51ce7389defeb19e74574636ede2606ea91bc8c20a6bf92db4d6eb8f78074d51" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q2_K.gguf", + "size": 12617079264, + "blob_id": "35579bbb5fb183ae52d0edc86d6b091660cea883", + "lfs_sha256": "8c054b20577f89c2653afe7b43fa61523256767578431d8a747b7374dcd491f3" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q2_K_L.gguf", + "size": 13113719264, + "blob_id": "26a7aad30e7819c0099fcb46dc4b78d1fdfbe0fe", + "lfs_sha256": "a967518e7ffa6576d96bc7b4c072d621fe9539e6732139c0588a67cc73970d23" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q3_K_L.gguf", + "size": 16886495712, + "blob_id": "2c553922496c2e72f3f42f32d74bb31be16d799e", + "lfs_sha256": "0373b291779838ee682c34b1790bd8de8766b6ee7bef961e6c84463a003d39bb" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q3_K_M.gguf", + "size": 16226548192, + "blob_id": "0d2ae5ad648e17baf2c6ab1aea611b36e1de17b3", + "lfs_sha256": "af82648fceadc5f9119326a6b4bd06f88752240172e3c336bcb9828fc952489f" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q3_K_S.gguf", + "size": 15513516512, + "blob_id": "39a14460f117e981bc6cc934eb60f36aa90c8a59", + "lfs_sha256": "6ad31e0001adef3bf1fea91c803107a04ddf1685e706c65dc8d66153e3d38e74" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q3_K_XL.gguf", + "size": 17331485152, + "blob_id": "a0da596da8f0952329b8df8459c229d744997767", + "lfs_sha256": "a66b73f1fd057987b8ec5cf7f3ac65fbac3a7e46ec7017c07c5dd93d70cb01a2" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_0.gguf", + "size": 19942611424, + "blob_id": "f5e2fb7fc1931384a5e0b2cd5f3b1accfc623817", + "lfs_sha256": "72467da57bf63f2224a21d35ed4c3158ade3fe8fd7e3d9c338dde2302ade623f" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_1.gguf", + "size": 21973768672, + "blob_id": "302ba34e3c3fa0553ba6b6224a35a320e09f0394", + "lfs_sha256": "8b7398f3edf2ca17f74a922546ea8bd9ce3dd00b98b6e34665e8315eb6d7304c" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_K_L.gguf", + "size": 21768894944, + "blob_id": "e7afe3026684fcffa829eb94bc2502905837b8a9", + "lfs_sha256": "132a394f4671491ed2985c6319ed0b4aad848e3739dfaf4ddb739d7ebacca7a2" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_K_M.gguf", + "size": 21391448544, + "blob_id": "5a07d6d38f38b2fa77ca5c7f15b7e135ea4e41ed", + "lfs_sha256": "c56a7714fdcca7c62fd680f966c7ba31b033533183728944ab0327c7e6c4402c" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_K_S.gguf", + "size": 20592728544, + "blob_id": "b72e4fc3ea81928d832c0164f0ccc4b188122617", + "lfs_sha256": "03335870d1a728f2d8dd300c51bb39f1b662fd049870639db1b00f11b49cbc25" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q5_K_L.gguf", + "size": 25331333600, + "blob_id": "84f609cbce6fe8875fa007fe4ec3c32ba5b9ba77", + "lfs_sha256": "d2e680d0afc0b5ed4bbf24e44c5e63132518f7b5bce23ff482111447aacf29b5" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q5_K_M.gguf", + "size": 25017457120, + "blob_id": "fbc43c51d7081172a9f82463b3c65f9ed68014f6", + "lfs_sha256": "9c97afdfca80cf69e6c014623ed9015578284e78d08dd33d87e5595109d0554a" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q5_K_S.gguf", + "size": 24156150240, + "blob_id": "57d9ea84780e803549c89593c5e7229140b4422a", + "lfs_sha256": "bd90b9e3fe09bae6bb08c3a9f278517727704d79b75bfab5911312b0071dc22e" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q6_K.gguf", + "size": 30053415392, + "blob_id": "8c253fe9cd135abd586b7388d8cfefdb2a8f1db4", + "lfs_sha256": "b789562923de187419655a88403d7ec7cfa6b812a87eeb0a022baddc0291949f" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q6_K_L.gguf", + "size": 30299748832, + "blob_id": "564f1863548fb6356273e92e019761711852d791", + "lfs_sha256": "87460fb6d6613704a43c8f038029ee406ac489b5259d67688fb82330eb733274" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q8_0.gguf", + "size": 36914690528, + "blob_id": "11e4f0ce9ff9816e16107cf3e4d1582bd989f3e6", + "lfs_sha256": "9cb6c976f76dda5c1720f65b11412753c413bbefa98e0a015f6f75e9fc93db7c" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-bf16/allura-org_Qwen3.6-35B-A3B-Anko-bf16-00001-of-00002.gguf", + "size": 39742883936, + "blob_id": "6b1f242f3c05a0e822e924f8f47936f2b97eb414", + "lfs_sha256": "02ed2d77519a37c1ffc3be30ef21eb9acfede6290b527f07f8a9706a28d5f44c" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-bf16/allura-org_Qwen3.6-35B-A3B-Anko-bf16-00002-of-00002.gguf", + "size": 29633753376, + "blob_id": "da87a970339e957d3b6ce7d721796fa9ccb71d55", + "lfs_sha256": "15a10d1b159525bdbf4658c35c86c86c25d6257d73a86edaea8d65c082c3e080" + }, + { + "rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-imatrix.gguf", + "size": 192223904, + "blob_id": "c93558d288023076c501e5154196c8f48079bc52", + "lfs_sha256": "3b3fe9001d774a26764637b41a7994f41d56f4a7551af0d878959061e5d7e7f4" + }, + { + "rfilename": "mmproj-allura-org_Qwen3.6-35B-A3B-Anko-bf16.gguf", + "size": 902822240, + "blob_id": "d660b6c510a19e2f3aedfcebaae500fd48e08e49", + "lfs_sha256": "1c625f05cd52e90abc76a5f756226c3a5fe279593379c22f6c6846c970a0cd18" + }, + { + "rfilename": "mmproj-allura-org_Qwen3.6-35B-A3B-Anko-f16.gguf", + "size": 899283296, + "blob_id": "50314fc4bc2cd4ac50fb7b3220461794baf69f51", + "lfs_sha256": "67924785ff1885c2b34c15d0e52979e991acca64221694ba2cc3a6474a053fb4" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__darkc0de_Muse-Glimmer-30B-heretic-GGUF.json b/bpw/hf/repo-metadata/bartowski__darkc0de_Muse-Glimmer-30B-heretic-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..7d620d169f615d81e4a1312d6e18c90e7bfd290c --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__darkc0de_Muse-Glimmer-30B-heretic-GGUF.json @@ -0,0 +1,204 @@ +{ + "repo_id": "bartowski/darkc0de_Muse-Glimmer-30B-heretic-GGUF", + "requested_repo_id": "bartowski/darkc0de_Muse-Glimmer-30B-heretic-GGUF", + "commit_sha": "49f757ea312905be72d0e7dc331caec1f656f764", + "gguf": { + "total": 27854794240, + "architecture": "muse-glimmer", + "context_length": 131072, + "quantize_imatrix_file": "/models_out/Muse-Glimmer-30B-heretic-GGUF/darkc0de_Muse-Glimmer-30B-heretic-imatrix.gguf", + "chat_template": "{%- macro render_content(content) -%}{%- if content is string -%}{{- content -}}{%- elif content is not none -%}{%- for part in content -%}{%- if part['type'] == 'image' -%}{{- '<|patch|>' -}}{%- elif part['type'] == 'video' -%}{{- '<|video|>' -}}{%- elif part['type'] == 'text' -%}{{- part['text'] -}}{%- endif -%}{%- endfor -%}{%- endif -%}{%- endmacro -%}{%- macro render_atem(tc) -%}{%- set args = tc.function.arguments -%}{%- if args is not mapping -%}{{- raise_exception('Onyx ATEM chat template requires tool_call.function.arguments to be a dict (mapping); a JSON string cannot be parsed in the HF jinja sandbox.') -}}{%- endif -%}{{- '\\n\\n' -}}{%- for k, v in args.items() -%}{{- '' -}}{%- if v is boolean -%}{%- if v -%}true{%- else -%}false{%- endif -%}{%- elif v is none -%}null{%- elif v is mapping or (v is iterable and v is not string) -%}{{- v | tojson -}}{%- else -%}{{- v -}}{%- endif -%}{{- '\\n' -}}{%- endfor -%}{{- '\\n' -}}{%- endmacro -%}{%- macro render_tool_defs(tools) -%}{{- 'In this environment you have access to a set of tools you can use to answer the user\\'s question.\\n\\n' -}}{{- 'You can invoke a function by writing a \"\" block like the following:\\n' -}}{{- '\\n\\n$PARAMETER_VALUE\\n...\\n\\n\\n\\n' -}}{{- 'String and scalar parameters should be specified as is, while lists and objects should use JSON format. Note that spaces for string values are not stripped. The output is not expected to be valid XML and is parsed with regular expressions.\\n' -}}{{- 'Here are the functions available in JSONSchema format:\\n' -}}{{- '// Tool metadata\\n' -}}{%- set nsns = namespace(seen=[]) -%}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{%- set tns = fn.name.split('.')[0] -%}{%- if tns not in nsns.seen -%}{%- set nsns.seen = nsns.seen + [tns] -%}{%- endif -%}{%- endfor -%}{%- set nd = tool_namespace_descriptions if tool_namespace_descriptions is defined else {} -%}{%- for tns in nsns.seen -%}{{- '{\"name\": ' + (tns | tojson) + ', \"description\": ' + ((nd[tns] if tns in nd else '') | tojson) + '}\\n' -}}{%- endfor -%}{{- '// Function schemas' -}}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{{- '\\n{\"name\": ' + (fn.name | tojson) + ', \"description\": ' + (fn.description | tojson) + ', \"parameters\": ' + (fn.parameters | tojson) + '}' -}}{%- endfor -%}{{- '\\n\\nHere\\'s an example of how to call a function in the tool set:\\n' -}}{{- '(If the tool namespace is not specified, invoke the function directly as `example_function_name` rather than `example_tool_name.example_function_name`)\\n\\n' -}}{{- 'to=example_tool_name.example_function_name\\n\\n' -}}{{- '\\n\\n' -}}{{- 'value_1\\n' -}}{{- 'This is the value for the second parameter\\nthat can span\\n\"multiple\" lines\\n\\n' -}}{{- '\\n' -}}{%- endmacro -%}{%- macro render_reasoning() -%}{%- set rs = reasoning_strength if reasoning_strength is defined and reasoning_strength else 'high' -%}{{- 'Reasoning strength: ' + rs + '.' -}}{%- endmacro -%}{%- macro render_system_meta(tools) -%}{%- set rns = namespace(recipients=['\"self\"'], nslist=[]) -%}{%- if tools -%}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{%- set tns = fn.name.split('.')[0] -%}{%- if tns not in rns.nslist -%}{%- set rns.nslist = rns.nslist + [tns] -%}{%- endif -%}{%- endfor -%}{%- for tns in rns.nslist -%}{%- set rns.recipients = rns.recipients + ['\"' + tns + '.*\"'] -%}{%- endfor -%}{%- endif -%}{%- set rns.recipients = rns.recipients + ['\"user\"'] -%}{{- '# Valid recipients: ' + rns.recipients | join(', ') + '.' -}}{%- endmacro -%}{{- bos_token -}}{%- set ns = namespace(has_system=false) -%}{%- for m in messages -%}{%- if m['role'] == 'system' -%}{%- set ns.has_system = true -%}{%- endif -%}{%- endfor -%}{%- if not ns.has_system -%}{{- '<|start|>system<|message|>You are a helpful AI assistant.' -}}{%- set kc = knowledge_cutoff if knowledge_cutoff is defined and knowledge_cutoff else '2026-01-04' -%}{{- '\\nKnowledge cutoff: ' + kc + '.' -}}{%- if current_date is defined and current_date -%}{{- '\\nCurrent date: ' + current_date + '.' -}}{%- elif strftime_now is defined -%}{{- '\\nCurrent date: ' + strftime_now('%Y-%m-%d') + '.' -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_reasoning() -}}{%- if tools -%}{{- '\\n\\n' -}}{{- render_tool_defs(tools) -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_system_meta(tools) -}}{{- '<|eot|>' -}}{%- endif -%}{%- for message in messages -%}{%- set role = message['role'] -%}{%- set end_token = '<|eom|>' if (not loop.last and messages[loop.index0 + 1]['role'] == role) else '<|eot|>' -%}{%- if role == 'system' -%}{{- '<|start|>system<|message|>' -}}{{- render_content(message['content']) -}}{{- '\\n\\n' -}}{{- render_reasoning() -}}{%- if tools -%}{{- '\\n\\n' -}}{{- render_tool_defs(tools) -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_system_meta(tools) -}}{{- '<|eot|>' -}}{%- elif role == 'user' -%}{{- '<|start|>user<|message|>' -}}{{- render_content(message['content']) -}}{{- '<|eot|>' -}}{%- elif role == 'tool' -%}{%- set tname = message.get('name') -%}{%- if not tname -%}{%- set tcid = message.get('tool_call_id') -%}{%- set rns = namespace(name=tcid if tcid else '') -%}{%- for m in messages -%}{%- if m.get('tool_calls') -%}{%- for tc in m['tool_calls'] -%}{%- if tcid is not none and tc.id is defined and tc.id == tcid -%}{%- set rns.name = tc.function.name -%}{%- endif -%}{%- endfor -%}{%- endif -%}{%- endfor -%}{%- set tname = rns.name -%}{%- endif -%}{{- '<|start|>tool ' + tname + '<|message|>\\n' -}}{{- render_content(message['content']) -}}{{- '\\n<|eot|>' -}}{%- elif role == 'assistant' -%}{%- if message.get('reasoning_content') -%}{{- '<|start|>assistant to=self<|message|>' + message['reasoning_content'] + '<|eom|>' -}}{%- endif -%}{%- if message.get('tool_calls') -%}{%- for tc in message['tool_calls'] -%}{{- '<|start|>assistant to=' + tc.function.name + '<|message|>' -}}{{- render_atem(tc) -}}{%- if loop.last -%}{{- end_token -}}{%- else -%}{{- '<|eom|>' -}}{%- endif -%}{%- endfor -%}{%- else -%}{%- set recipient = message.get('recipient') or 'user' -%}{%- set end_turn = message.get('end_turn') -%}{%- if end_turn is none -%}{%- set end_turn = not (recipient and recipient != 'user') -%}{%- endif -%}{{- '<|start|>assistant' -}}{%- if recipient -%}{{- ' to=' + recipient -}}{%- endif -%}{{- '<|message|>' -}}{{- render_content(message['content']) -}}{{- ('<|eot|>' if end_turn else '<|eom|>') -}}{%- endif -%}{%- endif -%}{%- endfor -%}{%- if add_generation_prompt -%}{{- '<|start|>assistant' -}}{%- endif -%}", + "bos_token": "<|begin_of_text|>", + "eos_token": "<|end_of_text|>", + "totalFileSize": 10657479360 + }, + "fetched_at_utc": "2026-09-06T11:32:08.222166+00:00", + "siblings": [ + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ2_M.gguf", + "size": 10657479360, + "blob_id": "3abcdd15f266fecf1c124b464ad1350570a7626b", + "lfs_sha256": "e128ba75bcdcf0d473dbbc68ed8af3c99c94cf75118ad116364ba8637f869c4a" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ2_S.gguf", + "size": 10040015552, + "blob_id": "56acb1d6c2d4be2b894603688a02f92d17fcc868", + "lfs_sha256": "805564efe7375fff8164508ee6daf2d106f04ba706a5c0b4ccca90cb2bad93a0" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ2_XS.gguf", + "size": 9582585280, + "blob_id": "b97d3d4f62aa93f0f82e49ffdf98fcb2c0b16898", + "lfs_sha256": "8e40248c39e2f12df634380dbc3a9cdca3f4a307b2c341cee6318c6709aba72c" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ2_XXS.gguf", + "size": 8920819136, + "blob_id": "f399ee8e60475026f3b9daffd06ce5ccb844fc2d", + "lfs_sha256": "d985136d1e5ff6a6a7afc2e1b0840dee2729d11e151827b5e5190500f533a3d5" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ3_M.gguf", + "size": 13106238400, + "blob_id": "6986517061e58db05bd24be41fb0d1044e86774d", + "lfs_sha256": "f0de67a2dabc2d1c9df57d3241f48c5222fb4b26d50826b7e26eb1ce8c4a8ee6" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ3_XS.gguf", + "size": 12315026368, + "blob_id": "06bf59cd99ab2accd67f013cff4ba6f1c90d6e82", + "lfs_sha256": "0b95665a1ee46afd01e43650ea9012711dfd20967857929a7b033b820cedeb2b" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ3_XXS.gguf", + "size": 11546641088, + "blob_id": "0e1e6a4e940bc21b2af14060f48417dd9a5989df", + "lfs_sha256": "cc1ef554f3fbf7555e2a0b1b32f77b2011805b18d93320e6bf5c0a44ad1de008" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ4_NL.gguf", + "size": 16238568640, + "blob_id": "04d1542cf2030d78137917bc8efc1d866a9a42d0", + "lfs_sha256": "ae4e2f65ea2ef62c99e935a7577b0a5dcee285f0fc45f61b5883da0ced7f552e" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ4_XS.gguf", + "size": 15435096256, + "blob_id": "00e8b22d4307e032d58602dbad7a16c6f954dee2", + "lfs_sha256": "f4405e4c4496a225dd765dc4603c14de80afa41ac70816faaf32284ed87069db" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q2_K.gguf", + "size": 11035580096, + "blob_id": "3206808b41a77611b62fc3247ecc70be8418feb9", + "lfs_sha256": "cd2fbe6c9a3e2ed66144cfc25903e6f6db917bd17a0f610e82d9d7b78bcaaef4" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q2_K_L.gguf", + "size": 12348892096, + "blob_id": "c6e868131372589c310f2aab259d3e2cfe65b0de", + "lfs_sha256": "5c20f5ee96aafaf00124bd53bb2c654dbc60ea03d6584da95eb466ec7b4d0b1c" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q3_K_L.gguf", + "size": 14782112704, + "blob_id": "ca455056c56f677470ea19f56082553eb2058485", + "lfs_sha256": "b9d2c7ddc3bbbce58431b1f8ae77f046c3fa4d4dcaa2982272f2d2b395389763" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q3_K_M.gguf", + "size": 13962519488, + "blob_id": "1648c8b0c6c19d3bd13a79a4097f6f9eb4f8778b", + "lfs_sha256": "259623bc1946bd02393c964e3628280be0809f108421055be9cec900097b5633" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q3_K_S.gguf", + "size": 12789199808, + "blob_id": "ab1e07cd808ebf6b5b0198340429b2ac53f2d498", + "lfs_sha256": "0130e6f1c7a2e6aff914c6caed580a43ddf33b0a7978f5555a18314d28a8c471" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q3_K_XL.gguf", + "size": 15958840256, + "blob_id": "f006b95b4d65c31c1e93deb2650eeefc11239fb0", + "lfs_sha256": "3bb484e03eedaea0d1d3c4fcc917b4a747cc87471eeebccc9c18ad56593b54f5" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_0.gguf", + "size": 16265565376, + "blob_id": "b1003a024eb8cc0bc03f69c89c60819e91f9cb2b", + "lfs_sha256": "c3353fa5aef514606e4ed27aadb421dd1ab82047c27c7394a53d31bbce8c70d4" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_1.gguf", + "size": 17828207808, + "blob_id": "7761fd25d2d0e235fa2b667a6c218006d9b8ec22", + "lfs_sha256": "1aa21d1dc4db5286aa62b48c3b084be52308ea1ed75df8cec29d1e602deb6343" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_K_L.gguf", + "size": 18304441280, + "blob_id": "ac91940aa12a9d39af7dfa8eeba2906795b5f96b", + "lfs_sha256": "ab5c0cbde145c3a14c7578b1c65265c0665cedd219c9614560e7ab0a3a013bf5" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_K_M.gguf", + "size": 17306324160, + "blob_id": "7c62c8ab1faf5d9732bba021bac2071acc0e8ae7", + "lfs_sha256": "728cdea6a1c4add69ac878574db05505b2475ca5366480ef7f720b2c2b263ed9" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_K_S.gguf", + "size": 16320943296, + "blob_id": "dc0701b1dc67e95bc22d3a00b6448e90b4c0585a", + "lfs_sha256": "55bc86d5028b19c9a4a38ff22db3009f81cce39bd1d5aac634bea6df7daba147" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q5_K_L.gguf", + "size": 20935584704, + "blob_id": "1361a5649c6d94c45ed227f4f6b10bf3ccd57e67", + "lfs_sha256": "4adb06ca0516891e4b77bcd41185eab03571c7fbc244e99cde18403c50657d43" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q5_K_M.gguf", + "size": 20105571520, + "blob_id": "2466634573e142ff6b9d02c7e60eb47463335ce6", + "lfs_sha256": "725022bb8d7351993318cad45a6ede40a8247f6723457f8c0f364aef39482ef1" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q5_K_S.gguf", + "size": 19440690368, + "blob_id": "d9c47b0e1a0432786fd5130e00aa9ed733a7948b", + "lfs_sha256": "775df11fb4aca114585fc2b3b3617f0b2990cd07f36b92cf9cd7eafc78934d74" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q6_K.gguf", + "size": 23414418880, + "blob_id": "97485ab849d7ea4b53228234a8f0d64fd8dcf6f9", + "lfs_sha256": "8ef0557c91c7b21bf572231524c789f8b049c838d2ce3b00c6c0f487a19ddfd6" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q6_K_L.gguf", + "size": 24065821632, + "blob_id": "9ab31cebbc695112dcd0eab85185ecc7008e91df", + "lfs_sha256": "b8f1451c723d3d7afd57a3968000654b179eebae008de95ac8c0dbc956fa48c5" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q8_0.gguf", + "size": 29612958368, + "blob_id": "b2808ada0a2918190fbd30156b728edec9b5e5e4", + "lfs_sha256": "a501532b4a1f02341ff96a19321a2682f4b1ada1ee29b688edc217ca035448f5" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-bf16/darkc0de_Muse-Glimmer-30B-heretic-bf16-00001-of-00002.gguf", + "size": 39802091424, + "blob_id": "dfceb16643eeedbd91bce1d092924c9e088b3c03", + "lfs_sha256": "591f100d7c2462ce514851245bf7f8aaef4348f459b4f43b6f7062c86d51c9b0" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-bf16/darkc0de_Muse-Glimmer-30B-heretic-bf16-00002-of-00002.gguf", + "size": 15923420064, + "blob_id": "5d8717c1c612304d3c8cc290c31fc2f87c46ac5c", + "lfs_sha256": "bbe38f5854574be49705dd65b2a613335721a82f6a0c5a38be0ec823ae479e14" + }, + { + "rfilename": "darkc0de_Muse-Glimmer-30B-heretic-imatrix.gguf", + "size": 13376128, + "blob_id": "7d00c166f85bf034710bbfdab959b98e5cf3f2b5", + "lfs_sha256": "92b7dd5a2edc16fa5db1fb7561ef6238213e25102ef4afe953d63b23fd6904c3" + }, + { + "rfilename": "mmproj-darkc0de_Muse-Glimmer-30B-heretic-bf16.gguf", + "size": 3849174048, + "blob_id": "dd1a1f5ca4e052a257ef554c0b50d1214ee4489f", + "lfs_sha256": "3e39cb6b42ef57d17cdde58a92b73749e61ff24656f1c7b8abf964e9e4a6f723" + }, + { + "rfilename": "mmproj-darkc0de_Muse-Glimmer-30B-heretic-f16.gguf", + "size": 3847367712, + "blob_id": "3250629acda75aee2ed5238e00d38b4dcc08903e", + "lfs_sha256": "ecf13cbfe622f1f321fa31dc0d20337446b129f16e172ba6d6062358052902a1" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__google_gemma-3n-E4B-it-GGUF.json b/bpw/hf/repo-metadata/bartowski__google_gemma-3n-E4B-it-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..3ec56c570eb7a6aa4b7ab9090ef18e869674c825 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__google_gemma-3n-E4B-it-GGUF.json @@ -0,0 +1,144 @@ +{ + "repo_id": "bartowski/google_gemma-3n-E4B-it-GGUF", + "requested_repo_id": "bartowski/google_gemma-3n-E4B-it-GGUF", + "commit_sha": "6dd3cb1e6c463bf6982385d1fdb2f23754cf2b29", + "gguf": { + "total": 6866172400, + "architecture": "gemma3n", + "context_length": 32768, + "quantize_imatrix_file": "/models_out/gemma-3n-E4B-it-GGUF/google_gemma-3n-E4B-it.imatrix", + "chat_template": "{{ bos_token }}\n{%- if messages[0]['role'] == 'system' -%}\n {%- if messages[0]['content'] is string -%}\n {%- set first_user_prefix = messages[0]['content'] + '\n\n' -%}\n {%- else -%}\n {%- set first_user_prefix = messages[0]['content'][0]['text'] + '\n\n' -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n{%- else -%}\n {%- set first_user_prefix = \"\" -%}\n {%- set loop_messages = messages -%}\n{%- endif -%}\n{%- for message in loop_messages -%}\n {%- if (message['role'] == 'user') != (loop.index0 % 2 == 0) -%}\n {{ raise_exception(\"Conversation roles must alternate user/assistant/user/assistant/...\") }}\n {%- endif -%}\n {%- if (message['role'] == 'assistant') -%}\n {%- set role = \"model\" -%}\n {%- else -%}\n {%- set role = message['role'] -%}\n {%- endif -%}\n {{ '' + role + '\n' + (first_user_prefix if loop.first else \"\") }}\n {%- if message['content'] is string -%}\n {{ message['content'] | trim }}\n {%- elif message['content'] is iterable -%}\n {%- for item in message['content'] -%}\n {%- if item['type'] == 'audio' -%}\n {{ '' }}\n {%- elif item['type'] == 'image' -%}\n {{ '' }}\n {%- elif item['type'] == 'text' -%}\n {{ item['text'] | trim }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{ raise_exception(\"Invalid content type\") }}\n {%- endif -%}\n {{ '\n' }}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n {{'model\n'}}\n{%- endif -%}\n", + "bos_token": "", + "eos_token": "", + "totalFileSize": 3294107520 + }, + "fetched_at_utc": "2026-09-06T11:32:08.257124+00:00", + "siblings": [ + { + "rfilename": "google_gemma-3n-E4B-it-IQ3_M.gguf", + "size": 3294107520, + "blob_id": "d17ae5c5504a5a83fafd411409b576b6488f4d2d", + "lfs_sha256": "a3935bbb5cc6e0ee476fed039089dc5123bc4dd1064785d1016af4ca14da1c8d" + }, + { + "rfilename": "google_gemma-3n-E4B-it-IQ3_XS.gguf", + "size": 3166394240, + "blob_id": "3dbb706dd3cb099ae562ca2baca021b6639c31af", + "lfs_sha256": "fdfb502901b7e819f2ba7291d1de240f2121525d0428394cb894da5e6342f8a1" + }, + { + "rfilename": "google_gemma-3n-E4B-it-IQ4_NL.gguf", + "size": 4089993088, + "blob_id": "008baa63f8af4e078724606bb540dc4c880a134d", + "lfs_sha256": "5aa73eb6bdb9eecdf82850221821c59086f8c6948de80c418976cd85e7c443c1" + }, + { + "rfilename": "google_gemma-3n-E4B-it-IQ4_XS.gguf", + "size": 3895023488, + "blob_id": "003d112069c7278e61a9ab7ee93289ed61447a9f", + "lfs_sha256": "ec43a69462be559e6c48f6ededc417039f81b5fb9faab2e09748ce841ebb7a1f" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q2_K.gguf", + "size": 2757318528, + "blob_id": "c1ee0fc005d0e8122a8b7f03005e3eed59dacba7", + "lfs_sha256": "18c2788c41c435c5e26ca5007b81c4da17a6687d2cd9e315a1125ace62006bc2" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q2_K_L.gguf", + "size": 4612249472, + "blob_id": "713409e87daac7a81a8a730d9dff39688668bd2e", + "lfs_sha256": "e9c390a8a3a81b04d9ee7674f357a69bcaa58f05a9bfe180cbb990d00b89a131" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q3_K_L.gguf", + "size": 3601995648, + "blob_id": "a1d5b2a3f231f8a6ab4a682cdd869bfa5d732b9d", + "lfs_sha256": "1b4270aa3dbe43ef6e430f5645f43942e72777d92493c4496779968c8236840a" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q3_K_M.gguf", + "size": 3440908160, + "blob_id": "1f0ba1af241ba0984c83b75fb799923f37f76908", + "lfs_sha256": "13bae2b95d94e7ef64f81cdef9a0b469cfc485e39d422cd94e86d1b5bdbcf567" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q3_K_S.gguf", + "size": 3251910528, + "blob_id": "897556d625a7813c4872c478c1f11da03a1148f6", + "lfs_sha256": "a5f98949558e9305330860fad1ca33bab488acbb4b3c683c08e9a7fb885a3e1f" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q3_K_XL.gguf", + "size": 5218375552, + "blob_id": "3d1fe5d644ac57ae0ec57806eb34d526ddd2cd1a", + "lfs_sha256": "3dbd58aaec14b44387bfdcc5cb77f79d3202956cad8e928d28c5a85055614ca6" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q4_0.gguf", + "size": 4093794176, + "blob_id": "d16c78b9e9381f5ce64e406c0fd22aaf9a26d5ab", + "lfs_sha256": "e0fb08521de84554c14c131d6fd09d065c852ab76b0f84bd965dbc9948a668e2" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q4_1.gguf", + "size": 4477638528, + "blob_id": "1f1b66aa83b132f91ddaf059268e824beca5f22b", + "lfs_sha256": "520c56c672a5ec3323fb3c06b97bf5c5098fba698dce956b8dd68c16e6c3e91e" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q4_K_L.gguf", + "size": 5541492608, + "blob_id": "2442f123458bc9d4663f785922a98d22af8eecb4", + "lfs_sha256": "36a20030b46a51d5b3059dc47fea5b6196578a9de9e128a6c745c5bc0fee8e8a" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q4_K_M.gguf", + "size": 4237064064, + "blob_id": "dcb36d188964bb2fa70ea5431388f15cdfd76ce9", + "lfs_sha256": "70b4129714d30cfd7d36ff449257a2633485693ea6f5da9c2057f20fb7cbe1f8" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q4_K_S.gguf", + "size": 4102707072, + "blob_id": "1c8abb1fc2c798579282c3dc29164a77c867cb4e", + "lfs_sha256": "a54fe35f559e2060256acad4dcf992635c187e6768ff12fabe4c0d2465a3509f" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q5_K_L.gguf", + "size": 5958825856, + "blob_id": "27b177e2f6e456088b8af634e11045f9730518ab", + "lfs_sha256": "28f529f2bba68e11c491c5282b6ea3f9073dbace3d0ec592b8436a821a92520e" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q5_K_M.gguf", + "size": 4947998592, + "blob_id": "c7217b0bbc36686df61d68a04a67d16184c63101", + "lfs_sha256": "6c63ee24020ff14efa35edf8f5cc6dec96960d2c69e1c65a3e68459d75559f45" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q5_K_S.gguf", + "size": 4869871488, + "blob_id": "56cfa80e01da60f9727ebe4b71e2168a7b8aae6b", + "lfs_sha256": "ed89e1ce214c7bbc6c7f5f607593b15f0338a3211314515493e6956d45a5b2eb" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q6_K.gguf", + "size": 5703366528, + "blob_id": "5276d2c55da8f97fa8dd3e5b8d81e6552fcaca32", + "lfs_sha256": "a3c33c4a0a01b86d3e509acab4335a9acfc59948955581b4a91025089cefd49f" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q6_K_L.gguf", + "size": 6402242432, + "blob_id": "348ef8dfd474c586ea706ebdb8bf5b518abec46e", + "lfs_sha256": "535ce46cd3e26fd9bf60be0ad877b3e65829eb925b8f12dd60e15eabe06ddc5e" + }, + { + "rfilename": "google_gemma-3n-E4B-it-Q8_0.gguf", + "size": 7353292672, + "blob_id": "07373926a5c04806885c3f296814b68b9363711d", + "lfs_sha256": "e2c69d482d1a7dae9d3b1e477626e30c0c29825ea2dc05e4ef55159230a07c80" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__google_gemma-4-31B-it-GGUF.json b/bpw/hf/repo-metadata/bartowski__google_gemma-4-31B-it-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..6b114c75115445347f0a044bfa977ea84e9d8687 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__google_gemma-4-31B-it-GGUF.json @@ -0,0 +1,222 @@ +{ + "repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "requested_repo_id": "bartowski/google_gemma-4-31B-it-GGUF", + "commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14", + "gguf": { + "total": 30697345596, + "architecture": "gemma4", + "context_length": 262144, + "quantize_imatrix_file": "/models_out/gemma-4-31B-it-GGUF/google_gemma-4-31B-it-imatrix.gguf", + "chat_template": "{#\n Template: Google Gemma 4 Canonical Chat Template\n Author: Google Gemma Engineering Team\n Published: 2026-07-09\n Context: Fixed tool-calling loops, turn closures, and thinking content-ordering.\n#}\n{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- else -%}\n {{- raise_exception(\n \"chat_template: tool_calls[].function.arguments must be a \"\n \"JSON object (mapping), not a string. Deserialize arguments \"\n \"before passing to the template.\"\n ) -}}\n {%- endif -%}\n {{- '}' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- if not enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n", + "bos_token": "", + "eos_token": "", + "totalFileSize": 10112172384 + }, + "fetched_at_utc": "2026-09-06T11:32:08.259208+00:00", + "siblings": [ + { + "rfilename": "google_gemma-4-31B-it-IQ1_M.gguf", + "size": 10112172384, + "blob_id": "d2f0f6c615b92584cd6ac1b4ae8f47c2d0589b1c", + "lfs_sha256": "99870ee4aeeab03532bbb72f0af7332d6f2e3f9de4a4ba26c6aff8b906a8a201" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ2_M.gguf", + "size": 12649773408, + "blob_id": "73437320ecd6874a9e842277e2cedc1274e15d5c", + "lfs_sha256": "3f98b832e1a097356f55fc40a44c6193a877ce0467eea38e7001fb96e9cd9a8f" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ2_S.gguf", + "size": 12075358560, + "blob_id": "b567d6a239a499d9464381808290e2f97fba2490", + "lfs_sha256": "26c268ebddd0c4315dc57a0846e74bee8cb99836f186b4ce561eaae9e8755066" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ2_XS.gguf", + "size": 11500943712, + "blob_id": "9fedc43ec2b21bd7a0500986d8fd30a83cd714ea", + "lfs_sha256": "8c4abed66c765ff6ebb96ee257a65018f3d800351cc6e0db288735bc05919d43" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ2_XXS.gguf", + "size": 10830190944, + "blob_id": "cac8a61d61d428982f42b40073016eaa70cf4d97", + "lfs_sha256": "3023b2dc6f8719ada9536c22a5b57408ddb1f18d4377de8efa7997237329ec3f" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ3_M.gguf", + "size": 15129829728, + "blob_id": "6715bd34589438b76e6110db75197ecaf2d523bb", + "lfs_sha256": "34fee56068a087c32e753ac1c25d45e329bc3e5c6a768279e20ff4f107ca7802" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ3_XS.gguf", + "size": 13841353056, + "blob_id": "925498d3a30f35e5a318b6b620af62e53ed96b20", + "lfs_sha256": "9919f8d192412bad9161890a3c5ac748d553b9018e6856de47bc2a4fe91401e1" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ3_XXS.gguf", + "size": 12981709152, + "blob_id": "19b3ee0a13ed232a38d5873c9985e682aee5d0c4", + "lfs_sha256": "c9f34994715a016cd0bcd7ff4c1f5710718bbcc25d40796302db0a89b6d0d8ea" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ4_NL.gguf", + "size": 18025687392, + "blob_id": "1f4f2711d7358c5d26b4104b9e1c256120ab184b", + "lfs_sha256": "95cf739e546a1c8ade9b84ce4cd0358a5c87f69c450e04d768126acbd2f17723" + }, + { + "rfilename": "google_gemma-4-31B-it-IQ4_XS.gguf", + "size": 17155893600, + "blob_id": "b59383c6b45db1b193770bb20171294913929b21", + "lfs_sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7" + }, + { + "rfilename": "google_gemma-4-31B-it-Q2_K.gguf", + "size": 12631624032, + "blob_id": "325896cc7d478d3e147bdcac94c7a7b90816cf8a", + "lfs_sha256": "0c9ac8f56177147f30a8845b3637e119ee5c0ba528af73cd363fb486f05ef0c7" + }, + { + "rfilename": "google_gemma-4-31B-it-Q2_K_L.gguf", + "size": 12972935520, + "blob_id": "47eb49bef2a849a1f1ec7482015e9c082ff57810", + "lfs_sha256": "a0ca05763da9239a8ac4b4c267a43a1abd8dbfe3e373181d6f4ad837b81578fb" + }, + { + "rfilename": "google_gemma-4-31B-it-Q3_K_L.gguf", + "size": 16810625376, + "blob_id": "4c0c275e630c8a92cdb2ca10ac300072d5d7e51e", + "lfs_sha256": "a61e2576c8d95ee021f162462555e17b4b02c1f72691e69edc85c01e81151e70" + }, + { + "rfilename": "google_gemma-4-31B-it-Q3_K_M.gguf", + "size": 15918123360, + "blob_id": "2fd1df519f200327a692a5e2e4d3ea0f48851e74", + "lfs_sha256": "eafa3499f35610f0c71af7b688328692f710d01283e140b5089991cf6478f486" + }, + { + "rfilename": "google_gemma-4-31B-it-Q3_K_S.gguf", + "size": 14329063776, + "blob_id": "a2cf56f8ca22f1c3c91be65ee1ba63e8224b60cc", + "lfs_sha256": "99398bdab6241b3e513c129a4c24e8047bee51026585bfaa9eee80f656154789" + }, + { + "rfilename": "google_gemma-4-31B-it-Q3_K_XL.gguf", + "size": 17151936864, + "blob_id": "ec0fddb2eac8df7bba5bfed79638da7e6f0cc3fc", + "lfs_sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d" + }, + { + "rfilename": "google_gemma-4-31B-it-Q4_0.gguf", + "size": 18076264800, + "blob_id": "23f5b60f840a5af9d76c470c2867078145284e7d", + "lfs_sha256": "4591e5ee10527739514d6db436b51169c882949e3858d30285aa997b0b253554" + }, + { + "rfilename": "google_gemma-4-31B-it-Q4_1.gguf", + "size": 19765274976, + "blob_id": "607b1f4fa00b0674fcb8a54062c98c841e8a923b", + "lfs_sha256": "567d744757d575d84c0a42278091223aa2351cdae8f375d4962eec44272659be" + }, + { + "rfilename": "google_gemma-4-31B-it-Q4_K_L.gguf", + "size": 19939801440, + "blob_id": "8bc880b18d5d191bccd731649264250a02a2abf5", + "lfs_sha256": "805ecb7f3d6b2cca58f31a6bc3579716173ec21f310e3af62c2b728c51488057" + }, + { + "rfilename": "google_gemma-4-31B-it-Q4_K_M.gguf", + "size": 19598489952, + "blob_id": "7594698d77f635be3502d0c8d96d932471e31152", + "lfs_sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75" + }, + { + "rfilename": "google_gemma-4-31B-it-Q4_K_S.gguf", + "size": 18195655008, + "blob_id": "95c7ba769a21639e6ae01e8e8b52dc72213869e2", + "lfs_sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52" + }, + { + "rfilename": "google_gemma-4-31B-it-Q5_K_L.gguf", + "size": 22950189408, + "blob_id": "43c1e4b482b60dd0b4da6696cb993e9945513129", + "lfs_sha256": "ca773a604cd05507c95d671119a83a010ba0bda42e4c715b542be32ed68ad649" + }, + { + "rfilename": "google_gemma-4-31B-it-Q5_K_M.gguf", + "size": 22608877920, + "blob_id": "7a963084f6cdcb7da40cf2a3f81463e751c5a543", + "lfs_sha256": "9f6882d4780880c96f2292c7daf5d5f18fa7e3678cecc47fc22649e93ce6f693" + }, + { + "rfilename": "google_gemma-4-31B-it-Q5_K_S.gguf", + "size": 21504862560, + "blob_id": "b1a6fe63eaaeb44e120be1f343c863ecd6a93df1", + "lfs_sha256": "7761c1ff2f0ec42fb5aa510f0c6b172d9042e94b289d9a9b73ce63ea5f6f7b0d" + }, + { + "rfilename": "google_gemma-4-31B-it-Q6_K.gguf", + "size": 26726721888, + "blob_id": "31800ae3368a423eb734c6de73ace1229e1090de", + "lfs_sha256": "3ddedb5dbd39acced499c489181983f27bd6e6bd3cd5d4a367696eeda3d1e397" + }, + { + "rfilename": "google_gemma-4-31B-it-Q6_K_L.gguf", + "size": 27068033376, + "blob_id": "6800429d54d33bddd56d3a8bd6af1bac1728cf2a", + "lfs_sha256": "f77819db7b83a145425084048efec024b5efbc175bc0fdc4bc4bfe7d4b5802df" + }, + { + "rfilename": "google_gemma-4-31B-it-Q8_0.gguf", + "size": 32635677024, + "blob_id": "45cd238bdf89e32c18c21a471fd9c76c09d0d444", + "lfs_sha256": "b2021742dad920260eea1a2fe3f7ebacc6f4963b4242ea3211f6bdb46e494a8e" + }, + { + "rfilename": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf", + "size": 39996137216, + "blob_id": "68120905430cc3810b9c0e3d69c1773194a19317", + "lfs_sha256": "00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a" + }, + { + "rfilename": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf", + "size": 21417052704, + "blob_id": "f0c9f314dfeac9e2d7e5d4b98cae84337247628f", + "lfs_sha256": "ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29" + }, + { + "rfilename": "google_gemma-4-31B-it-imatrix.gguf", + "size": 13753952, + "blob_id": "4865396c0e2aadc94d7104e5d8cecd758f10612e", + "lfs_sha256": "f749aac429f5a1fd6fda4bc10823682669b8f45a10805230442a7a648ac70620" + }, + { + "rfilename": "mmproj-google_gemma-4-31B-it-bf16.gguf", + "size": 1200726208, + "blob_id": "c9a5b8f86a5fc67382932fe4ab6d6b80e94788ef", + "lfs_sha256": "21487ff26d08f7ddd1d654d3bbfc1ae1020aab3119f5bf654742ce4697732e4e" + }, + { + "rfilename": "mmproj-google_gemma-4-31B-it-f16.gguf", + "size": 1198956736, + "blob_id": "ea9623d5bfc1de80b5f7e6fcca391a292772de2d", + "lfs_sha256": "3e3f3f593b34bb4f518ada3e7999e4cbcd2a5864fa86ebc23fad3cbc4fbeba40" + }, + { + "rfilename": "mtp-google_gemma-4-31B-it-Q4_0.gguf", + "size": 349161984, + "blob_id": "ff73b1b2549086cfc7cf96a3c72a085671798225", + "lfs_sha256": "3103d6e845443e3a6156704aa84feeb43bb7ffef96a47a522ad6449c342b6809" + }, + { + "rfilename": "mtp-google_gemma-4-31B-it-Q8_0.gguf", + "size": 514705920, + "blob_id": "7918f333efcb8f9a3d7725bd15fba8335e7df31a", + "lfs_sha256": "743b2b719e448f9a06e774b4f33dd7a391a73e94d32297c7590256484562eb52" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__google_gemma-4-E4B-it-GGUF.json b/bpw/hf/repo-metadata/bartowski__google_gemma-4-E4B-it-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..5fe1de2ddc095865508505f62eacd3daab8c3deb --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__google_gemma-4-E4B-it-GGUF.json @@ -0,0 +1,173 @@ +{ + "repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "requested_repo_id": "bartowski/google_gemma-4-E4B-it-GGUF", + "commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66", + "gguf": { + "total": 7518069290, + "architecture": "gemma4", + "context_length": 131072, + "chat_template": "{#\n Template: Google Gemma 4 Canonical Chat Template\n Author: Google Gemma Engineering Team\n Published: 2026-07-09\n Context: Fixed tool-calling loops, turn closures, and thinking content-ordering.\n#}\n{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- else -%}\n {{- raise_exception(\n \"chat_template: tool_calls[].function.arguments must be a \"\n \"JSON object (mapping), not a string. Deserialize arguments \"\n \"before passing to the template.\"\n ) -}}\n {%- endif -%}\n {{- '}' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n", + "bos_token": "", + "eos_token": "", + "totalFileSize": 15053097184 + }, + "fetched_at_utc": "2026-09-06T11:32:08.266683+00:00", + "siblings": [ + { + "rfilename": "google_gemma-4-E4B-it-IQ2_M.gguf", + "size": 3959908832, + "blob_id": "a9b3039b66548f63060fdf484b23d9610f76fad4", + "lfs_sha256": "190322506e26415013651e5023fe744b0501a81d4ad37aa7017bb81214cbdbb5" + }, + { + "rfilename": "google_gemma-4-E4B-it-IQ3_M.gguf", + "size": 4767781344, + "blob_id": "c0a7da1eecc209d1abf32fb1b9fc990bcb227aaa", + "lfs_sha256": "6d54d6921059d70e140b164b9e5968e2328d9a9cb0933b5a8c87b82c1bdda53a" + }, + { + "rfilename": "google_gemma-4-E4B-it-IQ3_XS.gguf", + "size": 4632039904, + "blob_id": "c41fcfa3772452c515b91d11433ff02ff0e486d5", + "lfs_sha256": "80b0047ff8508575c6ad408798331f4dd7a5242b33111cc7818b94b774ab32de" + }, + { + "rfilename": "google_gemma-4-E4B-it-IQ4_NL.gguf", + "size": 5232226784, + "blob_id": "e739f2a476b937551820af70f720d948d5b1595d", + "lfs_sha256": "b56f70624694ca5f2362cdafe6acffe35c5e0f44693c568f3f09fa83b968fb74" + }, + { + "rfilename": "google_gemma-4-E4B-it-IQ4_XS.gguf", + "size": 5112828384, + "blob_id": "df0608ab7841f710ec1eaa2c95b482edb0f92c31", + "lfs_sha256": "a24429604e6f680e7bdf087b863a6cecc90f80b3d908f95d888f4f05003fdee3" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q2_K.gguf", + "size": 4458093024, + "blob_id": "6b7a06e2f11c1f107304fcc2e7ca853b6866d686", + "lfs_sha256": "f4346a0965c793a99afd787d5f1c88afe8f75e6235ffcc35f043ed546c9d7bf4" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q2_K_L.gguf", + "size": 5303245280, + "blob_id": "37168dce0ebe7db6745e57af45d2576174984df9", + "lfs_sha256": "8126ce4d0ce855795cd5195bdcf1e50c1c7a8e5fdcd64d55bb7dff3db11d53a7" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q3_K_L.gguf", + "size": 5034226144, + "blob_id": "665bdbd28fb4c9f4b402ef650c2b30626f309720", + "lfs_sha256": "488ade6a569eaef44abbd0312ae7b34c924026d94cb6a0eb41fb2bd2be73ceb5" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q3_K_M.gguf", + "size": 4898730464, + "blob_id": "0a7b6b8b3f634956a977b12205c94ca6ac00dc0f", + "lfs_sha256": "f60327936976524fbb9119a20e72819ea2369e0811de2b572eb0a2a21ecad71e" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q3_K_S.gguf", + "size": 4699695584, + "blob_id": "3463fca4206d7d89f2f0fd2dd7bbfef1582b74ab", + "lfs_sha256": "19a50462126b053de22a9cc9085aad3cc2241c9de55129f12bde7924a67e48ef" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q3_K_XL.gguf", + "size": 5879378400, + "blob_id": "65a30ee76c98d4ae13da837778480cee2549ac06", + "lfs_sha256": "00c50656f4b16b98ff9e07199e3c9fb5e776c159a62aaae9f56628b375f689f7" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q4_0.gguf", + "size": 5223860704, + "blob_id": "21180eb13fa7c952c5e52de9ea61dac354898c66", + "lfs_sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q4_1.gguf", + "size": 5458479584, + "blob_id": "d85882e4154c7386450d5dfea46c7dde456d7c01", + "lfs_sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q4_K_L.gguf", + "size": 6250322400, + "blob_id": "1af0b02f042e0f56196e469bef37916ea918b94a", + "lfs_sha256": "675f1326a7bc3e3971d7cc1b9003bd14e41a5c6c733ac0f1833fc993188fc92e" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q4_K_M.gguf", + "size": 5405170144, + "blob_id": "d3d38b7aebbcc982083c3a555da0f137c6026af2", + "lfs_sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q4_K_S.gguf", + "size": 5235657184, + "blob_id": "296eba9cd1e1f59d67e41db61fc0632189923823", + "lfs_sha256": "81508a92a401ccd81292b0da59f43af7360b7b2215a67bc7901830d58bfdf260" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q5_K_L.gguf", + "size": 6666035680, + "blob_id": "6a3df0fa59715c6496909439395856f1247c7311", + "lfs_sha256": "847e2dc03edd61b6a3a05e0c25c858e971ac897f53aad0351b282897d2ab1db4" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q5_K_M.gguf", + "size": 5820883424, + "blob_id": "3960e83c3dcc1bd61906da38c7d4940e9018765c", + "lfs_sha256": "1c57b87a06a7c0fd1b9fa8f5d5e505b720c15099648e0dcdc78acd857f72a7cc" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q5_K_S.gguf", + "size": 5701290464, + "blob_id": "5f5b48819af1664dfa8e15819d2496d2d79426d4", + "lfs_sha256": "ad6dfecd1d11c18e62047d6c93777d927ce8cfff7de99289773d3a197887a140" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q6_K.gguf", + "size": 6329954784, + "blob_id": "c4b45ac409e881cdab9bbd06f845ede7f679eff8", + "lfs_sha256": "bea1c94443c91fff61a722d9da5cd3f1cf0196d1e914798ee89d3c00ea365df9" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q6_K_L.gguf", + "size": 7175107040, + "blob_id": "7d55615c43438af82758da0970d84b5c9118f76a", + "lfs_sha256": "d31cc5eb279a992932e3cbde4d3ba9a3ba9b8cb41c16087561e5dadb88c0e4dc" + }, + { + "rfilename": "google_gemma-4-E4B-it-Q8_0.gguf", + "size": 8031242720, + "blob_id": "8ae83d8caa8c4fab040a99cc39118688bcc3a3bc", + "lfs_sha256": "6a6eba0d36a051b5d924211a889c1436717006e7c5d413830c47caa1d46cb598" + }, + { + "rfilename": "google_gemma-4-E4B-it-bf16.gguf", + "size": 15053097184, + "blob_id": "357095828759635a5a7ae49c861e2b9399deb6c2", + "lfs_sha256": "af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac" + }, + { + "rfilename": "google_gemma-4-E4B-it-imatrix.gguf", + "size": 4429024, + "blob_id": "41d3ec1b34856a3dfc7e8eb63a62d9b7d9674a66", + "lfs_sha256": "d7419858304e589b410a20e6343e8065eed9a8064f64b73eb689c6a488d699a9" + }, + { + "rfilename": "mmproj-google_gemma-4-E4B-it-bf16.gguf", + "size": 991552000, + "blob_id": "617fec9fe639b7a8acb48866fdef6d05f7b199b1", + "lfs_sha256": "ffa64aebf7144bbadd5a1e143b77794d88e76a81cc0168d91de0770eb49e88e0" + }, + { + "rfilename": "mmproj-google_gemma-4-E4B-it-f16.gguf", + "size": 990372352, + "blob_id": "a9c0f391f947bfd18d3ac9c0a02dfe7fbfc96982", + "lfs_sha256": "fd29ffa385f51ed8df3e8f48a865c7997ff6d01ed50c11bed2ae90f0d75f104e" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF.json b/bpw/hf/repo-metadata/bartowski__huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..084afbe76edc45b6b76c84c47633098a077f831f --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF.json @@ -0,0 +1,149 @@ +{ + "repo_id": "bartowski/huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF", + "requested_repo_id": "bartowski/huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF", + "commit_sha": "19d84eb522d97e9e16eecaf49662f9f84404eefa", + "gguf": { + "total": 6866172400, + "architecture": "gemma3n", + "context_length": 32768, + "chat_template": "{{ bos_token }}\n{%- if messages[0]['role'] == 'system' -%}\n {%- if messages[0]['content'] is string -%}\n {%- set first_user_prefix = messages[0]['content'] + '\n\n' -%}\n {%- else -%}\n {%- set first_user_prefix = messages[0]['content'][0]['text'] + '\n\n' -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n{%- else -%}\n {%- set first_user_prefix = \"\" -%}\n {%- set loop_messages = messages -%}\n{%- endif -%}\n{%- for message in loop_messages -%}\n {%- if (message['role'] == 'user') != (loop.index0 % 2 == 0) -%}\n {{ raise_exception(\"Conversation roles must alternate user/assistant/user/assistant/...\") }}\n {%- endif -%}\n {%- if (message['role'] == 'assistant') -%}\n {%- set role = \"model\" -%}\n {%- else -%}\n {%- set role = message['role'] -%}\n {%- endif -%}\n {{ '' + role + '\n' + (first_user_prefix if loop.first else \"\") }}\n {%- if message['content'] is string -%}\n {{ message['content'] | trim }}\n {%- elif message['content'] is iterable -%}\n {%- for item in message['content'] -%}\n {%- if item['type'] == 'audio' -%}\n {{ '' }}\n {%- elif item['type'] == 'image' -%}\n {{ '' }}\n {%- elif item['type'] == 'text' -%}\n {{ item['text'] | trim }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{ raise_exception(\"Invalid content type\") }}\n {%- endif -%}\n {{ '\n' }}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n {{'model\n'}}\n{%- endif -%}\n", + "bos_token": "", + "eos_token": "", + "totalFileSize": 13740103360 + }, + "fetched_at_utc": "2026-09-06T11:32:08.311173+00:00", + "siblings": [ + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-IQ3_M.gguf", + "size": 3294107648, + "blob_id": "64c70264cc60e60110f8957f3120a2fca627343e", + "lfs_sha256": "5bc269673469f974e6aa7128cc3b537a141f4540638dcb4f00a5fbca70598db7" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-IQ3_XS.gguf", + "size": 3166394368, + "blob_id": "40180e93ef28cf8059d5ee2ec8abac4a977f8e4b", + "lfs_sha256": "aec38012151f7ee99e2514a3cf3483b48d2514e475964ab628bed457525eda02" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-IQ4_NL.gguf", + "size": 4089993216, + "blob_id": "a00a43327870da4eb795fe8dbedeaca4a40d0fe7", + "lfs_sha256": "e4ea418676b3aca05f5bf7edf86dfedffea9d6139b9e48f3edc8cc016bfdf86e" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-IQ4_XS.gguf", + "size": 3895023616, + "blob_id": "b30fc91b9eca9a37dcaa68e2000d8c1cdc6d3d7e", + "lfs_sha256": "4798aedca19326b9d38fdd529d7e0b3008e918a596f41082d581c978694414ff" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q2_K.gguf", + "size": 2757318656, + "blob_id": "f8fb884f7d8026af740a77a86c660b1f7a1733e9", + "lfs_sha256": "8f7bc62c252b5c387849f2671a04c476913037047e39ff12f175e99849600ec4" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q2_K_L.gguf", + "size": 4612249600, + "blob_id": "ea7029a1738d8345ef7dc26c794e3a223a0a2abf", + "lfs_sha256": "50c2fbafc97b0f3bcb8dfd7dc8e8f62e74ac04831fd6d9451be0165ee0aa884b" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q3_K_L.gguf", + "size": 3601995776, + "blob_id": "fefcbe333d44815282972decbb84f27a9c82724d", + "lfs_sha256": "2e7fb8fb4e6faf453bdde6b753b3461d77a71ae27697f1e3be2545d333b50e23" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q3_K_M.gguf", + "size": 3440908288, + "blob_id": "7decfc9ca4a707699595003ce8b6b4b1a8a200fa", + "lfs_sha256": "41b7e8f8bd74cc2abec6833f01584ad961c2b548ea46016e886917d567d4e7e4" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q3_K_S.gguf", + "size": 3251910656, + "blob_id": "8ed99bc824e9a5fc021835774477e883e1f86673", + "lfs_sha256": "2f32c94b82730ef568e5d71fa87866edae30cdbeb9f234415647a8bf8191e975" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q3_K_XL.gguf", + "size": 5218375680, + "blob_id": "2d9718108fab3f6d6d76e131aafd40daba520ccf", + "lfs_sha256": "58bcf322c54f1612c6e4add5271e55baf7181a9bc9054e88b28fb5b67a74363c" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_0.gguf", + "size": 4093794304, + "blob_id": "a13d8210509bc27d885fdf78d0d0c3b6c5481c6b", + "lfs_sha256": "2ae26ec4f6deadee4c2648ea8fda85adacefccf4ec5d305a9feb7197068536b8" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_1.gguf", + "size": 4477638656, + "blob_id": "cb6d590acdb27eb21a03009fe1f1fe7b848baa5c", + "lfs_sha256": "3f9c07aa01f884fd7c28ee39c1afe00720c1ed48ef2ea4322fa190daec55d257" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_L.gguf", + "size": 5541492736, + "blob_id": "57507811eeaaee016a7256acb693b7d4fa244e40", + "lfs_sha256": "528473be2cb9a09e4d9f4844f224860e75a1bfd450cfabe017d277d11e1e44cf" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_M.gguf", + "size": 4237064192, + "blob_id": "58b06fe6c6409efe32281d80c58c25511ca65c5f", + "lfs_sha256": "bf3f41f5d90c30777054d5cc23c10a31f08a833e774a014733f918b5c73f2265" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_S.gguf", + "size": 4102707200, + "blob_id": "5b76c9d4f211f89cc7606538207ad795fa3503f5", + "lfs_sha256": "33771ed0dc774badaed690f13230fadd475a2dc2b2f45cb58333ec794b8ba052" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q5_K_L.gguf", + "size": 5958825984, + "blob_id": "de108763791d4783790b5425181e3aafc19c1266", + "lfs_sha256": "85ca58bc53c2d7ed826c1bb98a947ebb46fce50fba1c2c8929a9c854db59dfed" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q5_K_M.gguf", + "size": 4947998720, + "blob_id": "374ee67d8c4235720c642557c86d39e2dd0e916b", + "lfs_sha256": "1becd929c03776a8b75f6e5cdac8cca02ac2154c4ad1921f872944478bb7e9ac" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q5_K_S.gguf", + "size": 4869871616, + "blob_id": "4df751cdba424c455247acea53e4233032c76b60", + "lfs_sha256": "2a4d2a838a250e6809adf997234bf4cc51651cd891191ead0f058b5e40df407a" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q6_K.gguf", + "size": 5703366656, + "blob_id": "e1e7c7ab6e075b35945b9b2273b770e752c63fcb", + "lfs_sha256": "23ee86ce074b772639d21b7e56e0102cf2f4196de10955843795311ebf16b32b" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q6_K_L.gguf", + "size": 6402242560, + "blob_id": "7db7b87e467f1c575b396c6816025ff858913d5f", + "lfs_sha256": "deb5fa3ab2d2377936dc34dbdf17ec86d55a24a09f98200a33978463d6059cb9" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q8_0.gguf", + "size": 7353292800, + "blob_id": "13c879e70e7a0a05f1ecd69c45cb1596bfeaccea", + "lfs_sha256": "4980dba55c9d9892a99d527a4ebb791f54996abdb93783f8e2d9cbec381ee35d" + }, + { + "rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-bf16.gguf", + "size": 13740103360, + "blob_id": "e38b6cae9e3ff999d79f1a026d1a244b61097c95", + "lfs_sha256": "c00edf1e08c781e07370db0f2f6dc3e81dec7a9920da6d93a268caf33f2d69fb" + } + ] +} diff --git a/bpw/hf/repo-metadata/bartowski__zai-org_GLM-4.6V-Flash-GGUF.json b/bpw/hf/repo-metadata/bartowski__zai-org_GLM-4.6V-Flash-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..7e96a6cfef47bf9da48450cf49e183e0aa9db8c1 --- /dev/null +++ b/bpw/hf/repo-metadata/bartowski__zai-org_GLM-4.6V-Flash-GGUF.json @@ -0,0 +1,185 @@ +{ + "repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "requested_repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF", + "commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa", + "gguf": { + "total": 9400279040, + "architecture": "glm4", + "context_length": 131072, + "chat_template": "[gMASK]\n{%- if tools -%}\n<|system|>\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within XML tags:\n\n{% for tool in tools %}\n{{ tool | tojson(ensure_ascii=False) }}\n{% endfor %}\n\n\nFor each function call, output the function name and arguments within the following XML format:\n{function-name}\n{arg-key-1}\n{arg-value-1}\n{arg-key-2}\n{arg-value-2}\n...\n{%- endif -%}\n{%- macro visible_text(content) -%}\n {%- if content is string -%}\n {{- content }}\n {%- elif content is iterable and content is not mapping -%}\n {%- for item in content -%}\n {%- if item is mapping and item.type == 'text' -%}\n {{- item.text }}\n {%- elif item is mapping and (item.type == 'image' or 'image' in item) -%}\n <|begin_of_image|><|image|><|end_of_image|>\n {%- elif item is mapping and (item.type == 'video' or 'video' in item) -%}\n <|begin_of_video|><|video|><|end_of_video|>\n {%- elif item is string -%}\n {{- item }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- content }}\n {%- endif -%}\n{%- endmacro -%}\n{%- set ns = namespace(last_user_index=-1) %}\n{%- for m in messages %}\n {%- if m.role == 'user' %}\n {% set ns.last_user_index = loop.index0 -%}\n {%- endif %}\n{%- endfor %}\n{% for m in messages %}\n{%- if m.role == 'user' -%}<|user|>\n{% if m.content is string %}\n{{ m.content }}\n{%- else %}\n{%- for item in m.content %}\n{% if item.type == 'video' or 'video' in item %}\n<|begin_of_video|><|video|><|end_of_video|>{% elif item.type == 'image' or 'image' in item %}\n<|begin_of_image|><|image|><|end_of_image|>{% elif item.type == 'text' %}\n{{ item.text }}\n{%- endif %}\n{%- endfor %}\n{%- endif %}\n{{- '/nothink' if (enable_thinking is defined and not enable_thinking and not visible_text(m.content).endswith(\"/nothink\")) else '' -}}\n{%- elif m.role == 'assistant' -%}\n<|assistant|>\n{%- set reasoning_content = '' %}\n{%- set content = visible_text(m.content) %}\n{%- if m.reasoning_content is string %}\n {%- set reasoning_content = m.reasoning_content %}\n{%- else %}\n {%- if '' in content %}\n {%- set reasoning_content = content.split('')[0].rstrip('\\n').split('')[-1].lstrip('\\n') %}\n {%- set content = content.split('')[-1].lstrip('\\n') %}\n {%- endif %}\n{%- endif %}\n{%- if loop.index0 > ns.last_user_index and reasoning_content -%}\n{{ '\\n' + reasoning_content.strip() + ''}}\n{%- else -%}\n{{ '\\n' }}\n{%- endif -%}\n{%- if content.strip() -%}\n{{ '\\n' + content.strip() }}\n{%- endif -%}\n{% if m.tool_calls %}\n{% for tc in m.tool_calls %}\n{%- if tc.function %}\n {%- set tc = tc.function %}\n{%- endif %}\n{{ '\\n' + tc.name }}\n{% set _args = tc.arguments %}\n{% for k, v in _args.items() %}\n{{ k }}\n{{ v | tojson(ensure_ascii=False) if v is not string else v }}\n{% endfor %}\n{% endfor %}\n{% endif %}\n{%- elif m.role == 'tool' -%}\n{%- if m.content is string -%}\n{%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|observation|>' }}\n{%- endif %}\n{{- '\\n\\n' }}\n{{- m.content }}\n{{- '\\n' }}\n{% elif m.content is iterable and m.content is not mapping %}\n{%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n{{- '<|observation|>' }}\n{%- endif %}\n{{- '\\n\\n' }}\n{%- for tr in m.content -%}\n {%- if tr is mapping and tr.type is defined -%}\n {%- set t = tr.type | lower -%}\n {%- if t == 'text' and tr.text is defined -%}\n{{ tr.text }}\n {%- elif t in ['image', 'image_url'] -%}\n<|begin_of_image|><|image|><|end_of_image|>\n {%- elif t in ['video', 'video_url'] -%}\n<|begin_of_video|><|video|><|end_of_video|>\n {%- else -%}\n{{ tr | tojson(ensure_ascii=False) }}\n {%- endif -%}\n {%- else -%}\n{{ tr.output if tr.output is defined else tr }}\n {%- endif -%}\n{%- endfor -%}\n{{- '\\n' }}\n{%- else -%}\n<|observation|>{% for tr in m.content %}\n\n\n{{ tr.output if tr.output is defined else tr }}\n{% endfor -%}\n{% endif -%}\n{%- elif m.role == 'system' -%}\n<|system|>\n{{ visible_text(m.content) }}\n{%- endif -%}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n<|assistant|>\n{{'\\n' if (enable_thinking is defined and not enable_thinking) else ''}}\n{%- endif -%}", + "bos_token": "<|endoftext|>", + "eos_token": "<|endoftext|>", + "totalFileSize": 18811585376 + }, + "fetched_at_utc": "2026-09-06T11:32:08.295151+00:00", + "siblings": [ + { + "rfilename": "mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf", + "size": 1840903936, + "blob_id": "81b6f9a8d790bf6e4d407259d5fde274d6693eb4", + "lfs_sha256": "219b0fcf326d8d023004ce9fc27fa643bd73ebfb73684e8e0af742c1fd755b63" + }, + { + "rfilename": "mmproj-zai-org_GLM-4.6V-Flash-f16.gguf", + "size": 1786959616, + "blob_id": "baef217c6a87ce9ebfe630de348e070fa72b74ea", + "lfs_sha256": "fc35333718b524d7f43ff0ec6d0c1b9d05e673815c1dec641c04b9bef91e1cd6" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-IQ2_M.gguf", + "size": 3946316928, + "blob_id": "977e8cd7f187e0307251192f19e00da6b658aa4f", + "lfs_sha256": "83828fa39ac228d2a3e498c8e2e379ea0fba57fd57101e9bedb9a58fb7550ca1" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-IQ2_S.gguf", + "size": 3783787648, + "blob_id": "1039b808dc61508c6c67d891c5969d4e8ffc98fa", + "lfs_sha256": "d73fa5f46fa464b614e20b36e404a4839bdc67330c32420ed9962ff6c02e0644" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-IQ3_M.gguf", + "size": 4721804416, + "blob_id": "679efc7468034d1aa7951465483224e3d36da9b6", + "lfs_sha256": "aaa6ca968711b6c4ec278dceb13e41003031e3918301fc244bee05f05b622d23" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-IQ3_XS.gguf", + "size": 4406412416, + "blob_id": "02b99f319c974e9bf74dad71c481e623ea74a416", + "lfs_sha256": "c71d7cace201af737168600bc602a48208213d255f0319696fb3f0e25f6b4dd2" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-IQ3_XXS.gguf", + "size": 4226811008, + "blob_id": "71472b457021d53e4c1614c8e29d8d3a7b7dc874", + "lfs_sha256": "fc2675945e56f766dc7f3f7574a6c3f2a3029cc65f4ecaf0d950daf04946a8ab" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf", + "size": 5465179264, + "blob_id": "49570bb7e8757e22a59333fde0a5144e25a72947", + "lfs_sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-IQ4_XS.gguf", + "size": 5262279808, + "blob_id": "2a69beb03c90c1d959a3e8abcc402953e4ee7ce9", + "lfs_sha256": "4342477286625c4cfcd70d0023bdb3ac30613fcce729123e0277097c7dc42e2d" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q2_K.gguf", + "size": 4006347904, + "blob_id": "b81c6c2b5320e0dcc55b724639d9903b802b865e", + "lfs_sha256": "cf1424d416359cf024f3af12483e91e5677e36d4095dfa3ce362d50326803e34" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q2_K_L.gguf", + "size": 4612555904, + "blob_id": "52567ab27a8442442300ac1b9e34a2209750c869", + "lfs_sha256": "998ebfc475c04dc1312a99393f2aeb284c8409fb749094a6a9aa624a1f663ced" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q3_K_L.gguf", + "size": 5196612736, + "blob_id": "b341a26528f2924890886c73f08e16ce24281df1", + "lfs_sha256": "4edc500ea49c378697226f8aff14b5cc7c29fd6bef852a0b6271d4251b531ee6" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q3_K_M.gguf", + "size": 4974511232, + "blob_id": "9502c9f3fc305712cfe5bc751a8de0927f9188fa", + "lfs_sha256": "c980955e1ab069b3ff2260c0622fa2e4809c6b1cdc5b3283eca27c89015988ec" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q3_K_S.gguf", + "size": 4592043136, + "blob_id": "63920a8eb836dd57c6b321acf2d0d917f2811448", + "lfs_sha256": "d9640d8e2db2e23042ee0612d304dbace1f691690a95a462641810fc6396d8c3" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf", + "size": 5739775104, + "blob_id": "befe54a6d9afe5e9e9eca35f00544e621164b07e", + "lfs_sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q4_0.gguf", + "size": 5477467264, + "blob_id": "1635a36bcafd855a2516ace9746de81b132393ff", + "lfs_sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q4_1.gguf", + "size": 6008603776, + "blob_id": "6f0dcfd50881f35f248ede021bb2976e4ea2583e", + "lfs_sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q4_K_L.gguf", + "size": 6627296384, + "blob_id": "ada4ea1b80a9a5c207eb6d09aab944380d241a09", + "lfs_sha256": "37a557ff039803e7092bc5b76383a2284799188307383f609c34ef3c5cb67170" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf", + "size": 6166578304, + "blob_id": "c1fcc0d4a0c20bc65dc67fbd2cc4fc53b95fdbf5", + "lfs_sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf", + "size": 5758485632, + "blob_id": "0c5a38a22b322a74c18d2360f4fda3cecb332151", + "lfs_sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q5_K_L.gguf", + "size": 7434044544, + "blob_id": "acfbddd1c7bf6059607790c0ee4e567fdb05b1e4", + "lfs_sha256": "4fd99fbced488a1f9d5dc00089f62cc194b793c3a42c4e3c6a827c497a45c48d" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q5_K_M.gguf", + "size": 7050921088, + "blob_id": "9bb11aee590bca36681c72ab4d1321cbb0478c3d", + "lfs_sha256": "40101581d76a68bcc475e7938f17a92fec99c5759b88f84a5ec51592cead4b81" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q5_K_S.gguf", + "size": 6697518208, + "blob_id": "164812897eba63959f4627bcb383dafa511f1936", + "lfs_sha256": "381e3182e731a9c57bef65307ef162ab1dcdaaa400f549a2f62cda3a98977e0f" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q6_K.gguf", + "size": 8266646656, + "blob_id": "921b106335f4eaacceb67942305d062c985b03f0", + "lfs_sha256": "db13135801258f338179d35c9183481b875939a2d2531d926e42a085fb4513b4" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q6_K_L.gguf", + "size": 8567325824, + "blob_id": "6517686dc4eb9ffde81cf6c78bfe7a8d2b024dbb", + "lfs_sha256": "de1e44e36c16e7c7fdd3039d051d8481949ca520bca3be4c144a3842d58e31fc" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-Q8_0.gguf", + "size": 9999615104, + "blob_id": "ccac462cce7b39f160145fe9216141d6b2a37070", + "lfs_sha256": "dc4226a14195bbaec623ceb404e4049b66ff937b5ab23044319909164e6e899c" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-bf16.gguf", + "size": 18811585376, + "blob_id": "f1d785aa7f6181dbe97fc2f011604e7ebafeb216", + "lfs_sha256": "d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f" + }, + { + "rfilename": "zai-org_GLM-4.6V-Flash-imatrix.gguf", + "size": 5505056, + "blob_id": "4fe3b2b270f92952950f195610b9990a1a82bd2b", + "lfs_sha256": "c8a2a26bf670e3a695b5e50e9a541996fb9eef9f9ec8488be1a6d7d96f111a8d" + } + ] +} diff --git a/bpw/hf/repo-metadata/ggml-org__Kimi-VL-A3B-Thinking-2506-GGUF.json b/bpw/hf/repo-metadata/ggml-org__Kimi-VL-A3B-Thinking-2506-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..b0f46b70d4876ea0bba8f2a16a2f8c63704f515b --- /dev/null +++ b/bpw/hf/repo-metadata/ggml-org__Kimi-VL-A3B-Thinking-2506-GGUF.json @@ -0,0 +1,59 @@ +{ + "repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF", + "requested_repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF", + "commit_sha": "e7dcd093335f922a057772febc7ab27eda985b40", + "gguf": { + "total": 15960110208, + "architecture": "deepseek2", + "context_length": 131072, + "chat_template": "{%- for message in messages -%}{%- if loop.first and messages[0]['role'] != 'system' -%}{{'<|im_system|>system<|im_middle|>You are a helpful assistant<|im_end|>'}}{%- endif -%}{%- if message['role'] == 'system' -%}{{'<|im_system|>'}}{%- endif -%}{%- if message['role'] == 'user' -%}{{'<|im_user|>'}}{%- endif -%}{%- if message['role'] == 'assistant' -%}{{'<|im_assistant|>'}}{%- endif -%}{{- message['role'] -}}{{'<|im_middle|>'}}{%- if message['content'] is string -%}{{- message['content'] + '<|im_end|>' -}}{%- else -%}{%- for content in message['content'] -%}{%- if content['type'] == 'image' or 'image' in content or 'image_url' in content -%}{{'<|media_start|>image<|media_content|><|media_pad|><|media_end|>'}}{%- else -%}{{content['text']}}{%- endif -%}{%- endfor -%}{{'<|im_end|>'}}{%- endif -%}{%- endfor -%}{%- if add_generation_prompt -%}{{'<|im_assistant|>assistant<|im_middle|>'}}{%- endif -%}", + "bos_token": "[BOS]", + "eos_token": "[EOS]", + "totalFileSize": 31934229408 + }, + "fetched_at_utc": "2026-09-06T11:32:08.297763+00:00", + "siblings": [ + { + "rfilename": "Kimi-VL-A3B-Thinking-2506-Q4_K_M.gguf", + "size": 10540747680, + "blob_id": "d571446ed6b1e018b02f80a43f24963c6cb3ddca", + "lfs_sha256": "72253d82d21c546587139dfd12597d491c25a13c6540d2ce18ca1581967338c5" + }, + { + "rfilename": "Kimi-VL-A3B-Thinking-2506-Q8_0.gguf", + "size": 16974941088, + "blob_id": "006c73cabb329c52494eea103b2dc885a776d8a7", + "lfs_sha256": "ffcfd257855ee9f16243d8d16b4d74fcb106d3dc1fd65f466d1c089bf320b377" + }, + { + "rfilename": "Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "size": 31934229408, + "blob_id": "31f87edc3afad1f5d97969393881f624a73a438d", + "lfs_sha256": "952f3faa372910984089d16db89927548c0f11dab36ee21f57ea79df23b32378" + }, + { + "rfilename": "Kimi-VL-A3B-Thinking-2506-f16.gguf", + "size": 31934229408, + "blob_id": "9e5dccb871561453073d44465b29da1a53480713", + "lfs_sha256": "00dc49807794d7368aca96898a6bf6f5e4bbe60fa539ddc0464a8e531b8f08f5" + }, + { + "rfilename": "mmproj-Kimi-VL-A3B-Thinking-2506-Q8_0.gguf", + "size": 618098624, + "blob_id": "66261f6c3f607f90f814f248fb4d289ff54d55aa", + "lfs_sha256": "5af5e5fc0ad5e2348f5227ddfa97e9241d453020c149dbe0e920ed603189ca15" + }, + { + "rfilename": "mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf", + "size": 906726464, + "blob_id": "26f2b6422d7d898fad42d3dad9822c0901d24142", + "lfs_sha256": "fc9b4043c3cd9a4649eec121b688e0e3bf609f6b3f836e45282f8a34f3ffee39" + }, + { + "rfilename": "mmproj-Kimi-VL-A3B-Thinking-2506-f16.gguf", + "size": 905371712, + "blob_id": "378856d2a23831ea2d5b4fcf08d076b54ea52fda", + "lfs_sha256": "1386854a5031970a92ec458ddcc2dfce575f28edf6463643e50ac2f008068fb3" + } + ] +} diff --git a/bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF.json b/bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..c7fabcb3751de3355d6be96327ec1c1cb9e86dd2 --- /dev/null +++ b/bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF.json @@ -0,0 +1,82 @@ +{ + "repo_id": "mradermacher/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF", + "requested_repo_id": "mradermacher/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF", + "commit_sha": "ec81e38fab4c2b75f64e7457dafdf66e88e427c2", + "gguf": { + "total": 30532122624, + "architecture": "qwen3moe", + "context_length": 40960, + "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {{- messages[0].content + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within XML tags:\\n\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n\\n\\nFor each function call, return a json object with function name and arguments within XML tags:\\n\\n{\\\"name\\\": , \\\"arguments\\\": }\\n<|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0].content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" and message.content is string and not(message.content.startswith('') and message.content.endswith('')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if message.content is string %}\n {%- set content = message.content %}\n {%- else %}\n {%- set content = '' %}\n {%- endif %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '' in content %}\n {%- set reasoning_content = content.split('')[0].rstrip('\\n').split('')[-1].lstrip('\\n') %}\n {%- set content = content.split('')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- if loop.index0 > ns.last_query_index %}\n {%- if loop.last or (not loop.last and reasoning_content) %}\n {{- '<|im_start|>' + message.role + '\\n\\n' + reasoning_content.strip('\\n') + '\\n\\n\\n' + content.lstrip('\\n') }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n\\n' }}\n {{- content }}\n {{- '\\n' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '\\n\\n\\n\\n' }}\n {%- endif %}\n{%- endif %}", + "eos_token": "<|im_end|>", + "totalFileSize": 16557093472 + }, + "fetched_at_utc": "2026-09-06T11:32:08.339231+00:00", + "siblings": [ + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.IQ4_XS.gguf", + "size": 16557093472, + "blob_id": "6f063a807e7ac8a7822b3098e925c8dcdae77ce1", + "lfs_sha256": "3910cdd866a76adbf4ae29448a45b438c500005e35e06ba38bdab55f4bb1c8cd" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q2_K.gguf", + "size": 11258610272, + "blob_id": "2676e1cc448a4cecda04f945722d41009d62ebed", + "lfs_sha256": "1354a707f5f7e10672d4fe171dfcb0c0a25307036ec094ccacac54585040d1e3" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q3_K_L.gguf", + "size": 15900670560, + "blob_id": "e83b2bd64a598075781bdd155f3b538504f0a977", + "lfs_sha256": "015288f4a8e83a6ed7263bfb22cd13358dcce1e2046f85619c189635a0743253" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q3_K_M.gguf", + "size": 14711847520, + "blob_id": "bf9c562a3cc91ad839fb05e6c8ce3061a33a802c", + "lfs_sha256": "b476ee669abb7c8bdcd191bf9536903ebd96ef7d26cca46f5cc64464c3dca299" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q3_K_S.gguf", + "size": 13292468832, + "blob_id": "d74089bcce5f1afb95bfb0a136ddbaa979d51fce", + "lfs_sha256": "e42881424efcd8d045e49067e1ef161a14865cc05d24a364df8d7331765af297" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q4_K_M.gguf", + "size": 18556686944, + "blob_id": "37bf5077e32243fcd0603fac7296d82c497fa2b6", + "lfs_sha256": "6683808ce05b9b87b78e9adae36d0a9da86673db7a5293f9ea8f1c5572f7d821" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q4_K_S.gguf", + "size": 17456009824, + "blob_id": "cbc7786203912c031def29031edd3be66df1950c", + "lfs_sha256": "d10be56dad3c6c7a4b30f8ed4db2a6c1c2195c3c93c8da9a84d73aea52c8a28d" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q5_K_M.gguf", + "size": 21725581920, + "blob_id": "d6654b7b966f2a214484e95902c38396ac058882", + "lfs_sha256": "c046ce0619cc7e57682ac9998df4946cff4c123fe80dd0eedfd94334fe574afc" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q5_K_S.gguf", + "size": 21080511072, + "blob_id": "94adfe0c737cecbb24c4d346e2b0f3b75d293341", + "lfs_sha256": "20c7a94b43506f91ed4f77ec005787299d33f36054e296cdeed4e4e160aa5ffe" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q6_K.gguf", + "size": 25092532832, + "blob_id": "326abc9897e8e3bdabb3ec20b3dfa2eba41b6e49", + "lfs_sha256": "2aa8901a579864699b7b8e5dc27419eda35859fc44f55883f8f1f84a5c2c7617" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q8_0.gguf", + "size": 32483932768, + "blob_id": "c9212fac5c22ebb110a690d003ac18c5188eab1c", + "lfs_sha256": "7180a59c7992c1245a88502c82cd1dc820f2de0fb46623454b96d376d36feb51" + } + ] +} diff --git a/bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF.json b/bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..22d3bcf0dceab08005840c93f655a8cf561f1b9f --- /dev/null +++ b/bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF.json @@ -0,0 +1,161 @@ +{ + "repo_id": "mradermacher/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF", + "requested_repo_id": "mradermacher/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF", + "commit_sha": "71a2191afbbdcf8ed15a11528d98f9c0747150f5", + "gguf": { + "total": 30532122624, + "architecture": "qwen3moe", + "context_length": 40960, + "quantize_imatrix_file": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.imatrix.gguf", + "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {{- messages[0].content + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within XML tags:\\n\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n\\n\\nFor each function call, return a json object with function name and arguments within XML tags:\\n\\n{\\\"name\\\": , \\\"arguments\\\": }\\n<|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0].content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" and message.content is string and not(message.content.startswith('') and message.content.endswith('')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if message.content is string %}\n {%- set content = message.content %}\n {%- else %}\n {%- set content = '' %}\n {%- endif %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '' in content %}\n {%- set reasoning_content = content.split('')[0].rstrip('\\n').split('')[-1].lstrip('\\n') %}\n {%- set content = content.split('')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- if loop.index0 > ns.last_query_index %}\n {%- if loop.last or (not loop.last and reasoning_content) %}\n {{- '<|im_start|>' + message.role + '\\n\\n' + reasoning_content.strip('\\n') + '\\n\\n\\n' + content.lstrip('\\n') }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n\\n' }}\n {{- content }}\n {{- '\\n' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '\\n\\n\\n\\n' }}\n {%- endif %}\n{%- endif %}", + "eos_token": "<|im_end|>", + "totalFileSize": 7078292384 + }, + "fetched_at_utc": "2026-09-06T11:32:08.403992+00:00", + "siblings": [ + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ1_M.gguf", + "size": 7078292384, + "blob_id": "8170f46cb460497b686c4322a70acaafc4e7b83e", + "lfs_sha256": "e3a098819dff4b93c3ce27e24983d42898ef0fe1dd041c66c6125c06258a98e4" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ1_S.gguf", + "size": 6416509856, + "blob_id": "99be3f73d73dc607784cc2805d63f5e23428b81a", + "lfs_sha256": "03fc643bca35fa368e9707c14dcff7af57a82a9d57a8e3cb00080455a6616f9e" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ2_M.gguf", + "size": 10169508768, + "blob_id": "eadd35adcc0c4173161474203718f33db8614c53", + "lfs_sha256": "0730026e9e1b00bc93cb3fafa5978a225385c88927233e89d4a192334d90b579" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ2_S.gguf", + "size": 9287132064, + "blob_id": "1c53e1eaed13ea57fdcab6177870dbd56063e8e5", + "lfs_sha256": "520816ec6fd95ffaa5b6f5f0b0e2445018adbd407d0ec735e02f62882e2b3655" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ2_XS.gguf", + "size": 9076222880, + "blob_id": "7a43f9e93a0e777deb7a8a4f8cd7955cbc207ab6", + "lfs_sha256": "48f3321ec5c53d8f9dcc3a788fdab5103fe3c5e4574241d29a2d33412f3233f7" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ2_XXS.gguf", + "size": 8181263264, + "blob_id": "a654c7a4b1e982620e9e931d179ecc96c62f4d41", + "lfs_sha256": "ca800b4d45134cdf26bbe084bf0f103b31c393b5d63562e1e7cfb129cbd2f5d5" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ3_M.gguf", + "size": 13513063328, + "blob_id": "78e58500bb60e56c7596037fd943a00991562940", + "lfs_sha256": "625bc7b45ff8a1d1107a166cfee6afe31f717aeeddc5af253520fd8b4c56c452" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ3_S.gguf", + "size": 13299153824, + "blob_id": "77ea7e1eb09f2f1bea0f575ff30295b953ee9e63", + "lfs_sha256": "baa007e33bb2f0af5fa9a1d6280e8d6d8f3d62be124f566b3688439b0053ae52" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ3_XS.gguf", + "size": 12598442912, + "blob_id": "e0196ce2835730599ac51e0959e744bcc90ed2f5", + "lfs_sha256": "6f3b0f9ac7b60c08c57ac1f9c92afce9a457d4d1a623b9e8cd195662229b3d2b" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ3_XXS.gguf", + "size": 11849327520, + "blob_id": "6f13e37f2a68ee952ffe4e415e784ad502730ab5", + "lfs_sha256": "64713833a8ec5b9d556c3f9ba5fdf6ea4853b9946af3915c67697e749b2b6da5" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ4_XS.gguf", + "size": 16368350112, + "blob_id": "8123e21b72ea342e5c61516d3ca823ebb86ff06a", + "lfs_sha256": "67ac0904b5b599a9c377ca966da32e427fc08c8380afa78a4ade60af9ace7d95" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q2_K.gguf", + "size": 11258610592, + "blob_id": "94935d543939bbc064b71eff2485d3aad6433cca", + "lfs_sha256": "70d70bbb6adcb4cc96ca927598f4878508bc762e1746fcec423eeb58c68f533f" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q2_K_S.gguf", + "size": 10519364512, + "blob_id": "8ec9f6e3926db2f95c783b9833fe28f97765e649", + "lfs_sha256": "6ef8c0280c210e75dc05e9e4e984526c4aee396dfb0b54413276039642329d8d" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q3_K_L.gguf", + "size": 15900670880, + "blob_id": "bc3065b27c80e6bf9a9db10d506a99279e00dde7", + "lfs_sha256": "8b361b8e4e690cd7f3f70a1a0f183e2b5e59e3e148ced181263dc081533b227f" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q3_K_M.gguf", + "size": 14711847840, + "blob_id": "f023e6c1e510bd3bf70869690d8634c4148288fc", + "lfs_sha256": "cb7ac37d6f98b410d795785b2f8f7225ad90461461c4fc0931f6ae29cd6cfde8" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q3_K_S.gguf", + "size": 13292469152, + "blob_id": "458b6a7eb031ff1b4912ea65f1f295be545ea7fc", + "lfs_sha256": "ceb1043b73facadafed47ccecf50cd623908ebc382629bf365a0376c9b3096bd" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q4_0.gguf", + "size": 17379988384, + "blob_id": "cae8587dbd1a858884af5d0b57e3e17afb950fb5", + "lfs_sha256": "fb580b5752b458cb9bffd0de462ef8d5734145faba6e6ce185ab44b8ec8ccc69" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q4_1.gguf", + "size": 19192501152, + "blob_id": "695ccefec7ec8a4e3e13769cbd94e3084179b88d", + "lfs_sha256": "1e351aaabad9f01242582bd1c42d6677f5ad6b80ded04fb7d8ef9d3f22dc3adc" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q4_K_M.gguf", + "size": 18556687264, + "blob_id": "2896c6cd792f84e571edb701b86b89caa6cba2f5", + "lfs_sha256": "bc19804d636e9ddcbf2f10c45537692ef0a4cb7703ff5133d5c4834517d9dad6" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q4_K_S.gguf", + "size": 17456010144, + "blob_id": "1dd59eba076c98ae95639708e608d2ee4199fab7", + "lfs_sha256": "a9f66a6fd5c5121e151feea777c3da7d95b0b46f5fff11da4b8108a2ce1d0842" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q5_K_M.gguf", + "size": 21725582240, + "blob_id": "ce8ff79f729234d16ede45b606ba8f10cc4f98a9", + "lfs_sha256": "b4197528852f4337fbef77d4ed7c65d24b53db935ac8bf4c22389c2dab81574b" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q5_K_S.gguf", + "size": 21080511392, + "blob_id": "da1ed69b15d82868205b689e310ba8bbe8db7f46", + "lfs_sha256": "2b17e366f568dcd4f8ac2abf576dfccdbf875a017d3eae1e74fc3b369ceff0dd" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q6_K.gguf", + "size": 25092533152, + "blob_id": "f2194e697d2eba7e06aa6d4b62f7832cfb6b712e", + "lfs_sha256": "54345129259a01b79cb37c06e08de394ef88979e9a5acec3eae5f595c456edbc" + }, + { + "rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.imatrix.gguf", + "size": 122029312, + "blob_id": "b75869a3bd1af77fb8d56f89d10950d9fd4acaef", + "lfs_sha256": "35240639f078793bcb93c62bfdd9a5ebf878d7eb35ab74ec86a3ddd153c98992" + } + ] +} diff --git a/bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-GGUF.json b/bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-GGUF.json new file mode 100644 index 0000000000000000000000000000000000000000..6d233ac1192da8d0de71debca297a13a3bd0c820 --- /dev/null +++ b/bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-GGUF.json @@ -0,0 +1,94 @@ +{ + "repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "requested_repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF", + "commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059", + "gguf": { + "total": 30532122624, + "architecture": "qwen3moe", + "context_length": 40960, + "chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n'}}{% if message['content'] is string %}{{ message['content'] }}{% else %}{% for content in message['content'] %}{% if content['type'] == 'image' %}{{ '\n' }}{% elif content['type'] == 'video' %}{{ '