Instructions to use elichen-skymizer/GAP-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use elichen-skymizer/GAP-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf elichen-skymizer/GAP-models:UD-Q4_K_XL # Run inference directly in the terminal: llama cli -hf elichen-skymizer/GAP-models:UD-Q4_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf elichen-skymizer/GAP-models:UD-Q4_K_XL # Run inference directly in the terminal: llama cli -hf elichen-skymizer/GAP-models:UD-Q4_K_XL
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf elichen-skymizer/GAP-models:UD-Q4_K_XL # Run inference directly in the terminal: ./build/bin/llama cli -hf elichen-skymizer/GAP-models:UD-Q4_K_XL
Use Docker
docker model run hf.co/elichen-skymizer/GAP-models:UD-Q4_K_XL
- Llama new
- LM Studio
- Jan
- Ollama
How to use elichen-skymizer/GAP-models with Ollama:
ollama run hf.co/elichen-skymizer/GAP-models:UD-Q4_K_XL
- Unsloth Desktop
- Pi
How to use elichen-skymizer/GAP-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf elichen-skymizer/GAP-models:UD-Q4_K_XL
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "elichen-skymizer/GAP-models:UD-Q4_K_XL" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use elichen-skymizer/GAP-models with Docker Model Runner:
docker model run hf.co/elichen-skymizer/GAP-models:UD-Q4_K_XL
- Lemonade
How to use elichen-skymizer/GAP-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull elichen-skymizer/GAP-models:UD-Q4_K_XL
Run and chat with the model
lemonade run user.GAP-models-UD-Q4_K_XL
List all available models
lemonade list
- Hermes Agent
How to use elichen-skymizer/GAP-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf elichen-skymizer/GAP-models:UD-Q4_K_XL
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default elichen-skymizer/GAP-models:UD-Q4_K_XL
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use elichen-skymizer/GAP-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf elichen-skymizer/GAP-models:UD-Q4_K_XL
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "elichen-skymizer/GAP-models:UD-Q4_K_XL" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Upload folder using huggingface_hub
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- .gitattributes +15 -0
- DECODING_PARAMS.md +81 -0
- README.md +36 -0
- backup_metadata/SHA256SUMS +473 -0
- backup_metadata/candidate-disposition.json +0 -0
- backup_metadata/manifest.json +0 -0
- bpw/BPW.csv +71 -0
- bpw/BPW.json +2087 -0
- bpw/REPORT.md +180 -0
- bpw/REVIEW.md +15 -0
- bpw/build_report.py +75 -0
- bpw/hf/README.md +21 -0
- bpw/hf/check_scan.py +41 -0
- bpw/hf/checks.log +1 -0
- bpw/hf/excluded.json +137 -0
- bpw/hf/file-matches.json +0 -0
- bpw/hf/hf-bpw-estimates.csv +71 -0
- bpw/hf/hf-bpw-estimates.json +0 -0
- bpw/hf/inventory.json +668 -0
- bpw/hf/repo-metadata/bartowski__Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF.json +192 -0
- bpw/hf/repo-metadata/bartowski__Jackrong_Qwen3.5-4B-Neo-GGUF.json +178 -0
- bpw/hf/repo-metadata/bartowski__Muse-Glimmer-30B-GGUF.json +216 -0
- bpw/hf/repo-metadata/bartowski__OpenGVLab_InternVL3_5-30B-A3B-GGUF.json +203 -0
- bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.5-4B-GGUF.json +178 -0
- bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.6-35B-A3B-GGUF.json +222 -0
- bpw/hf/repo-metadata/bartowski__ReadyArt_gemma-4-31B-it-scotoma-2-GGUF.json +204 -0
- bpw/hf/repo-metadata/bartowski__ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF.json +204 -0
- bpw/hf/repo-metadata/bartowski__allura-org_Qwen3.6-35B-A3B-Anko-GGUF.json +204 -0
- bpw/hf/repo-metadata/bartowski__darkc0de_Muse-Glimmer-30B-heretic-GGUF.json +204 -0
- bpw/hf/repo-metadata/bartowski__google_gemma-3n-E4B-it-GGUF.json +144 -0
- bpw/hf/repo-metadata/bartowski__google_gemma-4-31B-it-GGUF.json +222 -0
- bpw/hf/repo-metadata/bartowski__google_gemma-4-E4B-it-GGUF.json +173 -0
- bpw/hf/repo-metadata/bartowski__huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF.json +149 -0
- bpw/hf/repo-metadata/bartowski__zai-org_GLM-4.6V-Flash-GGUF.json +185 -0
- bpw/hf/repo-metadata/ggml-org__Kimi-VL-A3B-Thinking-2506-GGUF.json +59 -0
- bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF.json +82 -0
- bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF.json +161 -0
- bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-GGUF.json +94 -0
- bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-i1-GGUF.json +161 -0
- bpw/hf/repo-metadata/unsloth__GLM-4.6V-Flash-GGUF.json +191 -0
- bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-GGUF.json +166 -0
- bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-MTP-GGUF.json +160 -0
- bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-GGUF.json +186 -0
- bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-MTP-GGUF.json +174 -0
- bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-GGUF.json +161 -0
- bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-litert-preview-GGUF.json +161 -0
- bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-GGUF.json +198 -0
- bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-qat-GGUF.json +71 -0
- bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-GGUF.json +185 -0
- bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-qat-GGUF.json +77 -0
.gitattributes
CHANGED
|
@@ -158,3 +158,18 @@ qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf filter=lfs diff=lfs merge
|
|
| 158 |
qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 159 |
qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
|
| 160 |
qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 158 |
qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 159 |
qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
|
| 160 |
qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 161 |
+
bpw/native-bpw.json filter=lfs diff=lfs merge=lfs -text
|
| 162 |
+
gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 163 |
+
gemma-4-31b-it/unsloth/mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 164 |
+
glm-4.6v-flash/unsloth/mmproj-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 165 |
+
internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 166 |
+
internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 167 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
| 168 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
| 169 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 170 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
| 171 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 172 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 173 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 174 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/mmproj-Kimi-VL-A3B-Instruct-bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 175 |
+
kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
DECODING_PARAMS.md
ADDED
|
@@ -0,0 +1,81 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# 本機模型的 model-card decoding 參數
|
| 2 |
+
|
| 3 |
+
查核日期: 2026-09-06 (UTC)。本次盤點 ~/models 的 GGUF 清單,核對八個選定 reference 入口的 header、reference profiles 及官方 model-card / generation_config;不代表全部量化版本完成 decoding 或完整性驗證。Reference 操作與待補流程見 [RunPod handover](/home/ubuntu/llamacpp_reference_runpod_handover.md)。舊 smoke 與移除模型的紀錄仍保留,不能當作目前完整工作清單。
|
| 4 |
+
|
| 5 |
+
本次目標為 9 個 checkpoint。Kimi Instruct 與 Thinking-2506 分開,使用本機 llama.cpp 轉換的 BF16 LLM / BF16 mmproj;其餘使用 Bartowski BF16 pair。Muse 已重新下載並完成 21 列容量與 thinking/high 生成驗收。Gemma 26B 與 Qwen3-VL 不在本次目標清單。使用各交接包的外部 profiles,不使用仍含 Gemma 26B 的歷史內建 profile。
|
| 6 |
+
|
| 7 |
+
本次固定 n_threads=8、threads_batch=8、metric_threads=8、FA on、all GPU layers、swa_full=false。100 / 500 題的 generated-token caps 由本輪 native 調查提出,不沿用舊 profile。初始探測提案為 pilot instruct=2048 / thinking=8192,較少預選題目的長度敏感度為 4096 / 16384;兩個小模型的 100 / 500 已凍結為 [可執行起始協定](/home/ubuntu/llamacpp_reference_runpod_handover_qwen_gemma_4b.md);其 500 cap 為 1024 / 4096,其餘 SNR 與最終評估組也已完成起始協定交付;最後三模型見 [專用交接](/home/ubuntu/llamacpp_reference_runpod_handover_internvl_glm_muse.md)。各模型採自己的 mmproj 預設,不傳 image-min-tokens / image-max-tokens,包括不顯式傳 -1。
|
| 8 |
+
|
| 9 |
+
下表列出官方推薦,含明確標記的歷史模型。`—` 表示引用段落沒有指定,不能解讀成 0 或停用。模型名稱連到官方來源;舊 server smoke 實際傳送的 overrides 由 [llamacpp_smoke_models.json](/home/ubuntu/projects/llm_reference_generator/scripts/llamacpp_smoke_models.json) 決定。
|
| 10 |
+
|
| 11 |
+
| 模型與模式 | temperature | top_p | top_k | min_p | presence_penalty | repetition_penalty |
|
| 12 |
+
|---|---:|---:|---:|---:|---:|---:|
|
| 13 |
+
| [Qwen3.5-4B](https://huggingface.co/Qwen/Qwen3.5-4B#best-practices):non-thinking / general | 0.7 | 0.8 | 20 | 0.0 | 1.5 | 1.0 |
|
| 14 |
+
| [Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B#best-practices):non-thinking | 0.7 | 0.8 | 20 | 0.0 | 1.5 | 1.0 |
|
| 15 |
+
| 歷史: [Qwen3-VL-4B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct#generation-hyperparameters):VL | 0.7 | 0.8 | 20 | — | 1.5 | 1.0 |
|
| 16 |
+
| 歷史: [Qwen3-VL-4B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-4B-Thinking#generation-hyperparameters):VL | 1.0 | 0.95 | 20 | — | 0.0 | 1.0 |
|
| 17 |
+
| [Gemma-4-E4B-it](https://huggingface.co/google/gemma-4-E4B-it#1-sampling-parameters):所有情境 | 1.0 | 0.95 | 64 | — | — | — |
|
| 18 |
+
| 歷史: [Gemma-4-26B-A4B-it](https://huggingface.co/google/gemma-4-26B-A4B-it#1-sampling-parameters):所有情境 | 1.0 | 0.95 | 64 | — | — | — |
|
| 19 |
+
| [Gemma-4-31B-it](https://huggingface.co/google/gemma-4-31B-it#1-sampling-parameters):所有情境 | 1.0 | 0.95 | 64 | — | — | — |
|
| 20 |
+
| [Muse-Glimmer-30B](https://huggingface.co/meta-models/Muse-Glimmer-30B#best-practices):官方 sampling 建議 | 1.0 | 0.95 | 64 | — | — | — |
|
| 21 |
+
| [GLM-4.6V-Flash](https://huggingface.co/zai-org/GLM-4.6V-Flash#evaluation-settings):官方評測設定 | 0.8 | 0.6 | 2 | — | — | 1.1 |
|
| 22 |
+
| [Kimi-VL-A3B-Instruct](https://huggingface.co/moonshotai/Kimi-VL-A3B-Instruct#model-variants):Instruct | 0.2 | — | — | — | — | — |
|
| 23 |
+
| [Kimi-VL-A3B-Thinking-2506](https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506#31-inference-with-vllm):Thinking | 0.8 | — | — | — | — | — |
|
| 24 |
+
| [InternVL3.5-30B-A3B](https://huggingface.co/OpenGVLab/InternVL3_5-30B-A3B/blob/ba1762d830e2aeddb3272b66ba9e0abf7e69f626/README.md#L410): thinking | 0.6 | U | U | U | U | U |
|
| 25 |
+
|
| 26 |
+
InternVL 列的 U 同樣表示未指定。一般模式沒有統一 sampling 推薦;官方 Thinking Mode 需要 R1 system prompt,並建議 do_sample=True、temperature=0.6。本機與官方 template 都沒有 enable_thinking 分支。Reference 需保存 system prompt 本文與 hash,不能只保存一個 thinking boolean。
|
| 27 |
+
|
| 28 |
+
Kimi 是兩個專用 checkpoint,template 都沒有 enable_thinking 分支。Instruct card 與 generation_config 的 temperature 是 0.2;Thinking-2506 [card](https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506/blob/aa1730989e7558695b44ee493623e03bd325a994/README.md#L113) 是 0.8,[generation_config](https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506/blob/aa1730989e7558695b44ee493623e03bd325a994/generation_config.json) 與本機 GGUF 是 0.6。[本機 Thinking README](/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/README.md:30),記錄驗模採 greedy / top-k0 / top-p1 / min-p0。這些是不同 recipe,正式 reference 尚待選定,不能把驗模設定當成官方推薦。
|
| 29 |
+
|
| 30 |
+
本機 header 實測: Gemma 的 GGUF 指定 temp=1、top_k=64、top_p=0.95;GLM 指定 temp=0.8、top_k=2、top_p=0.6;Kimi Instruct / Thinking 分別指定 temp=0.2 / 0.6。InternVL 與 Qwen3.5 沒有 sampling metadata。原始檢查存於 [NVMe inventory](/opt/dlami/nvme/skymizer-decoding-audit-20260906/local-reference-headers.json)。這是 header 檢查,不取代完整性或品質驗收。
|
| 31 |
+
|
| 32 |
+
Native sampling 優先順序為 explicit CLI flags、GGUF sampling metadata、編譯時 defaults。目前 defaults 包括 top_k=40、top_p=0.95、min_p=0.05、temperature=0.8、repeat_last_n=64。現有 Gemma / GLM profiles 的 effective min_p 確實是 0.05,不能將主表未指定解讀成關閉。Qwen profiles 有明確 --min-p 0。完整 sampler 順序與 penalty 範圍也需固定並記錄。
|
| 33 |
+
|
| 34 |
+
八個正式來源都已由本機紀錄及官方 Hub 核對。兩個 Kimi 固定 revisions 為 Instruct 398eede0903cd983a2bfa0cc634e9ac1d843f375、Thinking-2506 aa1730989e7558695b44ee493623e03bd325a994。InternVL 官方來源為 OpenGVLab/InternVL3_5-30B-A3B,revision ba1762d830e2aeddb3272b66ba9e0abf7e69f626;GGUF 的 general.base_model 可能指前一階段 MPO / Base / Instruct 祖先,不能直接當作這次 reference 的精確來源。其他五個 checkpoint 的固定 card_source 仍見 [profiles](/home/ubuntu/projects/llama.cpp/tools/skymizer/scripts/reference_model_profiles.json)。
|
| 35 |
+
|
| 36 |
+
Kimi 的 temperature 建議見 Instruct card 的「Recommended parameter settings」;Thinking-2506 自己的推論範例也使用 0.8。舊 server smoke matrix 額外設定 `top_p=1.0`、`top_k=-1`(關閉 top-k),這是既有實驗沿用的設定,官方推薦段落未指定這兩項。Instruct card 也允許 greedy,本表沿用 0.2 的 sampling 建議。
|
| 37 |
+
|
| 38 |
+
## 模式與輸出長度
|
| 39 |
+
|
| 40 |
+
Seed=1234 是本次實驗設定,所查官方推薦沒有共同指定 seed。新 generation caps 須結合分 checkpoint / mode / dataset 的實測長度、容量與成本,不能用下列官方最大輸出建議直接填入。舊 vLLM 的 instruct=512 / thinking=2048 SNR 平台只作候選起點,不視為 native 已驗證;本輪原始單卡校準兩小時,後經使用者延長同一起點的截止至2026-09-06 17:00 UTC,接受 budget 截斷與 repetition 排除。完整協定見 [reference handover](/home/ubuntu/llamacpp_reference_runpod_handover.md)。
|
| 41 |
+
|
| 42 |
+
[Qwen3.5](https://huggingface.co/Qwen/Qwen3.5-4B/blob/851bf6e806efd8d0a36b00ddf55e13ccb7b8cd0a/README.md) 與 [Qwen3.6](https://huggingface.co/Qwen/Qwen3.6-35B-A3B/blob/995ad96eacd98c81ed38be0c5b274b04031597b0/README.md) 官方一般建議 max-output=32768,高難數理 / 競賽程式題為 81920。[Kimi Thinking 官方推論 recipe](https://huggingface.co/blog/moonshotai/kimi-vl-a3b-thinking-2506#get-started) 使用 32768。Qwen3.5 的上述固定 revision 沒有 generation_config.json;不從 Qwen3.6 或其他模型借用設定。
|
| 43 |
+
|
| 44 |
+
- Qwen3.5 / 3.6 的主表值是關閉 thinking 時使用的設定。兩張 card 的 thinking / general 都列 `temperature=1.0, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0`;thinking / precise coding 則將 temperature 改為 0.6、presence_penalty 改為 0.0。[Qwen3.5](https://huggingface.co/Qwen/Qwen3.5-4B#best-practices)、[Qwen3.6](https://huggingface.co/Qwen/Qwen3.6-35B-A3B#best-practices)。
|
| 45 |
+
- Qwen3.5 card 的 non-thinking / reasoning 在兩處不一致:API 前的建議區塊列 `1.0 / 0.95 / 20 / presence 1.5`,Best Practices 列 `1.0 / 1.0 / 40 / presence 2.0`(依序為 temperature / top_p / top_k / presence)。兩處的 min_p 都是 0、repetition_penalty 都是 1。本次移轉的 non-thinking / general 值不受影響;若改跑 reasoning,protocol 要明確記下選用哪個段落。[官方 card](https://huggingface.co/Qwen/Qwen3.5-4B#best-practices)。
|
| 46 |
+
- Qwen3-VL 主表引用 VL 區塊。Instruct 的 VL `out_seq_length=16384`,Thinking 的 VL 為 40960,兩者都列 `greedy=false`。Text 區塊另有設定:Instruct 使用 `temperature=1.0, top_p=1.0, top_k=40, presence_penalty=2.0`;Thinking 使用 `1.0 / 0.95 / 20 / presence 1.5`,兩者 repetition_penalty 都是 1.0。[Instruct card](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct#generation-hyperparameters)、[Thinking card](https://huggingface.co/Qwen/Qwen3-VL-4B-Thinking#generation-hyperparameters)。
|
| 47 |
+
- GLM 的值是重現排行榜評測所用的設定,card 另列 `max_generate_tokens=16K`。[官方來源](https://huggingface.co/zai-org/GLM-4.6V-Flash#evaluation-settings)。
|
| 48 |
+
- Gemma 的 sampling 建議不按 thinking 模式分組,也沒有在該段指定通用的生成長度、min_p、penalties 或 seed;範例的 `max_new_tokens` 不當成通用建議。[官方來源](https://huggingface.co/google/gemma-4-26B-A4B-it#1-sampling-parameters)。
|
| 49 |
+
|
| 50 |
+
## Gemma thinking 與先前驗證紀錄
|
| 51 |
+
|
| 52 |
+
歷史原生 `llama-reference` 驗證(2026-09-06,當時模型清單):8 個目錄、10 個權重版本的 instruct/thinking 共 48 筆,均完成生成與 KLD replay;另有 3 筆純文字 lane 測試。Gemma E4B、26B、31B 都已實際測過兩種模式。部分 thinking 回答到達 token cap;GLM thinking 雙圖題有一筆顏色誤答,流程通過不代表答案品質全對。當時結果與 review 紀錄見 [原生測試報告](/home/ubuntu/projects/llm_reference_generator/logs/native-reference/REPORT.md)。下表保留先前 server 路徑的驗證歷史。
|
| 53 |
+
|
| 54 |
+
|
| 55 |
+
官方以 system prompt 開頭的 `<|think|>` 啟用 thinking。舊 server 路徑把 `--enable_thinking` / `--no_enable_thinking` 轉成 `/apply-template` 的 `chat_template_kwargs.enable_thinking`,由 llama-server template 加入或移除控制內容,無需手動拼 system prompt。[官方 thinking 說明](https://huggingface.co/google/gemma-4-26B-A4B-it#2-thinking-mode-configuration)。
|
| 56 |
+
|
| 57 |
+
| 模型 | 本機確認範圍 |
|
| 58 |
+
|---|---|
|
| 59 |
+
| Gemma-4-E4B-it | llama-server 的 default / false / true template 已驗證;生成、GT prefix 與 KLD replay 位置檢查通過。[紀錄](/home/ubuntu/projects/llm_reference_generator/logs/native-template-refactor/results.json) |
|
| 60 |
+
| Gemma-4-26B-A4B-it | BF16、MXFP4_MOE、UD-Q3_K_M、UD-Q4_K_M、UD-Q4_K_S 均通過非 thinking 的文字、單圖、雙圖、OCR;thinking=true 能生成思考內容,logprobs 為有限值。thinking probe 上限 32 tokens,未驗證完整思考答案。[報告](/home/ubuntu/projects/llm_reference_generator/logs/gemma-4-26b-a4b-smoke/REPORT.md) |
|
| 61 |
+
| [Gemma-4-31B-it](https://huggingface.co/google/gemma-4-31B-it#2-thinking-mode-configuration) | 官方說明支援 thinking;已讀取本機 bartowski BF16 GGUF:template 有 `enable_thinking` 分支,true 會加入 `<|think|>`。這次是 template 靜態確認,未新增 31B thinking 生成測試。 |
|
| 62 |
+
|
| 63 |
+
舊 server 路徑省略 thinking 旗標時沿用 server 設定;GGUF template 本身的 default 不一定等於 server 最終採用值,要看 `/apply-template` 的實際結果。26B 個別紀錄見 [gemma-4-26b-a4b-it/DECODING_PARAMS.md](gemma-4-26b-a4b-it/DECODING_PARAMS.md)。
|
| 64 |
+
|
| 65 |
+
## 套用方式與紀錄
|
| 66 |
+
|
| 67 |
+
現在的原生入口位於 `~/projects/llama.cpp/tools/skymizer/cli/generate_reference.py`,在 `--` 後傳 llama.cpp sampling flags;有效值存在 metadata 與 row,無 HF tokenizer 對齊步驟。以下 `sampling_policy` 與 server echo 說明保留給舊 server 流程。
|
| 68 |
+
|
| 69 |
+
`sampling_policy=native` 預設沿用 llama-server 的 sampler 順序與未覆寫數值;這份 Markdown 不會自動載入。要使用主表數值,須明確給 generator 的 sampling flags,或設定 server 預設。model-card 數值也可搭配 native policy 使用,不必為此切換到 `vllm-like`。
|
| 70 |
+
|
| 71 |
+
`vllm-like` 是另一種 sampler / penalty 語意。使用哪個 policy、實際有哪些 overrides,都應記在 study protocol;生成 row 的 `generation_sampling_params` 保存 server echo 的實際值,`generation_server_args.sampling_sources` 記錄來源。[操作指南](/home/ubuntu/llamacpp_reference_dataset_guide.md)。
|
| 72 |
+
|
| 73 |
+
本文件新增 Gemma 26B 的參數紀錄,不會自動把它加入標準 smoke matrix。前次 26B smoke 使用 server-native sampling,因此只證明當時設定下流程可運作,不能當成已驗證官方建議參數下的品質結果。
|
| 74 |
+
|
| 75 |
+
## 本輪 native warning 查核
|
| 76 |
+
|
| 77 |
+
Gemma 的 `</s>` / `<|tool_response>` 型別 warning 與 GLM 的 EOT warning 伴隨 native 相容處理;Qwen 的 unused blk.32 / blk.40 tensors 是 autoregressive 模式略過的 embedded MTP 層,不能據此判定權重損壞。InternVL 的 NORMAL `</s>` token 128247 會被 native 加成 CONTROL / EOG,若生成它可能提前停止;短測未觀察到此情況,仍記為停止語義差異。Vocabulary fingerprint 不包含完整 EOG 集合,因此 binary / source identity 與實際 stop token 必須一併保存。
|
| 78 |
+
|
| 79 |
+
[逐模型 header / runtime / stop 證據](/opt/dlami/nvme/skymizer-length-audit-20260906/warning-triage/header-runtime-evidence.json)、[原始碼與 binary commit 查核](/opt/dlami/nvme/skymizer-length-audit-20260906/warning-triage/source-verification.json)。這些結論是 loader 行為查核,不是對全部 candidate 的完整性核准。
|
| 80 |
+
|
| 81 |
+
本輪最終評估組已通過獨立 gpt-6-astra max review,commit b2ced7edde884c3a72218974687fdceb4acb5bd4。InternVL R1 system prompt 由 profile 明確傳入;GLM 保留原生 thinking branch;Muse 只收 thinking/high,固定 current_date=2026-09-06,完整 native sampler config78 已實測相等。3 模型均使用 c32768/b2048/ub512/np1/t8/tb8、FA on、all GPU layers、f16 K/V、fit off、省略 image flags、swa_full=false。Upstream 支援基底固定6a1a922d269908a29cbd4b49c27e6a8e7fd10fae,不新增模型實作。候選數值品質另行檢測,不由短 reference 驗收推論。
|
README.md
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- gguf
|
| 4 |
+
- multimodal
|
| 5 |
+
- quantization
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
# GAP model archive
|
| 9 |
+
|
| 10 |
+
This repository backs up the retained local models used for GAP reference generation and quantization evaluation. It contains multiple model families and checkpoints. Select an individual checkpoint and its projector when loading a model.
|
| 11 |
+
|
| 12 |
+
The directory layout preserves the original model-family/provider paths. The two Kimi checkpoints keep their separate directories, conversion records, and original Hugging Face source files. Split GGUF files, projectors, and draft heads are retained with their model files.
|
| 13 |
+
|
| 14 |
+
## Files and provenance
|
| 15 |
+
|
| 16 |
+
[The manifest](backup_metadata/manifest.json) records file sizes, SHA256 values, checksum evidence, and pinned source identities. [SHA256SUMS](backup_metadata/SHA256SUMS) covers the backed-up source files. Files produced by local conversion retain their conversion records; a pinned base checkpoint does not imply that the converted GGUF was downloaded from that source repository.
|
| 17 |
+
|
| 18 |
+
Some source identities are established by exact full-file SHA256 agreement with a pinned upstream file. This establishes byte identity without reconstructing the original download history. Verified identical Hub files may be copied server-side into this repository; other files are uploaded from local storage. Both transfer paths are checked against the same final file manifest.
|
| 19 |
+
|
| 20 |
+
## Qualification scope
|
| 21 |
+
|
| 22 |
+
[Candidate disposition](backup_metadata/candidate-disposition.json) is the current qualification record. It supersedes older smoke-test summaries retained in conversion directories.
|
| 23 |
+
|
| 24 |
+
Candidate usability is evaluated with the current llama.cpp CUDA 13.2.51 build on an NVIDIA RTX PRO 6000. The upstream model-support boundary is commit `6a1a922d269908a29cbd4b49c27e6a8e7fd10fae`. The sparse numerical screen uses three fixed text windows and 765 next-token targets per candidate; flagged numerical results receive additional fixed-window confirmation. Reference NLL columns and runtime settings are checked against same-checkpoint controls.
|
| 25 |
+
|
| 26 |
+
A passing sparse screen means that the tested files did not show the screened severe failures. It does not certify full-corpus quality, all image/context combinations, or a statistical SNR claim. Projectors, draft heads, and original source tensors are auxiliary artifacts, not separately qualified standalone candidates.
|
| 27 |
+
|
| 28 |
+
Confirmed candidates unusable in this CUDA environment are excluded from this archive. When their full-file SHA matches upstream, the recorded reason is a runtime-specific numerical failure, not a corrupt download.
|
| 29 |
+
|
| 30 |
+
Gemma metadata compatibility is scoped to the current no-tool benchmark: token IDs, decoded pieces, full-corpus tokenization, and rendered benchmark prompts must agree. EOS metadata differences do not by themselves establish numerical failure. The applicable compatibility setting and numerical outcome are recorded with the candidate disposition.
|
| 31 |
+
|
| 32 |
+
## Licenses and attribution
|
| 33 |
+
|
| 34 |
+
The files retain the licenses and terms of their respective model authors and providers. This archive does not assign one replacement license to all included models. Consult the pinned source repositories in the manifest and the original model/conversion records for attribution and applicable model terms.
|
| 35 |
+
|
| 36 |
+
Rebuildable virtual environments, caches, Git internals, and agent working directories are excluded from the backup.
|
backup_metadata/SHA256SUMS
ADDED
|
@@ -0,0 +1,473 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
aee47727c2d3049491c1bf049cd2f6e1963badd3a8947ab3f9b711a0ad56d3ba DECODING_PARAMS.md
|
| 2 |
+
442d560a29da5e7a001c431decba3eb1560641c179df00d4b4f63e63fb90d771 bpw/BPW.csv
|
| 3 |
+
f8c9f0c783ec3602c3eaa9eced3112c8947c5e28649daf39f92066339e6f72d1 bpw/BPW.json
|
| 4 |
+
d9a33df7b3a2ba695d76b4ad7af1d88e91f00948c0da99c57628f19fbac9942a bpw/REPORT.md
|
| 5 |
+
8fd785fa418595252201c14864610fc0a637450b97f63e3785efdffee9b5426d bpw/REVIEW.md
|
| 6 |
+
3041c5285ebc9780047fecdcbd0c42058343d985c0c5223def206b849e2b145c bpw/build_report.py
|
| 7 |
+
1077851bce21123b81e51b32f29c0bd87dfe68969d7f87a32288341ad4d3f4f4 bpw/hf/README.md
|
| 8 |
+
26d912662d89bbf455a20a0768a8a3d4a75647f00c3dfa36e67b171c281157d6 bpw/hf/check_scan.py
|
| 9 |
+
90c542af66fd62fc0256a1fbf28a804b87ba862fc416a0663fd99b835e435643 bpw/hf/checks.log
|
| 10 |
+
59b9c7eed8c4e8bf1eb6f9a213c0842dfb3266427bb43751b0bff7fea3fe12ad bpw/hf/excluded.json
|
| 11 |
+
115d3901137c47c45be45b7ef3d0d32a2612ad0612cd722e547f92a25ac8c71f bpw/hf/file-matches.json
|
| 12 |
+
94b22dd3275ed0419813e4ee2a0175810e52ef9d23c925bd2aecb89b7c94065f bpw/hf/hf-bpw-estimates.csv
|
| 13 |
+
a61c38b1f34d45e08092599c4b01f2d4cb0028c278820acca2872e6c13cb8a9c bpw/hf/hf-bpw-estimates.json
|
| 14 |
+
8bb0baf3a3a77e530267ba9d2cfc1a407ee25cd4f4e6dd2cecd51e9e9d504467 bpw/hf/inventory.json
|
| 15 |
+
ae60863468409f106b304ceb2d589f6b44de7edbb7246f421e562481ca303e0a bpw/hf/repo-metadata/bartowski__Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF.json
|
| 16 |
+
2ca179ac064f55f5515d3fb31b04494f6c40963bf4c72bb0781eef2fec83349e bpw/hf/repo-metadata/bartowski__Jackrong_Qwen3.5-4B-Neo-GGUF.json
|
| 17 |
+
a5481c82b52b86820a7232f693870f7d4d0b3113a64ce966cd283c7539000903 bpw/hf/repo-metadata/bartowski__Muse-Glimmer-30B-GGUF.json
|
| 18 |
+
abfa609b0e6c5eb72ccace1e1abdd2f0bc93eff8c36bc2cd123a255b053b41ab bpw/hf/repo-metadata/bartowski__OpenGVLab_InternVL3_5-30B-A3B-GGUF.json
|
| 19 |
+
0e9a473a6fcdf7cbb0622bc3bba1f4b145f7920490ca8304faefd96b8e83b679 bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.5-4B-GGUF.json
|
| 20 |
+
691d71c633f61e1d91255aea040f9daf76b3d5f21ec2a5842fc1583f55c08348 bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.6-35B-A3B-GGUF.json
|
| 21 |
+
92042d305ec2e16c8eea1cbd85cb1083fecfa68bb6715436a6e079b294da97ee bpw/hf/repo-metadata/bartowski__ReadyArt_gemma-4-31B-it-scotoma-2-GGUF.json
|
| 22 |
+
65704a6c2cdf929e846773aab2a8363b509e2004e367bb9cfc1db9519a8676d4 bpw/hf/repo-metadata/bartowski__ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF.json
|
| 23 |
+
297066582c0d5723809fbb3d4b084fd914ea0589728e31a8d77d9f37e620822d bpw/hf/repo-metadata/bartowski__allura-org_Qwen3.6-35B-A3B-Anko-GGUF.json
|
| 24 |
+
e2347d20305c8309d46f558b0761a7b2d09e14e4868f1cce02f85e9353d69ef2 bpw/hf/repo-metadata/bartowski__darkc0de_Muse-Glimmer-30B-heretic-GGUF.json
|
| 25 |
+
ab42eff98a2ed33d98826fc056b158e33ba5921ba83db89c48c6f86c15653022 bpw/hf/repo-metadata/bartowski__google_gemma-3n-E4B-it-GGUF.json
|
| 26 |
+
bbdc3f8de36e6b5fe7b78f02ca6756f77bb8e78062f7f6448340be6aa62cbc7b bpw/hf/repo-metadata/bartowski__google_gemma-4-31B-it-GGUF.json
|
| 27 |
+
6835928c30b5c3155a4daa99fb9a4ce9f5fed325becf79f6903a47ca89cfdbba bpw/hf/repo-metadata/bartowski__google_gemma-4-E4B-it-GGUF.json
|
| 28 |
+
4887670f9022da02654f3f76eec99ebfcf516bb84529d215c12b09df02613343 bpw/hf/repo-metadata/bartowski__huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF.json
|
| 29 |
+
c5c917494d5ce8e1049c51f246ac08da30bbba231db2e6b22842b24509a82e86 bpw/hf/repo-metadata/bartowski__zai-org_GLM-4.6V-Flash-GGUF.json
|
| 30 |
+
cb6f7f4f49ea02351bdd5cd15a5e1704a873673bc93e20fd10407a36b160bcaf bpw/hf/repo-metadata/ggml-org__Kimi-VL-A3B-Thinking-2506-GGUF.json
|
| 31 |
+
3500efd7576084b5d2980569976157b96263e186e5c15558a6711b4e31a425a6 bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF.json
|
| 32 |
+
dd1223aaecd16cf1b18a81040ecd4c638dff27242ea675de3734f8ae34616f8b bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF.json
|
| 33 |
+
4f8a61f81deba1d1c013b1eb88a0c4e4f25bd4f28ee4caeacc9d970b26684086 bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-GGUF.json
|
| 34 |
+
87eb08d054963fe5d2e36997538d8f43379a5b72f493a57af48f34b09ab6e0ec bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-i1-GGUF.json
|
| 35 |
+
804c2446f87f81dcadf83dbf81d4ac16ab2141794f97e094cb5c8539f9ce7803 bpw/hf/repo-metadata/unsloth__GLM-4.6V-Flash-GGUF.json
|
| 36 |
+
2a48c5d3807e2c08aa172b38aedb85338a1652126bc12029b0214301915c4846 bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-GGUF.json
|
| 37 |
+
5c402e96a7ee07c79ca857047648fc4e8b23494261c4c3b370c87e1f1b9263b4 bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-MTP-GGUF.json
|
| 38 |
+
ffc0a7858244d6d7ea3369823d1cbf48adaf0dc7d4f43051bc854b5032699388 bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-GGUF.json
|
| 39 |
+
f3dd9452e1b758c89b29ac19a9efcd538ddd3e6c2ab332ef47e30c5f37cf28a7 bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-MTP-GGUF.json
|
| 40 |
+
57980ddf4afe2a3c4ae343f9fd469913d001727aa9eb9e1c45dbdae35439d051 bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-GGUF.json
|
| 41 |
+
0e627f70f3f4583e68a5a0a45ba14247a90676c57dc5ec1d0bb947ffc1133448 bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-litert-preview-GGUF.json
|
| 42 |
+
07ea1b10bf0a98f6232ccc1d10732049c32b2487fa44256d399ae686e6de697a bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-GGUF.json
|
| 43 |
+
d9db6b1164b0eff3ee5e616dea87894092e2ad5f944ad880300e11dd40580b37 bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-qat-GGUF.json
|
| 44 |
+
7f2184cf0a9620e6355a2b4fe1b3a1c977d888746822cb2872fba986b4b6fecd bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-GGUF.json
|
| 45 |
+
d1070ee62a98848127e13bc54e96759fd71e55db186946bc36784d68f69a21be bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-qat-GGUF.json
|
| 46 |
+
89d010b467b4d3ea0e99011b39cd0fc8fecb6f20283267695ae3baf70588a147 bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-qat-mobile-GGUF.json
|
| 47 |
+
c4e3d1e0677150d35722bc1c086ef5600debe0e578395201c2fb596e0e9498c1 bpw/hf/repository-discovery.json
|
| 48 |
+
55ab641973192bc9ad92268e6134878246a350c6ade9a9b9c8dd8d614e36592b bpw/hf/scan.log
|
| 49 |
+
d1a71c525e9cd169f6f7ddf862881cc6c003dc572124eb4808e51a9968ec1e4f bpw/hf/scan_hf.py
|
| 50 |
+
0797ac9440cae2cb03cf19bf1dd34e90c84c229a5870c0c694d815ed21e36d4a bpw/hf/summary.json
|
| 51 |
+
8760508d3cee162ec48e21128afe94bf0359619b690e1651f40b31fde22ea090 bpw/main-tensor-shape-validation.json
|
| 52 |
+
553cf7d5d9e9d3ea565e3c747ca8daf34861e8472e79a38ec08f9da8400be0d4 bpw/model-removals-20260906.json
|
| 53 |
+
3ac40c5526e9ac6c71072f11d9dc3e0c16a9d23b22ce270b64c2837c2cb987e7 bpw/model-removals-q3-k-s-20260906.json
|
| 54 |
+
8e74ddeebf450c4c351bc172d9c8bf31b0b1adbd4ca9a7c5e1fc3f2a99bcd402 bpw/native-bpw.csv
|
| 55 |
+
0c2ee9efd2cf21c9d890b7ac47017c7d0f6128112f7356c173de20e68afc0be2 bpw/native-bpw.json
|
| 56 |
+
51625e55bff23efa01a107a88b4d953af61ef370865618e2f4f1a44a5da74421 bpw/native-scan.log
|
| 57 |
+
65ca0470ca28854caa47c2c479dbf06fbe90538bfddda391d7f1a7a6534b4530 bpw/refresh-validation.json
|
| 58 |
+
f85544114bb26a20b8242eee51c3a33ccb41263a749deff2f3e1472ffb9eceb4 bpw/refresh-validation.log
|
| 59 |
+
582b4cecece7458c4d9566eba8d19e184f06b8f736cc7cc6fc09dcc9e05716bb bpw/report-validation.json
|
| 60 |
+
935b10b1bed14e5e60a00c09009637fa73b1a7d66fb5a5bf8f5d6aba24675218 bpw/scan_native_bpw.py
|
| 61 |
+
84b8cc5fc87fd0d71eadaaf5ee8f05b2d3a109a7508c228025adb6c14bd32ee8 bpw/validate_native_bpw.py
|
| 62 |
+
d7ca1cf55a2dc5fbbe3386a4467984e1f30ef15a2fc0a9b14533c314a9a74788 bpw/validate_refresh.py
|
| 63 |
+
279e6b73fa5ff7c02169649bcc4863cf2ccdd668979a417902c99bbe1ff31802 bpw/validation.json
|
| 64 |
+
298ad89cbb3f2b877e19c6088a392bdf5b04386adfe8d449bf2c1d4e4762bf4b bpw/validation.log
|
| 65 |
+
00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf
|
| 66 |
+
ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29 gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf
|
| 67 |
+
05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7 gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf
|
| 68 |
+
0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf
|
| 69 |
+
4591e5ee10527739514d6db436b51169c882949e3858d30285aa997b0b253554 gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_0.gguf
|
| 70 |
+
567d744757d575d84c0a42278091223aa2351cdae8f375d4962eec44272659be gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_1.gguf
|
| 71 |
+
2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75 gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf
|
| 72 |
+
a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52 gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf
|
| 73 |
+
21487ff26d08f7ddd1d654d3bbfc1ae1020aab3119f5bf654742ce4697732e4e gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf
|
| 74 |
+
743b2b719e448f9a06e774b4f33dd7a391a73e94d32297c7590256484562eb52 gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf
|
| 75 |
+
75afa3b3ce99d8b85c27f85cf29f9e1171814211435c7eac4a387c5b36a68629 gemma-4-31b-it/integrity-check-20260906.json
|
| 76 |
+
3ad569528558f3915d907ead645aff66193c5a255d38a948ac313ca3654411e4 gemma-4-31b-it/integrity-check-20260906.md
|
| 77 |
+
811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92 gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf
|
| 78 |
+
e3d40b6e363954c993a6e28b160d881dfe5a243b62746bd4092b393d4f1d54e5 gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_XS.gguf
|
| 79 |
+
5c558b9b009e3ee69bde43e2b98a45d1f5afd316b9fbf447edd2ad4945a187bc gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_0.gguf
|
| 80 |
+
4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6 gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf
|
| 81 |
+
38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84 gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf
|
| 82 |
+
41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf
|
| 83 |
+
73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716 gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf
|
| 84 |
+
9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575 gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf
|
| 85 |
+
7a4601b12ec680f706a7e0c7e1f78f579b1db64d485a9e352ee87d4b9daa45e4 gemma-4-31b-it/unsloth/mmproj-BF16.gguf
|
| 86 |
+
b56f70624694ca5f2362cdafe6acffe35c5e0f44693c568f3f09fa83b968fb74 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_NL.gguf
|
| 87 |
+
a24429604e6f680e7bdf087b863a6cecc90f80b3d908f95d888f4f05003fdee3 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-IQ4_XS.gguf
|
| 88 |
+
00c50656f4b16b98ff9e07199e3c9fb5e776c159a62aaae9f56628b375f689f7 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q3_K_XL.gguf
|
| 89 |
+
604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf
|
| 90 |
+
be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf
|
| 91 |
+
d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf
|
| 92 |
+
81508a92a401ccd81292b0da59f43af7360b7b2215a67bc7901830d58bfdf260 gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_S.gguf
|
| 93 |
+
af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf
|
| 94 |
+
ffa64aebf7144bbadd5a1e143b77794d88e76a81cc0168d91de0770eb49e88e0 gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf
|
| 95 |
+
fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf
|
| 96 |
+
0847f7300471e9a61abaeb46b45b3d61e393af8fa6d6aa70c563623773670dd9 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_XS.gguf
|
| 97 |
+
4a403d2e4d80281063e4f517b1c061ded8476b4011a4fc2ba7dbff707075547e gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_0.gguf
|
| 98 |
+
430685a687edf70c4fdb1158aa92c34dbb38e1230f674849f198a954cc748405 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_1.gguf
|
| 99 |
+
85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf
|
| 100 |
+
0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf
|
| 101 |
+
7558880ee42b79ab732481bd7250e85c41d9ef044b22634b8a912eb184224009 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q3_K_XL.gguf
|
| 102 |
+
3cf61de12daa015ee0f7b68e7b7c541405bf220e1e942bad8b47cab827d7df80 gemma-4-e4b-it/unsloth/gemma-4-E4B-it-UD-Q4_K_XL.gguf
|
| 103 |
+
ee01cba03fd9c71ea2ea722225d24a84f72e7197714367e550ef705ef8851bc6 gemma-4-e4b-it/unsloth/mmproj-BF16.gguf
|
| 104 |
+
219b0fcf326d8d023004ce9fc27fa643bd73ebfb73684e8e0af742c1fd755b63 glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf
|
| 105 |
+
107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455 glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf
|
| 106 |
+
4342477286625c4cfcd70d0023bdb3ac30613fcce729123e0277097c7dc42e2d glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_XS.gguf
|
| 107 |
+
e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf
|
| 108 |
+
6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf
|
| 109 |
+
bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612 glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf
|
| 110 |
+
1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85 glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf
|
| 111 |
+
66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3 glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf
|
| 112 |
+
d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf
|
| 113 |
+
d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf
|
| 114 |
+
23ea7196ed6f595c44591266a1b4b90d56db5a66c5223d49a41a587b81ace35d glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_XS.gguf
|
| 115 |
+
c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf
|
| 116 |
+
66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf
|
| 117 |
+
4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf
|
| 118 |
+
258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf
|
| 119 |
+
b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628 glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf
|
| 120 |
+
74c30227dc957ed360a29b6002622472ec6fcc6a5105a1ba9a5b2a331e3a7833 glm-4.6v-flash/unsloth/mmproj-BF16.gguf
|
| 121 |
+
bf516e4962edd42afebb1f2dd1cbe9f5223863adec745bc4d81a0b1211ca5111 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_NL.gguf
|
| 122 |
+
c686a3a767fb94ef19499815036fdfb63213664cf0d5867c63848c7ec532d69c internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-IQ4_XS.gguf
|
| 123 |
+
c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf
|
| 124 |
+
b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf
|
| 125 |
+
f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf
|
| 126 |
+
c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf
|
| 127 |
+
a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95 internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf
|
| 128 |
+
37ab465cd0c2b47b6b68e17f6e1f3ffd48701a27518c71ad7ac21b7f5a8d9f24 internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf
|
| 129 |
+
469c362f36f7ad24dec0da0c75b2ebc681f60b160cee303421388b8375fc2161 internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf
|
| 130 |
+
d7b31eac832bb0d9adac61b3d5c81071df31ce1ad710d0e5758564e377bb14ea internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf
|
| 131 |
+
be28be57166c9903fe701c99596aa3c7df9f8c834f3109e6e9b4668d72cc646f internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.IQ4_XS.gguf
|
| 132 |
+
497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2 internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf
|
| 133 |
+
adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf
|
| 134 |
+
d768d7983f8bb8e7804812679b0626a2fc8a87383461b0285ee5e23370143f2b internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-IQ4_XS.gguf
|
| 135 |
+
6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9 internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf
|
| 136 |
+
cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27 internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf
|
| 137 |
+
97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80 internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf
|
| 138 |
+
30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf
|
| 139 |
+
06f4f7fa1e43a8ef3a1bca3ccb3411392506e4ca5b090fb15d1dbf4f4e1cd84a internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.mmproj-f16.gguf
|
| 140 |
+
7df3cc4aea067c496f012ab019e6cd68d023260d09edda1a874d849407ddd5e8 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/README.md
|
| 141 |
+
03b7838aaaf18a925facbcecf4d55a4f1569c313ae15a0718290a6284557e2db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/IQ4_NL-gguf-metadata.json
|
| 142 |
+
0133d2ae30d2d53e50cc30b41b734a150f022dbafb92b9fe5f6fd16ca0b1ed9e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/IQ4_XS-gguf-metadata.json
|
| 143 |
+
0c3d4df0d16b728146c7d56f2cb45558ec6542affb7853f0e9647289976c62c7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_0-gguf-metadata.json
|
| 144 |
+
a50b96ef2eca372eb668d866ad87d6ea6323eaefc6e411c82d7734c921a4d850 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_1-gguf-metadata.json
|
| 145 |
+
41b1f719042e2e027e22db41709708c1afb3b0839a306ae9f97913895cceda9f kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_K_M-gguf-metadata.json
|
| 146 |
+
fc6221a6305e49fdfd448efab5f719fede66846ae55363ea661cfb367985c3c1 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/Q4_K_S-gguf-metadata.json
|
| 147 |
+
24506cee5d9fb04f5b9601eab6fa0deb81497f18a9a600f3ef115ae7481b9409 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/SHA256SUMS
|
| 148 |
+
0a2f1d4ef6d0f1560c2346c2f03a491c8d5860f83165dae901ea285172beee17 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/bf16-structural-validation.json
|
| 149 |
+
a5387611ba8fbb7cae8583c5033a783276f13dc46b5039eee7fb38de6abf30c0 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/convert.py
|
| 150 |
+
6cc733d1d78ee81e43db3ad6048bb8ca20362577076cc811334e2dee1b6d9fb3 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/converter-help.txt
|
| 151 |
+
84a30db1c77a9c7c25f07dc350943e6ea6609ed92911dad149e2a36088053039 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/download.log
|
| 152 |
+
402972df91139cccce5c4e78d58c71f2fc280c247c15c8a21e51a36e8d77e7a2 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/environment-install.log
|
| 153 |
+
430991a44703de334edfcd291a50fbff9f560c5da97033a37a422e0f2462a080 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/finalize.py
|
| 154 |
+
7ddcbb5f0983ce3e83b6c9bb77d29c70863092c487f8433491fbfdeabbe24ed7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/hash_outputs.py
|
| 155 |
+
d507e19b297b81b9dcbd035ead7747e6d41a8612d35dd61a252c3075462ee932 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/independent-review.json
|
| 156 |
+
0a344bd4d189120753d40805fafc4f3977cfe43f5f99a4421a176a07fcd503e7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/independent_review.py
|
| 157 |
+
d0b80fd9af9fe9f24b825aaf2adc040f23b5f520339191fcd19372358f3e7468 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/manifest.json
|
| 158 |
+
19bbdeced9a9cda3c3ac719b2245778bb5a723f56863b9c4f073b35a434c897a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/manual-answer-review.json
|
| 159 |
+
86b0f251385c87edd983690acebb5311d9f7d934d91f80dfc0aab8912d13d0ac kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-conversion.log
|
| 160 |
+
62e0f8c914512923d2328b20cd173125a3d688417436ca4b4babc706ebd4717e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-gguf-metadata.json
|
| 161 |
+
ea3e770cc512da8b04940d6787e99c64efce5b0eedc6b74fb5f4a795ceedafd7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-launch.log
|
| 162 |
+
ea3e770cc512da8b04940d6787e99c64efce5b0eedc6b74fb5f4a795ceedafd7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/mmproj-status.json
|
| 163 |
+
0715622d1b8d24b833d31e4af2c0de704365d877922fbe99a72e0883c3df9e1d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/output-checksums.json
|
| 164 |
+
03b3a45a5d39b0c9b466343b538350f110317117a2f97412de0594a05574e54d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/output-checksums.log
|
| 165 |
+
bbeb84c5b9e416c248c102dfeaaaf4aea99cf3d774cb08e73c2650a2b28af03d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantization-summary.json
|
| 166 |
+
fa467bb97c03b75982343d0c54bc180dd2ce96997cb0bbf606cc3a92b27b7a8e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_NL.json
|
| 167 |
+
54437ca05eb10f0c5c75c31efb69ef2165295bcf873657ad32c2f6c32dd67415 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_NL.log
|
| 168 |
+
8c2dd36a9aed7361eab919393212d5ed0ed1ad03dd06ca886742f2e8d052cce5 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_XS.json
|
| 169 |
+
16cbb78feacfd244be26d80d8ddb2b2a5f6317e3ce1ed2f96d0e2f870b00be7e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-IQ4_XS.log
|
| 170 |
+
01f26b719e635cc4d07bb727ff5260bc012249bea56e7c76e729fb4e0da998fe kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_0.json
|
| 171 |
+
4289bee35b743ee4b1b1132914baf4ec65cd3e56ce4767c9c83f20a86d669615 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_0.log
|
| 172 |
+
c39ca9d15f9ae9f4db2c940f90d9ec7aab51bf2129ce6bac72c4f0ebfe2d4e78 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_1.json
|
| 173 |
+
06de5a296c1d5578ec20b783bc73f83713c1d1333a89b2bf031189dcbc57a142 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_1.log
|
| 174 |
+
849d625003784e62b3cd840d10325ba37b611dfbd2f7dac00bef9ee66b881662 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_M.json
|
| 175 |
+
8f214e491d4fff21b7340b42259a13cea3e1dc101b002dcb4e73d124ad5bd917 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_M.log
|
| 176 |
+
8a9d2e5299a9590218f65434653be46ba926981259e237dfef63eb2906e8fc0d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_S.json
|
| 177 |
+
9868bb3d3c8757c774048e1ffd76191be00dc780933cc42e1b01b634f9dce1ef kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-Q4_K_S.log
|
| 178 |
+
66c39b8bada2ffd705f70fdfc9b09deaca32d8ff9e071d81be4e19bf7e4902c7 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-all.log
|
| 179 |
+
1ba23d0fb43512ca1396280a8fd271bdc734888855dcc745fef13919001a83dc kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize-build.log
|
| 180 |
+
1ca2a80f507910d60625ebb25a918eb517cb20ca581ab9507f7ea09f37a96fac kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/quantize_all.py
|
| 181 |
+
a52a07f17ace264c4b932fa396fae80ecb0d2849faf3ea65d94c8a16ab9986b0 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/requirements.lock.txt
|
| 182 |
+
2ea3dbd7c83e77a5dd827c94e58cc01fc75c8339c43626f4ef3966aa0bfb7f81 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/run_smoke.py
|
| 183 |
+
4cb51193a96f44cb1c4dfbb40e17a4eb1891ad8fcd7e4d1fdb9fd3f4760d0b1d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL-launch.log
|
| 184 |
+
4cb51193a96f44cb1c4dfbb40e17a4eb1891ad8fcd7e4d1fdb9fd3f4760d0b1d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL-status.json
|
| 185 |
+
5b8428db0a3a50373e331706a38cee5b1668963325084adbd92cc2be9e9c3ce2 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL.log
|
| 186 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/events.jsonl
|
| 187 |
+
618f2ad33a69305d60fe2b62efed62c869d18cfd98bb1bd56ef9baa86f09d657 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/generations.jsonl
|
| 188 |
+
09994322e103f2f5e42fc7437d4bb7ef0247541b6bb637657b77d9742c04281a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_NL/metadata.json
|
| 189 |
+
5d91e2fb0fa073e35874d78f66316e8780ec6aadead22663601070c706402374 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS-launch.log
|
| 190 |
+
5d91e2fb0fa073e35874d78f66316e8780ec6aadead22663601070c706402374 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS-status.json
|
| 191 |
+
57b02e1985f4cbfb8f5cf53f42fddd26b2c05c06e12797d2cd4ec0615a36046c kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS.log
|
| 192 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/events.jsonl
|
| 193 |
+
ed5d7429d1d96a03a37a8b5f147aaa758000410c2b23316631378c6e24633c18 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/generations.jsonl
|
| 194 |
+
0ca30f160b1016c3e420af1d6442ff632ef4106e5b8af2a08e44cf5f6be005ad kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/IQ4_XS/metadata.json
|
| 195 |
+
a34cbf7863de4f68ba8dfb1526e362217939645205bc24b89132e9ba1a2d272a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0-launch.log
|
| 196 |
+
a34cbf7863de4f68ba8dfb1526e362217939645205bc24b89132e9ba1a2d272a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0-status.json
|
| 197 |
+
ccc8ccf7de92bf40727a101f8db236dd048440d251ea32904d23555aaa53f5ba kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0.log
|
| 198 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/events.jsonl
|
| 199 |
+
e776ce4447912f4a24d38c508c9d23857ba86d3363b1bf7754e33b747df33c38 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/generations.jsonl
|
| 200 |
+
df16019b9dbe81ccc58f52e8e33212cdf188b3a7774aee8e60ac1df3f16658bf kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_0/metadata.json
|
| 201 |
+
452aa440c36b981157a7c7f0f965e2fab429cf62994aef4a4facc5264b0ff641 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1-launch.log
|
| 202 |
+
452aa440c36b981157a7c7f0f965e2fab429cf62994aef4a4facc5264b0ff641 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1-status.json
|
| 203 |
+
f3ec1f2ad96bb5a986bdeb1291ce01cff4fa23f0b045be3572fdb871f21a2385 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1.log
|
| 204 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/events.jsonl
|
| 205 |
+
b191db11ab0a472ed3c28b534120d9cc6d600f5a7f62c5a6a26817f83dabfd83 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/generations.jsonl
|
| 206 |
+
03c0388e81d0d2732b800c794bbb2d93bbb74b31341f7a4834e3f4e8dc7f5e3e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_1/metadata.json
|
| 207 |
+
3ab5721761df874ebefb36d4ff009f8322670861483ce2325a455c79acc93fcb kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M-launch.log
|
| 208 |
+
3ab5721761df874ebefb36d4ff009f8322670861483ce2325a455c79acc93fcb kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M-status.json
|
| 209 |
+
1320cadc9b97567c5d8c0263157c499cabe3e6287e24ad52489422ca01443f23 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M.log
|
| 210 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/events.jsonl
|
| 211 |
+
0e1e2fcad8562975a088c737a277d303d3997662ef8896ca193c6e958d1d48e8 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/generations.jsonl
|
| 212 |
+
1b804e56f9c97af09b5d7cb506700056912791114c4fdff179317e96ee9c8204 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_M/metadata.json
|
| 213 |
+
3a54e50628f77f1a8f553a115461904be33d3cbcae707ca13744b20ce8926057 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S-launch.log
|
| 214 |
+
3a54e50628f77f1a8f553a115461904be33d3cbcae707ca13744b20ce8926057 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S-status.json
|
| 215 |
+
eefda7cd128eba25b87072440d1ee6f505efd140ba3895a6f1b0056c16aba546 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S.log
|
| 216 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/events.jsonl
|
| 217 |
+
77c9e1e2b3664bff2c463309aedba57bff08c35bcaabe91c9db3ab92929236de kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/generations.jsonl
|
| 218 |
+
fb5c40b7727d85a850ec4e56f796e5ca235586e3e85e0e518576155133a06877 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/Q4_K_S/metadata.json
|
| 219 |
+
a13a019caf4e22863464ff962fe4614ab2f9aca153e53e7fcd10f68de73b5f11 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16-launch.log
|
| 220 |
+
a13a019caf4e22863464ff962fe4614ab2f9aca153e53e7fcd10f68de73b5f11 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16-status.json
|
| 221 |
+
0d20d4887178ff0e90d47911cd591601e74668841fc3f2cc351947d41de349cf kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16.log
|
| 222 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/events.jsonl
|
| 223 |
+
09a4655e77511e2f19cadc4b25bb2c52c67e547be28fd6871802069654ee5be9 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/generations.jsonl
|
| 224 |
+
f80ca18420103598765cbc2da4c096f6f1eca62456eeeefabbf50e66a4c40d10 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/bf16/metadata.json
|
| 225 |
+
9cbd771461ca413a0271d77d8595bfb2df9e764136279352a6901990016eceec kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/inputs/blue.png
|
| 226 |
+
06196589d548330cd7dd06a644a1502e0bf21590f4031a14e4caffad5a152189 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/inputs/red.png
|
| 227 |
+
4e71c9809735a0ae13d3114c0fe3c56db34a8ca9aa78cc389de41c25d41e53fe kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/quantized-launch.log
|
| 228 |
+
73e18201baeebd547d87161a9445f7737529e42d7a3e7030c75ff76dfca2d246 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/quantized-summary.json
|
| 229 |
+
f53eac1e2a83cc0efc20c6fe94febeffba3d479b50f8aaeef4037aec815d7f1d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke/requests.jsonl
|
| 230 |
+
cea924500c0721b6eafc6f2935b55f26a86d3255443fd633b9e255d6bee90422 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/smoke_quantized.py
|
| 231 |
+
aa18595a55b5c1db2aafc5bcdb3b87111b3db5e94383f323c5a36fb2f370d15b kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-tensor-summary.json
|
| 232 |
+
953c0884b5988a16370a8464acbe7ce43553c2bff2b324b6192c839dd404598b kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-verification.json
|
| 233 |
+
23bdab2500c452c166158c15091f124b07bc2d9339da865ab4b10cdc5c4c1223 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source-verification.log
|
| 234 |
+
7b93144429130e36e915c33a8f00a3e53c5200fb9070ca49c4b9d9a813d15c7a kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/source.json
|
| 235 |
+
0c0807344c32ab1ec080e0960129d70bd8731dc348ae39482b002791f473dac2 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-conversion.log
|
| 236 |
+
6afe9cab2faf00ad9a68374facf9baf4bde178c6098809c9b7816ff01054c118 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-gguf-metadata.json
|
| 237 |
+
1c7e67e1d8abc6e6d0a62d31dc32f57ceb3725bda7374ae9205b79b0b3ecddbf kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-launch.log
|
| 238 |
+
1c7e67e1d8abc6e6d0a62d31dc32f57ceb3725bda7374ae9205b79b0b3ecddbf kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/text-status.json
|
| 239 |
+
3c900930fe9badb5874b5a2da2cac5e24ceaa6cb665fb9b706dfb6ac06730e77 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/conversion/verify_source.py
|
| 240 |
+
c58cb09727b7fea047dc29f253c6aa3632fc93b538d055cb8db9831db024d73f kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/.gitattributes
|
| 241 |
+
7fa4d4e39537a43a7d6cc6f62873eb014b2f8bc3da2142111ba2ad29d4984794 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/README.md
|
| 242 |
+
172c7450a66b9b3644538888ffa24d02047e535e9d1f911564460203fbf7e8e8 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/chat_template.jinja
|
| 243 |
+
af3810295de6b08232776b74110ed482fa0183f4aeaec586ff4f7593910951cb kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/config.json
|
| 244 |
+
d30462b89993b9fef138db983d3884bbc39750effadf2efe67f404d28ee40e5b kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/configuration_kimi_vl.py
|
| 245 |
+
da26dd1916774784790db2b83336bad62d0917356743478ba6eb0c425c53eac5 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/generation_config.json
|
| 246 |
+
bb58551e088f3bb0027b1886ca5ff42776c485acec1a9aafe91553ff76926870 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/image_processing_kimi_vl.py
|
| 247 |
+
a5ef3ebd9727f82e34417a778317d2cc9c08762fe0bc4a2ee333b8a52cf7c1a5 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00001-of-00007.safetensors
|
| 248 |
+
45ecd00decdad65e7d3f494028ed0c79d0cd56f145adae077ffa78b5b8ff95c0 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00002-of-00007.safetensors
|
| 249 |
+
b9ba98f01e22eea43da8cfbf6f09ff0857616cd9e1df4603a735c111755109ef kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00003-of-00007.safetensors
|
| 250 |
+
8f7eb3fc5c12481fd1a81d2708fa4a299ff4c207a5dbafb5b8bef25ab9fd8b23 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00004-of-00007.safetensors
|
| 251 |
+
db83e896b3d75f4bc51f621ae90ad61e8f6f7901f49a06b5c40348b839057206 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00005-of-00007.safetensors
|
| 252 |
+
abed41982a3f9c7d05f69bb560dad7bcb93cfa764c77a2b59127f35dc787983c kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00006-of-00007.safetensors
|
| 253 |
+
2e2ddd33f2b4f472898482860585bd6d73d4397c8c833ed9d00a2024443f7a77 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model-00007-of-00007.safetensors
|
| 254 |
+
178ba3a15cb12f6ceac42aecfe665a8f041d47e948220d75b073088957efedd8 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/model.safetensors.index.json
|
| 255 |
+
74e8f18afa5bf8f580ef5be5f15b51506f1e4f604df5a84f508a7796b8947c0b kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/modeling_kimi_vl.py
|
| 256 |
+
d968a7d7f83f82c3b0e1061079dcdbefd6f2c75b7ee4240cce995afaeae1f622 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/preprocessor_config.json
|
| 257 |
+
f8e64816baed0a92d85d0a987b587028ad55a0779f3ace8c5b68db705dc61561 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/processing_kimi_vl.py
|
| 258 |
+
b6c497a7469b33ced9c38afb1ad6e47f03f5e5dc05f15930799210ec050c5103 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tiktoken.model
|
| 259 |
+
0ae85e29c37689fefe41b8bfdb7aebd9a0152defedbf37fae0f8413000512029 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tokenization_moonshot.py
|
| 260 |
+
d7861718cab22c7962e14b4693b4009dd526115cd392dc779069a8173be95703 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/hf-source/tokenizer_config.json
|
| 261 |
+
294596d8c89ec237e50341a73d8122b1527db4e6eb0ed0243f86785fc772bfcd kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_NL.gguf
|
| 262 |
+
6e5bdf00c77ef6f4c0a871cbf2f997cb11806b7423b50decd5e4ed3989f3b973 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-IQ4_XS.gguf
|
| 263 |
+
e3ffa932cd1318ce1231d97d832f92b90093900b2185d50d54e39c8d9d421080 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_0.gguf
|
| 264 |
+
0050110bc63babd859a849d160818e5ce46518c9dd92e38e50d072ee71a353ca kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_1.gguf
|
| 265 |
+
43a34db4974f67ad13ff3e1f8347ef1b25dbc15b077146d1c74627e3294ec49d kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_M.gguf
|
| 266 |
+
bb2f63e9b13a0d561e19890a6c5611cd8b27c0a406b596ebd33fab9cf88187f1 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-Q4_K_S.gguf
|
| 267 |
+
6a7457a032488a1ac96b3b42cd69ad48406222d7abcd1af6042c13f5e3f33005 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/Kimi-VL-A3B-Instruct-bf16.gguf
|
| 268 |
+
7b21d8dd54ebbd6a873a0a625bb0a1a7e002b975d43ba542681f5cca7d834ba3 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/llamacpp/mmproj-Kimi-VL-A3B-Instruct-bf16.gguf
|
| 269 |
+
c59481e1bdb3a284198ca16e523fefa1ce8a24b7dad8ad2275dccfd58807ee39 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.IQ4_XS.gguf
|
| 270 |
+
74e9aa21a6a6e90d6ff56b7ec311f830a0b6cf88ff7dababacc8f34c867bde1e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_M.gguf
|
| 271 |
+
3363ac782c25fe60d0d27061285d9eddfff1af087650756cfde183296343f22f kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.Q4_K_S.gguf
|
| 272 |
+
d1364554ff094ee66dfd2fb3787cc87cf3ebc5c944eb965f354e3c6eaf60aed2 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_NL.gguf
|
| 273 |
+
5d6aad466030edeb73f44b4a32c0c98d081d0e03a300366d6b63fbf469bff073 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-IQ4_XS.gguf
|
| 274 |
+
0ea3afdd920792fd4583d8c84a979e4e0af52a2e7456ae6bb75731da999b3b1e kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_0.gguf
|
| 275 |
+
81aaa3efc0a129abeae7149b8195d09ce5467b4436c1c412fd5cd89161d04f40 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_1.gguf
|
| 276 |
+
7710f9aa5bf56a38a03f26738cdbf10563a72938a41025307b57768dad40f306 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.i1-Q4_K_M.gguf
|
| 277 |
+
794ffead89866df5b3c698c74ca16bd7d31b48575123edee24f476c9a15c4ad5 kimi-vl-a3b-separate/kimi-vl-a3b-instruct/mradermacher/Kimi-VL-A3B-Instruct.mmproj-f16.gguf
|
| 278 |
+
ce788856c8f0224d3e4b00e81836f8d859c7918ccac3920c96c2c3eeabd7bbca kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/README.md
|
| 279 |
+
e487a0d4544c3fb05b6f3665a9acab0ac02ceb098c10a4363b2505e2533fe187 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/IQ4_NL-gguf-metadata.json
|
| 280 |
+
f9379cbaa918d9cedd95d23fc35b236fd6514c7a95c7a99498dbe157654ffd1c kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/IQ4_XS-gguf-metadata.json
|
| 281 |
+
8d9f7d8f9cac6d487f32f1b32a487d4f2731337aa3c432a818062de95a6ff65f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_0-gguf-metadata.json
|
| 282 |
+
b558901e4e47bff1486c56d7a79b991849b13b29ed9890e1c996063707485c63 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_1-gguf-metadata.json
|
| 283 |
+
db935d2d82fe616f011a39bed75808827d992570b6c89a473f79001396f37e5d kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_K_M-gguf-metadata.json
|
| 284 |
+
03c46e6afd5e50ff9072ff487cafda2e1cd79983ca430e2ca58174103a0c7ef3 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/Q4_K_S-gguf-metadata.json
|
| 285 |
+
7bdbaae627cf7208b14a4b8b7c46101195340a31e4269bf1a15c35e62cd9edee kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/SHA256SUMS
|
| 286 |
+
2645320f3c591cc5255c5b39a73bb0ead833f7ef20fb47a2d9aa5c2fc6587cd2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/all-converted-output-checksums.json
|
| 287 |
+
7e40e10a8a262f49b1119297599244dd17774291d3d62a5fbe4a0ca41d322811 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-smoke-independent-review.json
|
| 288 |
+
b89250de61b1a47f4fb7cf7f55ab89d7435f2253ceb2485c097d91dc4e5b959c kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-structural-validation.json
|
| 289 |
+
5ba5b31852b5066130efda64a9ca54e199ae9817a3f2def703655c00e6e45338 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/bf16-temp08-review.json
|
| 290 |
+
60d86bda5476b0bfcaecf75527969091cdc74d018e63cebb7f16dba9cfe7ed6e kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert-mmproj-launch.log
|
| 291 |
+
03c66430b6be73f91b1aadae21f2b42a5a80ffa2fc56cc65a58d7f569140e0d8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert-text-launch.log
|
| 292 |
+
673b91c96b0b78ac9aea7d10b009b9603ea08d069be176a1ac1de29f5cae3647 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/convert.py
|
| 293 |
+
2ba993d87a8656d882f49daa2bb2fb1f4e09085810a836b54f2fb4adb0ea2467 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/download-command.json
|
| 294 |
+
1d6959baa01df79aac4cf31df3f02b8a7bb4c5650d6a7f9c48adb31fbab795dd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/download.log
|
| 295 |
+
0c7dd6510b64cd2310c18f1b3abf6eda80cd7ebd044240ce6087f0d3d5ee3e8e kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/finalize.py
|
| 296 |
+
eee9e5bcdf58ae2b285c59902d4f61788248fc9d6692fa9e740595eb7e71ee7a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/hash_outputs.py
|
| 297 |
+
c0b1490ad85772421e1b0e4ca05f2046fdab771841ec85d61bc8ad7cc2265545 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/independent-review.json
|
| 298 |
+
36929d630b6448503f5fc9135f8eab52ebb67dfa3ba379952a182eefe7224b2a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/independent_review.py
|
| 299 |
+
1ea5b24c2e02ab0facd7035538518600728597edece898632100de6a110227e2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/manifest.json
|
| 300 |
+
03a571e01631ab9384d49512e5ec2f6ba40f83ca7f5d8715d14d6e5b598eebd4 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/manual-answer-review.json
|
| 301 |
+
ec0ee65549d988fdb22505b9baba8905350cf4d1dd768fb3510ac83c8ba76d47 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-conversion.log
|
| 302 |
+
187e63eed34cbdcb825188321777f385559ba39a4853fdf04b892d3213fd9b75 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-gguf-metadata.json
|
| 303 |
+
60d86bda5476b0bfcaecf75527969091cdc74d018e63cebb7f16dba9cfe7ed6e kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/mmproj-status.json
|
| 304 |
+
c4b045f3fb30d5ffa047255fe5cb030fb6f0f4e5147c3012c577950c1b321d42 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/output-checksums.json
|
| 305 |
+
34501423e961dff5e96ed2f352a96a01bb3f85237910b60d2ef5d2b72304c975 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/output-checksums.log
|
| 306 |
+
41ee38db7fe5b2177bd67256153e778094ab6659398207d3b06aabb396caf100 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/prepare-status.json
|
| 307 |
+
5a2684dd31d1c5bdbbc564703e4579ca39d14c1de6e4ba30d2854742eae33214 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/prepare_bf16.py
|
| 308 |
+
8e1f2b8e6ee0b6b163192926066d10208c570763cdb3a52c14ff60087fd65529 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantization-summary.json
|
| 309 |
+
8b1cb85ffb1d590b3b06ffa0791831215833d328bedb8a52c4fc3274594ad798 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_NL.json
|
| 310 |
+
f5075e55e59246e60e84a8b557258960de2c661074524f7391e9ba4724c9d5e0 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_NL.log
|
| 311 |
+
297854fd42d4ba7291bec7e13bc9442be53d01128e5f5493d10fc54b4a1a0115 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_XS.json
|
| 312 |
+
6104f3a049af319ebde2ace188c43556c7ef5b0771863c2fe4e89c05fc41c7f9 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-IQ4_XS.log
|
| 313 |
+
f54ebc96645a0282b0e1e960ebbfe347115ff0406764112716c22834cc02a661 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_0.json
|
| 314 |
+
307b032e7a49691d6768b7bac5065e8d888fc8f97ca308246fbcbdc2dd53c734 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_0.log
|
| 315 |
+
ffbe73a98ede18090c142c1fd9ab77b47d7beba1fa44636369d1b539b33cffb8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_1.json
|
| 316 |
+
6570f92cde8773c4154f6103c049fb1d4d6236edfb4282e5c4ad6da376b692cd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_1.log
|
| 317 |
+
5c4b5e3be935ec045b0e9efe231292b522e308218bd057fce7cc40a4c46cbf13 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_M.json
|
| 318 |
+
c0d36715c6c4e2257f0aa73ddae4b19bba94dedb739b381741fd215d824ed9b5 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_M.log
|
| 319 |
+
ad3923c9c6e9b6094c9b5617b9167cb9c0c2281f419b4cda95bf34f2467ab1df kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_S.json
|
| 320 |
+
b0b468ea42239e99a3fda373d8ff23d6658266b575ac05f2e1519c1749edb005 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-Q4_K_S.log
|
| 321 |
+
7b820a3869efe92900a0ac4c4b43ca6f152b372cc500eb73b1048d5261cab841 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize-all.log
|
| 322 |
+
180222a9664dd2dbc226dd1a9902acc483bbdcc24168d9db201aceeaca8f0894 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/quantize_all.py
|
| 323 |
+
6e99230bdf3d965e045251fb8645efae89d1662a0835037f9c0c6786dfb5cabe kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/rejected-models-review.json
|
| 324 |
+
c84863a324d73a38045954d0f70a9458c820b928e6834adcbcb17abbc1a572fd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/rejected-models.json
|
| 325 |
+
a52a07f17ace264c4b932fa396fae80ecb0d2849faf3ea65d94c8a16ab9986b0 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/requirements.lock.txt
|
| 326 |
+
3ca593a4d0def61c9f9db5ca4f7026f1420f88a965dce7a21aa6bccf49165e58 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/retain_passed_models.py
|
| 327 |
+
7604505a30606645b3e5b2c73ddcfb24ccc702ea810740be06b35998f4f1d73a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/run_smoke.py
|
| 328 |
+
c8949c6ccd2436bf3709fffa4ab17b7607603505f4f5e7894b4f6a2e32c1707f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL-launch.log
|
| 329 |
+
c8949c6ccd2436bf3709fffa4ab17b7607603505f4f5e7894b4f6a2e32c1707f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL-status.json
|
| 330 |
+
cbd829d93a3b7f06aab097ae80f2973efd31544dc802d9cd6f02e85fcc5c1441 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL.log
|
| 331 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/events.jsonl
|
| 332 |
+
a1b5b920fffcdb6cd007adbb29d18bd4d6da03dfc433de6fe65f77606ef3206d kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/generations.jsonl
|
| 333 |
+
7552abe068decc358d46ffebf484b1ad6b74d65d3f16ca6cdd7379af62294bad kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_NL/metadata.json
|
| 334 |
+
342193699b52a16abff1a2f95a93cd56bf3ce214b265b16c162aaae8ae13e841 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS-launch.log
|
| 335 |
+
342193699b52a16abff1a2f95a93cd56bf3ce214b265b16c162aaae8ae13e841 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS-status.json
|
| 336 |
+
84d646a3ce8b586312abce2e4e7b82442c0867b7b71ce2ce7eb4031c8c2c3114 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS.log
|
| 337 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/events.jsonl
|
| 338 |
+
6f37eca888a01c6e1a40870aed3502b229c48f15d848f72dba7004e639372025 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/generations.jsonl
|
| 339 |
+
76dce01ca2bbb06c698c1ae4800a582591f33177dc4fd0bc894e732b7d576b57 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/IQ4_XS/metadata.json
|
| 340 |
+
065da35af654520cca46c670a504b916cbb286988c6b5ccb9ec39f6f91fbfd17 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0-launch.log
|
| 341 |
+
065da35af654520cca46c670a504b916cbb286988c6b5ccb9ec39f6f91fbfd17 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0-status.json
|
| 342 |
+
e6027a2dcfc3b117779f9c25f264633b9f6ae1bfedecfde1ef0eab06500dd3cd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0.log
|
| 343 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/events.jsonl
|
| 344 |
+
f4f6615465697e8c867a39b1e44e593e62dbc3d94fad6263d3c49fff4290ca66 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/generations.jsonl
|
| 345 |
+
0026a55a8c0f9ab40f57894163d7605fbc1ca3adc0e1e5369e9c4be7fa5cbe99 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_0/metadata.json
|
| 346 |
+
68b321f24e469b735788c699c4341321bc379074af131df0047fb800a3d0f869 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1-launch.log
|
| 347 |
+
68b321f24e469b735788c699c4341321bc379074af131df0047fb800a3d0f869 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1-status.json
|
| 348 |
+
2d2d7b8bb8cb4f6175fdad07dddeac6feaff1dbb593d1d26d9b78980165d5fd7 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1.log
|
| 349 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/events.jsonl
|
| 350 |
+
b09d332279a74bbe6a06d4fa1adaa519a3f90febf03a118b5f4ab31d24656d18 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/generations.jsonl
|
| 351 |
+
1de3cfd752d1d39272ae6743e1a45783f0a710265e49af3006b79969222a405e kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_1/metadata.json
|
| 352 |
+
4ee5cd758f2f94dfad8613d71da2e4498ce3f05c8c2d642a4fb3715ee0c810d2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M-launch.log
|
| 353 |
+
4ee5cd758f2f94dfad8613d71da2e4498ce3f05c8c2d642a4fb3715ee0c810d2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M-status.json
|
| 354 |
+
7ec27b7bb0019df505b0a034e37363fd385ab0445889c3a65b720ff094699756 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M.log
|
| 355 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/events.jsonl
|
| 356 |
+
fd117d46693e2909211d65880f38a3b811a6d822c724030dd53a3fa8caaf9087 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/generations.jsonl
|
| 357 |
+
0d71355d48e23724c7c3171536a51ea534829785374b175c163c0b15f1535363 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_M/metadata.json
|
| 358 |
+
129a92d94be9958fb6fc40104299895f78171c60252c9578ce83dfe80dc20493 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S-launch.log
|
| 359 |
+
129a92d94be9958fb6fc40104299895f78171c60252c9578ce83dfe80dc20493 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S-status.json
|
| 360 |
+
f84c50ae83e355d0507b97e5497b77b80c54d84157975a7107c1700f81d838ea kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S.log
|
| 361 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/events.jsonl
|
| 362 |
+
603cd3059e7fbbb63a4861256cc3995a87576fca04a243015052192b3a9135d4 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/generations.jsonl
|
| 363 |
+
402d3606ef939947e4b7c7ef89091b6ea438c519357fbfe0b197c21d318fb69f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/Q4_K_S/metadata.json
|
| 364 |
+
35c6b21a16f3f665f2662a33c415adfe255cb1636f0736fc14bacfc663d8611d kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy-launch.log
|
| 365 |
+
35c6b21a16f3f665f2662a33c415adfe255cb1636f0736fc14bacfc663d8611d kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy-status.json
|
| 366 |
+
5697d7fe5db1a94bbe59ebe3eb3dca474a80146e873f305f3b457cb6d5ed05f5 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy.log
|
| 367 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/events.jsonl
|
| 368 |
+
207f688b2d68a53daa53b28263b465d827b398ad535a17ec6c3a4eaf61f47f32 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/generations.jsonl
|
| 369 |
+
51608aca8533d1b2c40468343a9b05f29f01f5421f6587ce3ce53a3cdd2a12af kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-greedy/metadata.json
|
| 370 |
+
a396b2b76dd9d9578c069626924c60e8056103bfd345dd48ca2211b424a686d8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-launch.log
|
| 371 |
+
4ea9d03b5774f381a629308b6a5e719d24585e53d37fa509ea61b9d6b0cac547 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-status.json
|
| 372 |
+
a396b2b76dd9d9578c069626924c60e8056103bfd345dd48ca2211b424a686d8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16-temp08-status.json
|
| 373 |
+
f61952e280bbe12b1237b26f318fc7a3c2ad2fbf05dcfaedd82f6a24754230aa kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16.log
|
| 374 |
+
d8d11dbf90bca9c39d1d61b5966e503bf8c728781cb9a31992960d26d26bd1db kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/events.jsonl
|
| 375 |
+
7f967db40e35aa3d5303ee6b4e93abd14e6e88540c2d4e688385ae2856d981fd kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/generations.jsonl
|
| 376 |
+
952732c12dbdd392fe70087a6ded83c23274d6f409164c75a264558642019042 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/bf16/metadata.json
|
| 377 |
+
9cbd771461ca413a0271d77d8595bfb2df9e764136279352a6901990016eceec kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/inputs/blue.png
|
| 378 |
+
06196589d548330cd7dd06a644a1502e0bf21590f4031a14e4caffad5a152189 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/inputs/red.png
|
| 379 |
+
5655b3abb947ef5a35dc1fd0d90cbe3280edb4c10ce8c51a636ee27f41b13deb kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/quantized-launch.log
|
| 380 |
+
fd4a837edccb3e3873af8060249c6931579d9326aefb5b0870120b46698940ff kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/quantized-summary.json
|
| 381 |
+
68d4d8d6b0bda9837b6727089bfcec7aa29603e67ea6df9756ef0154eac4468a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke/requests.jsonl
|
| 382 |
+
e91983dd10fc46da904aa71a51e7c5e15ad098e7ae78a297b74d51b85ea5f810 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/smoke_quantized.py
|
| 383 |
+
fe1a865235c50a2a5f3cde80fdc6a10417ac3ca85e1193077ea62d4e5dceb4e1 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source-tensor-summary.json
|
| 384 |
+
21b831d70cd0e69ba62c5d9e0faf46e762eb5c244bc471411ca41a41453fbe38 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source-verification.json
|
| 385 |
+
2d5860af87de9fec555d3da986a6bf73968ac0d275d86ec2028e4abecf556546 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/source.json
|
| 386 |
+
aec8c260be2cc2fdcecc9999b68471c254aa0f22fb76e1abbd6902577b95f0b6 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-conversion.log
|
| 387 |
+
b3aa4a4e7f2e86c75c2e566bb343cedd904fecb7e2eb5a083b396da450d31b46 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-gguf-metadata.json
|
| 388 |
+
03c66430b6be73f91b1aadae21f2b42a5a80ffa2fc56cc65a58d7f569140e0d8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/text-status.json
|
| 389 |
+
13338e4ef72eacb7705a439730efaa7e8c80b2951487d69a1d01211b5e89c77f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify-bf16-launch.log
|
| 390 |
+
ef885264b3d71f4ba2dc0126f6a9f851ef5c05c58a8d7ff0e32ccfd762bae4c6 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify-source-launch.log
|
| 391 |
+
981845bf5a7765e88109f5b64f1efbc684dc4f5fbbddd44a1477a4fd14515a9a kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify_bf16.py
|
| 392 |
+
3c900930fe9badb5874b5a2da2cac5e24ceaa6cb665fb9b706dfb6ac06730e77 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/conversion/verify_source.py
|
| 393 |
+
12db7934bb09e5bfa3026498ff609bf6bb8c03894487c6ed7f680224f1e3a219 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/.gitattributes
|
| 394 |
+
840d2b966176f9e1742bd3143dcf8cde33e444734f799e1502cba9d0c85643bf kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/README.md
|
| 395 |
+
172c7450a66b9b3644538888ffa24d02047e535e9d1f911564460203fbf7e8e8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/chat_template.jinja
|
| 396 |
+
af3810295de6b08232776b74110ed482fa0183f4aeaec586ff4f7593910951cb kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/config.json
|
| 397 |
+
d30462b89993b9fef138db983d3884bbc39750effadf2efe67f404d28ee40e5b kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/configuration_kimi_vl.py
|
| 398 |
+
35ad1985a08535077a2c1dbe678ff7c41d84f3e671864a310403a2967c663d85 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/generation_config.json
|
| 399 |
+
bb58551e088f3bb0027b1886ca5ff42776c485acec1a9aafe91553ff76926870 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/image_processing_kimi_vl.py
|
| 400 |
+
ad54ac1d25ae137fb4e89fcf39361c7e42f0951fff840a4d0caf06a23b0cb76f kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00001-of-00007.safetensors
|
| 401 |
+
40a15784c7369dea09c3d82c27e57854f14ebd0866ec68c8fa472082e8fcf597 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00002-of-00007.safetensors
|
| 402 |
+
b99f6b16bac0a911051719b61eb39c5ada045c1f24e5a56bb435e8d08a603eb7 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00003-of-00007.safetensors
|
| 403 |
+
3adb7ef982fde34b13216e9f615a8f697e9d354c53b8727ac2bc775f2971f745 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00004-of-00007.safetensors
|
| 404 |
+
a8fc6e1c9fbc43e4ef6f065a87d0f636524ff8374555e8f9e2cef756ac456677 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00005-of-00007.safetensors
|
| 405 |
+
80c5bb5a0a5017cf3baa95ada6723151df9d94a7d01024bd4b8510be2d6c6084 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00006-of-00007.safetensors
|
| 406 |
+
76e788219ca8b1716490932db3c3bf16b57f0a64d4af499b2237af3366049a79 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model-00007-of-00007.safetensors
|
| 407 |
+
178ba3a15cb12f6ceac42aecfe665a8f041d47e948220d75b073088957efedd8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/model.safetensors.index.json
|
| 408 |
+
a3a7caeecdeec75bc56e6c857c16fb049c5d107957ae97765d75fd8038cf9c43 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/modeling_kimi_vl.py
|
| 409 |
+
48c72c768c5dfeb731c7a9ec1a144cdc0ec058b18d808767c29ba0d502934377 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/preprocessor_config.json
|
| 410 |
+
594aa42c97e0bc8ab8d10fa514764246fa0bd74921c51a1f9bb8ea9755d21df7 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/processing_kimi_vl.py
|
| 411 |
+
b6c497a7469b33ced9c38afb1ad6e47f03f5e5dc05f15930799210ec050c5103 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tiktoken.model
|
| 412 |
+
0ae85e29c37689fefe41b8bfdb7aebd9a0152defedbf37fae0f8413000512029 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tokenization_moonshot.py
|
| 413 |
+
d7861718cab22c7962e14b4693b4009dd526115cd392dc779069a8173be95703 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/hf-source/tokenizer_config.json
|
| 414 |
+
9083e9ac29082a023d4f3ebd9610d89962fa205eb5da7034777b0bdf5ae0e348 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_0.gguf
|
| 415 |
+
780924706c8a9df254c30b33e6384de8b01db2d81a6332f0c7f8b0c44162db76 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_1.gguf
|
| 416 |
+
33b0598c3700e15456e4789608cd7396445201a881d97e14df17b48beda29492 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_M.gguf
|
| 417 |
+
a709f9add5d63f4dfd5f9dbc418a1a862331c2247363417c3a56549672bd7540 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-Q4_K_S.gguf
|
| 418 |
+
714bdf24880a7c71d4cd2a34121e39c2cbf31cbfcf1860b13e8f99ddcac0d8c8 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/Kimi-VL-A3B-Thinking-2506-bf16.gguf
|
| 419 |
+
238c5eb49a350e381d946d35d289c781334a01a88b6c0c31d6bfeef8ef45daaf kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/llamacpp/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf
|
| 420 |
+
597373061abb3d5e125c6d8b976eedb1059bb2c4e91a5509d5cc8d8d66767ca2 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_M.gguf
|
| 421 |
+
562745f30cd79c89dc247ad41ccdcd40e78e6d549493e9609ff5bf19aa0fa885 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.Q4_K_S.gguf
|
| 422 |
+
9d03ed1f97009ae541f2b29ced6b564dcd947ecf430689a395be6c91a3e0b660 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_NL.gguf
|
| 423 |
+
8dcfc5da55f85016482ac849615ca743a4e0085f8be5052726cd7dfed04e0678 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-IQ4_XS.gguf
|
| 424 |
+
3b3bf0ced352c03af1380107323e65d26048b3fcfb442684c449229a93cd767c kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_0.gguf
|
| 425 |
+
61fa02dadce8e5caf65e4660db204b18024135ea8db88f35c8925eac82de73bc kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_1.gguf
|
| 426 |
+
8bfff5f8d6b391e3ed3c6d548760d6917cd3e17f246af8ada800b6d485d569bc kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_M.gguf
|
| 427 |
+
3d4efede5cbe05496dc71648a230529c03ab8ae7b68b5bd5006f4551e3b84785 kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.i1-Q4_K_S.gguf
|
| 428 |
+
50d5a7af02a92c68c797b0d5637f75492682beca325c48bf2a09961f422a651c kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/mradermacher/Kimi-VL-A3B-Thinking-2506.mmproj-f16.gguf
|
| 429 |
+
8ccfdf140472a18928bb867e05f69c215fb7eb6e9c16a212b0ffa76f2eb023e0 muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_NL.gguf
|
| 430 |
+
b3c03d94c007ae487fd5259b340ad23286190b62b0d4d452f06bc1cf8840a7da muse-glimmer-30b/bartowski/Muse-Glimmer-30B-IQ4_XS.gguf
|
| 431 |
+
95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999 muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf
|
| 432 |
+
91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4 muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf
|
| 433 |
+
0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384 muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf
|
| 434 |
+
1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf
|
| 435 |
+
bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860 muse-glimmer-30b/bartowski/bf16/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf
|
| 436 |
+
e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16 muse-glimmer-30b/bartowski/bf16/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf
|
| 437 |
+
787e0708e439f0caa8e6caaafa5f0fec38e112766c150f313ac074e5cab087fc muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf
|
| 438 |
+
3727a47650ae65be12e91aae49f9b9f4bef09dc6c401a54ca1bd3d1a6160f35a muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf
|
| 439 |
+
820d18e00c59376331eba62dd716a6bcdcaa305c2316f5da3a2fab36c7c37e15 muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q3_K_XL.gguf
|
| 440 |
+
82bece304887a313ece08400bc030f6066c7bff5b906b0cd40308ec8a409fd38 muse-glimmer-30b/unsloth/Muse-Glimmer-30B-UD-Q4_K_XL.gguf
|
| 441 |
+
27d9a805fa29b943cfb6ad4843367cd4eaaaf06bd452d8cc3e00a2cd18a677bc muse-glimmer-30b/unsloth/dflash-kquant.gguf
|
| 442 |
+
d08cdcfa0b41d8e20554b52df404ba4f7b440d0bc502a90038508b6407df8ee1 muse-glimmer-30b/unsloth/mmproj-Muse-Glimmer-30B-BF16.gguf
|
| 443 |
+
f007c3dbf67df668354d37ae13d87fd5789059704977959187e8342aec03b66f qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_NL.gguf
|
| 444 |
+
628124c61a806897d3f28dcd416be6daff94f62f731eb900d4381875eac9e412 qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-IQ4_XS.gguf
|
| 445 |
+
3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf
|
| 446 |
+
3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf
|
| 447 |
+
13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983 qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf
|
| 448 |
+
3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf
|
| 449 |
+
714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5 qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf
|
| 450 |
+
463f39bd1c291c1186c319a8c90ff8640aafa678b14cbee2232d695113dfbb66 qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf
|
| 451 |
+
9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf
|
| 452 |
+
ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9 qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf
|
| 453 |
+
658a9e7e406deb06d0179755e3c14f6a82915a4be4962a2f92a64d948d2e572f qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_XS.gguf
|
| 454 |
+
298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf
|
| 455 |
+
af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf
|
| 456 |
+
00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4 qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf
|
| 457 |
+
27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77 qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf
|
| 458 |
+
b252c5610a42ca82d20fe2a12813e9d069eed89292907e26c783eeb0bc961bc7 qwen3.5-4b/unsloth/Qwen3.5-4B-UD-Q4_K_XL.gguf
|
| 459 |
+
302b92d565080b9cc0281186979ae75a7429ec23d14f6f7607a035539b21f3a6 qwen3.5-4b/unsloth/mmproj-BF16.gguf
|
| 460 |
+
dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf
|
| 461 |
+
c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9 qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf
|
| 462 |
+
41e9f836690bde9619928538cb4dd170472d2e851243637f7092937a151297ad qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_NL.gguf
|
| 463 |
+
afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf
|
| 464 |
+
52312daa5b2190c1f5723d33c3315c01c55af4206f6c6e6eb63f3d8dd52bb85e qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_0.gguf
|
| 465 |
+
8babe2c6f46b43815cae7ec2b970be8508d6867234ebf16c376bd9cc79477354 qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_1.gguf
|
| 466 |
+
49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf
|
| 467 |
+
b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772 qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf
|
| 468 |
+
20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf
|
| 469 |
+
1c625f05cd52e90abc76a5f756226c3a5fe279593379c22f6c6846c970a0cd18 qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf
|
| 470 |
+
ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61 qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf
|
| 471 |
+
a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf
|
| 472 |
+
707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450 qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf
|
| 473 |
+
356dfaa3111376a4f7165e32e8749713378d1700b37cf52e0c50d9f23322334d qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf
|
backup_metadata/candidate-disposition.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
backup_metadata/manifest.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
bpw/BPW.csv
ADDED
|
@@ -0,0 +1,71 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
family,producer,model,shards,main_parameters,main_bpw,llama_cpp_bpw,hf_estimated_bpw,embedded_mtp_parameters,embedded_mtp_bytes,main_tensor_bytes,llama_cpp_parameters,llama_cpp_tensor_bytes,file_bytes,hf_gguf_total,hf_repo,hf_commit
|
| 2 |
+
gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16.gguf,2,30697345596,16.000694143144507,16.000694143144507,16.00482093227042,0,0,61397354736,30697345596,61397354736,61413189920,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14
|
| 3 |
+
gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf,1,30697345596,4.46685093299622,4.46685093299622,4.470977738801101,0,0,17140058352,30697345596,17140058352,17155893600,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14
|
| 4 |
+
gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf,1,30697345596,4.4658197725689766,4.4658197725689766,4.4699465783738574,0,0,17136101616,30697345596,17136101616,17151936864,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14
|
| 5 |
+
gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf,1,30697345596,5.1034131645706085,5.1034131645706085,5.107539970375489,0,0,19582654704,30697345596,19582654704,19598489952,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14
|
| 6 |
+
gemma-4-31b-it,bartowski,gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf,1,30697345596,4.737821960050881,4.737821960050881,4.741948765855762,0,0,18179819760,30697345596,18179819760,18195655008,30697345596,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14
|
| 7 |
+
gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf,1,30697345596,4.50119305852962,4.50119305852962,4.505320022784683,0,0,17271834864,30697345596,17271834864,17287670720,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec
|
| 8 |
+
gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf,1,30697345596,4.978216838784682,4.978216838784682,4.982343803039745,0,0,19102255344,30697345596,19102255344,19118091200,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec
|
| 9 |
+
gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf,1,30697345596,4.771200174750119,4.771200174750119,4.7753271390051815,0,0,18307897584,30697345596,18307897584,18323733440,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec
|
| 10 |
+
gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf,1,30697345596,4.530424214988859,4.530424214988859,4.5345511792439215,0,0,17383999728,30697345596,17383999728,17399835584,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec
|
| 11 |
+
gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf,1,30697345596,4.004095274739858,4.004095274739858,4.008222238994921,0,0,15364387056,30697345596,15364387056,15380222912,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec
|
| 12 |
+
gemma-4-31b-it,unsloth,gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf,1,30697345596,4.9013057208309645,4.9013057208309645,4.905432685086026,0,0,18807134448,30697345596,18807134448,18822970304,30697345596,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec
|
| 13 |
+
gemma-4-e4b-it,bartowski,gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf,1,7518069290,5.541883956751881,5.541883956751881,5.558725787162837,0,0,5208033448,7518069290,5208033448,5223860704,7518069290,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66
|
| 14 |
+
gemma-4-e4b-it,bartowski,gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf,1,7518069290,5.79154260814215,5.79154260814215,5.808384438553106,0,0,5442652328,7518069290,5442652328,5458479584,7518069290,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66
|
| 15 |
+
gemma-4-e4b-it,bartowski,gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf,1,7518069290,5.734815873717492,5.734815873717492,5.75165770412845,0,0,5389342888,7518069290,5389342888,5405170144,7518069290,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66
|
| 16 |
+
gemma-4-e4b-it,bartowski,gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf,1,7518069290,16.00120414319831,16.00120414319831,16.018045701198904,0,0,15037270184,7518069290,15037270184,15053097184,7518069290,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66
|
| 17 |
+
gemma-4-e4b-it,unsloth,gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf,1,7518069290,16.00120414319831,16.00120414319831,16.018046416276114,0,0,15037270184,7518069290,15037270184,15053097856,7518069290,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3
|
| 18 |
+
gemma-4-e4b-it,unsloth,gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf,1,7518069290,5.128988297472848,5.128988297472848,5.145830842961012,0,0,4820011176,7518069290,4820011176,4835839104,7518069290,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3
|
| 19 |
+
gemma-4-e4b-it,unsloth,gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf,1,7518069290,5.279380611827269,5.279380611827269,5.296223157315434,0,0,4961343656,7518069290,4961343656,4977171584,7518069290,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3
|
| 20 |
+
gemma-4-e4b-it,unsloth,gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf,1,7518069290,5.138577142323731,5.138577142323731,5.155419687811896,0,0,4829022376,7518069290,4829022376,4844850304,7518069290,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3
|
| 21 |
+
glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf,1,9400279040,4.6431295996932445,4.6431295996932445,4.651078327138681,0,0,5455839232,9400279040,5455839232,5465179264,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa
|
| 22 |
+
glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf,1,9400279040,4.876821249765794,4.876821249765794,4.88476997721123,0,0,5730435072,9400279040,5730435072,5739775104,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa
|
| 23 |
+
glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf,1,9400279040,4.653587161599833,4.653587161599833,4.661535889045268,0,0,5468127232,9400279040,5468127232,5477467264,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa
|
| 24 |
+
glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf,1,9400279040,5.105604817450185,5.105604817450185,5.113553544895621,0,0,5999263744,9400279040,5999263744,6008603776,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa
|
| 25 |
+
glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf,1,9400279040,5.240047233321278,5.240047233321278,5.247995960766714,0,0,6157238272,9400279040,6157238272,6166578304,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa
|
| 26 |
+
glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf,1,9400279040,4.892744630695558,4.892744630695558,4.900693358140994,0,0,5749145600,9400279040,5749145600,5758485632,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa
|
| 27 |
+
glm-4.6v-flash,bartowski,glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf,1,9400279040,16.00143617183517,16.00143617183517,16.0093846541815,0,0,18802245632,9400279040,18802245632,18811585376,9400279040,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa
|
| 28 |
+
glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf,1,9400279040,4.6431295996932445,4.6431295996932445,4.651078735637192,0,0,5455839232,9400279040,5455839232,5465179744,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8
|
| 29 |
+
glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf,1,9400279040,4.653587161599833,4.653587161599833,4.66153629754378,0,0,5468127232,9400279040,5468127232,5477467744,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8
|
| 30 |
+
glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf,1,9400279040,5.105604817450185,5.105604817450185,5.113553953394132,0,0,5999263744,9400279040,5999263744,6008604256,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8
|
| 31 |
+
glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf,1,9400279040,5.240047233321278,5.240047233321278,5.247996369265225,0,0,6157238272,9400279040,6157238272,6166578784,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8
|
| 32 |
+
glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf,1,9400279040,4.892744630695558,4.892744630695558,4.900693766639506,0,0,5749145600,9400279040,5749145600,5758486112,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8
|
| 33 |
+
glm-4.6v-flash,unsloth,glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf,1,9400279040,5.257727484651349,5.257727484651349,5.265676620595297,0,0,6178013184,9400279040,6178013184,6187353696,9400279040,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8
|
| 34 |
+
internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf,1,30532122624,3.890801228821896,3.890801228821896,3.8923646319494094,0,0,14849302528,30532122624,14849302528,14855269280,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9
|
| 35 |
+
internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf,1,30532122624,4.6182641129955915,4.6182641129955915,4.619827516123106,0,0,17625675776,30532122624,17625675776,17631642528,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9
|
| 36 |
+
internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf,1,30532122624,5.033007534143985,5.033007534143985,5.034570937271498,0,0,19208550400,30532122624,19208550400,19214517152,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9
|
| 37 |
+
internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf,1,30532122624,4.880424231850484,4.880424231850484,4.881987634977999,0,0,18626213888,30532122624,18626213888,18632180640,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9
|
| 38 |
+
internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf,1,30532122624,4.710716466432072,4.710716466432072,4.712279869559586,0,0,17978521600,30532122624,17978521600,17984488352,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9
|
| 39 |
+
internvl3.5-30b-a3b,bartowski,internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf,2,30532122624,16.006704469863458,16.006704469863458,16.008267856221746,0,0,61089832960,30532122624,61089832960,61095799648,30532122624,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9
|
| 40 |
+
internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf,1,30532122624,4.860642450431683,4.860642450431683,4.862205954174541,0,0,18550716416,30532122624,18550716416,18556683552,30532122624,mradermacher/InternVL3_5-30B-A3B-GGUF,21b0a0caee18e68b38b257a60ac86f883cd65059
|
| 41 |
+
internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf,1,30532122624,4.572243996500465,4.572243996500465,4.573807500243322,0,0,17450039296,30532122624,17450039296,17456006432,30532122624,mradermacher/InternVL3_5-30B-A3B-GGUF,21b0a0caee18e68b38b257a60ac86f883cd65059
|
| 42 |
+
internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf,1,30532122624,4.552324841599588,4.552324841599588,4.553888412419341,0,0,17374017536,30532122624,17374017536,17379984928,30532122624,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95
|
| 43 |
+
internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf,1,30532122624,5.027237847896834,5.027237847896834,5.028801418716587,0,0,19186530304,30532122624,19186530304,19192497696,30532122624,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95
|
| 44 |
+
internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf,1,30532122624,4.860642450431683,4.860642450431683,4.862206021251437,0,0,18550716416,30532122624,18550716416,18556683808,30532122624,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95
|
| 45 |
+
internvl3.5-30b-a3b,mradermacher,internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf,1,30532122624,4.572243996500465,4.572243996500465,4.573807567320217,0,0,17450039296,30532122624,17450039296,17456006688,30532122624,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95
|
| 46 |
+
kimi-vl-a3b-separate,ggml-org,kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf,1,15960110208,16.003544837677353,16.003544837677353,16.007022002639044,0,0,31927292416,15960110208,31927292416,31934229408,15960110208,ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF,e7dcd093335f922a057772febc7ab27eda985b40
|
| 47 |
+
muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf,1,27854794240,4.667764100346124,4.667764100346124,4.671530531040103,0,0,16252451072,27854794240,16252451072,16265565216,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857
|
| 48 |
+
muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf,1,27854794240,5.116560790362528,5.116560790362528,5.120327221056507,0,0,17815093504,27854794240,17815093504,17828207648,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857
|
| 49 |
+
muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf,1,27854794240,4.966673875096626,4.966673875096626,4.970440305790605,0,0,17293209856,27854794240,17293209856,17306324000,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857
|
| 50 |
+
muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf,1,27854794240,4.68366884393112,4.68366884393112,4.6874352746250985,0,0,16307828992,27854794240,16307828992,16320943136,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857
|
| 51 |
+
muse-glimmer-30b,bartowski,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16.gguf,2,27854794240,16.000806706946257,16.000806706946257,16.00457311006868,0,0,55712397312,27854794240,55712397312,55725511360,27854794240,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857
|
| 52 |
+
qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf,1,4205751296,5.015775548131698,5.112972644422943,5.1332558926113245,120599552,128176128,2636888064,4326350848,2765064192,2776033248,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6
|
| 53 |
+
qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf,1,4205751296,5.403467440790869,5.489857399563356,5.510140647751737,120599552,128176128,2840705024,4326350848,2968881152,2979850208,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6
|
| 54 |
+
qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf,1,4205751296,5.466576450648973,5.551207208981309,5.571490457169691,120599552,128176128,2873882624,4326350848,3002058752,3013027808,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6
|
| 55 |
+
qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf,1,4205751296,5.1491615047700625,5.242640389760641,5.262923637949023,120599552,128176128,2707011584,4326350848,2835187712,2846156768,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6
|
| 56 |
+
qwen3.5-4b,bartowski,qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf,1,4205751296,16.003657985201034,16.003605248059625,16.023888022869844,120599552,241225728,8413425664,4326350848,8654651392,8665620192,4326350848,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6
|
| 57 |
+
qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf,1,4205751296,16.003657985201034,16.003657985201034,16.0245207842171,0,0,8413425664,4205751296,8413425664,8424393632,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523
|
| 58 |
+
qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf,1,4205751296,4.8865968588172075,4.8865968588172075,4.907460144785508,0,0,2568976384,4205751296,2568976384,2579944608,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523
|
| 59 |
+
qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf,1,4205751296,4.892829847445168,4.892829847445168,4.913693133413469,0,0,2572253184,4205751296,2572253184,2583221408,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523
|
| 60 |
+
qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf,1,4205751296,5.27553534920197,5.27553534920197,5.296398635170271,0,0,2773448704,4205751296,2773448704,2784416928,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523
|
| 61 |
+
qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf,1,4205751296,5.192831381344714,5.192831381344714,5.213694667313015,0,0,2729969664,4205751296,2729969664,2740937888,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523
|
| 62 |
+
qwen3.5-4b,unsloth,qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf,1,4205751296,4.906542422426683,4.906542422426683,4.927405708394984,0,0,2579462144,4205751296,2579462144,2590430368,4205751296,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523
|
| 63 |
+
qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16.gguf,2,34660610688,16.01025405960672,16.010014969206477,16.012491363215652,844640768,1689303040,69365647872,35505251456,71054950912,71065941536,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f
|
| 64 |
+
qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf,1,34660610688,4.337051653046743,4.436203072528381,4.438679488168163,844640768,897955840,18790607360,35505251456,19688563200,19699553920,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f
|
| 65 |
+
qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf,1,34660610688,5.020934045926987,5.103816465025404,5.106292880665185,844640768,897955840,21753580032,35505251456,22651535872,22662526592,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f
|
| 66 |
+
qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf,1,34660610688,4.9338158117106055,5.018770702041807,5.021247117681588,844640768,897955840,21376133632,35505251456,22274089472,22285080192,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f
|
| 67 |
+
qwen3.6-35b-a3b,bartowski,qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf,1,34660610688,4.749463606911968,4.838804084767781,4.841280500407562,844640768,897955840,20577413632,35505251456,21475369472,21486360192,35505251456,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f
|
| 68 |
+
qwen3.6-35b-a3b,unsloth,qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf,1,34660610688,3.8855683765152706,3.8855683765152706,3.8881049845627,0,0,16834521600,34660610688,16834521600,16845511648,34660610688,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c
|
| 69 |
+
qwen3.6-35b-a3b,unsloth,qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf,1,34660610688,5.106324096397871,5.106324096397871,5.108860704445301,0,0,22123538944,34660610688,22123538944,22134528992,34660610688,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c
|
| 70 |
+
qwen3.6-35b-a3b,unsloth,qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf,1,34660610688,4.8197708108425585,4.8197708108425585,4.822307418889988,0,0,20882024960,34660610688,20882024960,20893015008,34660610688,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c
|
| 71 |
+
qwen3.6-35b-a3b,unsloth,qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf,1,34660610688,5.15847024466599,5.15847024466599,5.161006852713419,0,0,22349466112,34660610688,22349466112,22360456160,34660610688,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c
|
bpw/BPW.json
ADDED
|
@@ -0,0 +1,2087 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"provenance": {
|
| 3 |
+
"created_utc": "2026-09-06T11:32:10.745771+00:00",
|
| 4 |
+
"models_dir": "/home/ubuntu/models",
|
| 5 |
+
"library": "/home/ubuntu/projects/llama.cpp/build/bin/libggml-base.so.0.23.0",
|
| 6 |
+
"library_sha256": "a591ae0a3ab643b34f6eb222c842a6abe28a2b988f3fbf0c49727b4451c4762f",
|
| 7 |
+
"script_sha256": "935b10b1bed14e5e60a00c09009637fa73b1a7d66fb5a5bf8f5d6aba24675218",
|
| 8 |
+
"method": "llama.cpp native gguf_init_from_file(no_alloc=true, ctx=NULL), gguf_get_tensor_size/ne; metadata only",
|
| 9 |
+
"main_bpw": "8 * main tensor bytes / main stored parameter count; embedded nextn blocks excluded",
|
| 10 |
+
"llama_cpp_bpw": "8 * all tensor bytes / all stored parameter count; matches llama_model_loader.print_info",
|
| 11 |
+
"file_bpw_local_parameters": "8 * file bytes / all stored parameter count; includes GGUF metadata and padding"
|
| 12 |
+
},
|
| 13 |
+
"rows": [
|
| 14 |
+
{
|
| 15 |
+
"family": "gemma-4-31b-it",
|
| 16 |
+
"producer": "bartowski",
|
| 17 |
+
"model": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16.gguf",
|
| 18 |
+
"shards": 2,
|
| 19 |
+
"architecture": "gemma4",
|
| 20 |
+
"main_parameters": 30697345596,
|
| 21 |
+
"main_tensor_bytes": 61397354736,
|
| 22 |
+
"main_bpw": 16.000694143144507,
|
| 23 |
+
"llama_cpp_parameters": 30697345596,
|
| 24 |
+
"llama_cpp_tensor_bytes": 61397354736,
|
| 25 |
+
"llama_cpp_bpw": 16.000694143144507,
|
| 26 |
+
"file_bytes": 61413189920,
|
| 27 |
+
"file_bpw_local_parameters": 16.00482093227042,
|
| 28 |
+
"embedded_mtp_parameters": 0,
|
| 29 |
+
"embedded_mtp_bytes": 0,
|
| 30 |
+
"embedded_mtp_tensors": [],
|
| 31 |
+
"tensor_count": 833,
|
| 32 |
+
"files": [
|
| 33 |
+
"/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf",
|
| 34 |
+
"/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf"
|
| 35 |
+
],
|
| 36 |
+
"hf_repo": "bartowski/google_gemma-4-31B-it-GGUF",
|
| 37 |
+
"hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14",
|
| 38 |
+
"hf_gguf_total": 30697345596,
|
| 39 |
+
"hf_estimated_bpw": 16.00482093227042
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"family": "gemma-4-31b-it",
|
| 43 |
+
"producer": "bartowski",
|
| 44 |
+
"model": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf",
|
| 45 |
+
"shards": 1,
|
| 46 |
+
"architecture": "gemma4",
|
| 47 |
+
"main_parameters": 30697345596,
|
| 48 |
+
"main_tensor_bytes": 17140058352,
|
| 49 |
+
"main_bpw": 4.46685093299622,
|
| 50 |
+
"llama_cpp_parameters": 30697345596,
|
| 51 |
+
"llama_cpp_tensor_bytes": 17140058352,
|
| 52 |
+
"llama_cpp_bpw": 4.46685093299622,
|
| 53 |
+
"file_bytes": 17155893600,
|
| 54 |
+
"file_bpw_local_parameters": 4.470977738801101,
|
| 55 |
+
"embedded_mtp_parameters": 0,
|
| 56 |
+
"embedded_mtp_bytes": 0,
|
| 57 |
+
"embedded_mtp_tensors": [],
|
| 58 |
+
"tensor_count": 833,
|
| 59 |
+
"files": [
|
| 60 |
+
"/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf"
|
| 61 |
+
],
|
| 62 |
+
"hf_repo": "bartowski/google_gemma-4-31B-it-GGUF",
|
| 63 |
+
"hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14",
|
| 64 |
+
"hf_gguf_total": 30697345596,
|
| 65 |
+
"hf_estimated_bpw": 4.470977738801101
|
| 66 |
+
},
|
| 67 |
+
{
|
| 68 |
+
"family": "gemma-4-31b-it",
|
| 69 |
+
"producer": "bartowski",
|
| 70 |
+
"model": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf",
|
| 71 |
+
"shards": 1,
|
| 72 |
+
"architecture": "gemma4",
|
| 73 |
+
"main_parameters": 30697345596,
|
| 74 |
+
"main_tensor_bytes": 17136101616,
|
| 75 |
+
"main_bpw": 4.4658197725689766,
|
| 76 |
+
"llama_cpp_parameters": 30697345596,
|
| 77 |
+
"llama_cpp_tensor_bytes": 17136101616,
|
| 78 |
+
"llama_cpp_bpw": 4.4658197725689766,
|
| 79 |
+
"file_bytes": 17151936864,
|
| 80 |
+
"file_bpw_local_parameters": 4.4699465783738574,
|
| 81 |
+
"embedded_mtp_parameters": 0,
|
| 82 |
+
"embedded_mtp_bytes": 0,
|
| 83 |
+
"embedded_mtp_tensors": [],
|
| 84 |
+
"tensor_count": 833,
|
| 85 |
+
"files": [
|
| 86 |
+
"/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf"
|
| 87 |
+
],
|
| 88 |
+
"hf_repo": "bartowski/google_gemma-4-31B-it-GGUF",
|
| 89 |
+
"hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14",
|
| 90 |
+
"hf_gguf_total": 30697345596,
|
| 91 |
+
"hf_estimated_bpw": 4.4699465783738574
|
| 92 |
+
},
|
| 93 |
+
{
|
| 94 |
+
"family": "gemma-4-31b-it",
|
| 95 |
+
"producer": "bartowski",
|
| 96 |
+
"model": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf",
|
| 97 |
+
"shards": 1,
|
| 98 |
+
"architecture": "gemma4",
|
| 99 |
+
"main_parameters": 30697345596,
|
| 100 |
+
"main_tensor_bytes": 19582654704,
|
| 101 |
+
"main_bpw": 5.1034131645706085,
|
| 102 |
+
"llama_cpp_parameters": 30697345596,
|
| 103 |
+
"llama_cpp_tensor_bytes": 19582654704,
|
| 104 |
+
"llama_cpp_bpw": 5.1034131645706085,
|
| 105 |
+
"file_bytes": 19598489952,
|
| 106 |
+
"file_bpw_local_parameters": 5.107539970375489,
|
| 107 |
+
"embedded_mtp_parameters": 0,
|
| 108 |
+
"embedded_mtp_bytes": 0,
|
| 109 |
+
"embedded_mtp_tensors": [],
|
| 110 |
+
"tensor_count": 833,
|
| 111 |
+
"files": [
|
| 112 |
+
"/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf"
|
| 113 |
+
],
|
| 114 |
+
"hf_repo": "bartowski/google_gemma-4-31B-it-GGUF",
|
| 115 |
+
"hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14",
|
| 116 |
+
"hf_gguf_total": 30697345596,
|
| 117 |
+
"hf_estimated_bpw": 5.107539970375489
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"family": "gemma-4-31b-it",
|
| 121 |
+
"producer": "bartowski",
|
| 122 |
+
"model": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf",
|
| 123 |
+
"shards": 1,
|
| 124 |
+
"architecture": "gemma4",
|
| 125 |
+
"main_parameters": 30697345596,
|
| 126 |
+
"main_tensor_bytes": 18179819760,
|
| 127 |
+
"main_bpw": 4.737821960050881,
|
| 128 |
+
"llama_cpp_parameters": 30697345596,
|
| 129 |
+
"llama_cpp_tensor_bytes": 18179819760,
|
| 130 |
+
"llama_cpp_bpw": 4.737821960050881,
|
| 131 |
+
"file_bytes": 18195655008,
|
| 132 |
+
"file_bpw_local_parameters": 4.741948765855762,
|
| 133 |
+
"embedded_mtp_parameters": 0,
|
| 134 |
+
"embedded_mtp_bytes": 0,
|
| 135 |
+
"embedded_mtp_tensors": [],
|
| 136 |
+
"tensor_count": 833,
|
| 137 |
+
"files": [
|
| 138 |
+
"/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf"
|
| 139 |
+
],
|
| 140 |
+
"hf_repo": "bartowski/google_gemma-4-31B-it-GGUF",
|
| 141 |
+
"hf_commit": "619aca7589c72be65dd968de8602ad23d68b5c14",
|
| 142 |
+
"hf_gguf_total": 30697345596,
|
| 143 |
+
"hf_estimated_bpw": 4.741948765855762
|
| 144 |
+
},
|
| 145 |
+
{
|
| 146 |
+
"family": "gemma-4-31b-it",
|
| 147 |
+
"producer": "unsloth",
|
| 148 |
+
"model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf",
|
| 149 |
+
"shards": 1,
|
| 150 |
+
"architecture": "gemma4",
|
| 151 |
+
"main_parameters": 30697345596,
|
| 152 |
+
"main_tensor_bytes": 17271834864,
|
| 153 |
+
"main_bpw": 4.50119305852962,
|
| 154 |
+
"llama_cpp_parameters": 30697345596,
|
| 155 |
+
"llama_cpp_tensor_bytes": 17271834864,
|
| 156 |
+
"llama_cpp_bpw": 4.50119305852962,
|
| 157 |
+
"file_bytes": 17287670720,
|
| 158 |
+
"file_bpw_local_parameters": 4.505320022784683,
|
| 159 |
+
"embedded_mtp_parameters": 0,
|
| 160 |
+
"embedded_mtp_bytes": 0,
|
| 161 |
+
"embedded_mtp_tensors": [],
|
| 162 |
+
"tensor_count": 833,
|
| 163 |
+
"files": [
|
| 164 |
+
"/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf"
|
| 165 |
+
],
|
| 166 |
+
"hf_repo": "unsloth/gemma-4-31B-it-GGUF",
|
| 167 |
+
"hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec",
|
| 168 |
+
"hf_gguf_total": 30697345596,
|
| 169 |
+
"hf_estimated_bpw": 4.505320022784683
|
| 170 |
+
},
|
| 171 |
+
{
|
| 172 |
+
"family": "gemma-4-31b-it",
|
| 173 |
+
"producer": "unsloth",
|
| 174 |
+
"model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf",
|
| 175 |
+
"shards": 1,
|
| 176 |
+
"architecture": "gemma4",
|
| 177 |
+
"main_parameters": 30697345596,
|
| 178 |
+
"main_tensor_bytes": 19102255344,
|
| 179 |
+
"main_bpw": 4.978216838784682,
|
| 180 |
+
"llama_cpp_parameters": 30697345596,
|
| 181 |
+
"llama_cpp_tensor_bytes": 19102255344,
|
| 182 |
+
"llama_cpp_bpw": 4.978216838784682,
|
| 183 |
+
"file_bytes": 19118091200,
|
| 184 |
+
"file_bpw_local_parameters": 4.982343803039745,
|
| 185 |
+
"embedded_mtp_parameters": 0,
|
| 186 |
+
"embedded_mtp_bytes": 0,
|
| 187 |
+
"embedded_mtp_tensors": [],
|
| 188 |
+
"tensor_count": 833,
|
| 189 |
+
"files": [
|
| 190 |
+
"/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf"
|
| 191 |
+
],
|
| 192 |
+
"hf_repo": "unsloth/gemma-4-31B-it-GGUF",
|
| 193 |
+
"hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec",
|
| 194 |
+
"hf_gguf_total": 30697345596,
|
| 195 |
+
"hf_estimated_bpw": 4.982343803039745
|
| 196 |
+
},
|
| 197 |
+
{
|
| 198 |
+
"family": "gemma-4-31b-it",
|
| 199 |
+
"producer": "unsloth",
|
| 200 |
+
"model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf",
|
| 201 |
+
"shards": 1,
|
| 202 |
+
"architecture": "gemma4",
|
| 203 |
+
"main_parameters": 30697345596,
|
| 204 |
+
"main_tensor_bytes": 18307897584,
|
| 205 |
+
"main_bpw": 4.771200174750119,
|
| 206 |
+
"llama_cpp_parameters": 30697345596,
|
| 207 |
+
"llama_cpp_tensor_bytes": 18307897584,
|
| 208 |
+
"llama_cpp_bpw": 4.771200174750119,
|
| 209 |
+
"file_bytes": 18323733440,
|
| 210 |
+
"file_bpw_local_parameters": 4.7753271390051815,
|
| 211 |
+
"embedded_mtp_parameters": 0,
|
| 212 |
+
"embedded_mtp_bytes": 0,
|
| 213 |
+
"embedded_mtp_tensors": [],
|
| 214 |
+
"tensor_count": 833,
|
| 215 |
+
"files": [
|
| 216 |
+
"/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf"
|
| 217 |
+
],
|
| 218 |
+
"hf_repo": "unsloth/gemma-4-31B-it-GGUF",
|
| 219 |
+
"hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec",
|
| 220 |
+
"hf_gguf_total": 30697345596,
|
| 221 |
+
"hf_estimated_bpw": 4.7753271390051815
|
| 222 |
+
},
|
| 223 |
+
{
|
| 224 |
+
"family": "gemma-4-31b-it",
|
| 225 |
+
"producer": "unsloth",
|
| 226 |
+
"model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf",
|
| 227 |
+
"shards": 1,
|
| 228 |
+
"architecture": "gemma4",
|
| 229 |
+
"main_parameters": 30697345596,
|
| 230 |
+
"main_tensor_bytes": 17383999728,
|
| 231 |
+
"main_bpw": 4.530424214988859,
|
| 232 |
+
"llama_cpp_parameters": 30697345596,
|
| 233 |
+
"llama_cpp_tensor_bytes": 17383999728,
|
| 234 |
+
"llama_cpp_bpw": 4.530424214988859,
|
| 235 |
+
"file_bytes": 17399835584,
|
| 236 |
+
"file_bpw_local_parameters": 4.5345511792439215,
|
| 237 |
+
"embedded_mtp_parameters": 0,
|
| 238 |
+
"embedded_mtp_bytes": 0,
|
| 239 |
+
"embedded_mtp_tensors": [],
|
| 240 |
+
"tensor_count": 833,
|
| 241 |
+
"files": [
|
| 242 |
+
"/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf"
|
| 243 |
+
],
|
| 244 |
+
"hf_repo": "unsloth/gemma-4-31B-it-GGUF",
|
| 245 |
+
"hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec",
|
| 246 |
+
"hf_gguf_total": 30697345596,
|
| 247 |
+
"hf_estimated_bpw": 4.5345511792439215
|
| 248 |
+
},
|
| 249 |
+
{
|
| 250 |
+
"family": "gemma-4-31b-it",
|
| 251 |
+
"producer": "unsloth",
|
| 252 |
+
"model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf",
|
| 253 |
+
"shards": 1,
|
| 254 |
+
"architecture": "gemma4",
|
| 255 |
+
"main_parameters": 30697345596,
|
| 256 |
+
"main_tensor_bytes": 15364387056,
|
| 257 |
+
"main_bpw": 4.004095274739858,
|
| 258 |
+
"llama_cpp_parameters": 30697345596,
|
| 259 |
+
"llama_cpp_tensor_bytes": 15364387056,
|
| 260 |
+
"llama_cpp_bpw": 4.004095274739858,
|
| 261 |
+
"file_bytes": 15380222912,
|
| 262 |
+
"file_bpw_local_parameters": 4.008222238994921,
|
| 263 |
+
"embedded_mtp_parameters": 0,
|
| 264 |
+
"embedded_mtp_bytes": 0,
|
| 265 |
+
"embedded_mtp_tensors": [],
|
| 266 |
+
"tensor_count": 833,
|
| 267 |
+
"files": [
|
| 268 |
+
"/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf"
|
| 269 |
+
],
|
| 270 |
+
"hf_repo": "unsloth/gemma-4-31B-it-GGUF",
|
| 271 |
+
"hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec",
|
| 272 |
+
"hf_gguf_total": 30697345596,
|
| 273 |
+
"hf_estimated_bpw": 4.008222238994921
|
| 274 |
+
},
|
| 275 |
+
{
|
| 276 |
+
"family": "gemma-4-31b-it",
|
| 277 |
+
"producer": "unsloth",
|
| 278 |
+
"model": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf",
|
| 279 |
+
"shards": 1,
|
| 280 |
+
"architecture": "gemma4",
|
| 281 |
+
"main_parameters": 30697345596,
|
| 282 |
+
"main_tensor_bytes": 18807134448,
|
| 283 |
+
"main_bpw": 4.9013057208309645,
|
| 284 |
+
"llama_cpp_parameters": 30697345596,
|
| 285 |
+
"llama_cpp_tensor_bytes": 18807134448,
|
| 286 |
+
"llama_cpp_bpw": 4.9013057208309645,
|
| 287 |
+
"file_bytes": 18822970304,
|
| 288 |
+
"file_bpw_local_parameters": 4.905432685086026,
|
| 289 |
+
"embedded_mtp_parameters": 0,
|
| 290 |
+
"embedded_mtp_bytes": 0,
|
| 291 |
+
"embedded_mtp_tensors": [],
|
| 292 |
+
"tensor_count": 833,
|
| 293 |
+
"files": [
|
| 294 |
+
"/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf"
|
| 295 |
+
],
|
| 296 |
+
"hf_repo": "unsloth/gemma-4-31B-it-GGUF",
|
| 297 |
+
"hf_commit": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec",
|
| 298 |
+
"hf_gguf_total": 30697345596,
|
| 299 |
+
"hf_estimated_bpw": 4.905432685086026
|
| 300 |
+
},
|
| 301 |
+
{
|
| 302 |
+
"family": "gemma-4-e4b-it",
|
| 303 |
+
"producer": "bartowski",
|
| 304 |
+
"model": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf",
|
| 305 |
+
"shards": 1,
|
| 306 |
+
"architecture": "gemma4",
|
| 307 |
+
"main_parameters": 7518069290,
|
| 308 |
+
"main_tensor_bytes": 5208033448,
|
| 309 |
+
"main_bpw": 5.541883956751881,
|
| 310 |
+
"llama_cpp_parameters": 7518069290,
|
| 311 |
+
"llama_cpp_tensor_bytes": 5208033448,
|
| 312 |
+
"llama_cpp_bpw": 5.541883956751881,
|
| 313 |
+
"file_bytes": 5223860704,
|
| 314 |
+
"file_bpw_local_parameters": 5.558725787162837,
|
| 315 |
+
"embedded_mtp_parameters": 0,
|
| 316 |
+
"embedded_mtp_bytes": 0,
|
| 317 |
+
"embedded_mtp_tensors": [],
|
| 318 |
+
"tensor_count": 720,
|
| 319 |
+
"files": [
|
| 320 |
+
"/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf"
|
| 321 |
+
],
|
| 322 |
+
"hf_repo": "bartowski/google_gemma-4-E4B-it-GGUF",
|
| 323 |
+
"hf_commit": "029e94146666900b08caf49a3b47b413dfa8ec66",
|
| 324 |
+
"hf_gguf_total": 7518069290,
|
| 325 |
+
"hf_estimated_bpw": 5.558725787162837
|
| 326 |
+
},
|
| 327 |
+
{
|
| 328 |
+
"family": "gemma-4-e4b-it",
|
| 329 |
+
"producer": "bartowski",
|
| 330 |
+
"model": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf",
|
| 331 |
+
"shards": 1,
|
| 332 |
+
"architecture": "gemma4",
|
| 333 |
+
"main_parameters": 7518069290,
|
| 334 |
+
"main_tensor_bytes": 5442652328,
|
| 335 |
+
"main_bpw": 5.79154260814215,
|
| 336 |
+
"llama_cpp_parameters": 7518069290,
|
| 337 |
+
"llama_cpp_tensor_bytes": 5442652328,
|
| 338 |
+
"llama_cpp_bpw": 5.79154260814215,
|
| 339 |
+
"file_bytes": 5458479584,
|
| 340 |
+
"file_bpw_local_parameters": 5.808384438553106,
|
| 341 |
+
"embedded_mtp_parameters": 0,
|
| 342 |
+
"embedded_mtp_bytes": 0,
|
| 343 |
+
"embedded_mtp_tensors": [],
|
| 344 |
+
"tensor_count": 720,
|
| 345 |
+
"files": [
|
| 346 |
+
"/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf"
|
| 347 |
+
],
|
| 348 |
+
"hf_repo": "bartowski/google_gemma-4-E4B-it-GGUF",
|
| 349 |
+
"hf_commit": "029e94146666900b08caf49a3b47b413dfa8ec66",
|
| 350 |
+
"hf_gguf_total": 7518069290,
|
| 351 |
+
"hf_estimated_bpw": 5.808384438553106
|
| 352 |
+
},
|
| 353 |
+
{
|
| 354 |
+
"family": "gemma-4-e4b-it",
|
| 355 |
+
"producer": "bartowski",
|
| 356 |
+
"model": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf",
|
| 357 |
+
"shards": 1,
|
| 358 |
+
"architecture": "gemma4",
|
| 359 |
+
"main_parameters": 7518069290,
|
| 360 |
+
"main_tensor_bytes": 5389342888,
|
| 361 |
+
"main_bpw": 5.734815873717492,
|
| 362 |
+
"llama_cpp_parameters": 7518069290,
|
| 363 |
+
"llama_cpp_tensor_bytes": 5389342888,
|
| 364 |
+
"llama_cpp_bpw": 5.734815873717492,
|
| 365 |
+
"file_bytes": 5405170144,
|
| 366 |
+
"file_bpw_local_parameters": 5.75165770412845,
|
| 367 |
+
"embedded_mtp_parameters": 0,
|
| 368 |
+
"embedded_mtp_bytes": 0,
|
| 369 |
+
"embedded_mtp_tensors": [],
|
| 370 |
+
"tensor_count": 720,
|
| 371 |
+
"files": [
|
| 372 |
+
"/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf"
|
| 373 |
+
],
|
| 374 |
+
"hf_repo": "bartowski/google_gemma-4-E4B-it-GGUF",
|
| 375 |
+
"hf_commit": "029e94146666900b08caf49a3b47b413dfa8ec66",
|
| 376 |
+
"hf_gguf_total": 7518069290,
|
| 377 |
+
"hf_estimated_bpw": 5.75165770412845
|
| 378 |
+
},
|
| 379 |
+
{
|
| 380 |
+
"family": "gemma-4-e4b-it",
|
| 381 |
+
"producer": "bartowski",
|
| 382 |
+
"model": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf",
|
| 383 |
+
"shards": 1,
|
| 384 |
+
"architecture": "gemma4",
|
| 385 |
+
"main_parameters": 7518069290,
|
| 386 |
+
"main_tensor_bytes": 15037270184,
|
| 387 |
+
"main_bpw": 16.00120414319831,
|
| 388 |
+
"llama_cpp_parameters": 7518069290,
|
| 389 |
+
"llama_cpp_tensor_bytes": 15037270184,
|
| 390 |
+
"llama_cpp_bpw": 16.00120414319831,
|
| 391 |
+
"file_bytes": 15053097184,
|
| 392 |
+
"file_bpw_local_parameters": 16.018045701198904,
|
| 393 |
+
"embedded_mtp_parameters": 0,
|
| 394 |
+
"embedded_mtp_bytes": 0,
|
| 395 |
+
"embedded_mtp_tensors": [],
|
| 396 |
+
"tensor_count": 720,
|
| 397 |
+
"files": [
|
| 398 |
+
"/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf"
|
| 399 |
+
],
|
| 400 |
+
"hf_repo": "bartowski/google_gemma-4-E4B-it-GGUF",
|
| 401 |
+
"hf_commit": "029e94146666900b08caf49a3b47b413dfa8ec66",
|
| 402 |
+
"hf_gguf_total": 7518069290,
|
| 403 |
+
"hf_estimated_bpw": 16.018045701198904
|
| 404 |
+
},
|
| 405 |
+
{
|
| 406 |
+
"family": "gemma-4-e4b-it",
|
| 407 |
+
"producer": "unsloth",
|
| 408 |
+
"model": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf",
|
| 409 |
+
"shards": 1,
|
| 410 |
+
"architecture": "gemma4",
|
| 411 |
+
"main_parameters": 7518069290,
|
| 412 |
+
"main_tensor_bytes": 15037270184,
|
| 413 |
+
"main_bpw": 16.00120414319831,
|
| 414 |
+
"llama_cpp_parameters": 7518069290,
|
| 415 |
+
"llama_cpp_tensor_bytes": 15037270184,
|
| 416 |
+
"llama_cpp_bpw": 16.00120414319831,
|
| 417 |
+
"file_bytes": 15053097856,
|
| 418 |
+
"file_bpw_local_parameters": 16.018046416276114,
|
| 419 |
+
"embedded_mtp_parameters": 0,
|
| 420 |
+
"embedded_mtp_bytes": 0,
|
| 421 |
+
"embedded_mtp_tensors": [],
|
| 422 |
+
"tensor_count": 720,
|
| 423 |
+
"files": [
|
| 424 |
+
"/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf"
|
| 425 |
+
],
|
| 426 |
+
"hf_repo": "unsloth/gemma-4-E4B-it-GGUF",
|
| 427 |
+
"hf_commit": "bfc15c382204943c3a8fff0c750b94ae2364d7a3",
|
| 428 |
+
"hf_gguf_total": 7518069290,
|
| 429 |
+
"hf_estimated_bpw": 16.018046416276114
|
| 430 |
+
},
|
| 431 |
+
{
|
| 432 |
+
"family": "gemma-4-e4b-it",
|
| 433 |
+
"producer": "unsloth",
|
| 434 |
+
"model": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf",
|
| 435 |
+
"shards": 1,
|
| 436 |
+
"architecture": "gemma4",
|
| 437 |
+
"main_parameters": 7518069290,
|
| 438 |
+
"main_tensor_bytes": 4820011176,
|
| 439 |
+
"main_bpw": 5.128988297472848,
|
| 440 |
+
"llama_cpp_parameters": 7518069290,
|
| 441 |
+
"llama_cpp_tensor_bytes": 4820011176,
|
| 442 |
+
"llama_cpp_bpw": 5.128988297472848,
|
| 443 |
+
"file_bytes": 4835839104,
|
| 444 |
+
"file_bpw_local_parameters": 5.145830842961012,
|
| 445 |
+
"embedded_mtp_parameters": 0,
|
| 446 |
+
"embedded_mtp_bytes": 0,
|
| 447 |
+
"embedded_mtp_tensors": [],
|
| 448 |
+
"tensor_count": 720,
|
| 449 |
+
"files": [
|
| 450 |
+
"/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf"
|
| 451 |
+
],
|
| 452 |
+
"hf_repo": "unsloth/gemma-4-E4B-it-GGUF",
|
| 453 |
+
"hf_commit": "bfc15c382204943c3a8fff0c750b94ae2364d7a3",
|
| 454 |
+
"hf_gguf_total": 7518069290,
|
| 455 |
+
"hf_estimated_bpw": 5.145830842961012
|
| 456 |
+
},
|
| 457 |
+
{
|
| 458 |
+
"family": "gemma-4-e4b-it",
|
| 459 |
+
"producer": "unsloth",
|
| 460 |
+
"model": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf",
|
| 461 |
+
"shards": 1,
|
| 462 |
+
"architecture": "gemma4",
|
| 463 |
+
"main_parameters": 7518069290,
|
| 464 |
+
"main_tensor_bytes": 4961343656,
|
| 465 |
+
"main_bpw": 5.279380611827269,
|
| 466 |
+
"llama_cpp_parameters": 7518069290,
|
| 467 |
+
"llama_cpp_tensor_bytes": 4961343656,
|
| 468 |
+
"llama_cpp_bpw": 5.279380611827269,
|
| 469 |
+
"file_bytes": 4977171584,
|
| 470 |
+
"file_bpw_local_parameters": 5.296223157315434,
|
| 471 |
+
"embedded_mtp_parameters": 0,
|
| 472 |
+
"embedded_mtp_bytes": 0,
|
| 473 |
+
"embedded_mtp_tensors": [],
|
| 474 |
+
"tensor_count": 720,
|
| 475 |
+
"files": [
|
| 476 |
+
"/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf"
|
| 477 |
+
],
|
| 478 |
+
"hf_repo": "unsloth/gemma-4-E4B-it-GGUF",
|
| 479 |
+
"hf_commit": "bfc15c382204943c3a8fff0c750b94ae2364d7a3",
|
| 480 |
+
"hf_gguf_total": 7518069290,
|
| 481 |
+
"hf_estimated_bpw": 5.296223157315434
|
| 482 |
+
},
|
| 483 |
+
{
|
| 484 |
+
"family": "gemma-4-e4b-it",
|
| 485 |
+
"producer": "unsloth",
|
| 486 |
+
"model": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf",
|
| 487 |
+
"shards": 1,
|
| 488 |
+
"architecture": "gemma4",
|
| 489 |
+
"main_parameters": 7518069290,
|
| 490 |
+
"main_tensor_bytes": 4829022376,
|
| 491 |
+
"main_bpw": 5.138577142323731,
|
| 492 |
+
"llama_cpp_parameters": 7518069290,
|
| 493 |
+
"llama_cpp_tensor_bytes": 4829022376,
|
| 494 |
+
"llama_cpp_bpw": 5.138577142323731,
|
| 495 |
+
"file_bytes": 4844850304,
|
| 496 |
+
"file_bpw_local_parameters": 5.155419687811896,
|
| 497 |
+
"embedded_mtp_parameters": 0,
|
| 498 |
+
"embedded_mtp_bytes": 0,
|
| 499 |
+
"embedded_mtp_tensors": [],
|
| 500 |
+
"tensor_count": 720,
|
| 501 |
+
"files": [
|
| 502 |
+
"/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf"
|
| 503 |
+
],
|
| 504 |
+
"hf_repo": "unsloth/gemma-4-E4B-it-GGUF",
|
| 505 |
+
"hf_commit": "bfc15c382204943c3a8fff0c750b94ae2364d7a3",
|
| 506 |
+
"hf_gguf_total": 7518069290,
|
| 507 |
+
"hf_estimated_bpw": 5.155419687811896
|
| 508 |
+
},
|
| 509 |
+
{
|
| 510 |
+
"family": "glm-4.6v-flash",
|
| 511 |
+
"producer": "bartowski",
|
| 512 |
+
"model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 513 |
+
"shards": 1,
|
| 514 |
+
"architecture": "glm4",
|
| 515 |
+
"main_parameters": 9400279040,
|
| 516 |
+
"main_tensor_bytes": 5455839232,
|
| 517 |
+
"main_bpw": 4.6431295996932445,
|
| 518 |
+
"llama_cpp_parameters": 9400279040,
|
| 519 |
+
"llama_cpp_tensor_bytes": 5455839232,
|
| 520 |
+
"llama_cpp_bpw": 4.6431295996932445,
|
| 521 |
+
"file_bytes": 5465179264,
|
| 522 |
+
"file_bpw_local_parameters": 4.651078327138681,
|
| 523 |
+
"embedded_mtp_parameters": 0,
|
| 524 |
+
"embedded_mtp_bytes": 0,
|
| 525 |
+
"embedded_mtp_tensors": [],
|
| 526 |
+
"tensor_count": 523,
|
| 527 |
+
"files": [
|
| 528 |
+
"/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf"
|
| 529 |
+
],
|
| 530 |
+
"hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 531 |
+
"hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa",
|
| 532 |
+
"hf_gguf_total": 9400279040,
|
| 533 |
+
"hf_estimated_bpw": 4.651078327138681
|
| 534 |
+
},
|
| 535 |
+
{
|
| 536 |
+
"family": "glm-4.6v-flash",
|
| 537 |
+
"producer": "bartowski",
|
| 538 |
+
"model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf",
|
| 539 |
+
"shards": 1,
|
| 540 |
+
"architecture": "glm4",
|
| 541 |
+
"main_parameters": 9400279040,
|
| 542 |
+
"main_tensor_bytes": 5730435072,
|
| 543 |
+
"main_bpw": 4.876821249765794,
|
| 544 |
+
"llama_cpp_parameters": 9400279040,
|
| 545 |
+
"llama_cpp_tensor_bytes": 5730435072,
|
| 546 |
+
"llama_cpp_bpw": 4.876821249765794,
|
| 547 |
+
"file_bytes": 5739775104,
|
| 548 |
+
"file_bpw_local_parameters": 4.88476997721123,
|
| 549 |
+
"embedded_mtp_parameters": 0,
|
| 550 |
+
"embedded_mtp_bytes": 0,
|
| 551 |
+
"embedded_mtp_tensors": [],
|
| 552 |
+
"tensor_count": 523,
|
| 553 |
+
"files": [
|
| 554 |
+
"/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf"
|
| 555 |
+
],
|
| 556 |
+
"hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 557 |
+
"hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa",
|
| 558 |
+
"hf_gguf_total": 9400279040,
|
| 559 |
+
"hf_estimated_bpw": 4.88476997721123
|
| 560 |
+
},
|
| 561 |
+
{
|
| 562 |
+
"family": "glm-4.6v-flash",
|
| 563 |
+
"producer": "bartowski",
|
| 564 |
+
"model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf",
|
| 565 |
+
"shards": 1,
|
| 566 |
+
"architecture": "glm4",
|
| 567 |
+
"main_parameters": 9400279040,
|
| 568 |
+
"main_tensor_bytes": 5468127232,
|
| 569 |
+
"main_bpw": 4.653587161599833,
|
| 570 |
+
"llama_cpp_parameters": 9400279040,
|
| 571 |
+
"llama_cpp_tensor_bytes": 5468127232,
|
| 572 |
+
"llama_cpp_bpw": 4.653587161599833,
|
| 573 |
+
"file_bytes": 5477467264,
|
| 574 |
+
"file_bpw_local_parameters": 4.661535889045268,
|
| 575 |
+
"embedded_mtp_parameters": 0,
|
| 576 |
+
"embedded_mtp_bytes": 0,
|
| 577 |
+
"embedded_mtp_tensors": [],
|
| 578 |
+
"tensor_count": 523,
|
| 579 |
+
"files": [
|
| 580 |
+
"/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf"
|
| 581 |
+
],
|
| 582 |
+
"hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 583 |
+
"hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa",
|
| 584 |
+
"hf_gguf_total": 9400279040,
|
| 585 |
+
"hf_estimated_bpw": 4.661535889045268
|
| 586 |
+
},
|
| 587 |
+
{
|
| 588 |
+
"family": "glm-4.6v-flash",
|
| 589 |
+
"producer": "bartowski",
|
| 590 |
+
"model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf",
|
| 591 |
+
"shards": 1,
|
| 592 |
+
"architecture": "glm4",
|
| 593 |
+
"main_parameters": 9400279040,
|
| 594 |
+
"main_tensor_bytes": 5999263744,
|
| 595 |
+
"main_bpw": 5.105604817450185,
|
| 596 |
+
"llama_cpp_parameters": 9400279040,
|
| 597 |
+
"llama_cpp_tensor_bytes": 5999263744,
|
| 598 |
+
"llama_cpp_bpw": 5.105604817450185,
|
| 599 |
+
"file_bytes": 6008603776,
|
| 600 |
+
"file_bpw_local_parameters": 5.113553544895621,
|
| 601 |
+
"embedded_mtp_parameters": 0,
|
| 602 |
+
"embedded_mtp_bytes": 0,
|
| 603 |
+
"embedded_mtp_tensors": [],
|
| 604 |
+
"tensor_count": 523,
|
| 605 |
+
"files": [
|
| 606 |
+
"/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf"
|
| 607 |
+
],
|
| 608 |
+
"hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 609 |
+
"hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa",
|
| 610 |
+
"hf_gguf_total": 9400279040,
|
| 611 |
+
"hf_estimated_bpw": 5.113553544895621
|
| 612 |
+
},
|
| 613 |
+
{
|
| 614 |
+
"family": "glm-4.6v-flash",
|
| 615 |
+
"producer": "bartowski",
|
| 616 |
+
"model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 617 |
+
"shards": 1,
|
| 618 |
+
"architecture": "glm4",
|
| 619 |
+
"main_parameters": 9400279040,
|
| 620 |
+
"main_tensor_bytes": 6157238272,
|
| 621 |
+
"main_bpw": 5.240047233321278,
|
| 622 |
+
"llama_cpp_parameters": 9400279040,
|
| 623 |
+
"llama_cpp_tensor_bytes": 6157238272,
|
| 624 |
+
"llama_cpp_bpw": 5.240047233321278,
|
| 625 |
+
"file_bytes": 6166578304,
|
| 626 |
+
"file_bpw_local_parameters": 5.247995960766714,
|
| 627 |
+
"embedded_mtp_parameters": 0,
|
| 628 |
+
"embedded_mtp_bytes": 0,
|
| 629 |
+
"embedded_mtp_tensors": [],
|
| 630 |
+
"tensor_count": 523,
|
| 631 |
+
"files": [
|
| 632 |
+
"/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf"
|
| 633 |
+
],
|
| 634 |
+
"hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 635 |
+
"hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa",
|
| 636 |
+
"hf_gguf_total": 9400279040,
|
| 637 |
+
"hf_estimated_bpw": 5.247995960766714
|
| 638 |
+
},
|
| 639 |
+
{
|
| 640 |
+
"family": "glm-4.6v-flash",
|
| 641 |
+
"producer": "bartowski",
|
| 642 |
+
"model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 643 |
+
"shards": 1,
|
| 644 |
+
"architecture": "glm4",
|
| 645 |
+
"main_parameters": 9400279040,
|
| 646 |
+
"main_tensor_bytes": 5749145600,
|
| 647 |
+
"main_bpw": 4.892744630695558,
|
| 648 |
+
"llama_cpp_parameters": 9400279040,
|
| 649 |
+
"llama_cpp_tensor_bytes": 5749145600,
|
| 650 |
+
"llama_cpp_bpw": 4.892744630695558,
|
| 651 |
+
"file_bytes": 5758485632,
|
| 652 |
+
"file_bpw_local_parameters": 4.900693358140994,
|
| 653 |
+
"embedded_mtp_parameters": 0,
|
| 654 |
+
"embedded_mtp_bytes": 0,
|
| 655 |
+
"embedded_mtp_tensors": [],
|
| 656 |
+
"tensor_count": 523,
|
| 657 |
+
"files": [
|
| 658 |
+
"/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf"
|
| 659 |
+
],
|
| 660 |
+
"hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 661 |
+
"hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa",
|
| 662 |
+
"hf_gguf_total": 9400279040,
|
| 663 |
+
"hf_estimated_bpw": 4.900693358140994
|
| 664 |
+
},
|
| 665 |
+
{
|
| 666 |
+
"family": "glm-4.6v-flash",
|
| 667 |
+
"producer": "bartowski",
|
| 668 |
+
"model": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 669 |
+
"shards": 1,
|
| 670 |
+
"architecture": "glm4",
|
| 671 |
+
"main_parameters": 9400279040,
|
| 672 |
+
"main_tensor_bytes": 18802245632,
|
| 673 |
+
"main_bpw": 16.00143617183517,
|
| 674 |
+
"llama_cpp_parameters": 9400279040,
|
| 675 |
+
"llama_cpp_tensor_bytes": 18802245632,
|
| 676 |
+
"llama_cpp_bpw": 16.00143617183517,
|
| 677 |
+
"file_bytes": 18811585376,
|
| 678 |
+
"file_bpw_local_parameters": 16.0093846541815,
|
| 679 |
+
"embedded_mtp_parameters": 0,
|
| 680 |
+
"embedded_mtp_bytes": 0,
|
| 681 |
+
"embedded_mtp_tensors": [],
|
| 682 |
+
"tensor_count": 523,
|
| 683 |
+
"files": [
|
| 684 |
+
"/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf"
|
| 685 |
+
],
|
| 686 |
+
"hf_repo": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 687 |
+
"hf_commit": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa",
|
| 688 |
+
"hf_gguf_total": 9400279040,
|
| 689 |
+
"hf_estimated_bpw": 16.0093846541815
|
| 690 |
+
},
|
| 691 |
+
{
|
| 692 |
+
"family": "glm-4.6v-flash",
|
| 693 |
+
"producer": "unsloth",
|
| 694 |
+
"model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 695 |
+
"shards": 1,
|
| 696 |
+
"architecture": "glm4",
|
| 697 |
+
"main_parameters": 9400279040,
|
| 698 |
+
"main_tensor_bytes": 5455839232,
|
| 699 |
+
"main_bpw": 4.6431295996932445,
|
| 700 |
+
"llama_cpp_parameters": 9400279040,
|
| 701 |
+
"llama_cpp_tensor_bytes": 5455839232,
|
| 702 |
+
"llama_cpp_bpw": 4.6431295996932445,
|
| 703 |
+
"file_bytes": 5465179744,
|
| 704 |
+
"file_bpw_local_parameters": 4.651078735637192,
|
| 705 |
+
"embedded_mtp_parameters": 0,
|
| 706 |
+
"embedded_mtp_bytes": 0,
|
| 707 |
+
"embedded_mtp_tensors": [],
|
| 708 |
+
"tensor_count": 523,
|
| 709 |
+
"files": [
|
| 710 |
+
"/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf"
|
| 711 |
+
],
|
| 712 |
+
"hf_repo": "unsloth/GLM-4.6V-Flash-GGUF",
|
| 713 |
+
"hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8",
|
| 714 |
+
"hf_gguf_total": 9400279040,
|
| 715 |
+
"hf_estimated_bpw": 4.651078735637192
|
| 716 |
+
},
|
| 717 |
+
{
|
| 718 |
+
"family": "glm-4.6v-flash",
|
| 719 |
+
"producer": "unsloth",
|
| 720 |
+
"model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf",
|
| 721 |
+
"shards": 1,
|
| 722 |
+
"architecture": "glm4",
|
| 723 |
+
"main_parameters": 9400279040,
|
| 724 |
+
"main_tensor_bytes": 5468127232,
|
| 725 |
+
"main_bpw": 4.653587161599833,
|
| 726 |
+
"llama_cpp_parameters": 9400279040,
|
| 727 |
+
"llama_cpp_tensor_bytes": 5468127232,
|
| 728 |
+
"llama_cpp_bpw": 4.653587161599833,
|
| 729 |
+
"file_bytes": 5477467744,
|
| 730 |
+
"file_bpw_local_parameters": 4.66153629754378,
|
| 731 |
+
"embedded_mtp_parameters": 0,
|
| 732 |
+
"embedded_mtp_bytes": 0,
|
| 733 |
+
"embedded_mtp_tensors": [],
|
| 734 |
+
"tensor_count": 523,
|
| 735 |
+
"files": [
|
| 736 |
+
"/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf"
|
| 737 |
+
],
|
| 738 |
+
"hf_repo": "unsloth/GLM-4.6V-Flash-GGUF",
|
| 739 |
+
"hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8",
|
| 740 |
+
"hf_gguf_total": 9400279040,
|
| 741 |
+
"hf_estimated_bpw": 4.66153629754378
|
| 742 |
+
},
|
| 743 |
+
{
|
| 744 |
+
"family": "glm-4.6v-flash",
|
| 745 |
+
"producer": "unsloth",
|
| 746 |
+
"model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf",
|
| 747 |
+
"shards": 1,
|
| 748 |
+
"architecture": "glm4",
|
| 749 |
+
"main_parameters": 9400279040,
|
| 750 |
+
"main_tensor_bytes": 5999263744,
|
| 751 |
+
"main_bpw": 5.105604817450185,
|
| 752 |
+
"llama_cpp_parameters": 9400279040,
|
| 753 |
+
"llama_cpp_tensor_bytes": 5999263744,
|
| 754 |
+
"llama_cpp_bpw": 5.105604817450185,
|
| 755 |
+
"file_bytes": 6008604256,
|
| 756 |
+
"file_bpw_local_parameters": 5.113553953394132,
|
| 757 |
+
"embedded_mtp_parameters": 0,
|
| 758 |
+
"embedded_mtp_bytes": 0,
|
| 759 |
+
"embedded_mtp_tensors": [],
|
| 760 |
+
"tensor_count": 523,
|
| 761 |
+
"files": [
|
| 762 |
+
"/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf"
|
| 763 |
+
],
|
| 764 |
+
"hf_repo": "unsloth/GLM-4.6V-Flash-GGUF",
|
| 765 |
+
"hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8",
|
| 766 |
+
"hf_gguf_total": 9400279040,
|
| 767 |
+
"hf_estimated_bpw": 5.113553953394132
|
| 768 |
+
},
|
| 769 |
+
{
|
| 770 |
+
"family": "glm-4.6v-flash",
|
| 771 |
+
"producer": "unsloth",
|
| 772 |
+
"model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 773 |
+
"shards": 1,
|
| 774 |
+
"architecture": "glm4",
|
| 775 |
+
"main_parameters": 9400279040,
|
| 776 |
+
"main_tensor_bytes": 6157238272,
|
| 777 |
+
"main_bpw": 5.240047233321278,
|
| 778 |
+
"llama_cpp_parameters": 9400279040,
|
| 779 |
+
"llama_cpp_tensor_bytes": 6157238272,
|
| 780 |
+
"llama_cpp_bpw": 5.240047233321278,
|
| 781 |
+
"file_bytes": 6166578784,
|
| 782 |
+
"file_bpw_local_parameters": 5.247996369265225,
|
| 783 |
+
"embedded_mtp_parameters": 0,
|
| 784 |
+
"embedded_mtp_bytes": 0,
|
| 785 |
+
"embedded_mtp_tensors": [],
|
| 786 |
+
"tensor_count": 523,
|
| 787 |
+
"files": [
|
| 788 |
+
"/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf"
|
| 789 |
+
],
|
| 790 |
+
"hf_repo": "unsloth/GLM-4.6V-Flash-GGUF",
|
| 791 |
+
"hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8",
|
| 792 |
+
"hf_gguf_total": 9400279040,
|
| 793 |
+
"hf_estimated_bpw": 5.247996369265225
|
| 794 |
+
},
|
| 795 |
+
{
|
| 796 |
+
"family": "glm-4.6v-flash",
|
| 797 |
+
"producer": "unsloth",
|
| 798 |
+
"model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 799 |
+
"shards": 1,
|
| 800 |
+
"architecture": "glm4",
|
| 801 |
+
"main_parameters": 9400279040,
|
| 802 |
+
"main_tensor_bytes": 5749145600,
|
| 803 |
+
"main_bpw": 4.892744630695558,
|
| 804 |
+
"llama_cpp_parameters": 9400279040,
|
| 805 |
+
"llama_cpp_tensor_bytes": 5749145600,
|
| 806 |
+
"llama_cpp_bpw": 4.892744630695558,
|
| 807 |
+
"file_bytes": 5758486112,
|
| 808 |
+
"file_bpw_local_parameters": 4.900693766639506,
|
| 809 |
+
"embedded_mtp_parameters": 0,
|
| 810 |
+
"embedded_mtp_bytes": 0,
|
| 811 |
+
"embedded_mtp_tensors": [],
|
| 812 |
+
"tensor_count": 523,
|
| 813 |
+
"files": [
|
| 814 |
+
"/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf"
|
| 815 |
+
],
|
| 816 |
+
"hf_repo": "unsloth/GLM-4.6V-Flash-GGUF",
|
| 817 |
+
"hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8",
|
| 818 |
+
"hf_gguf_total": 9400279040,
|
| 819 |
+
"hf_estimated_bpw": 4.900693766639506
|
| 820 |
+
},
|
| 821 |
+
{
|
| 822 |
+
"family": "glm-4.6v-flash",
|
| 823 |
+
"producer": "unsloth",
|
| 824 |
+
"model": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf",
|
| 825 |
+
"shards": 1,
|
| 826 |
+
"architecture": "glm4",
|
| 827 |
+
"main_parameters": 9400279040,
|
| 828 |
+
"main_tensor_bytes": 6178013184,
|
| 829 |
+
"main_bpw": 5.257727484651349,
|
| 830 |
+
"llama_cpp_parameters": 9400279040,
|
| 831 |
+
"llama_cpp_tensor_bytes": 6178013184,
|
| 832 |
+
"llama_cpp_bpw": 5.257727484651349,
|
| 833 |
+
"file_bytes": 6187353696,
|
| 834 |
+
"file_bpw_local_parameters": 5.265676620595297,
|
| 835 |
+
"embedded_mtp_parameters": 0,
|
| 836 |
+
"embedded_mtp_bytes": 0,
|
| 837 |
+
"embedded_mtp_tensors": [],
|
| 838 |
+
"tensor_count": 523,
|
| 839 |
+
"files": [
|
| 840 |
+
"/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf"
|
| 841 |
+
],
|
| 842 |
+
"hf_repo": "unsloth/GLM-4.6V-Flash-GGUF",
|
| 843 |
+
"hf_commit": "c78a0727cb5ee489db2f218a212f613943023ee8",
|
| 844 |
+
"hf_gguf_total": 9400279040,
|
| 845 |
+
"hf_estimated_bpw": 5.265676620595297
|
| 846 |
+
},
|
| 847 |
+
{
|
| 848 |
+
"family": "internvl3.5-30b-a3b",
|
| 849 |
+
"producer": "bartowski",
|
| 850 |
+
"model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf",
|
| 851 |
+
"shards": 1,
|
| 852 |
+
"architecture": "qwen3moe",
|
| 853 |
+
"main_parameters": 30532122624,
|
| 854 |
+
"main_tensor_bytes": 14849302528,
|
| 855 |
+
"main_bpw": 3.890801228821896,
|
| 856 |
+
"llama_cpp_parameters": 30532122624,
|
| 857 |
+
"llama_cpp_tensor_bytes": 14849302528,
|
| 858 |
+
"llama_cpp_bpw": 3.890801228821896,
|
| 859 |
+
"file_bytes": 14855269280,
|
| 860 |
+
"file_bpw_local_parameters": 3.8923646319494094,
|
| 861 |
+
"embedded_mtp_parameters": 0,
|
| 862 |
+
"embedded_mtp_bytes": 0,
|
| 863 |
+
"embedded_mtp_tensors": [],
|
| 864 |
+
"tensor_count": 579,
|
| 865 |
+
"files": [
|
| 866 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf"
|
| 867 |
+
],
|
| 868 |
+
"hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF",
|
| 869 |
+
"hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9",
|
| 870 |
+
"hf_gguf_total": 30532122624,
|
| 871 |
+
"hf_estimated_bpw": 3.8923646319494094
|
| 872 |
+
},
|
| 873 |
+
{
|
| 874 |
+
"family": "internvl3.5-30b-a3b",
|
| 875 |
+
"producer": "bartowski",
|
| 876 |
+
"model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf",
|
| 877 |
+
"shards": 1,
|
| 878 |
+
"architecture": "qwen3moe",
|
| 879 |
+
"main_parameters": 30532122624,
|
| 880 |
+
"main_tensor_bytes": 17625675776,
|
| 881 |
+
"main_bpw": 4.6182641129955915,
|
| 882 |
+
"llama_cpp_parameters": 30532122624,
|
| 883 |
+
"llama_cpp_tensor_bytes": 17625675776,
|
| 884 |
+
"llama_cpp_bpw": 4.6182641129955915,
|
| 885 |
+
"file_bytes": 17631642528,
|
| 886 |
+
"file_bpw_local_parameters": 4.619827516123106,
|
| 887 |
+
"embedded_mtp_parameters": 0,
|
| 888 |
+
"embedded_mtp_bytes": 0,
|
| 889 |
+
"embedded_mtp_tensors": [],
|
| 890 |
+
"tensor_count": 579,
|
| 891 |
+
"files": [
|
| 892 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf"
|
| 893 |
+
],
|
| 894 |
+
"hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF",
|
| 895 |
+
"hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9",
|
| 896 |
+
"hf_gguf_total": 30532122624,
|
| 897 |
+
"hf_estimated_bpw": 4.619827516123106
|
| 898 |
+
},
|
| 899 |
+
{
|
| 900 |
+
"family": "internvl3.5-30b-a3b",
|
| 901 |
+
"producer": "bartowski",
|
| 902 |
+
"model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf",
|
| 903 |
+
"shards": 1,
|
| 904 |
+
"architecture": "qwen3moe",
|
| 905 |
+
"main_parameters": 30532122624,
|
| 906 |
+
"main_tensor_bytes": 19208550400,
|
| 907 |
+
"main_bpw": 5.033007534143985,
|
| 908 |
+
"llama_cpp_parameters": 30532122624,
|
| 909 |
+
"llama_cpp_tensor_bytes": 19208550400,
|
| 910 |
+
"llama_cpp_bpw": 5.033007534143985,
|
| 911 |
+
"file_bytes": 19214517152,
|
| 912 |
+
"file_bpw_local_parameters": 5.034570937271498,
|
| 913 |
+
"embedded_mtp_parameters": 0,
|
| 914 |
+
"embedded_mtp_bytes": 0,
|
| 915 |
+
"embedded_mtp_tensors": [],
|
| 916 |
+
"tensor_count": 579,
|
| 917 |
+
"files": [
|
| 918 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf"
|
| 919 |
+
],
|
| 920 |
+
"hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF",
|
| 921 |
+
"hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9",
|
| 922 |
+
"hf_gguf_total": 30532122624,
|
| 923 |
+
"hf_estimated_bpw": 5.034570937271498
|
| 924 |
+
},
|
| 925 |
+
{
|
| 926 |
+
"family": "internvl3.5-30b-a3b",
|
| 927 |
+
"producer": "bartowski",
|
| 928 |
+
"model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf",
|
| 929 |
+
"shards": 1,
|
| 930 |
+
"architecture": "qwen3moe",
|
| 931 |
+
"main_parameters": 30532122624,
|
| 932 |
+
"main_tensor_bytes": 18626213888,
|
| 933 |
+
"main_bpw": 4.880424231850484,
|
| 934 |
+
"llama_cpp_parameters": 30532122624,
|
| 935 |
+
"llama_cpp_tensor_bytes": 18626213888,
|
| 936 |
+
"llama_cpp_bpw": 4.880424231850484,
|
| 937 |
+
"file_bytes": 18632180640,
|
| 938 |
+
"file_bpw_local_parameters": 4.881987634977999,
|
| 939 |
+
"embedded_mtp_parameters": 0,
|
| 940 |
+
"embedded_mtp_bytes": 0,
|
| 941 |
+
"embedded_mtp_tensors": [],
|
| 942 |
+
"tensor_count": 579,
|
| 943 |
+
"files": [
|
| 944 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf"
|
| 945 |
+
],
|
| 946 |
+
"hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF",
|
| 947 |
+
"hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9",
|
| 948 |
+
"hf_gguf_total": 30532122624,
|
| 949 |
+
"hf_estimated_bpw": 4.881987634977999
|
| 950 |
+
},
|
| 951 |
+
{
|
| 952 |
+
"family": "internvl3.5-30b-a3b",
|
| 953 |
+
"producer": "bartowski",
|
| 954 |
+
"model": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf",
|
| 955 |
+
"shards": 1,
|
| 956 |
+
"architecture": "qwen3moe",
|
| 957 |
+
"main_parameters": 30532122624,
|
| 958 |
+
"main_tensor_bytes": 17978521600,
|
| 959 |
+
"main_bpw": 4.710716466432072,
|
| 960 |
+
"llama_cpp_parameters": 30532122624,
|
| 961 |
+
"llama_cpp_tensor_bytes": 17978521600,
|
| 962 |
+
"llama_cpp_bpw": 4.710716466432072,
|
| 963 |
+
"file_bytes": 17984488352,
|
| 964 |
+
"file_bpw_local_parameters": 4.712279869559586,
|
| 965 |
+
"embedded_mtp_parameters": 0,
|
| 966 |
+
"embedded_mtp_bytes": 0,
|
| 967 |
+
"embedded_mtp_tensors": [],
|
| 968 |
+
"tensor_count": 579,
|
| 969 |
+
"files": [
|
| 970 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf"
|
| 971 |
+
],
|
| 972 |
+
"hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF",
|
| 973 |
+
"hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9",
|
| 974 |
+
"hf_gguf_total": 30532122624,
|
| 975 |
+
"hf_estimated_bpw": 4.712279869559586
|
| 976 |
+
},
|
| 977 |
+
{
|
| 978 |
+
"family": "internvl3.5-30b-a3b",
|
| 979 |
+
"producer": "bartowski",
|
| 980 |
+
"model": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf",
|
| 981 |
+
"shards": 2,
|
| 982 |
+
"architecture": "qwen3moe",
|
| 983 |
+
"main_parameters": 30532122624,
|
| 984 |
+
"main_tensor_bytes": 61089832960,
|
| 985 |
+
"main_bpw": 16.006704469863458,
|
| 986 |
+
"llama_cpp_parameters": 30532122624,
|
| 987 |
+
"llama_cpp_tensor_bytes": 61089832960,
|
| 988 |
+
"llama_cpp_bpw": 16.006704469863458,
|
| 989 |
+
"file_bytes": 61095799648,
|
| 990 |
+
"file_bpw_local_parameters": 16.008267856221746,
|
| 991 |
+
"embedded_mtp_parameters": 0,
|
| 992 |
+
"embedded_mtp_bytes": 0,
|
| 993 |
+
"embedded_mtp_tensors": [],
|
| 994 |
+
"tensor_count": 579,
|
| 995 |
+
"files": [
|
| 996 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf",
|
| 997 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf"
|
| 998 |
+
],
|
| 999 |
+
"hf_repo": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF",
|
| 1000 |
+
"hf_commit": "a6824f88ffe59c72fc9864a87d40753556cba5d9",
|
| 1001 |
+
"hf_gguf_total": 30532122624,
|
| 1002 |
+
"hf_estimated_bpw": 16.008267856221746
|
| 1003 |
+
},
|
| 1004 |
+
{
|
| 1005 |
+
"family": "internvl3.5-30b-a3b",
|
| 1006 |
+
"producer": "mradermacher",
|
| 1007 |
+
"model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf",
|
| 1008 |
+
"shards": 1,
|
| 1009 |
+
"architecture": "qwen3moe",
|
| 1010 |
+
"main_parameters": 30532122624,
|
| 1011 |
+
"main_tensor_bytes": 18550716416,
|
| 1012 |
+
"main_bpw": 4.860642450431683,
|
| 1013 |
+
"llama_cpp_parameters": 30532122624,
|
| 1014 |
+
"llama_cpp_tensor_bytes": 18550716416,
|
| 1015 |
+
"llama_cpp_bpw": 4.860642450431683,
|
| 1016 |
+
"file_bytes": 18556683552,
|
| 1017 |
+
"file_bpw_local_parameters": 4.862205954174541,
|
| 1018 |
+
"embedded_mtp_parameters": 0,
|
| 1019 |
+
"embedded_mtp_bytes": 0,
|
| 1020 |
+
"embedded_mtp_tensors": [],
|
| 1021 |
+
"tensor_count": 579,
|
| 1022 |
+
"files": [
|
| 1023 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf"
|
| 1024 |
+
],
|
| 1025 |
+
"hf_repo": "mradermacher/InternVL3_5-30B-A3B-GGUF",
|
| 1026 |
+
"hf_commit": "21b0a0caee18e68b38b257a60ac86f883cd65059",
|
| 1027 |
+
"hf_gguf_total": 30532122624,
|
| 1028 |
+
"hf_estimated_bpw": 4.862205954174541
|
| 1029 |
+
},
|
| 1030 |
+
{
|
| 1031 |
+
"family": "internvl3.5-30b-a3b",
|
| 1032 |
+
"producer": "mradermacher",
|
| 1033 |
+
"model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf",
|
| 1034 |
+
"shards": 1,
|
| 1035 |
+
"architecture": "qwen3moe",
|
| 1036 |
+
"main_parameters": 30532122624,
|
| 1037 |
+
"main_tensor_bytes": 17450039296,
|
| 1038 |
+
"main_bpw": 4.572243996500465,
|
| 1039 |
+
"llama_cpp_parameters": 30532122624,
|
| 1040 |
+
"llama_cpp_tensor_bytes": 17450039296,
|
| 1041 |
+
"llama_cpp_bpw": 4.572243996500465,
|
| 1042 |
+
"file_bytes": 17456006432,
|
| 1043 |
+
"file_bpw_local_parameters": 4.573807500243322,
|
| 1044 |
+
"embedded_mtp_parameters": 0,
|
| 1045 |
+
"embedded_mtp_bytes": 0,
|
| 1046 |
+
"embedded_mtp_tensors": [],
|
| 1047 |
+
"tensor_count": 579,
|
| 1048 |
+
"files": [
|
| 1049 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf"
|
| 1050 |
+
],
|
| 1051 |
+
"hf_repo": "mradermacher/InternVL3_5-30B-A3B-GGUF",
|
| 1052 |
+
"hf_commit": "21b0a0caee18e68b38b257a60ac86f883cd65059",
|
| 1053 |
+
"hf_gguf_total": 30532122624,
|
| 1054 |
+
"hf_estimated_bpw": 4.573807500243322
|
| 1055 |
+
},
|
| 1056 |
+
{
|
| 1057 |
+
"family": "internvl3.5-30b-a3b",
|
| 1058 |
+
"producer": "mradermacher",
|
| 1059 |
+
"model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf",
|
| 1060 |
+
"shards": 1,
|
| 1061 |
+
"architecture": "qwen3moe",
|
| 1062 |
+
"main_parameters": 30532122624,
|
| 1063 |
+
"main_tensor_bytes": 17374017536,
|
| 1064 |
+
"main_bpw": 4.552324841599588,
|
| 1065 |
+
"llama_cpp_parameters": 30532122624,
|
| 1066 |
+
"llama_cpp_tensor_bytes": 17374017536,
|
| 1067 |
+
"llama_cpp_bpw": 4.552324841599588,
|
| 1068 |
+
"file_bytes": 17379984928,
|
| 1069 |
+
"file_bpw_local_parameters": 4.553888412419341,
|
| 1070 |
+
"embedded_mtp_parameters": 0,
|
| 1071 |
+
"embedded_mtp_bytes": 0,
|
| 1072 |
+
"embedded_mtp_tensors": [],
|
| 1073 |
+
"tensor_count": 579,
|
| 1074 |
+
"files": [
|
| 1075 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf"
|
| 1076 |
+
],
|
| 1077 |
+
"hf_repo": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF",
|
| 1078 |
+
"hf_commit": "120d600e464788a15e2140e1c9650c543d575d95",
|
| 1079 |
+
"hf_gguf_total": 30532122624,
|
| 1080 |
+
"hf_estimated_bpw": 4.553888412419341
|
| 1081 |
+
},
|
| 1082 |
+
{
|
| 1083 |
+
"family": "internvl3.5-30b-a3b",
|
| 1084 |
+
"producer": "mradermacher",
|
| 1085 |
+
"model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf",
|
| 1086 |
+
"shards": 1,
|
| 1087 |
+
"architecture": "qwen3moe",
|
| 1088 |
+
"main_parameters": 30532122624,
|
| 1089 |
+
"main_tensor_bytes": 19186530304,
|
| 1090 |
+
"main_bpw": 5.027237847896834,
|
| 1091 |
+
"llama_cpp_parameters": 30532122624,
|
| 1092 |
+
"llama_cpp_tensor_bytes": 19186530304,
|
| 1093 |
+
"llama_cpp_bpw": 5.027237847896834,
|
| 1094 |
+
"file_bytes": 19192497696,
|
| 1095 |
+
"file_bpw_local_parameters": 5.028801418716587,
|
| 1096 |
+
"embedded_mtp_parameters": 0,
|
| 1097 |
+
"embedded_mtp_bytes": 0,
|
| 1098 |
+
"embedded_mtp_tensors": [],
|
| 1099 |
+
"tensor_count": 579,
|
| 1100 |
+
"files": [
|
| 1101 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf"
|
| 1102 |
+
],
|
| 1103 |
+
"hf_repo": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF",
|
| 1104 |
+
"hf_commit": "120d600e464788a15e2140e1c9650c543d575d95",
|
| 1105 |
+
"hf_gguf_total": 30532122624,
|
| 1106 |
+
"hf_estimated_bpw": 5.028801418716587
|
| 1107 |
+
},
|
| 1108 |
+
{
|
| 1109 |
+
"family": "internvl3.5-30b-a3b",
|
| 1110 |
+
"producer": "mradermacher",
|
| 1111 |
+
"model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf",
|
| 1112 |
+
"shards": 1,
|
| 1113 |
+
"architecture": "qwen3moe",
|
| 1114 |
+
"main_parameters": 30532122624,
|
| 1115 |
+
"main_tensor_bytes": 18550716416,
|
| 1116 |
+
"main_bpw": 4.860642450431683,
|
| 1117 |
+
"llama_cpp_parameters": 30532122624,
|
| 1118 |
+
"llama_cpp_tensor_bytes": 18550716416,
|
| 1119 |
+
"llama_cpp_bpw": 4.860642450431683,
|
| 1120 |
+
"file_bytes": 18556683808,
|
| 1121 |
+
"file_bpw_local_parameters": 4.862206021251437,
|
| 1122 |
+
"embedded_mtp_parameters": 0,
|
| 1123 |
+
"embedded_mtp_bytes": 0,
|
| 1124 |
+
"embedded_mtp_tensors": [],
|
| 1125 |
+
"tensor_count": 579,
|
| 1126 |
+
"files": [
|
| 1127 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf"
|
| 1128 |
+
],
|
| 1129 |
+
"hf_repo": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF",
|
| 1130 |
+
"hf_commit": "120d600e464788a15e2140e1c9650c543d575d95",
|
| 1131 |
+
"hf_gguf_total": 30532122624,
|
| 1132 |
+
"hf_estimated_bpw": 4.862206021251437
|
| 1133 |
+
},
|
| 1134 |
+
{
|
| 1135 |
+
"family": "internvl3.5-30b-a3b",
|
| 1136 |
+
"producer": "mradermacher",
|
| 1137 |
+
"model": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf",
|
| 1138 |
+
"shards": 1,
|
| 1139 |
+
"architecture": "qwen3moe",
|
| 1140 |
+
"main_parameters": 30532122624,
|
| 1141 |
+
"main_tensor_bytes": 17450039296,
|
| 1142 |
+
"main_bpw": 4.572243996500465,
|
| 1143 |
+
"llama_cpp_parameters": 30532122624,
|
| 1144 |
+
"llama_cpp_tensor_bytes": 17450039296,
|
| 1145 |
+
"llama_cpp_bpw": 4.572243996500465,
|
| 1146 |
+
"file_bytes": 17456006688,
|
| 1147 |
+
"file_bpw_local_parameters": 4.573807567320217,
|
| 1148 |
+
"embedded_mtp_parameters": 0,
|
| 1149 |
+
"embedded_mtp_bytes": 0,
|
| 1150 |
+
"embedded_mtp_tensors": [],
|
| 1151 |
+
"tensor_count": 579,
|
| 1152 |
+
"files": [
|
| 1153 |
+
"/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf"
|
| 1154 |
+
],
|
| 1155 |
+
"hf_repo": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF",
|
| 1156 |
+
"hf_commit": "120d600e464788a15e2140e1c9650c543d575d95",
|
| 1157 |
+
"hf_gguf_total": 30532122624,
|
| 1158 |
+
"hf_estimated_bpw": 4.573807567320217
|
| 1159 |
+
},
|
| 1160 |
+
{
|
| 1161 |
+
"family": "kimi-vl-a3b-separate",
|
| 1162 |
+
"producer": "ggml-org",
|
| 1163 |
+
"model": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 1164 |
+
"shards": 1,
|
| 1165 |
+
"architecture": "deepseek2",
|
| 1166 |
+
"main_parameters": 15960110208,
|
| 1167 |
+
"main_tensor_bytes": 31927292416,
|
| 1168 |
+
"main_bpw": 16.003544837677353,
|
| 1169 |
+
"llama_cpp_parameters": 15960110208,
|
| 1170 |
+
"llama_cpp_tensor_bytes": 31927292416,
|
| 1171 |
+
"llama_cpp_bpw": 16.003544837677353,
|
| 1172 |
+
"file_bytes": 31934229408,
|
| 1173 |
+
"file_bpw_local_parameters": 16.007022002639044,
|
| 1174 |
+
"embedded_mtp_parameters": 0,
|
| 1175 |
+
"embedded_mtp_bytes": 0,
|
| 1176 |
+
"embedded_mtp_tensors": [],
|
| 1177 |
+
"tensor_count": 430,
|
| 1178 |
+
"files": [
|
| 1179 |
+
"/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf"
|
| 1180 |
+
],
|
| 1181 |
+
"hf_repo": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF",
|
| 1182 |
+
"hf_commit": "e7dcd093335f922a057772febc7ab27eda985b40",
|
| 1183 |
+
"hf_gguf_total": 15960110208,
|
| 1184 |
+
"hf_estimated_bpw": 16.007022002639044
|
| 1185 |
+
},
|
| 1186 |
+
{
|
| 1187 |
+
"family": "muse-glimmer-30b",
|
| 1188 |
+
"producer": "bartowski",
|
| 1189 |
+
"model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf",
|
| 1190 |
+
"shards": 1,
|
| 1191 |
+
"architecture": "muse-glimmer",
|
| 1192 |
+
"main_parameters": 27854794240,
|
| 1193 |
+
"main_tensor_bytes": 16252451072,
|
| 1194 |
+
"main_bpw": 4.667764100346124,
|
| 1195 |
+
"llama_cpp_parameters": 27854794240,
|
| 1196 |
+
"llama_cpp_tensor_bytes": 16252451072,
|
| 1197 |
+
"llama_cpp_bpw": 4.667764100346124,
|
| 1198 |
+
"file_bytes": 16265565216,
|
| 1199 |
+
"file_bpw_local_parameters": 4.671530531040103,
|
| 1200 |
+
"embedded_mtp_parameters": 0,
|
| 1201 |
+
"embedded_mtp_bytes": 0,
|
| 1202 |
+
"embedded_mtp_tensors": [],
|
| 1203 |
+
"tensor_count": 731,
|
| 1204 |
+
"files": [
|
| 1205 |
+
"/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf"
|
| 1206 |
+
],
|
| 1207 |
+
"hf_repo": "bartowski/Muse-Glimmer-30B-GGUF",
|
| 1208 |
+
"hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857",
|
| 1209 |
+
"hf_gguf_total": 27854794240,
|
| 1210 |
+
"hf_estimated_bpw": 4.671530531040103
|
| 1211 |
+
},
|
| 1212 |
+
{
|
| 1213 |
+
"family": "muse-glimmer-30b",
|
| 1214 |
+
"producer": "bartowski",
|
| 1215 |
+
"model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf",
|
| 1216 |
+
"shards": 1,
|
| 1217 |
+
"architecture": "muse-glimmer",
|
| 1218 |
+
"main_parameters": 27854794240,
|
| 1219 |
+
"main_tensor_bytes": 17815093504,
|
| 1220 |
+
"main_bpw": 5.116560790362528,
|
| 1221 |
+
"llama_cpp_parameters": 27854794240,
|
| 1222 |
+
"llama_cpp_tensor_bytes": 17815093504,
|
| 1223 |
+
"llama_cpp_bpw": 5.116560790362528,
|
| 1224 |
+
"file_bytes": 17828207648,
|
| 1225 |
+
"file_bpw_local_parameters": 5.120327221056507,
|
| 1226 |
+
"embedded_mtp_parameters": 0,
|
| 1227 |
+
"embedded_mtp_bytes": 0,
|
| 1228 |
+
"embedded_mtp_tensors": [],
|
| 1229 |
+
"tensor_count": 731,
|
| 1230 |
+
"files": [
|
| 1231 |
+
"/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf"
|
| 1232 |
+
],
|
| 1233 |
+
"hf_repo": "bartowski/Muse-Glimmer-30B-GGUF",
|
| 1234 |
+
"hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857",
|
| 1235 |
+
"hf_gguf_total": 27854794240,
|
| 1236 |
+
"hf_estimated_bpw": 5.120327221056507
|
| 1237 |
+
},
|
| 1238 |
+
{
|
| 1239 |
+
"family": "muse-glimmer-30b",
|
| 1240 |
+
"producer": "bartowski",
|
| 1241 |
+
"model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf",
|
| 1242 |
+
"shards": 1,
|
| 1243 |
+
"architecture": "muse-glimmer",
|
| 1244 |
+
"main_parameters": 27854794240,
|
| 1245 |
+
"main_tensor_bytes": 17293209856,
|
| 1246 |
+
"main_bpw": 4.966673875096626,
|
| 1247 |
+
"llama_cpp_parameters": 27854794240,
|
| 1248 |
+
"llama_cpp_tensor_bytes": 17293209856,
|
| 1249 |
+
"llama_cpp_bpw": 4.966673875096626,
|
| 1250 |
+
"file_bytes": 17306324000,
|
| 1251 |
+
"file_bpw_local_parameters": 4.970440305790605,
|
| 1252 |
+
"embedded_mtp_parameters": 0,
|
| 1253 |
+
"embedded_mtp_bytes": 0,
|
| 1254 |
+
"embedded_mtp_tensors": [],
|
| 1255 |
+
"tensor_count": 731,
|
| 1256 |
+
"files": [
|
| 1257 |
+
"/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf"
|
| 1258 |
+
],
|
| 1259 |
+
"hf_repo": "bartowski/Muse-Glimmer-30B-GGUF",
|
| 1260 |
+
"hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857",
|
| 1261 |
+
"hf_gguf_total": 27854794240,
|
| 1262 |
+
"hf_estimated_bpw": 4.970440305790605
|
| 1263 |
+
},
|
| 1264 |
+
{
|
| 1265 |
+
"family": "muse-glimmer-30b",
|
| 1266 |
+
"producer": "bartowski",
|
| 1267 |
+
"model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf",
|
| 1268 |
+
"shards": 1,
|
| 1269 |
+
"architecture": "muse-glimmer",
|
| 1270 |
+
"main_parameters": 27854794240,
|
| 1271 |
+
"main_tensor_bytes": 16307828992,
|
| 1272 |
+
"main_bpw": 4.68366884393112,
|
| 1273 |
+
"llama_cpp_parameters": 27854794240,
|
| 1274 |
+
"llama_cpp_tensor_bytes": 16307828992,
|
| 1275 |
+
"llama_cpp_bpw": 4.68366884393112,
|
| 1276 |
+
"file_bytes": 16320943136,
|
| 1277 |
+
"file_bpw_local_parameters": 4.6874352746250985,
|
| 1278 |
+
"embedded_mtp_parameters": 0,
|
| 1279 |
+
"embedded_mtp_bytes": 0,
|
| 1280 |
+
"embedded_mtp_tensors": [],
|
| 1281 |
+
"tensor_count": 731,
|
| 1282 |
+
"files": [
|
| 1283 |
+
"/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf"
|
| 1284 |
+
],
|
| 1285 |
+
"hf_repo": "bartowski/Muse-Glimmer-30B-GGUF",
|
| 1286 |
+
"hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857",
|
| 1287 |
+
"hf_gguf_total": 27854794240,
|
| 1288 |
+
"hf_estimated_bpw": 4.6874352746250985
|
| 1289 |
+
},
|
| 1290 |
+
{
|
| 1291 |
+
"family": "muse-glimmer-30b",
|
| 1292 |
+
"producer": "bartowski",
|
| 1293 |
+
"model": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16.gguf",
|
| 1294 |
+
"shards": 2,
|
| 1295 |
+
"architecture": "muse-glimmer",
|
| 1296 |
+
"main_parameters": 27854794240,
|
| 1297 |
+
"main_tensor_bytes": 55712397312,
|
| 1298 |
+
"main_bpw": 16.000806706946257,
|
| 1299 |
+
"llama_cpp_parameters": 27854794240,
|
| 1300 |
+
"llama_cpp_tensor_bytes": 55712397312,
|
| 1301 |
+
"llama_cpp_bpw": 16.000806706946257,
|
| 1302 |
+
"file_bytes": 55725511360,
|
| 1303 |
+
"file_bpw_local_parameters": 16.00457311006868,
|
| 1304 |
+
"embedded_mtp_parameters": 0,
|
| 1305 |
+
"embedded_mtp_bytes": 0,
|
| 1306 |
+
"embedded_mtp_tensors": [],
|
| 1307 |
+
"tensor_count": 731,
|
| 1308 |
+
"files": [
|
| 1309 |
+
"/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf",
|
| 1310 |
+
"/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf"
|
| 1311 |
+
],
|
| 1312 |
+
"hf_repo": "bartowski/Muse-Glimmer-30B-GGUF",
|
| 1313 |
+
"hf_commit": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857",
|
| 1314 |
+
"hf_gguf_total": 27854794240,
|
| 1315 |
+
"hf_estimated_bpw": 16.00457311006868
|
| 1316 |
+
},
|
| 1317 |
+
{
|
| 1318 |
+
"family": "qwen3.5-4b",
|
| 1319 |
+
"producer": "bartowski",
|
| 1320 |
+
"model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf",
|
| 1321 |
+
"shards": 1,
|
| 1322 |
+
"architecture": "qwen35",
|
| 1323 |
+
"main_parameters": 4205751296,
|
| 1324 |
+
"main_tensor_bytes": 2636888064,
|
| 1325 |
+
"main_bpw": 5.015775548131698,
|
| 1326 |
+
"llama_cpp_parameters": 4326350848,
|
| 1327 |
+
"llama_cpp_tensor_bytes": 2765064192,
|
| 1328 |
+
"llama_cpp_bpw": 5.112972644422943,
|
| 1329 |
+
"file_bytes": 2776033248,
|
| 1330 |
+
"file_bpw_local_parameters": 5.1332558926113245,
|
| 1331 |
+
"embedded_mtp_parameters": 120599552,
|
| 1332 |
+
"embedded_mtp_bytes": 128176128,
|
| 1333 |
+
"embedded_mtp_tensors": [
|
| 1334 |
+
"blk.32.attn_k.weight",
|
| 1335 |
+
"blk.32.attn_k_norm.weight",
|
| 1336 |
+
"blk.32.attn_norm.weight",
|
| 1337 |
+
"blk.32.attn_output.weight",
|
| 1338 |
+
"blk.32.attn_q.weight",
|
| 1339 |
+
"blk.32.attn_q_norm.weight",
|
| 1340 |
+
"blk.32.attn_v.weight",
|
| 1341 |
+
"blk.32.ffn_down.weight",
|
| 1342 |
+
"blk.32.ffn_gate.weight",
|
| 1343 |
+
"blk.32.ffn_up.weight",
|
| 1344 |
+
"blk.32.nextn.eh_proj.weight",
|
| 1345 |
+
"blk.32.nextn.enorm.weight",
|
| 1346 |
+
"blk.32.nextn.hnorm.weight",
|
| 1347 |
+
"blk.32.nextn.shared_head_norm.weight",
|
| 1348 |
+
"blk.32.post_attention_norm.weight"
|
| 1349 |
+
],
|
| 1350 |
+
"tensor_count": 441,
|
| 1351 |
+
"files": [
|
| 1352 |
+
"/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf"
|
| 1353 |
+
],
|
| 1354 |
+
"hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF",
|
| 1355 |
+
"hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6",
|
| 1356 |
+
"hf_gguf_total": 4326350848,
|
| 1357 |
+
"hf_estimated_bpw": 5.1332558926113245
|
| 1358 |
+
},
|
| 1359 |
+
{
|
| 1360 |
+
"family": "qwen3.5-4b",
|
| 1361 |
+
"producer": "bartowski",
|
| 1362 |
+
"model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf",
|
| 1363 |
+
"shards": 1,
|
| 1364 |
+
"architecture": "qwen35",
|
| 1365 |
+
"main_parameters": 4205751296,
|
| 1366 |
+
"main_tensor_bytes": 2840705024,
|
| 1367 |
+
"main_bpw": 5.403467440790869,
|
| 1368 |
+
"llama_cpp_parameters": 4326350848,
|
| 1369 |
+
"llama_cpp_tensor_bytes": 2968881152,
|
| 1370 |
+
"llama_cpp_bpw": 5.489857399563356,
|
| 1371 |
+
"file_bytes": 2979850208,
|
| 1372 |
+
"file_bpw_local_parameters": 5.510140647751737,
|
| 1373 |
+
"embedded_mtp_parameters": 120599552,
|
| 1374 |
+
"embedded_mtp_bytes": 128176128,
|
| 1375 |
+
"embedded_mtp_tensors": [
|
| 1376 |
+
"blk.32.attn_k.weight",
|
| 1377 |
+
"blk.32.attn_k_norm.weight",
|
| 1378 |
+
"blk.32.attn_norm.weight",
|
| 1379 |
+
"blk.32.attn_output.weight",
|
| 1380 |
+
"blk.32.attn_q.weight",
|
| 1381 |
+
"blk.32.attn_q_norm.weight",
|
| 1382 |
+
"blk.32.attn_v.weight",
|
| 1383 |
+
"blk.32.ffn_down.weight",
|
| 1384 |
+
"blk.32.ffn_gate.weight",
|
| 1385 |
+
"blk.32.ffn_up.weight",
|
| 1386 |
+
"blk.32.nextn.eh_proj.weight",
|
| 1387 |
+
"blk.32.nextn.enorm.weight",
|
| 1388 |
+
"blk.32.nextn.hnorm.weight",
|
| 1389 |
+
"blk.32.nextn.shared_head_norm.weight",
|
| 1390 |
+
"blk.32.post_attention_norm.weight"
|
| 1391 |
+
],
|
| 1392 |
+
"tensor_count": 441,
|
| 1393 |
+
"files": [
|
| 1394 |
+
"/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf"
|
| 1395 |
+
],
|
| 1396 |
+
"hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF",
|
| 1397 |
+
"hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6",
|
| 1398 |
+
"hf_gguf_total": 4326350848,
|
| 1399 |
+
"hf_estimated_bpw": 5.510140647751737
|
| 1400 |
+
},
|
| 1401 |
+
{
|
| 1402 |
+
"family": "qwen3.5-4b",
|
| 1403 |
+
"producer": "bartowski",
|
| 1404 |
+
"model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf",
|
| 1405 |
+
"shards": 1,
|
| 1406 |
+
"architecture": "qwen35",
|
| 1407 |
+
"main_parameters": 4205751296,
|
| 1408 |
+
"main_tensor_bytes": 2873882624,
|
| 1409 |
+
"main_bpw": 5.466576450648973,
|
| 1410 |
+
"llama_cpp_parameters": 4326350848,
|
| 1411 |
+
"llama_cpp_tensor_bytes": 3002058752,
|
| 1412 |
+
"llama_cpp_bpw": 5.551207208981309,
|
| 1413 |
+
"file_bytes": 3013027808,
|
| 1414 |
+
"file_bpw_local_parameters": 5.571490457169691,
|
| 1415 |
+
"embedded_mtp_parameters": 120599552,
|
| 1416 |
+
"embedded_mtp_bytes": 128176128,
|
| 1417 |
+
"embedded_mtp_tensors": [
|
| 1418 |
+
"blk.32.attn_k.weight",
|
| 1419 |
+
"blk.32.attn_k_norm.weight",
|
| 1420 |
+
"blk.32.attn_norm.weight",
|
| 1421 |
+
"blk.32.attn_output.weight",
|
| 1422 |
+
"blk.32.attn_q.weight",
|
| 1423 |
+
"blk.32.attn_q_norm.weight",
|
| 1424 |
+
"blk.32.attn_v.weight",
|
| 1425 |
+
"blk.32.ffn_down.weight",
|
| 1426 |
+
"blk.32.ffn_gate.weight",
|
| 1427 |
+
"blk.32.ffn_up.weight",
|
| 1428 |
+
"blk.32.nextn.eh_proj.weight",
|
| 1429 |
+
"blk.32.nextn.enorm.weight",
|
| 1430 |
+
"blk.32.nextn.hnorm.weight",
|
| 1431 |
+
"blk.32.nextn.shared_head_norm.weight",
|
| 1432 |
+
"blk.32.post_attention_norm.weight"
|
| 1433 |
+
],
|
| 1434 |
+
"tensor_count": 441,
|
| 1435 |
+
"files": [
|
| 1436 |
+
"/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf"
|
| 1437 |
+
],
|
| 1438 |
+
"hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF",
|
| 1439 |
+
"hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6",
|
| 1440 |
+
"hf_gguf_total": 4326350848,
|
| 1441 |
+
"hf_estimated_bpw": 5.571490457169691
|
| 1442 |
+
},
|
| 1443 |
+
{
|
| 1444 |
+
"family": "qwen3.5-4b",
|
| 1445 |
+
"producer": "bartowski",
|
| 1446 |
+
"model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf",
|
| 1447 |
+
"shards": 1,
|
| 1448 |
+
"architecture": "qwen35",
|
| 1449 |
+
"main_parameters": 4205751296,
|
| 1450 |
+
"main_tensor_bytes": 2707011584,
|
| 1451 |
+
"main_bpw": 5.1491615047700625,
|
| 1452 |
+
"llama_cpp_parameters": 4326350848,
|
| 1453 |
+
"llama_cpp_tensor_bytes": 2835187712,
|
| 1454 |
+
"llama_cpp_bpw": 5.242640389760641,
|
| 1455 |
+
"file_bytes": 2846156768,
|
| 1456 |
+
"file_bpw_local_parameters": 5.262923637949023,
|
| 1457 |
+
"embedded_mtp_parameters": 120599552,
|
| 1458 |
+
"embedded_mtp_bytes": 128176128,
|
| 1459 |
+
"embedded_mtp_tensors": [
|
| 1460 |
+
"blk.32.attn_k.weight",
|
| 1461 |
+
"blk.32.attn_k_norm.weight",
|
| 1462 |
+
"blk.32.attn_norm.weight",
|
| 1463 |
+
"blk.32.attn_output.weight",
|
| 1464 |
+
"blk.32.attn_q.weight",
|
| 1465 |
+
"blk.32.attn_q_norm.weight",
|
| 1466 |
+
"blk.32.attn_v.weight",
|
| 1467 |
+
"blk.32.ffn_down.weight",
|
| 1468 |
+
"blk.32.ffn_gate.weight",
|
| 1469 |
+
"blk.32.ffn_up.weight",
|
| 1470 |
+
"blk.32.nextn.eh_proj.weight",
|
| 1471 |
+
"blk.32.nextn.enorm.weight",
|
| 1472 |
+
"blk.32.nextn.hnorm.weight",
|
| 1473 |
+
"blk.32.nextn.shared_head_norm.weight",
|
| 1474 |
+
"blk.32.post_attention_norm.weight"
|
| 1475 |
+
],
|
| 1476 |
+
"tensor_count": 441,
|
| 1477 |
+
"files": [
|
| 1478 |
+
"/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf"
|
| 1479 |
+
],
|
| 1480 |
+
"hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF",
|
| 1481 |
+
"hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6",
|
| 1482 |
+
"hf_gguf_total": 4326350848,
|
| 1483 |
+
"hf_estimated_bpw": 5.262923637949023
|
| 1484 |
+
},
|
| 1485 |
+
{
|
| 1486 |
+
"family": "qwen3.5-4b",
|
| 1487 |
+
"producer": "bartowski",
|
| 1488 |
+
"model": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf",
|
| 1489 |
+
"shards": 1,
|
| 1490 |
+
"architecture": "qwen35",
|
| 1491 |
+
"main_parameters": 4205751296,
|
| 1492 |
+
"main_tensor_bytes": 8413425664,
|
| 1493 |
+
"main_bpw": 16.003657985201034,
|
| 1494 |
+
"llama_cpp_parameters": 4326350848,
|
| 1495 |
+
"llama_cpp_tensor_bytes": 8654651392,
|
| 1496 |
+
"llama_cpp_bpw": 16.003605248059625,
|
| 1497 |
+
"file_bytes": 8665620192,
|
| 1498 |
+
"file_bpw_local_parameters": 16.023888022869844,
|
| 1499 |
+
"embedded_mtp_parameters": 120599552,
|
| 1500 |
+
"embedded_mtp_bytes": 241225728,
|
| 1501 |
+
"embedded_mtp_tensors": [
|
| 1502 |
+
"blk.32.ffn_down.weight",
|
| 1503 |
+
"blk.32.ffn_gate.weight",
|
| 1504 |
+
"blk.32.ffn_up.weight",
|
| 1505 |
+
"blk.32.nextn.eh_proj.weight",
|
| 1506 |
+
"blk.32.attn_norm.weight",
|
| 1507 |
+
"blk.32.post_attention_norm.weight",
|
| 1508 |
+
"blk.32.attn_k_norm.weight",
|
| 1509 |
+
"blk.32.attn_k.weight",
|
| 1510 |
+
"blk.32.attn_output.weight",
|
| 1511 |
+
"blk.32.attn_q_norm.weight",
|
| 1512 |
+
"blk.32.attn_q.weight",
|
| 1513 |
+
"blk.32.attn_v.weight",
|
| 1514 |
+
"blk.32.nextn.shared_head_norm.weight",
|
| 1515 |
+
"blk.32.nextn.enorm.weight",
|
| 1516 |
+
"blk.32.nextn.hnorm.weight"
|
| 1517 |
+
],
|
| 1518 |
+
"tensor_count": 441,
|
| 1519 |
+
"files": [
|
| 1520 |
+
"/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf"
|
| 1521 |
+
],
|
| 1522 |
+
"hf_repo": "bartowski/Qwen_Qwen3.5-4B-GGUF",
|
| 1523 |
+
"hf_commit": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6",
|
| 1524 |
+
"hf_gguf_total": 4326350848,
|
| 1525 |
+
"hf_estimated_bpw": 16.023888022869844
|
| 1526 |
+
},
|
| 1527 |
+
{
|
| 1528 |
+
"family": "qwen3.5-4b",
|
| 1529 |
+
"producer": "unsloth",
|
| 1530 |
+
"model": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf",
|
| 1531 |
+
"shards": 1,
|
| 1532 |
+
"architecture": "qwen35",
|
| 1533 |
+
"main_parameters": 4205751296,
|
| 1534 |
+
"main_tensor_bytes": 8413425664,
|
| 1535 |
+
"main_bpw": 16.003657985201034,
|
| 1536 |
+
"llama_cpp_parameters": 4205751296,
|
| 1537 |
+
"llama_cpp_tensor_bytes": 8413425664,
|
| 1538 |
+
"llama_cpp_bpw": 16.003657985201034,
|
| 1539 |
+
"file_bytes": 8424393632,
|
| 1540 |
+
"file_bpw_local_parameters": 16.0245207842171,
|
| 1541 |
+
"embedded_mtp_parameters": 0,
|
| 1542 |
+
"embedded_mtp_bytes": 0,
|
| 1543 |
+
"embedded_mtp_tensors": [],
|
| 1544 |
+
"tensor_count": 426,
|
| 1545 |
+
"files": [
|
| 1546 |
+
"/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf"
|
| 1547 |
+
],
|
| 1548 |
+
"hf_repo": "unsloth/Qwen3.5-4B-GGUF",
|
| 1549 |
+
"hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523",
|
| 1550 |
+
"hf_gguf_total": 4205751296,
|
| 1551 |
+
"hf_estimated_bpw": 16.0245207842171
|
| 1552 |
+
},
|
| 1553 |
+
{
|
| 1554 |
+
"family": "qwen3.5-4b",
|
| 1555 |
+
"producer": "unsloth",
|
| 1556 |
+
"model": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf",
|
| 1557 |
+
"shards": 1,
|
| 1558 |
+
"architecture": "qwen35",
|
| 1559 |
+
"main_parameters": 4205751296,
|
| 1560 |
+
"main_tensor_bytes": 2568976384,
|
| 1561 |
+
"main_bpw": 4.8865968588172075,
|
| 1562 |
+
"llama_cpp_parameters": 4205751296,
|
| 1563 |
+
"llama_cpp_tensor_bytes": 2568976384,
|
| 1564 |
+
"llama_cpp_bpw": 4.8865968588172075,
|
| 1565 |
+
"file_bytes": 2579944608,
|
| 1566 |
+
"file_bpw_local_parameters": 4.907460144785508,
|
| 1567 |
+
"embedded_mtp_parameters": 0,
|
| 1568 |
+
"embedded_mtp_bytes": 0,
|
| 1569 |
+
"embedded_mtp_tensors": [],
|
| 1570 |
+
"tensor_count": 426,
|
| 1571 |
+
"files": [
|
| 1572 |
+
"/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf"
|
| 1573 |
+
],
|
| 1574 |
+
"hf_repo": "unsloth/Qwen3.5-4B-GGUF",
|
| 1575 |
+
"hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523",
|
| 1576 |
+
"hf_gguf_total": 4205751296,
|
| 1577 |
+
"hf_estimated_bpw": 4.907460144785508
|
| 1578 |
+
},
|
| 1579 |
+
{
|
| 1580 |
+
"family": "qwen3.5-4b",
|
| 1581 |
+
"producer": "unsloth",
|
| 1582 |
+
"model": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf",
|
| 1583 |
+
"shards": 1,
|
| 1584 |
+
"architecture": "qwen35",
|
| 1585 |
+
"main_parameters": 4205751296,
|
| 1586 |
+
"main_tensor_bytes": 2572253184,
|
| 1587 |
+
"main_bpw": 4.892829847445168,
|
| 1588 |
+
"llama_cpp_parameters": 4205751296,
|
| 1589 |
+
"llama_cpp_tensor_bytes": 2572253184,
|
| 1590 |
+
"llama_cpp_bpw": 4.892829847445168,
|
| 1591 |
+
"file_bytes": 2583221408,
|
| 1592 |
+
"file_bpw_local_parameters": 4.913693133413469,
|
| 1593 |
+
"embedded_mtp_parameters": 0,
|
| 1594 |
+
"embedded_mtp_bytes": 0,
|
| 1595 |
+
"embedded_mtp_tensors": [],
|
| 1596 |
+
"tensor_count": 426,
|
| 1597 |
+
"files": [
|
| 1598 |
+
"/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf"
|
| 1599 |
+
],
|
| 1600 |
+
"hf_repo": "unsloth/Qwen3.5-4B-GGUF",
|
| 1601 |
+
"hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523",
|
| 1602 |
+
"hf_gguf_total": 4205751296,
|
| 1603 |
+
"hf_estimated_bpw": 4.913693133413469
|
| 1604 |
+
},
|
| 1605 |
+
{
|
| 1606 |
+
"family": "qwen3.5-4b",
|
| 1607 |
+
"producer": "unsloth",
|
| 1608 |
+
"model": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf",
|
| 1609 |
+
"shards": 1,
|
| 1610 |
+
"architecture": "qwen35",
|
| 1611 |
+
"main_parameters": 4205751296,
|
| 1612 |
+
"main_tensor_bytes": 2773448704,
|
| 1613 |
+
"main_bpw": 5.27553534920197,
|
| 1614 |
+
"llama_cpp_parameters": 4205751296,
|
| 1615 |
+
"llama_cpp_tensor_bytes": 2773448704,
|
| 1616 |
+
"llama_cpp_bpw": 5.27553534920197,
|
| 1617 |
+
"file_bytes": 2784416928,
|
| 1618 |
+
"file_bpw_local_parameters": 5.296398635170271,
|
| 1619 |
+
"embedded_mtp_parameters": 0,
|
| 1620 |
+
"embedded_mtp_bytes": 0,
|
| 1621 |
+
"embedded_mtp_tensors": [],
|
| 1622 |
+
"tensor_count": 426,
|
| 1623 |
+
"files": [
|
| 1624 |
+
"/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf"
|
| 1625 |
+
],
|
| 1626 |
+
"hf_repo": "unsloth/Qwen3.5-4B-GGUF",
|
| 1627 |
+
"hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523",
|
| 1628 |
+
"hf_gguf_total": 4205751296,
|
| 1629 |
+
"hf_estimated_bpw": 5.296398635170271
|
| 1630 |
+
},
|
| 1631 |
+
{
|
| 1632 |
+
"family": "qwen3.5-4b",
|
| 1633 |
+
"producer": "unsloth",
|
| 1634 |
+
"model": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf",
|
| 1635 |
+
"shards": 1,
|
| 1636 |
+
"architecture": "qwen35",
|
| 1637 |
+
"main_parameters": 4205751296,
|
| 1638 |
+
"main_tensor_bytes": 2729969664,
|
| 1639 |
+
"main_bpw": 5.192831381344714,
|
| 1640 |
+
"llama_cpp_parameters": 4205751296,
|
| 1641 |
+
"llama_cpp_tensor_bytes": 2729969664,
|
| 1642 |
+
"llama_cpp_bpw": 5.192831381344714,
|
| 1643 |
+
"file_bytes": 2740937888,
|
| 1644 |
+
"file_bpw_local_parameters": 5.213694667313015,
|
| 1645 |
+
"embedded_mtp_parameters": 0,
|
| 1646 |
+
"embedded_mtp_bytes": 0,
|
| 1647 |
+
"embedded_mtp_tensors": [],
|
| 1648 |
+
"tensor_count": 426,
|
| 1649 |
+
"files": [
|
| 1650 |
+
"/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf"
|
| 1651 |
+
],
|
| 1652 |
+
"hf_repo": "unsloth/Qwen3.5-4B-GGUF",
|
| 1653 |
+
"hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523",
|
| 1654 |
+
"hf_gguf_total": 4205751296,
|
| 1655 |
+
"hf_estimated_bpw": 5.213694667313015
|
| 1656 |
+
},
|
| 1657 |
+
{
|
| 1658 |
+
"family": "qwen3.5-4b",
|
| 1659 |
+
"producer": "unsloth",
|
| 1660 |
+
"model": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf",
|
| 1661 |
+
"shards": 1,
|
| 1662 |
+
"architecture": "qwen35",
|
| 1663 |
+
"main_parameters": 4205751296,
|
| 1664 |
+
"main_tensor_bytes": 2579462144,
|
| 1665 |
+
"main_bpw": 4.906542422426683,
|
| 1666 |
+
"llama_cpp_parameters": 4205751296,
|
| 1667 |
+
"llama_cpp_tensor_bytes": 2579462144,
|
| 1668 |
+
"llama_cpp_bpw": 4.906542422426683,
|
| 1669 |
+
"file_bytes": 2590430368,
|
| 1670 |
+
"file_bpw_local_parameters": 4.927405708394984,
|
| 1671 |
+
"embedded_mtp_parameters": 0,
|
| 1672 |
+
"embedded_mtp_bytes": 0,
|
| 1673 |
+
"embedded_mtp_tensors": [],
|
| 1674 |
+
"tensor_count": 426,
|
| 1675 |
+
"files": [
|
| 1676 |
+
"/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf"
|
| 1677 |
+
],
|
| 1678 |
+
"hf_repo": "unsloth/Qwen3.5-4B-GGUF",
|
| 1679 |
+
"hf_commit": "e87f176479d0855a907a41277aca2f8ee7a09523",
|
| 1680 |
+
"hf_gguf_total": 4205751296,
|
| 1681 |
+
"hf_estimated_bpw": 4.927405708394984
|
| 1682 |
+
},
|
| 1683 |
+
{
|
| 1684 |
+
"family": "qwen3.6-35b-a3b",
|
| 1685 |
+
"producer": "bartowski",
|
| 1686 |
+
"model": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16.gguf",
|
| 1687 |
+
"shards": 2,
|
| 1688 |
+
"architecture": "qwen35moe",
|
| 1689 |
+
"main_parameters": 34660610688,
|
| 1690 |
+
"main_tensor_bytes": 69365647872,
|
| 1691 |
+
"main_bpw": 16.01025405960672,
|
| 1692 |
+
"llama_cpp_parameters": 35505251456,
|
| 1693 |
+
"llama_cpp_tensor_bytes": 71054950912,
|
| 1694 |
+
"llama_cpp_bpw": 16.010014969206477,
|
| 1695 |
+
"file_bytes": 71065941536,
|
| 1696 |
+
"file_bpw_local_parameters": 16.012491363215652,
|
| 1697 |
+
"embedded_mtp_parameters": 844640768,
|
| 1698 |
+
"embedded_mtp_bytes": 1689303040,
|
| 1699 |
+
"embedded_mtp_tensors": [
|
| 1700 |
+
"blk.40.ffn_gate_exps.weight",
|
| 1701 |
+
"blk.40.ffn_up_exps.weight",
|
| 1702 |
+
"blk.40.nextn.eh_proj.weight",
|
| 1703 |
+
"blk.40.attn_norm.weight",
|
| 1704 |
+
"blk.40.ffn_down_exps.weight",
|
| 1705 |
+
"blk.40.ffn_gate_inp.weight",
|
| 1706 |
+
"blk.40.ffn_down_shexp.weight",
|
| 1707 |
+
"blk.40.ffn_gate_shexp.weight",
|
| 1708 |
+
"blk.40.ffn_up_shexp.weight",
|
| 1709 |
+
"blk.40.ffn_gate_inp_shexp.weight",
|
| 1710 |
+
"blk.40.post_attention_norm.weight",
|
| 1711 |
+
"blk.40.attn_k_norm.weight",
|
| 1712 |
+
"blk.40.attn_k.weight",
|
| 1713 |
+
"blk.40.attn_output.weight",
|
| 1714 |
+
"blk.40.attn_q_norm.weight",
|
| 1715 |
+
"blk.40.attn_q.weight",
|
| 1716 |
+
"blk.40.attn_v.weight",
|
| 1717 |
+
"blk.40.nextn.shared_head_norm.weight",
|
| 1718 |
+
"blk.40.nextn.enorm.weight",
|
| 1719 |
+
"blk.40.nextn.hnorm.weight"
|
| 1720 |
+
],
|
| 1721 |
+
"tensor_count": 753,
|
| 1722 |
+
"files": [
|
| 1723 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf",
|
| 1724 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf"
|
| 1725 |
+
],
|
| 1726 |
+
"hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF",
|
| 1727 |
+
"hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f",
|
| 1728 |
+
"hf_gguf_total": 35505251456,
|
| 1729 |
+
"hf_estimated_bpw": 16.012491363215652
|
| 1730 |
+
},
|
| 1731 |
+
{
|
| 1732 |
+
"family": "qwen3.6-35b-a3b",
|
| 1733 |
+
"producer": "bartowski",
|
| 1734 |
+
"model": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf",
|
| 1735 |
+
"shards": 1,
|
| 1736 |
+
"architecture": "qwen35moe",
|
| 1737 |
+
"main_parameters": 34660610688,
|
| 1738 |
+
"main_tensor_bytes": 18790607360,
|
| 1739 |
+
"main_bpw": 4.337051653046743,
|
| 1740 |
+
"llama_cpp_parameters": 35505251456,
|
| 1741 |
+
"llama_cpp_tensor_bytes": 19688563200,
|
| 1742 |
+
"llama_cpp_bpw": 4.436203072528381,
|
| 1743 |
+
"file_bytes": 19699553920,
|
| 1744 |
+
"file_bpw_local_parameters": 4.438679488168163,
|
| 1745 |
+
"embedded_mtp_parameters": 844640768,
|
| 1746 |
+
"embedded_mtp_bytes": 897955840,
|
| 1747 |
+
"embedded_mtp_tensors": [
|
| 1748 |
+
"blk.40.attn_k.weight",
|
| 1749 |
+
"blk.40.attn_k_norm.weight",
|
| 1750 |
+
"blk.40.attn_norm.weight",
|
| 1751 |
+
"blk.40.attn_output.weight",
|
| 1752 |
+
"blk.40.attn_q.weight",
|
| 1753 |
+
"blk.40.attn_q_norm.weight",
|
| 1754 |
+
"blk.40.attn_v.weight",
|
| 1755 |
+
"blk.40.ffn_down_exps.weight",
|
| 1756 |
+
"blk.40.ffn_down_shexp.weight",
|
| 1757 |
+
"blk.40.ffn_gate_exps.weight",
|
| 1758 |
+
"blk.40.ffn_gate_inp.weight",
|
| 1759 |
+
"blk.40.ffn_gate_inp_shexp.weight",
|
| 1760 |
+
"blk.40.ffn_gate_shexp.weight",
|
| 1761 |
+
"blk.40.ffn_up_exps.weight",
|
| 1762 |
+
"blk.40.ffn_up_shexp.weight",
|
| 1763 |
+
"blk.40.nextn.eh_proj.weight",
|
| 1764 |
+
"blk.40.nextn.enorm.weight",
|
| 1765 |
+
"blk.40.nextn.hnorm.weight",
|
| 1766 |
+
"blk.40.nextn.shared_head_norm.weight",
|
| 1767 |
+
"blk.40.post_attention_norm.weight"
|
| 1768 |
+
],
|
| 1769 |
+
"tensor_count": 753,
|
| 1770 |
+
"files": [
|
| 1771 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf"
|
| 1772 |
+
],
|
| 1773 |
+
"hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF",
|
| 1774 |
+
"hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f",
|
| 1775 |
+
"hf_gguf_total": 35505251456,
|
| 1776 |
+
"hf_estimated_bpw": 4.438679488168163
|
| 1777 |
+
},
|
| 1778 |
+
{
|
| 1779 |
+
"family": "qwen3.6-35b-a3b",
|
| 1780 |
+
"producer": "bartowski",
|
| 1781 |
+
"model": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf",
|
| 1782 |
+
"shards": 1,
|
| 1783 |
+
"architecture": "qwen35moe",
|
| 1784 |
+
"main_parameters": 34660610688,
|
| 1785 |
+
"main_tensor_bytes": 21753580032,
|
| 1786 |
+
"main_bpw": 5.020934045926987,
|
| 1787 |
+
"llama_cpp_parameters": 35505251456,
|
| 1788 |
+
"llama_cpp_tensor_bytes": 22651535872,
|
| 1789 |
+
"llama_cpp_bpw": 5.103816465025404,
|
| 1790 |
+
"file_bytes": 22662526592,
|
| 1791 |
+
"file_bpw_local_parameters": 5.106292880665185,
|
| 1792 |
+
"embedded_mtp_parameters": 844640768,
|
| 1793 |
+
"embedded_mtp_bytes": 897955840,
|
| 1794 |
+
"embedded_mtp_tensors": [
|
| 1795 |
+
"blk.40.attn_k.weight",
|
| 1796 |
+
"blk.40.attn_k_norm.weight",
|
| 1797 |
+
"blk.40.attn_norm.weight",
|
| 1798 |
+
"blk.40.attn_output.weight",
|
| 1799 |
+
"blk.40.attn_q.weight",
|
| 1800 |
+
"blk.40.attn_q_norm.weight",
|
| 1801 |
+
"blk.40.attn_v.weight",
|
| 1802 |
+
"blk.40.ffn_down_exps.weight",
|
| 1803 |
+
"blk.40.ffn_down_shexp.weight",
|
| 1804 |
+
"blk.40.ffn_gate_exps.weight",
|
| 1805 |
+
"blk.40.ffn_gate_inp.weight",
|
| 1806 |
+
"blk.40.ffn_gate_inp_shexp.weight",
|
| 1807 |
+
"blk.40.ffn_gate_shexp.weight",
|
| 1808 |
+
"blk.40.ffn_up_exps.weight",
|
| 1809 |
+
"blk.40.ffn_up_shexp.weight",
|
| 1810 |
+
"blk.40.nextn.eh_proj.weight",
|
| 1811 |
+
"blk.40.nextn.enorm.weight",
|
| 1812 |
+
"blk.40.nextn.hnorm.weight",
|
| 1813 |
+
"blk.40.nextn.shared_head_norm.weight",
|
| 1814 |
+
"blk.40.post_attention_norm.weight"
|
| 1815 |
+
],
|
| 1816 |
+
"tensor_count": 753,
|
| 1817 |
+
"files": [
|
| 1818 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf"
|
| 1819 |
+
],
|
| 1820 |
+
"hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF",
|
| 1821 |
+
"hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f",
|
| 1822 |
+
"hf_gguf_total": 35505251456,
|
| 1823 |
+
"hf_estimated_bpw": 5.106292880665185
|
| 1824 |
+
},
|
| 1825 |
+
{
|
| 1826 |
+
"family": "qwen3.6-35b-a3b",
|
| 1827 |
+
"producer": "bartowski",
|
| 1828 |
+
"model": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf",
|
| 1829 |
+
"shards": 1,
|
| 1830 |
+
"architecture": "qwen35moe",
|
| 1831 |
+
"main_parameters": 34660610688,
|
| 1832 |
+
"main_tensor_bytes": 21376133632,
|
| 1833 |
+
"main_bpw": 4.9338158117106055,
|
| 1834 |
+
"llama_cpp_parameters": 35505251456,
|
| 1835 |
+
"llama_cpp_tensor_bytes": 22274089472,
|
| 1836 |
+
"llama_cpp_bpw": 5.018770702041807,
|
| 1837 |
+
"file_bytes": 22285080192,
|
| 1838 |
+
"file_bpw_local_parameters": 5.021247117681588,
|
| 1839 |
+
"embedded_mtp_parameters": 844640768,
|
| 1840 |
+
"embedded_mtp_bytes": 897955840,
|
| 1841 |
+
"embedded_mtp_tensors": [
|
| 1842 |
+
"blk.40.attn_k.weight",
|
| 1843 |
+
"blk.40.attn_k_norm.weight",
|
| 1844 |
+
"blk.40.attn_norm.weight",
|
| 1845 |
+
"blk.40.attn_output.weight",
|
| 1846 |
+
"blk.40.attn_q.weight",
|
| 1847 |
+
"blk.40.attn_q_norm.weight",
|
| 1848 |
+
"blk.40.attn_v.weight",
|
| 1849 |
+
"blk.40.ffn_down_exps.weight",
|
| 1850 |
+
"blk.40.ffn_down_shexp.weight",
|
| 1851 |
+
"blk.40.ffn_gate_exps.weight",
|
| 1852 |
+
"blk.40.ffn_gate_inp.weight",
|
| 1853 |
+
"blk.40.ffn_gate_inp_shexp.weight",
|
| 1854 |
+
"blk.40.ffn_gate_shexp.weight",
|
| 1855 |
+
"blk.40.ffn_up_exps.weight",
|
| 1856 |
+
"blk.40.ffn_up_shexp.weight",
|
| 1857 |
+
"blk.40.nextn.eh_proj.weight",
|
| 1858 |
+
"blk.40.nextn.enorm.weight",
|
| 1859 |
+
"blk.40.nextn.hnorm.weight",
|
| 1860 |
+
"blk.40.nextn.shared_head_norm.weight",
|
| 1861 |
+
"blk.40.post_attention_norm.weight"
|
| 1862 |
+
],
|
| 1863 |
+
"tensor_count": 753,
|
| 1864 |
+
"files": [
|
| 1865 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf"
|
| 1866 |
+
],
|
| 1867 |
+
"hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF",
|
| 1868 |
+
"hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f",
|
| 1869 |
+
"hf_gguf_total": 35505251456,
|
| 1870 |
+
"hf_estimated_bpw": 5.021247117681588
|
| 1871 |
+
},
|
| 1872 |
+
{
|
| 1873 |
+
"family": "qwen3.6-35b-a3b",
|
| 1874 |
+
"producer": "bartowski",
|
| 1875 |
+
"model": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf",
|
| 1876 |
+
"shards": 1,
|
| 1877 |
+
"architecture": "qwen35moe",
|
| 1878 |
+
"main_parameters": 34660610688,
|
| 1879 |
+
"main_tensor_bytes": 20577413632,
|
| 1880 |
+
"main_bpw": 4.749463606911968,
|
| 1881 |
+
"llama_cpp_parameters": 35505251456,
|
| 1882 |
+
"llama_cpp_tensor_bytes": 21475369472,
|
| 1883 |
+
"llama_cpp_bpw": 4.838804084767781,
|
| 1884 |
+
"file_bytes": 21486360192,
|
| 1885 |
+
"file_bpw_local_parameters": 4.841280500407562,
|
| 1886 |
+
"embedded_mtp_parameters": 844640768,
|
| 1887 |
+
"embedded_mtp_bytes": 897955840,
|
| 1888 |
+
"embedded_mtp_tensors": [
|
| 1889 |
+
"blk.40.attn_k.weight",
|
| 1890 |
+
"blk.40.attn_k_norm.weight",
|
| 1891 |
+
"blk.40.attn_norm.weight",
|
| 1892 |
+
"blk.40.attn_output.weight",
|
| 1893 |
+
"blk.40.attn_q.weight",
|
| 1894 |
+
"blk.40.attn_q_norm.weight",
|
| 1895 |
+
"blk.40.attn_v.weight",
|
| 1896 |
+
"blk.40.ffn_down_exps.weight",
|
| 1897 |
+
"blk.40.ffn_down_shexp.weight",
|
| 1898 |
+
"blk.40.ffn_gate_exps.weight",
|
| 1899 |
+
"blk.40.ffn_gate_inp.weight",
|
| 1900 |
+
"blk.40.ffn_gate_inp_shexp.weight",
|
| 1901 |
+
"blk.40.ffn_gate_shexp.weight",
|
| 1902 |
+
"blk.40.ffn_up_exps.weight",
|
| 1903 |
+
"blk.40.ffn_up_shexp.weight",
|
| 1904 |
+
"blk.40.nextn.eh_proj.weight",
|
| 1905 |
+
"blk.40.nextn.enorm.weight",
|
| 1906 |
+
"blk.40.nextn.hnorm.weight",
|
| 1907 |
+
"blk.40.nextn.shared_head_norm.weight",
|
| 1908 |
+
"blk.40.post_attention_norm.weight"
|
| 1909 |
+
],
|
| 1910 |
+
"tensor_count": 753,
|
| 1911 |
+
"files": [
|
| 1912 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf"
|
| 1913 |
+
],
|
| 1914 |
+
"hf_repo": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF",
|
| 1915 |
+
"hf_commit": "5c2410d71524f4f72b023ce8daf7a80528226d5f",
|
| 1916 |
+
"hf_gguf_total": 35505251456,
|
| 1917 |
+
"hf_estimated_bpw": 4.841280500407562
|
| 1918 |
+
},
|
| 1919 |
+
{
|
| 1920 |
+
"family": "qwen3.6-35b-a3b",
|
| 1921 |
+
"producer": "unsloth",
|
| 1922 |
+
"model": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf",
|
| 1923 |
+
"shards": 1,
|
| 1924 |
+
"architecture": "qwen35moe",
|
| 1925 |
+
"main_parameters": 34660610688,
|
| 1926 |
+
"main_tensor_bytes": 16834521600,
|
| 1927 |
+
"main_bpw": 3.8855683765152706,
|
| 1928 |
+
"llama_cpp_parameters": 34660610688,
|
| 1929 |
+
"llama_cpp_tensor_bytes": 16834521600,
|
| 1930 |
+
"llama_cpp_bpw": 3.8855683765152706,
|
| 1931 |
+
"file_bytes": 16845511648,
|
| 1932 |
+
"file_bpw_local_parameters": 3.8881049845627,
|
| 1933 |
+
"embedded_mtp_parameters": 0,
|
| 1934 |
+
"embedded_mtp_bytes": 0,
|
| 1935 |
+
"embedded_mtp_tensors": [],
|
| 1936 |
+
"tensor_count": 733,
|
| 1937 |
+
"files": [
|
| 1938 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf"
|
| 1939 |
+
],
|
| 1940 |
+
"hf_repo": "unsloth/Qwen3.6-35B-A3B-GGUF",
|
| 1941 |
+
"hf_commit": "a483e9e6cbd595906af30beda3187c2663a1118c",
|
| 1942 |
+
"hf_gguf_total": 34660610688,
|
| 1943 |
+
"hf_estimated_bpw": 3.8881049845627
|
| 1944 |
+
},
|
| 1945 |
+
{
|
| 1946 |
+
"family": "qwen3.6-35b-a3b",
|
| 1947 |
+
"producer": "unsloth",
|
| 1948 |
+
"model": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf",
|
| 1949 |
+
"shards": 1,
|
| 1950 |
+
"architecture": "qwen35moe",
|
| 1951 |
+
"main_parameters": 34660610688,
|
| 1952 |
+
"main_tensor_bytes": 22123538944,
|
| 1953 |
+
"main_bpw": 5.106324096397871,
|
| 1954 |
+
"llama_cpp_parameters": 34660610688,
|
| 1955 |
+
"llama_cpp_tensor_bytes": 22123538944,
|
| 1956 |
+
"llama_cpp_bpw": 5.106324096397871,
|
| 1957 |
+
"file_bytes": 22134528992,
|
| 1958 |
+
"file_bpw_local_parameters": 5.108860704445301,
|
| 1959 |
+
"embedded_mtp_parameters": 0,
|
| 1960 |
+
"embedded_mtp_bytes": 0,
|
| 1961 |
+
"embedded_mtp_tensors": [],
|
| 1962 |
+
"tensor_count": 733,
|
| 1963 |
+
"files": [
|
| 1964 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf"
|
| 1965 |
+
],
|
| 1966 |
+
"hf_repo": "unsloth/Qwen3.6-35B-A3B-GGUF",
|
| 1967 |
+
"hf_commit": "a483e9e6cbd595906af30beda3187c2663a1118c",
|
| 1968 |
+
"hf_gguf_total": 34660610688,
|
| 1969 |
+
"hf_estimated_bpw": 5.108860704445301
|
| 1970 |
+
},
|
| 1971 |
+
{
|
| 1972 |
+
"family": "qwen3.6-35b-a3b",
|
| 1973 |
+
"producer": "unsloth",
|
| 1974 |
+
"model": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf",
|
| 1975 |
+
"shards": 1,
|
| 1976 |
+
"architecture": "qwen35moe",
|
| 1977 |
+
"main_parameters": 34660610688,
|
| 1978 |
+
"main_tensor_bytes": 20882024960,
|
| 1979 |
+
"main_bpw": 4.8197708108425585,
|
| 1980 |
+
"llama_cpp_parameters": 34660610688,
|
| 1981 |
+
"llama_cpp_tensor_bytes": 20882024960,
|
| 1982 |
+
"llama_cpp_bpw": 4.8197708108425585,
|
| 1983 |
+
"file_bytes": 20893015008,
|
| 1984 |
+
"file_bpw_local_parameters": 4.822307418889988,
|
| 1985 |
+
"embedded_mtp_parameters": 0,
|
| 1986 |
+
"embedded_mtp_bytes": 0,
|
| 1987 |
+
"embedded_mtp_tensors": [],
|
| 1988 |
+
"tensor_count": 733,
|
| 1989 |
+
"files": [
|
| 1990 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf"
|
| 1991 |
+
],
|
| 1992 |
+
"hf_repo": "unsloth/Qwen3.6-35B-A3B-GGUF",
|
| 1993 |
+
"hf_commit": "a483e9e6cbd595906af30beda3187c2663a1118c",
|
| 1994 |
+
"hf_gguf_total": 34660610688,
|
| 1995 |
+
"hf_estimated_bpw": 4.822307418889988
|
| 1996 |
+
},
|
| 1997 |
+
{
|
| 1998 |
+
"family": "qwen3.6-35b-a3b",
|
| 1999 |
+
"producer": "unsloth",
|
| 2000 |
+
"model": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf",
|
| 2001 |
+
"shards": 1,
|
| 2002 |
+
"architecture": "qwen35moe",
|
| 2003 |
+
"main_parameters": 34660610688,
|
| 2004 |
+
"main_tensor_bytes": 22349466112,
|
| 2005 |
+
"main_bpw": 5.15847024466599,
|
| 2006 |
+
"llama_cpp_parameters": 34660610688,
|
| 2007 |
+
"llama_cpp_tensor_bytes": 22349466112,
|
| 2008 |
+
"llama_cpp_bpw": 5.15847024466599,
|
| 2009 |
+
"file_bytes": 22360456160,
|
| 2010 |
+
"file_bpw_local_parameters": 5.161006852713419,
|
| 2011 |
+
"embedded_mtp_parameters": 0,
|
| 2012 |
+
"embedded_mtp_bytes": 0,
|
| 2013 |
+
"embedded_mtp_tensors": [],
|
| 2014 |
+
"tensor_count": 733,
|
| 2015 |
+
"files": [
|
| 2016 |
+
"/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf"
|
| 2017 |
+
],
|
| 2018 |
+
"hf_repo": "unsloth/Qwen3.6-35B-A3B-GGUF",
|
| 2019 |
+
"hf_commit": "a483e9e6cbd595906af30beda3187c2663a1118c",
|
| 2020 |
+
"hf_gguf_total": 34660610688,
|
| 2021 |
+
"hf_estimated_bpw": 5.161006852713419
|
| 2022 |
+
}
|
| 2023 |
+
],
|
| 2024 |
+
"excluded": [
|
| 2025 |
+
{
|
| 2026 |
+
"path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf",
|
| 2027 |
+
"reason": "auxiliary filename/directory"
|
| 2028 |
+
},
|
| 2029 |
+
{
|
| 2030 |
+
"path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf",
|
| 2031 |
+
"reason": "auxiliary filename/directory"
|
| 2032 |
+
},
|
| 2033 |
+
{
|
| 2034 |
+
"path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/mmproj-BF16.gguf",
|
| 2035 |
+
"reason": "auxiliary filename/directory"
|
| 2036 |
+
},
|
| 2037 |
+
{
|
| 2038 |
+
"path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf",
|
| 2039 |
+
"reason": "auxiliary filename/directory"
|
| 2040 |
+
},
|
| 2041 |
+
{
|
| 2042 |
+
"path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/mmproj-BF16.gguf",
|
| 2043 |
+
"reason": "auxiliary filename/directory"
|
| 2044 |
+
},
|
| 2045 |
+
{
|
| 2046 |
+
"path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 2047 |
+
"reason": "auxiliary filename/directory"
|
| 2048 |
+
},
|
| 2049 |
+
{
|
| 2050 |
+
"path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/mmproj-BF16.gguf",
|
| 2051 |
+
"reason": "auxiliary filename/directory"
|
| 2052 |
+
},
|
| 2053 |
+
{
|
| 2054 |
+
"path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf",
|
| 2055 |
+
"reason": "auxiliary filename/directory"
|
| 2056 |
+
},
|
| 2057 |
+
{
|
| 2058 |
+
"path": "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 2059 |
+
"reason": "auxiliary filename/directory"
|
| 2060 |
+
},
|
| 2061 |
+
{
|
| 2062 |
+
"path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf",
|
| 2063 |
+
"reason": "auxiliary filename/directory"
|
| 2064 |
+
},
|
| 2065 |
+
{
|
| 2066 |
+
"path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf",
|
| 2067 |
+
"reason": "auxiliary filename/directory"
|
| 2068 |
+
},
|
| 2069 |
+
{
|
| 2070 |
+
"path": "/home/ubuntu/models/qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf",
|
| 2071 |
+
"reason": "auxiliary filename/directory"
|
| 2072 |
+
},
|
| 2073 |
+
{
|
| 2074 |
+
"path": "/home/ubuntu/models/qwen3.5-4b/unsloth/mmproj-BF16.gguf",
|
| 2075 |
+
"reason": "auxiliary filename/directory"
|
| 2076 |
+
},
|
| 2077 |
+
{
|
| 2078 |
+
"path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf",
|
| 2079 |
+
"reason": "auxiliary filename/directory"
|
| 2080 |
+
},
|
| 2081 |
+
{
|
| 2082 |
+
"path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf",
|
| 2083 |
+
"reason": "auxiliary filename/directory"
|
| 2084 |
+
}
|
| 2085 |
+
],
|
| 2086 |
+
"errors": []
|
| 2087 |
+
}
|
bpw/REPORT.md
ADDED
|
@@ -0,0 +1,180 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# 本機模型 BPW:HF 初估與 llama.cpp 精確計算
|
| 2 |
+
|
| 3 |
+
掃描時間:2026-09-06T11:32:10.745771+00:00。來源:`~/models/`。
|
| 4 |
+
|
| 5 |
+
目前共有 **70 組模型/量化版本、8 個 family**。主模型共 74 個 GGUF,分片合併為一筆;排除 15 個 mmproj/MTP/DFlash 檔案,0 個掃描錯誤。
|
| 6 |
+
|
| 7 |
+
完整可排序結果:[BPW.csv](BPW.csv);含檔案與來源資訊:[BPW.json](BPW.json)。
|
| 8 |
+
|
| 9 |
+
## 三種 BPW 的意義
|
| 10 |
+
|
| 11 |
+
- **主模型 BPW**:`8 × 主模型 tensor bytes ÷ 主模型實際儲存參數量`。排除內嵌 MTP 的 bytes 和 parameters;本次主表使用這個值。
|
| 12 |
+
- **llama.cpp BPW**:`8 × 全部 tensor bytes ÷ 全部實際儲存參數量`。與 `llama_model_loader::print_info` 的 BPW 公式相同;檔案內含 MTP 時也會算進去。
|
| 13 |
+
- **HF 初估**:保留原始程式的 `8 × 合併後 sibling.size ÷ info.gguf["total"]`,包含 GGUF metadata 與 padding。
|
| 14 |
+
|
| 15 |
+
精確值直接呼叫本機 llama.cpp 的 `libggml-base.so`,使用 `gguf_init_from_file(no_alloc=true, ctx=NULL)`、`gguf_get_tensor_size` 與 `gguf_get_tensor_ne`。只讀 header/tensor descriptors,不讀 tensor payload、不建立模型 context,也不使用 GPU。
|
| 16 |
+
|
| 17 |
+
分母採用 tensor shape 的實際元素數總和,包含全部 MoE experts;不是模型名稱的 4B/30B,也不是每 token 的 active parameters。BF16 檔案可能混有 F32 tensors,因此 BPW 可以稍高於 16。
|
| 18 |
+
|
| 19 |
+
所有 70 組 HF 分母都與 native 全 tensor 參數量一致;對應檔名與大小已核對。Hub 配對採 metadata 與檔案大小,沒有為此讀完整權重計算本機 SHA256。
|
| 20 |
+
|
| 21 |
+
## 各 family 總覽
|
| 22 |
+
|
| 23 |
+
| Family | 主模型參數量 | 版本數 | 量化版本主模型 BPW 範圍 |
|
| 24 |
+
|---|---:|---:|---:|
|
| 25 |
+
| gemma-4-31b-it | 30,697,345,596 | 11 | 4.0041–5.1034 |
|
| 26 |
+
| gemma-4-e4b-it | 7,518,069,290 | 8 | 5.1290–5.7915 |
|
| 27 |
+
| glm-4.6v-flash | 9,400,279,040 | 13 | 4.6431–5.2577 |
|
| 28 |
+
| internvl3.5-30b-a3b | 30,532,122,624 | 12 | 3.8908–5.0330 |
|
| 29 |
+
| kimi-vl-a3b-separate | 15,960,110,208 | 1 | 僅 BF16 |
|
| 30 |
+
| muse-glimmer-30b | 27,854,794,240 | 5 | 4.6678–5.1166 |
|
| 31 |
+
| qwen3.5-4b | 4,205,751,296 | 11 | 4.8866–5.4666 |
|
| 32 |
+
| qwen3.6-35b-a3b | 34,660,610,688 | 9 | 3.8856–5.1585 |
|
| 33 |
+
|
| 34 |
+
## 排除內嵌 MTP
|
| 35 |
+
|
| 36 |
+
bartowski Qwen3.5-4B 檔案內另有 **120,599,552** 個 MTP parameters;Qwen3.6-35B-A3B 另有 **844,640,768** 個。依 llama.cpp 的 `n_layer = n_layer_all - n_layer_nextn`,扣除完整尾端 MTP block,包含名稱沒有 `nextn` 字樣的 attention/FFN tensors。扣除後,兩個 family 的 bartowski 與 unsloth 主模型參數量、tensor 名稱與 shape 集合全部相同([shape 驗證](main-tensor-shape-validation.json))。
|
| 37 |
+
|
| 38 |
+
例如 Qwen3.5-4B bartowski Q4_K_M:主模型 **5.4666 BPW**,llama.cpp 全 tensor **5.5512 BPW**。因此不能直接用未調整的檔案 BPW 比較兩家主模型。
|
| 39 |
+
|
| 40 |
+
## 每個模型的完整結果
|
| 41 |
+
|
| 42 |
+
BPW 顯示六位小數;CSV/JSON 保存完整浮點值。BF16 分片已合併,檔名連結指向第一片。
|
| 43 |
+
|
| 44 |
+
### gemma-4-31b-it
|
| 45 |
+
|
| 46 |
+
| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |
|
| 47 |
+
|---|---|---:|---:|---:|
|
| 48 |
+
| bartowski | [google_gemma-4-31B-it-bf16.gguf](../gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf) (2 shards) | 16.000694 | 16.000694 | 16.004821 |
|
| 49 |
+
| bartowski | [google_gemma-4-31B-it-IQ4_XS.gguf](../gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf) | 4.466851 | 4.466851 | 4.470978 |
|
| 50 |
+
| bartowski | [google_gemma-4-31B-it-Q3_K_XL.gguf](../gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf) | 4.465820 | 4.465820 | 4.469947 |
|
| 51 |
+
| bartowski | [google_gemma-4-31B-it-Q4_K_M.gguf](../gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf) | 5.103413 | 5.103413 | 5.107540 |
|
| 52 |
+
| bartowski | [google_gemma-4-31B-it-Q4_K_S.gguf](../gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf) | 4.737822 | 4.737822 | 4.741949 |
|
| 53 |
+
| unsloth | [gemma-4-31B-it-IQ4_NL.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf) | 4.501193 | 4.501193 | 4.505320 |
|
| 54 |
+
| unsloth | [gemma-4-31B-it-Q4_1.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf) | 4.978217 | 4.978217 | 4.982344 |
|
| 55 |
+
| unsloth | [gemma-4-31B-it-Q4_K_M.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf) | 4.771200 | 4.771200 | 4.775327 |
|
| 56 |
+
| unsloth | [gemma-4-31B-it-Q4_K_S.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf) | 4.530424 | 4.530424 | 4.534551 |
|
| 57 |
+
| unsloth | [gemma-4-31B-it-UD-Q3_K_XL.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf) | 4.004095 | 4.004095 | 4.008222 |
|
| 58 |
+
| unsloth | [gemma-4-31B-it-UD-Q4_K_XL.gguf](../gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf) | 4.901306 | 4.901306 | 4.905433 |
|
| 59 |
+
|
| 60 |
+
### gemma-4-e4b-it
|
| 61 |
+
|
| 62 |
+
| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |
|
| 63 |
+
|---|---|---:|---:|---:|
|
| 64 |
+
| bartowski | [google_gemma-4-E4B-it-Q4_0.gguf](../gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf) | 5.541884 | 5.541884 | 5.558726 |
|
| 65 |
+
| bartowski | [google_gemma-4-E4B-it-Q4_1.gguf](../gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf) | 5.791543 | 5.791543 | 5.808384 |
|
| 66 |
+
| bartowski | [google_gemma-4-E4B-it-Q4_K_M.gguf](../gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf) | 5.734816 | 5.734816 | 5.751658 |
|
| 67 |
+
| bartowski | [google_gemma-4-E4B-it-bf16.gguf](../gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf) | 16.001204 | 16.001204 | 16.018046 |
|
| 68 |
+
| unsloth | [gemma-4-E4B-it-BF16.gguf](../gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf) | 16.001204 | 16.001204 | 16.018046 |
|
| 69 |
+
| unsloth | [gemma-4-E4B-it-IQ4_NL.gguf](../gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf) | 5.128988 | 5.128988 | 5.145831 |
|
| 70 |
+
| unsloth | [gemma-4-E4B-it-Q4_K_M.gguf](../gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf) | 5.279381 | 5.279381 | 5.296223 |
|
| 71 |
+
| unsloth | [gemma-4-E4B-it-Q4_K_S.gguf](../gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf) | 5.138577 | 5.138577 | 5.155420 |
|
| 72 |
+
|
| 73 |
+
### glm-4.6v-flash
|
| 74 |
+
|
| 75 |
+
| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |
|
| 76 |
+
|---|---|---:|---:|---:|
|
| 77 |
+
| bartowski | [zai-org_GLM-4.6V-Flash-IQ4_NL.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf) | 4.643130 | 4.643130 | 4.651078 |
|
| 78 |
+
| bartowski | [zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf) | 4.876821 | 4.876821 | 4.884770 |
|
| 79 |
+
| bartowski | [zai-org_GLM-4.6V-Flash-Q4_0.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf) | 4.653587 | 4.653587 | 4.661536 |
|
| 80 |
+
| bartowski | [zai-org_GLM-4.6V-Flash-Q4_1.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf) | 5.105605 | 5.105605 | 5.113554 |
|
| 81 |
+
| bartowski | [zai-org_GLM-4.6V-Flash-Q4_K_M.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf) | 5.240047 | 5.240047 | 5.247996 |
|
| 82 |
+
| bartowski | [zai-org_GLM-4.6V-Flash-Q4_K_S.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf) | 4.892745 | 4.892745 | 4.900693 |
|
| 83 |
+
| bartowski | [zai-org_GLM-4.6V-Flash-bf16.gguf](../glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf) | 16.001436 | 16.001436 | 16.009385 |
|
| 84 |
+
| unsloth | [GLM-4.6V-Flash-IQ4_NL.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf) | 4.643130 | 4.643130 | 4.651079 |
|
| 85 |
+
| unsloth | [GLM-4.6V-Flash-Q4_0.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf) | 4.653587 | 4.653587 | 4.661536 |
|
| 86 |
+
| unsloth | [GLM-4.6V-Flash-Q4_1.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf) | 5.105605 | 5.105605 | 5.113554 |
|
| 87 |
+
| unsloth | [GLM-4.6V-Flash-Q4_K_M.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf) | 5.240047 | 5.240047 | 5.247996 |
|
| 88 |
+
| unsloth | [GLM-4.6V-Flash-Q4_K_S.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf) | 4.892745 | 4.892745 | 4.900694 |
|
| 89 |
+
| unsloth | [GLM-4.6V-Flash-UD-Q4_K_XL.gguf](../glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf) | 5.257727 | 5.257727 | 5.265677 |
|
| 90 |
+
|
| 91 |
+
### internvl3.5-30b-a3b
|
| 92 |
+
|
| 93 |
+
| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |
|
| 94 |
+
|---|---|---:|---:|---:|
|
| 95 |
+
| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf) | 3.890801 | 3.890801 | 3.892365 |
|
| 96 |
+
| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf) | 4.618264 | 4.618264 | 4.619828 |
|
| 97 |
+
| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf) | 5.033008 | 5.033008 | 5.034571 |
|
| 98 |
+
| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf) | 4.880424 | 4.880424 | 4.881988 |
|
| 99 |
+
| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf](../internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf) | 4.710716 | 4.710716 | 4.712280 |
|
| 100 |
+
| bartowski | [OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf](../internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf) (2 shards) | 16.006704 | 16.006704 | 16.008268 |
|
| 101 |
+
| mradermacher | [InternVL3_5-30B-A3B.Q4_K_M.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf) | 4.860642 | 4.860642 | 4.862206 |
|
| 102 |
+
| mradermacher | [InternVL3_5-30B-A3B.Q4_K_S.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf) | 4.572244 | 4.572244 | 4.573808 |
|
| 103 |
+
| mradermacher | [InternVL3_5-30B-A3B.i1-Q4_0.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf) | 4.552325 | 4.552325 | 4.553888 |
|
| 104 |
+
| mradermacher | [InternVL3_5-30B-A3B.i1-Q4_1.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf) | 5.027238 | 5.027238 | 5.028801 |
|
| 105 |
+
| mradermacher | [InternVL3_5-30B-A3B.i1-Q4_K_M.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf) | 4.860642 | 4.860642 | 4.862206 |
|
| 106 |
+
| mradermacher | [InternVL3_5-30B-A3B.i1-Q4_K_S.gguf](../internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf) | 4.572244 | 4.572244 | 4.573808 |
|
| 107 |
+
|
| 108 |
+
### kimi-vl-a3b-separate
|
| 109 |
+
|
| 110 |
+
| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |
|
| 111 |
+
|---|---|---:|---:|---:|
|
| 112 |
+
| ggml-org | [Kimi-VL-A3B-Thinking-2506-bf16.gguf](../kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf) | 16.003545 | 16.003545 | 16.007022 |
|
| 113 |
+
|
| 114 |
+
### muse-glimmer-30b
|
| 115 |
+
|
| 116 |
+
| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |
|
| 117 |
+
|---|---|---:|---:|---:|
|
| 118 |
+
| bartowski | [Muse-Glimmer-30B-Q4_0.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf) | 4.667764 | 4.667764 | 4.671531 |
|
| 119 |
+
| bartowski | [Muse-Glimmer-30B-Q4_1.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf) | 5.116561 | 5.116561 | 5.120327 |
|
| 120 |
+
| bartowski | [Muse-Glimmer-30B-Q4_K_M.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf) | 4.966674 | 4.966674 | 4.970440 |
|
| 121 |
+
| bartowski | [Muse-Glimmer-30B-Q4_K_S.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf) | 4.683669 | 4.683669 | 4.687435 |
|
| 122 |
+
| bartowski | [Muse-Glimmer-30B-bf16.gguf](../muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf) (2 shards) | 16.000807 | 16.000807 | 16.004573 |
|
| 123 |
+
|
| 124 |
+
### qwen3.5-4b
|
| 125 |
+
|
| 126 |
+
| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |
|
| 127 |
+
|---|---|---:|---:|---:|
|
| 128 |
+
| bartowski | [Qwen_Qwen3.5-4B-Q4_0.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf) | 5.015776 | 5.112973 | 5.133256 |
|
| 129 |
+
| bartowski | [Qwen_Qwen3.5-4B-Q4_1.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf) | 5.403467 | 5.489857 | 5.510141 |
|
| 130 |
+
| bartowski | [Qwen_Qwen3.5-4B-Q4_K_M.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf) | 5.466576 | 5.551207 | 5.571490 |
|
| 131 |
+
| bartowski | [Qwen_Qwen3.5-4B-Q4_K_S.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf) | 5.149162 | 5.242640 | 5.262924 |
|
| 132 |
+
| bartowski | [Qwen_Qwen3.5-4B-bf16.gguf](../qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf) | 16.003658 | 16.003605 | 16.023888 |
|
| 133 |
+
| unsloth | [Qwen3.5-4B-BF16.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf) | 16.003658 | 16.003658 | 16.024521 |
|
| 134 |
+
| unsloth | [Qwen3.5-4B-IQ4_NL.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf) | 4.886597 | 4.886597 | 4.907460 |
|
| 135 |
+
| unsloth | [Qwen3.5-4B-Q4_0.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf) | 4.892830 | 4.892830 | 4.913693 |
|
| 136 |
+
| unsloth | [Qwen3.5-4B-Q4_1.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf) | 5.275535 | 5.275535 | 5.296399 |
|
| 137 |
+
| unsloth | [Qwen3.5-4B-Q4_K_M.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf) | 5.192831 | 5.192831 | 5.213695 |
|
| 138 |
+
| unsloth | [Qwen3.5-4B-Q4_K_S.gguf](../qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf) | 4.906542 | 4.906542 | 4.927406 |
|
| 139 |
+
|
| 140 |
+
### qwen3.6-35b-a3b
|
| 141 |
+
|
| 142 |
+
| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |
|
| 143 |
+
|---|---|---:|---:|---:|
|
| 144 |
+
| bartowski | [Qwen_Qwen3.6-35B-A3B-bf16.gguf](../qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf) (2 shards) | 16.010254 | 16.010015 | 16.012491 |
|
| 145 |
+
| bartowski | [Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf](../qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf) | 4.337052 | 4.436203 | 4.438679 |
|
| 146 |
+
| bartowski | [Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf](../qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf) | 5.020934 | 5.103816 | 5.106293 |
|
| 147 |
+
| bartowski | [Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf](../qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf) | 4.933816 | 5.018771 | 5.021247 |
|
| 148 |
+
| bartowski | [Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf](../qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf) | 4.749464 | 4.838804 | 4.841281 |
|
| 149 |
+
| unsloth | [Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf](../qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf) | 3.885568 | 3.885568 | 3.888105 |
|
| 150 |
+
| unsloth | [Qwen3.6-35B-A3B-UD-Q4_K_M.gguf](../qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf) | 5.106324 | 5.106324 | 5.108861 |
|
| 151 |
+
| unsloth | [Qwen3.6-35B-A3B-UD-Q4_K_S.gguf](../qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf) | 4.819771 | 4.819771 | 4.822307 |
|
| 152 |
+
| unsloth | [Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf](../qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf) | 5.158470 | 5.158470 | 5.161007 |
|
| 153 |
+
|
| 154 |
+
## 重跑方式
|
| 155 |
+
|
| 156 |
+
先用原公式取得 HF 初估:
|
| 157 |
+
|
| 158 |
+
```bash
|
| 159 |
+
~/projects/llama.cpp/.venv/bin/python ~/models/bpw/hf/scan_hf.py \
|
| 160 |
+
--models-dir ~/models --out ~/models/bpw/hf
|
| 161 |
+
```
|
| 162 |
+
|
| 163 |
+
再取得 llama.cpp native 精確值,重建並列表格:
|
| 164 |
+
|
| 165 |
+
```bash
|
| 166 |
+
python3 ~/models/bpw/scan_native_bpw.py --models-dir ~/models --out ~/models/bpw
|
| 167 |
+
python3 ~/models/bpw/build_report.py
|
| 168 |
+
```
|
| 169 |
+
|
| 170 |
+
Native scanner 僅需 Python 標準庫及本機 llama.cpp `build/bin/libggml-base.so`;其他 build 可用 `--library <路徑>` 指定。換模型目錄或輸出位置時,HF 與 native 使用同一批模型,並把兩份輸出放在上述相對結構。遇到缺片或錯誤會記錄並繼續其他模型,native scanner 最終回傳非零 exit code。
|
| 171 |
+
|
| 172 |
+
## 驗證與來源
|
| 173 |
+
|
| 174 |
+
- [HF 配對/分片測試](hf/checks.log),以及每個 repo 的固定 commit 與原始 metadata:`hf/repo-metadata/`。
|
| 175 |
+
- [本次更新驗證](refresh-validation.json):目前全部 tensor 數量/bytes、HF 配對、檔案清單與 MTP 主模型 shape;新增模型另以 GGUFReader 交叉檢查。初版的測試結果保留在 [validation.json](validation.json) 與 [validation.log](validation.log)。
|
| 176 |
+
- [初版 GPT-6-Astra max review](REVIEW.md):保留當時 82 筆的掃描器與數值審查,並非本次模型清單的 review。
|
| 177 |
+
- [Native 原始 metadata 與 library hash](native-bpw.json);掃描輸出:[native-scan.log](native-scan.log)。
|
| 178 |
+
- 本機 llama.cpp 原始碼:[tensor 統計與 BPW 公式](/home/ubuntu/projects/llama.cpp/src/llama-model-loader.cpp:591)、[MTP layer 邊界](/home/ubuntu/projects/llama.cpp/src/llama-hparams.cpp:347)。
|
| 179 |
+
|
| 180 |
+
本次掃描只讀 metadata。已刪除的模型不再列入目前表格;報告與數據直接更新為最新版,刪除紀錄是同目錄的 `model-removals*.json`。所有腳本、結果與 logs 都集中在 `~/models/bpw/`。
|
bpw/REVIEW.md
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# 初版 BPW 數值與配對 review
|
| 2 |
+
|
| 3 |
+
本紀錄對應初版的 82 筆結果;最新模型清單的驗證請看 `refresh-validation.json`。
|
| 4 |
+
|
| 5 |
+
日期:2026-09-06。Reviewer:GPT-6-Astra max。
|
| 6 |
+
|
| 7 |
+
結果:通過,沒有影響本次 82 筆結果或敘述的 blocking issue。
|
| 8 |
+
|
| 9 |
+
- 核對 gguf.h ctypes ABI 與 no_alloc=true、ctx=NULL 的 metadata-only 讀取行為。
|
| 10 |
+
- 依 gguf-py quant block/type size 表獨立重算全部 51,764 個 tensor descriptors,86 檔的元素數與 payload bytes 完全一致。
|
| 11 |
+
- 82 筆 main/llama.cpp/HF BPW、MTP block 邊界與 HF metadata commit/sibling size/total 全部一致。
|
| 12 |
+
- Qwen3.5、Qwen3.6 排除完整 MTP blocks 後,各 family 的 bartowski/unsloth 主模型 tensor 名稱與 shape 集合一致。
|
| 13 |
+
- 報告區分內嵌 MTP 與 metadata/padding,也明列未做完整權重 SHA256。
|
| 14 |
+
|
| 15 |
+
原始掃描/驗證腳本與 logs 位於同目錄及 hf/。
|
bpw/build_report.py
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#!/usr/bin/env python3
|
| 2 |
+
"""Join saved HF estimates and native GGUF measurements by exact local file sets."""
|
| 3 |
+
import csv
|
| 4 |
+
import json
|
| 5 |
+
from pathlib import Path
|
| 6 |
+
import re
|
| 7 |
+
|
| 8 |
+
ROOT=Path(__file__).resolve().parent
|
| 9 |
+
native=json.loads((ROOT/'native-bpw.json').read_text())
|
| 10 |
+
hf=json.loads((ROOT/'hf/hf-bpw-estimates.json').read_text())
|
| 11 |
+
lookup={tuple(sorted(r['local_paths'])):r for r in hf}
|
| 12 |
+
assert len(lookup)==len(hf)
|
| 13 |
+
rows=[]
|
| 14 |
+
for row in native['rows']:
|
| 15 |
+
h=lookup[tuple(sorted(row['files']))]
|
| 16 |
+
assert h['status']=='comparable' and h['hf_sibling_bytes']==row['file_bytes']
|
| 17 |
+
assert h['hf_gguf_total']==row['llama_cpp_parameters']
|
| 18 |
+
rows.append({**row,'hf_repo':h['repo_id'],'hf_commit':h['repo_commit_sha'],
|
| 19 |
+
'hf_gguf_total':h['hf_gguf_total'],'hf_estimated_bpw':h['hf_file_size_bpw_estimate']})
|
| 20 |
+
assert len(rows)==len(hf)
|
| 21 |
+
fields=['family','producer','model','shards','main_parameters','main_bpw','llama_cpp_bpw','hf_estimated_bpw',
|
| 22 |
+
'embedded_mtp_parameters','embedded_mtp_bytes','main_tensor_bytes','llama_cpp_parameters','llama_cpp_tensor_bytes',
|
| 23 |
+
'file_bytes','hf_gguf_total','hf_repo','hf_commit']
|
| 24 |
+
with (ROOT/'BPW.csv').open('w',newline='') as f:
|
| 25 |
+
writer=csv.DictWriter(f,fieldnames=fields,extrasaction='ignore');writer.writeheader();writer.writerows(rows)
|
| 26 |
+
(ROOT/'BPW.json').write_text(json.dumps({'provenance':native['provenance'],'rows':rows,'excluded':native['excluded'],'errors':native['errors']},indent=2)+'\n')
|
| 27 |
+
|
| 28 |
+
lines=['# 本機模型 BPW:HF 初估與 llama.cpp 精確計算', '',
|
| 29 |
+
f"掃描時間:{native['provenance']['created_utc']}。來源:`~/models/`。", '',
|
| 30 |
+
f"目前共有 **{len(rows)} 組模型/量化版本、{len({r['family'] for r in rows})} 個 family**。主模型共 {sum(r['shards'] for r in rows)} 個 GGUF,分片合併為一筆;排除 {len(native['excluded'])} 個 mmproj/MTP/DFlash 檔案,{len(native['errors'])} 個掃描錯誤。", '',
|
| 31 |
+
'完整可排序結果:[BPW.csv](BPW.csv);含檔案與來源資訊:[BPW.json](BPW.json)。', '',
|
| 32 |
+
'## 三種 BPW 的意義', '',
|
| 33 |
+
'- **主模型 BPW**:`8 × 主模型 tensor bytes ÷ 主模型實際儲存參數量`。排除內嵌 MTP 的 bytes 和 parameters;本次主表使用這個值。',
|
| 34 |
+
'- **llama.cpp BPW**:`8 × 全部 tensor bytes ÷ 全部實際儲存參數量`。與 `llama_model_loader::print_info` 的 BPW 公式相同;檔案內含 MTP 時也會算進去。',
|
| 35 |
+
'- **HF 初估**:保留原始程式的 `8 × 合併後 sibling.size ÷ info.gguf["total"]`,包含 GGUF metadata 與 padding。', '',
|
| 36 |
+
'精確值直接呼叫本機 llama.cpp 的 `libggml-base.so`,使用 `gguf_init_from_file(no_alloc=true, ctx=NULL)`、`gguf_get_tensor_size` 與 `gguf_get_tensor_ne`。只讀 header/tensor descriptors,不讀 tensor payload、不建立模型 context,也不使用 GPU。', '',
|
| 37 |
+
'分母採用 tensor shape 的實際元素數總和,包含全部 MoE experts;不是模型名稱的 4B/30B,也不是每 token 的 active parameters。BF16 檔案可能混有 F32 tensors,因此 BPW 可以稍高於 16。', '',
|
| 38 |
+
f'所有 {len(rows)} 組 HF 分母都與 native 全 tensor 參數量一致;對應檔名與大小已核對。Hub 配對採 metadata 與檔案大小,沒有為此讀完整權重計算本機 SHA256。', '',
|
| 39 |
+
'## 各 family 總覽', '',
|
| 40 |
+
'| Family | 主模型參數量 | 版本數 | 量化版本主模型 BPW 範圍 |',
|
| 41 |
+
'|---|---:|---:|---:|']
|
| 42 |
+
floatfile=re.compile(r'(^|[-_.])(bf16|f16|fp16|f32)([-_.]|$)',re.I)
|
| 43 |
+
for family in sorted({r['family'] for r in rows}):
|
| 44 |
+
group=[r for r in rows if r['family']==family]
|
| 45 |
+
params=sorted({r['main_parameters'] for r in group})
|
| 46 |
+
quant=[r['main_bpw'] for r in group if not floatfile.search(Path(r['model']).name)]
|
| 47 |
+
spread=f'{min(quant):.4f}–{max(quant):.4f}' if quant else '僅 BF16'
|
| 48 |
+
lines.append(f"| {family} | {' / '.join(f'{p:,}' for p in params)} | {len(group)} | {spread} |")
|
| 49 |
+
lines += ['', '## 排除內嵌 MTP', '',
|
| 50 |
+
'bartowski Qwen3.5-4B 檔案內另有 **120,599,552** 個 MTP parameters;Qwen3.6-35B-A3B 另有 **844,640,768** 個。依 llama.cpp 的 `n_layer = n_layer_all - n_layer_nextn`,扣除完整尾端 MTP block,包含名稱沒有 `nextn` 字樣的 attention/FFN tensors。扣除後,兩個 family 的 bartowski 與 unsloth 主模型參數量、tensor 名稱與 shape 集合全部相同([shape 驗證](main-tensor-shape-validation.json))。', '',
|
| 51 |
+
'例如 Qwen3.5-4B bartowski Q4_K_M:主模型 **5.4666 BPW**,llama.cpp 全 tensor **5.5512 BPW**。因此不能直接用未調整的檔案 BPW 比較兩家主模型。', '',
|
| 52 |
+
'## 每個模型的完整結果', '',
|
| 53 |
+
'BPW 顯示六位小數;CSV/JSON 保存完整浮點值。BF16 分片已合併,檔名連結指向第一片。']
|
| 54 |
+
for family in sorted({r['family'] for r in rows}):
|
| 55 |
+
lines += ['',f'### {family}','', '| Producer | GGUF(分片已合併) | 主模型 BPW | llama.cpp BPW | HF 初估 |', '|---|---|---:|---:|---:|']
|
| 56 |
+
for r in [r for r in rows if r['family']==family]:
|
| 57 |
+
path=Path(r['files'][0]).relative_to(Path(native['provenance']['models_dir']))
|
| 58 |
+
name=Path(r['model']).name
|
| 59 |
+
suffix=f" ({r['shards']} shards)" if r['shards']>1 else ''
|
| 60 |
+
lines.append(f"| {r['producer']} | [{name}](../{path}){suffix} | {r['main_bpw']:.6f} | {r['llama_cpp_bpw']:.6f} | {r['hf_estimated_bpw']:.6f} |")
|
| 61 |
+
lines += ['', '## 重跑方式', '', '先用原公式取得 HF 初估:', '', '```bash',
|
| 62 |
+
'~/projects/llama.cpp/.venv/bin/python ~/models/bpw/hf/scan_hf.py \\',
|
| 63 |
+
' --models-dir ~/models --out ~/models/bpw/hf', '```', '', '再取得 llama.cpp native 精確值,重建並列表格:', '', '```bash',
|
| 64 |
+
'python3 ~/models/bpw/scan_native_bpw.py --models-dir ~/models --out ~/models/bpw',
|
| 65 |
+
'python3 ~/models/bpw/build_report.py', '```', '',
|
| 66 |
+
'Native scanner 僅需 Python 標準庫及本機 llama.cpp `build/bin/libggml-base.so`;其他 build 可用 `--library <路徑>` 指定。換模型目錄或輸出位置時,HF 與 native 使用同一批模型,並把兩份輸出放在上述相對結構。遇到缺片或錯誤會記錄並繼續其他模型,native scanner 最終回傳非零 exit code。', '',
|
| 67 |
+
'## 驗證與來源', '',
|
| 68 |
+
'- [HF 配對/分片測試](hf/checks.log),以及每個 repo 的固定 commit 與原始 metadata:`hf/repo-metadata/`。',
|
| 69 |
+
'- [本次更新驗證](refresh-validation.json):目前全部 tensor 數量/bytes、HF 配對、檔案清單與 MTP 主模型 shape;新增模型另以 GGUFReader 交叉檢查。初版的測試結果保留在 [validation.json](validation.json) 與 [validation.log](validation.log)。',
|
| 70 |
+
'- [初版 GPT-6-Astra max review](REVIEW.md):保留當時 82 筆的掃描器與數值審查,並非本次模型清單的 review。',
|
| 71 |
+
'- [Native 原始 metadata 與 library hash](native-bpw.json);掃描輸出:[native-scan.log](native-scan.log)。',
|
| 72 |
+
'- 本機 llama.cpp 原始碼:[tensor 統計與 BPW 公式](/home/ubuntu/projects/llama.cpp/src/llama-model-loader.cpp:591)、[MTP layer 邊界](/home/ubuntu/projects/llama.cpp/src/llama-hparams.cpp:347)。', '',
|
| 73 |
+
'本次掃描只讀 metadata。已刪除的模型不再列入目前表格;報告與數據直接更新為最新版,刪除紀錄是同目錄的 `model-removals*.json`。所有腳本、結果與 logs 都集中在 `~/models/bpw/`。', '']
|
| 74 |
+
(ROOT/'REPORT.md').write_text('\n'.join(lines))
|
| 75 |
+
print('Saved REPORT.md, BPW.csv and BPW.json:',len(rows),'rows')
|
bpw/hf/README.md
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Hugging Face file-size BPW preliminary scan
|
| 2 |
+
|
| 3 |
+
Scope: visible GGUF files currently under /home/ubuntu/models. No model bytes were downloaded, hashed, modified, or uploaded.
|
| 4 |
+
|
| 5 |
+
Method: `HfApi.model_info(repo, files_metadata=True)`; sum matched HF sibling sizes over a complete local shard set, multiply by 8, divide by `info.gguf['total']`. Repositories were discovered with HF API author+family searches, then matched using unique basenames or exact publisher-relative paths and equal local/HF sizes. Multiple valid repository matches remain ambiguous rather than being guessed.
|
| 6 |
+
|
| 7 |
+
Result: 89 visible GGUF files, 15 projector/assistant exclusions, 74 main-model files, 70 variant rows after shard merging. All 70 rows matched and have usable HF totals. 15 repositories supply matches; 32 candidate repositories were checked. No missing metadata, size mismatch, ambiguous matches, incomplete shards, or API failures occurred in this inventory.
|
| 8 |
+
|
| 9 |
+
Files:
|
| 10 |
+
- scan_hf.py: standalone reproducible metadata-only scanner.
|
| 11 |
+
- hf-bpw-estimates.csv / .json: one row per local model/quantization variant, with grouped shards.
|
| 12 |
+
- file-matches.json: every local file and all candidate matches.
|
| 13 |
+
- repo-metadata/: queried repository commit, gguf metadata, GGUF sibling paths/sizes/LFS digests.
|
| 14 |
+
- repository-discovery.json: actual API search results.
|
| 15 |
+
- inventory.json / excluded.json: complete visible main-model/excluded inventory.
|
| 16 |
+
- summary.json / scan.log: counts, method, API progress and status.
|
| 17 |
+
- check_scan.py / checks.log: seven CPU-only matching/aggregation/adversarial reconciliation checks.
|
| 18 |
+
|
| 19 |
+
The numeric output is whole-file size per repository-reported parameter count, not native tensor BPW. File headers, alignment, mixed tensor storage, and denominator definitions can matter. Local/remote size agreement is not a SHA256 identity proof. This scan intentionally does not read weight payloads; native results are authoritative for tensor-exact BPW.
|
| 20 |
+
|
| 21 |
+
In particular, Qwen3.5 HF totals are 4,326,350,848 for bartowski/Qwen_Qwen3.5-4B-GGUF versus 4,205,751,296 for unsloth/Qwen3.5-4B-GGUF. Qwen3.6 totals are 35,505,251,456 versus 34,660,610,688 respectively. These raw repository denominators were preserved, not normalized. Any interpretation of embedded MTP or other tensor differences belongs with the native scan.
|
bpw/hf/check_scan.py
ADDED
|
@@ -0,0 +1,41 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
import copy
|
| 2 |
+
import importlib.util
|
| 3 |
+
import json
|
| 4 |
+
from pathlib import Path
|
| 5 |
+
|
| 6 |
+
base = Path(__file__).resolve().parent
|
| 7 |
+
spec = importlib.util.spec_from_file_location('scan_hf', base / 'scan_hf.py')
|
| 8 |
+
scan = importlib.util.module_from_spec(spec)
|
| 9 |
+
spec.loader.exec_module(scan)
|
| 10 |
+
local = {'local_path': '/models/family/owner/BF16/model-00001-of-00002.gguf',
|
| 11 |
+
'relative_path': 'family/owner/BF16/model-00001-of-00002.gguf', 'family': 'family',
|
| 12 |
+
'publisher': 'owner', 'basename': 'model-00001-of-00002.gguf', 'size': 10,
|
| 13 |
+
'publisher_relative_path': 'BF16/model-00001-of-00002.gguf'}
|
| 14 |
+
repo = {'repo_id': 'owner/verified-GGUF', 'commit_sha': 'a' * 40, 'gguf': {'total': 20},
|
| 15 |
+
'siblings': [{'rfilename': 'BF16/model-00001-of-00002.gguf', 'size': 10}]}
|
| 16 |
+
matched = scan.match_file(local, [repo])
|
| 17 |
+
assert matched['match_status'] == 'matched'
|
| 18 |
+
mismatch = copy.deepcopy(repo)
|
| 19 |
+
mismatch['siblings'][0]['size'] = 11
|
| 20 |
+
assert scan.match_file(local, [mismatch])['match_status'] == 'local_remote_size_mismatch'
|
| 21 |
+
other = copy.deepcopy(repo)
|
| 22 |
+
other['repo_id'] = 'owner/ambiguous-GGUF'
|
| 23 |
+
assert scan.match_file(local, [repo, other])['match_status'] == 'ambiguous_repository_or_sibling'
|
| 24 |
+
assert scan.aggregate([matched])[0]['status'] == 'incomplete_or_inconsistent_local_shards'
|
| 25 |
+
second_local = {k: v.replace('00001-of', '00002-of') if isinstance(v, str) else v for k, v in local.items()}
|
| 26 |
+
second_repo = copy.deepcopy(repo)
|
| 27 |
+
second_repo['siblings'][0]['rfilename'] = second_local['publisher_relative_path']
|
| 28 |
+
complete = scan.aggregate([matched, scan.match_file(second_local, [second_repo])])[0]
|
| 29 |
+
assert complete['status'] == 'comparable' and complete['hf_file_size_bpw_estimate'] == 8
|
| 30 |
+
single = {k: v.replace('-00001-of-00002', '') if isinstance(v, str) else v for k, v in local.items()}
|
| 31 |
+
missing = copy.deepcopy(repo)
|
| 32 |
+
missing['gguf'] = None
|
| 33 |
+
missing['siblings'][0]['rfilename'] = single['publisher_relative_path']
|
| 34 |
+
assert scan.aggregate([scan.match_file(single, [missing])])[0]['status'] == 'missing_or_invalid_gguf_total'
|
| 35 |
+
rows = json.loads((base / 'hf-bpw-estimates.json').read_text())
|
| 36 |
+
files = json.loads((base / 'inventory.json').read_text())
|
| 37 |
+
assert rows and sum(row['local_shards'] for row in rows) == len(files)
|
| 38 |
+
assert {p for row in rows for p in row['local_paths']} == {row['local_path'] for row in files}
|
| 39 |
+
assert all(row['local_bytes'] == row['hf_sibling_bytes'] and row['status'] == 'comparable' for row in rows)
|
| 40 |
+
assert all(len(row['repo_commit_sha']) == 40 for row in rows)
|
| 41 |
+
print('7 checks passed: unique match, mismatch rejection, ambiguous repo rejection, missing shard rejection, shard sum BPW, missing total rejection, complete actual inventory reconciliation.')
|
bpw/hf/checks.log
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
7 checks passed: unique match, mismatch rejection, ambiguous repo rejection, missing shard rejection, shard sum BPW, missing total rejection, complete actual inventory reconciliation.
|
bpw/hf/excluded.json
ADDED
|
@@ -0,0 +1,137 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[
|
| 2 |
+
{
|
| 3 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf",
|
| 4 |
+
"relative_path": "gemma-4-31b-it/bartowski/mmproj-google_gemma-4-31B-it-bf16.gguf",
|
| 5 |
+
"family": "gemma-4-31b-it",
|
| 6 |
+
"publisher": "bartowski",
|
| 7 |
+
"basename": "mmproj-google_gemma-4-31B-it-bf16.gguf",
|
| 8 |
+
"size": 1200726208,
|
| 9 |
+
"reason": "projector_or_assistant"
|
| 10 |
+
},
|
| 11 |
+
{
|
| 12 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf",
|
| 13 |
+
"relative_path": "gemma-4-31b-it/bartowski/mtp-google_gemma-4-31B-it-Q8_0.gguf",
|
| 14 |
+
"family": "gemma-4-31b-it",
|
| 15 |
+
"publisher": "bartowski",
|
| 16 |
+
"basename": "mtp-google_gemma-4-31B-it-Q8_0.gguf",
|
| 17 |
+
"size": 514705920,
|
| 18 |
+
"reason": "projector_or_assistant"
|
| 19 |
+
},
|
| 20 |
+
{
|
| 21 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/mmproj-BF16.gguf",
|
| 22 |
+
"relative_path": "gemma-4-31b-it/unsloth/mmproj-BF16.gguf",
|
| 23 |
+
"family": "gemma-4-31b-it",
|
| 24 |
+
"publisher": "unsloth",
|
| 25 |
+
"basename": "mmproj-BF16.gguf",
|
| 26 |
+
"size": 1200726496,
|
| 27 |
+
"reason": "projector_or_assistant"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf",
|
| 31 |
+
"relative_path": "gemma-4-e4b-it/bartowski/mmproj-google_gemma-4-E4B-it-bf16.gguf",
|
| 32 |
+
"family": "gemma-4-e4b-it",
|
| 33 |
+
"publisher": "bartowski",
|
| 34 |
+
"basename": "mmproj-google_gemma-4-E4B-it-bf16.gguf",
|
| 35 |
+
"size": 991552000,
|
| 36 |
+
"reason": "projector_or_assistant"
|
| 37 |
+
},
|
| 38 |
+
{
|
| 39 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/mmproj-BF16.gguf",
|
| 40 |
+
"relative_path": "gemma-4-e4b-it/unsloth/mmproj-BF16.gguf",
|
| 41 |
+
"family": "gemma-4-e4b-it",
|
| 42 |
+
"publisher": "unsloth",
|
| 43 |
+
"basename": "mmproj-BF16.gguf",
|
| 44 |
+
"size": 991552320,
|
| 45 |
+
"reason": "projector_or_assistant"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 49 |
+
"relative_path": "glm-4.6v-flash/bartowski/mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 50 |
+
"family": "glm-4.6v-flash",
|
| 51 |
+
"publisher": "bartowski",
|
| 52 |
+
"basename": "mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 53 |
+
"size": 1840903936,
|
| 54 |
+
"reason": "projector_or_assistant"
|
| 55 |
+
},
|
| 56 |
+
{
|
| 57 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/mmproj-BF16.gguf",
|
| 58 |
+
"relative_path": "glm-4.6v-flash/unsloth/mmproj-BF16.gguf",
|
| 59 |
+
"family": "glm-4.6v-flash",
|
| 60 |
+
"publisher": "unsloth",
|
| 61 |
+
"basename": "mmproj-BF16.gguf",
|
| 62 |
+
"size": 1840904320,
|
| 63 |
+
"reason": "projector_or_assistant"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf",
|
| 67 |
+
"relative_path": "internvl3.5-30b-a3b/bartowski/mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf",
|
| 68 |
+
"family": "internvl3.5-30b-a3b",
|
| 69 |
+
"publisher": "bartowski",
|
| 70 |
+
"basename": "mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf",
|
| 71 |
+
"size": 637310368,
|
| 72 |
+
"reason": "projector_or_assistant"
|
| 73 |
+
},
|
| 74 |
+
{
|
| 75 |
+
"local_path": "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 76 |
+
"relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 77 |
+
"family": "kimi-vl-a3b-separate",
|
| 78 |
+
"publisher": "ggml-org",
|
| 79 |
+
"basename": "mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 80 |
+
"size": 906726464,
|
| 81 |
+
"reason": "projector_or_assistant"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf",
|
| 85 |
+
"relative_path": "muse-glimmer-30b/bartowski/dflash-Muse-Glimmer-30B-Q8_0.gguf",
|
| 86 |
+
"family": "muse-glimmer-30b",
|
| 87 |
+
"publisher": "bartowski",
|
| 88 |
+
"basename": "dflash-Muse-Glimmer-30B-Q8_0.gguf",
|
| 89 |
+
"size": 2729046176,
|
| 90 |
+
"reason": "projector_or_assistant"
|
| 91 |
+
},
|
| 92 |
+
{
|
| 93 |
+
"local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf",
|
| 94 |
+
"relative_path": "muse-glimmer-30b/bartowski/mmproj-Muse-Glimmer-30B-bf16.gguf",
|
| 95 |
+
"family": "muse-glimmer-30b",
|
| 96 |
+
"publisher": "bartowski",
|
| 97 |
+
"basename": "mmproj-Muse-Glimmer-30B-bf16.gguf",
|
| 98 |
+
"size": 3849173920,
|
| 99 |
+
"reason": "projector_or_assistant"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf",
|
| 103 |
+
"relative_path": "qwen3.5-4b/bartowski/mmproj-Qwen_Qwen3.5-4B-bf16.gguf",
|
| 104 |
+
"family": "qwen3.5-4b",
|
| 105 |
+
"publisher": "bartowski",
|
| 106 |
+
"basename": "mmproj-Qwen_Qwen3.5-4B-bf16.gguf",
|
| 107 |
+
"size": 675569216,
|
| 108 |
+
"reason": "projector_or_assistant"
|
| 109 |
+
},
|
| 110 |
+
{
|
| 111 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/mmproj-BF16.gguf",
|
| 112 |
+
"relative_path": "qwen3.5-4b/unsloth/mmproj-BF16.gguf",
|
| 113 |
+
"family": "qwen3.5-4b",
|
| 114 |
+
"publisher": "unsloth",
|
| 115 |
+
"basename": "mmproj-BF16.gguf",
|
| 116 |
+
"size": 675569344,
|
| 117 |
+
"reason": "projector_or_assistant"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf",
|
| 121 |
+
"relative_path": "qwen3.6-35b-a3b/bartowski/mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf",
|
| 122 |
+
"family": "qwen3.6-35b-a3b",
|
| 123 |
+
"publisher": "bartowski",
|
| 124 |
+
"basename": "mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf",
|
| 125 |
+
"size": 902822240,
|
| 126 |
+
"reason": "projector_or_assistant"
|
| 127 |
+
},
|
| 128 |
+
{
|
| 129 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf",
|
| 130 |
+
"relative_path": "qwen3.6-35b-a3b/unsloth/mmproj-BF16.gguf",
|
| 131 |
+
"family": "qwen3.6-35b-a3b",
|
| 132 |
+
"publisher": "unsloth",
|
| 133 |
+
"basename": "mmproj-BF16.gguf",
|
| 134 |
+
"size": 902822624,
|
| 135 |
+
"reason": "projector_or_assistant"
|
| 136 |
+
}
|
| 137 |
+
]
|
bpw/hf/file-matches.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
bpw/hf/hf-bpw-estimates.csv
ADDED
|
@@ -0,0 +1,71 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
family,publisher,variant,local_parent,status,local_shards,expected_shards,local_bytes,hf_sibling_bytes,repo_id,repo_commit_sha,hf_gguf_total,hf_file_size_bpw_estimate,local_paths,hf_sibling_paths
|
| 2 |
+
gemma-4-31b-it,bartowski,google_gemma-4-31B-it-IQ4_XS.gguf,gemma-4-31b-it/bartowski,comparable,1,1,17155893600,17155893600,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,4.470977738801101,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf""]","[""google_gemma-4-31B-it-IQ4_XS.gguf""]"
|
| 3 |
+
gemma-4-31b-it,bartowski,google_gemma-4-31B-it-Q3_K_XL.gguf,gemma-4-31b-it/bartowski,comparable,1,1,17151936864,17151936864,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,4.4699465783738574,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf""]","[""google_gemma-4-31B-it-Q3_K_XL.gguf""]"
|
| 4 |
+
gemma-4-31b-it,bartowski,google_gemma-4-31B-it-Q4_K_M.gguf,gemma-4-31b-it/bartowski,comparable,1,1,19598489952,19598489952,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,5.107539970375489,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf""]","[""google_gemma-4-31B-it-Q4_K_M.gguf""]"
|
| 5 |
+
gemma-4-31b-it,bartowski,google_gemma-4-31B-it-Q4_K_S.gguf,gemma-4-31b-it/bartowski,comparable,1,1,18195655008,18195655008,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,4.741948765855762,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf""]","[""google_gemma-4-31B-it-Q4_K_S.gguf""]"
|
| 6 |
+
gemma-4-31b-it,bartowski,google_gemma-4-31B-it-bf16.gguf,gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16,comparable,2,2,61413189920,61413189920,bartowski/google_gemma-4-31B-it-GGUF,619aca7589c72be65dd968de8602ad23d68b5c14,30697345596,16.00482093227042,"[""/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf"", ""/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf""]","[""google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf"", ""google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf""]"
|
| 7 |
+
gemma-4-31b-it,unsloth,gemma-4-31B-it-IQ4_NL.gguf,gemma-4-31b-it/unsloth,comparable,1,1,17287670720,17287670720,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.505320022784683,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf""]","[""gemma-4-31B-it-IQ4_NL.gguf""]"
|
| 8 |
+
gemma-4-31b-it,unsloth,gemma-4-31B-it-Q4_1.gguf,gemma-4-31b-it/unsloth,comparable,1,1,19118091200,19118091200,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.982343803039745,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf""]","[""gemma-4-31B-it-Q4_1.gguf""]"
|
| 9 |
+
gemma-4-31b-it,unsloth,gemma-4-31B-it-Q4_K_M.gguf,gemma-4-31b-it/unsloth,comparable,1,1,18323733440,18323733440,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.7753271390051815,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf""]","[""gemma-4-31B-it-Q4_K_M.gguf""]"
|
| 10 |
+
gemma-4-31b-it,unsloth,gemma-4-31B-it-Q4_K_S.gguf,gemma-4-31b-it/unsloth,comparable,1,1,17399835584,17399835584,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.5345511792439215,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf""]","[""gemma-4-31B-it-Q4_K_S.gguf""]"
|
| 11 |
+
gemma-4-31b-it,unsloth,gemma-4-31B-it-UD-Q3_K_XL.gguf,gemma-4-31b-it/unsloth,comparable,1,1,15380222912,15380222912,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.008222238994921,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf""]","[""gemma-4-31B-it-UD-Q3_K_XL.gguf""]"
|
| 12 |
+
gemma-4-31b-it,unsloth,gemma-4-31B-it-UD-Q4_K_XL.gguf,gemma-4-31b-it/unsloth,comparable,1,1,18822970304,18822970304,unsloth/gemma-4-31B-it-GGUF,c1ac76e99d5513b141e8adde7288b85c3f9c32ec,30697345596,4.905432685086026,"[""/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf""]","[""gemma-4-31B-it-UD-Q4_K_XL.gguf""]"
|
| 13 |
+
gemma-4-e4b-it,bartowski,google_gemma-4-E4B-it-Q4_0.gguf,gemma-4-e4b-it/bartowski,comparable,1,1,5223860704,5223860704,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66,7518069290,5.558725787162837,"[""/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf""]","[""google_gemma-4-E4B-it-Q4_0.gguf""]"
|
| 14 |
+
gemma-4-e4b-it,bartowski,google_gemma-4-E4B-it-Q4_1.gguf,gemma-4-e4b-it/bartowski,comparable,1,1,5458479584,5458479584,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66,7518069290,5.808384438553106,"[""/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf""]","[""google_gemma-4-E4B-it-Q4_1.gguf""]"
|
| 15 |
+
gemma-4-e4b-it,bartowski,google_gemma-4-E4B-it-Q4_K_M.gguf,gemma-4-e4b-it/bartowski,comparable,1,1,5405170144,5405170144,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66,7518069290,5.75165770412845,"[""/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf""]","[""google_gemma-4-E4B-it-Q4_K_M.gguf""]"
|
| 16 |
+
gemma-4-e4b-it,bartowski,google_gemma-4-E4B-it-bf16.gguf,gemma-4-e4b-it/bartowski,comparable,1,1,15053097184,15053097184,bartowski/google_gemma-4-E4B-it-GGUF,029e94146666900b08caf49a3b47b413dfa8ec66,7518069290,16.018045701198904,"[""/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf""]","[""google_gemma-4-E4B-it-bf16.gguf""]"
|
| 17 |
+
gemma-4-e4b-it,unsloth,gemma-4-E4B-it-BF16.gguf,gemma-4-e4b-it/unsloth,comparable,1,1,15053097856,15053097856,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3,7518069290,16.018046416276114,"[""/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf""]","[""gemma-4-E4B-it-BF16.gguf""]"
|
| 18 |
+
gemma-4-e4b-it,unsloth,gemma-4-E4B-it-IQ4_NL.gguf,gemma-4-e4b-it/unsloth,comparable,1,1,4835839104,4835839104,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3,7518069290,5.145830842961012,"[""/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf""]","[""gemma-4-E4B-it-IQ4_NL.gguf""]"
|
| 19 |
+
gemma-4-e4b-it,unsloth,gemma-4-E4B-it-Q4_K_M.gguf,gemma-4-e4b-it/unsloth,comparable,1,1,4977171584,4977171584,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3,7518069290,5.296223157315434,"[""/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf""]","[""gemma-4-E4B-it-Q4_K_M.gguf""]"
|
| 20 |
+
gemma-4-e4b-it,unsloth,gemma-4-E4B-it-Q4_K_S.gguf,gemma-4-e4b-it/unsloth,comparable,1,1,4844850304,4844850304,unsloth/gemma-4-E4B-it-GGUF,bfc15c382204943c3a8fff0c750b94ae2364d7a3,7518069290,5.155419687811896,"[""/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf""]","[""gemma-4-E4B-it-Q4_K_S.gguf""]"
|
| 21 |
+
glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-IQ4_NL.gguf,glm-4.6v-flash/bartowski,comparable,1,1,5465179264,5465179264,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,4.651078327138681,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf""]","[""zai-org_GLM-4.6V-Flash-IQ4_NL.gguf""]"
|
| 22 |
+
glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf,glm-4.6v-flash/bartowski,comparable,1,1,5739775104,5739775104,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,4.88476997721123,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf""]","[""zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf""]"
|
| 23 |
+
glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q4_0.gguf,glm-4.6v-flash/bartowski,comparable,1,1,5477467264,5477467264,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,4.661535889045268,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf""]","[""zai-org_GLM-4.6V-Flash-Q4_0.gguf""]"
|
| 24 |
+
glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q4_1.gguf,glm-4.6v-flash/bartowski,comparable,1,1,6008603776,6008603776,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,5.113553544895621,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf""]","[""zai-org_GLM-4.6V-Flash-Q4_1.gguf""]"
|
| 25 |
+
glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q4_K_M.gguf,glm-4.6v-flash/bartowski,comparable,1,1,6166578304,6166578304,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,5.247995960766714,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf""]","[""zai-org_GLM-4.6V-Flash-Q4_K_M.gguf""]"
|
| 26 |
+
glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-Q4_K_S.gguf,glm-4.6v-flash/bartowski,comparable,1,1,5758485632,5758485632,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,4.900693358140994,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf""]","[""zai-org_GLM-4.6V-Flash-Q4_K_S.gguf""]"
|
| 27 |
+
glm-4.6v-flash,bartowski,zai-org_GLM-4.6V-Flash-bf16.gguf,glm-4.6v-flash/bartowski,comparable,1,1,18811585376,18811585376,bartowski/zai-org_GLM-4.6V-Flash-GGUF,6a3b3ca7bbda9a5495091faa7421ebb30365f6aa,9400279040,16.0093846541815,"[""/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf""]","[""zai-org_GLM-4.6V-Flash-bf16.gguf""]"
|
| 28 |
+
glm-4.6v-flash,unsloth,GLM-4.6V-Flash-IQ4_NL.gguf,glm-4.6v-flash/unsloth,comparable,1,1,5465179744,5465179744,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,4.651078735637192,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf""]","[""GLM-4.6V-Flash-IQ4_NL.gguf""]"
|
| 29 |
+
glm-4.6v-flash,unsloth,GLM-4.6V-Flash-Q4_0.gguf,glm-4.6v-flash/unsloth,comparable,1,1,5477467744,5477467744,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,4.66153629754378,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf""]","[""GLM-4.6V-Flash-Q4_0.gguf""]"
|
| 30 |
+
glm-4.6v-flash,unsloth,GLM-4.6V-Flash-Q4_1.gguf,glm-4.6v-flash/unsloth,comparable,1,1,6008604256,6008604256,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,5.113553953394132,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf""]","[""GLM-4.6V-Flash-Q4_1.gguf""]"
|
| 31 |
+
glm-4.6v-flash,unsloth,GLM-4.6V-Flash-Q4_K_M.gguf,glm-4.6v-flash/unsloth,comparable,1,1,6166578784,6166578784,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,5.247996369265225,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf""]","[""GLM-4.6V-Flash-Q4_K_M.gguf""]"
|
| 32 |
+
glm-4.6v-flash,unsloth,GLM-4.6V-Flash-Q4_K_S.gguf,glm-4.6v-flash/unsloth,comparable,1,1,5758486112,5758486112,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,4.900693766639506,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf""]","[""GLM-4.6V-Flash-Q4_K_S.gguf""]"
|
| 33 |
+
glm-4.6v-flash,unsloth,GLM-4.6V-Flash-UD-Q4_K_XL.gguf,glm-4.6v-flash/unsloth,comparable,1,1,6187353696,6187353696,unsloth/GLM-4.6V-Flash-GGUF,c78a0727cb5ee489db2f218a212f613943023ee8,9400279040,5.265676620595297,"[""/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf""]","[""GLM-4.6V-Flash-UD-Q4_K_XL.gguf""]"
|
| 34 |
+
internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,14855269280,14855269280,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,3.8923646319494094,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf""]"
|
| 35 |
+
internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,17631642528,17631642528,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,4.619827516123106,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf""]"
|
| 36 |
+
internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,19214517152,19214517152,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,5.034570937271498,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf""]"
|
| 37 |
+
internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,18632180640,18632180640,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,4.881987634977999,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf""]"
|
| 38 |
+
internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf,internvl3.5-30b-a3b/bartowski,comparable,1,1,17984488352,17984488352,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,4.712279869559586,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf""]"
|
| 39 |
+
internvl3.5-30b-a3b,bartowski,OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf,internvl3.5-30b-a3b/bartowski/bf16,comparable,2,2,61095799648,61095799648,bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF,a6824f88ffe59c72fc9864a87d40753556cba5d9,30532122624,16.008267856221746,"[""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf"", ""/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf""]","[""OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf"", ""OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf""]"
|
| 40 |
+
internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.Q4_K_M.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,18556683552,18556683552,mradermacher/InternVL3_5-30B-A3B-GGUF,21b0a0caee18e68b38b257a60ac86f883cd65059,30532122624,4.862205954174541,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf""]","[""InternVL3_5-30B-A3B.Q4_K_M.gguf""]"
|
| 41 |
+
internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.Q4_K_S.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,17456006432,17456006432,mradermacher/InternVL3_5-30B-A3B-GGUF,21b0a0caee18e68b38b257a60ac86f883cd65059,30532122624,4.573807500243322,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf""]","[""InternVL3_5-30B-A3B.Q4_K_S.gguf""]"
|
| 42 |
+
internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.i1-Q4_0.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,17379984928,17379984928,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95,30532122624,4.553888412419341,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf""]","[""InternVL3_5-30B-A3B.i1-Q4_0.gguf""]"
|
| 43 |
+
internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.i1-Q4_1.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,19192497696,19192497696,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95,30532122624,5.028801418716587,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf""]","[""InternVL3_5-30B-A3B.i1-Q4_1.gguf""]"
|
| 44 |
+
internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.i1-Q4_K_M.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,18556683808,18556683808,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95,30532122624,4.862206021251437,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf""]","[""InternVL3_5-30B-A3B.i1-Q4_K_M.gguf""]"
|
| 45 |
+
internvl3.5-30b-a3b,mradermacher,InternVL3_5-30B-A3B.i1-Q4_K_S.gguf,internvl3.5-30b-a3b/mradermacher,comparable,1,1,17456006688,17456006688,mradermacher/InternVL3_5-30B-A3B-i1-GGUF,120d600e464788a15e2140e1c9650c543d575d95,30532122624,4.573807567320217,"[""/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf""]","[""InternVL3_5-30B-A3B.i1-Q4_K_S.gguf""]"
|
| 46 |
+
kimi-vl-a3b-separate,ggml-org,Kimi-VL-A3B-Thinking-2506-bf16.gguf,kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org,comparable,1,1,31934229408,31934229408,ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF,e7dcd093335f922a057772febc7ab27eda985b40,15960110208,16.007022002639044,"[""/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf""]","[""Kimi-VL-A3B-Thinking-2506-bf16.gguf""]"
|
| 47 |
+
muse-glimmer-30b,bartowski,Muse-Glimmer-30B-Q4_0.gguf,muse-glimmer-30b/bartowski,comparable,1,1,16265565216,16265565216,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,4.671530531040103,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf""]","[""Muse-Glimmer-30B-Q4_0.gguf""]"
|
| 48 |
+
muse-glimmer-30b,bartowski,Muse-Glimmer-30B-Q4_1.gguf,muse-glimmer-30b/bartowski,comparable,1,1,17828207648,17828207648,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,5.120327221056507,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf""]","[""Muse-Glimmer-30B-Q4_1.gguf""]"
|
| 49 |
+
muse-glimmer-30b,bartowski,Muse-Glimmer-30B-Q4_K_M.gguf,muse-glimmer-30b/bartowski,comparable,1,1,17306324000,17306324000,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,4.970440305790605,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf""]","[""Muse-Glimmer-30B-Q4_K_M.gguf""]"
|
| 50 |
+
muse-glimmer-30b,bartowski,Muse-Glimmer-30B-Q4_K_S.gguf,muse-glimmer-30b/bartowski,comparable,1,1,16320943136,16320943136,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,4.6874352746250985,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf""]","[""Muse-Glimmer-30B-Q4_K_S.gguf""]"
|
| 51 |
+
muse-glimmer-30b,bartowski,Muse-Glimmer-30B-bf16.gguf,muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16,comparable,2,2,55725511360,55725511360,bartowski/Muse-Glimmer-30B-GGUF,01e1b7c30e19e1823ee9a73dec51d12f59ec4857,27854794240,16.00457311006868,"[""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf"", ""/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf""]","[""Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf"", ""Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf""]"
|
| 52 |
+
qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-Q4_0.gguf,qwen3.5-4b/bartowski,comparable,1,1,2776033248,2776033248,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,5.1332558926113245,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf""]","[""Qwen_Qwen3.5-4B-Q4_0.gguf""]"
|
| 53 |
+
qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-Q4_1.gguf,qwen3.5-4b/bartowski,comparable,1,1,2979850208,2979850208,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,5.510140647751737,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf""]","[""Qwen_Qwen3.5-4B-Q4_1.gguf""]"
|
| 54 |
+
qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-Q4_K_M.gguf,qwen3.5-4b/bartowski,comparable,1,1,3013027808,3013027808,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,5.571490457169691,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf""]","[""Qwen_Qwen3.5-4B-Q4_K_M.gguf""]"
|
| 55 |
+
qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-Q4_K_S.gguf,qwen3.5-4b/bartowski,comparable,1,1,2846156768,2846156768,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,5.262923637949023,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf""]","[""Qwen_Qwen3.5-4B-Q4_K_S.gguf""]"
|
| 56 |
+
qwen3.5-4b,bartowski,Qwen_Qwen3.5-4B-bf16.gguf,qwen3.5-4b/bartowski,comparable,1,1,8665620192,8665620192,bartowski/Qwen_Qwen3.5-4B-GGUF,4168f45a16a1290d65a4ec0fa312ae917a4c15d6,4326350848,16.023888022869844,"[""/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf""]","[""Qwen_Qwen3.5-4B-bf16.gguf""]"
|
| 57 |
+
qwen3.5-4b,unsloth,Qwen3.5-4B-BF16.gguf,qwen3.5-4b/unsloth,comparable,1,1,8424393632,8424393632,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,16.0245207842171,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf""]","[""Qwen3.5-4B-BF16.gguf""]"
|
| 58 |
+
qwen3.5-4b,unsloth,Qwen3.5-4B-IQ4_NL.gguf,qwen3.5-4b/unsloth,comparable,1,1,2579944608,2579944608,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,4.907460144785508,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf""]","[""Qwen3.5-4B-IQ4_NL.gguf""]"
|
| 59 |
+
qwen3.5-4b,unsloth,Qwen3.5-4B-Q4_0.gguf,qwen3.5-4b/unsloth,comparable,1,1,2583221408,2583221408,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,4.913693133413469,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf""]","[""Qwen3.5-4B-Q4_0.gguf""]"
|
| 60 |
+
qwen3.5-4b,unsloth,Qwen3.5-4B-Q4_1.gguf,qwen3.5-4b/unsloth,comparable,1,1,2784416928,2784416928,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,5.296398635170271,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf""]","[""Qwen3.5-4B-Q4_1.gguf""]"
|
| 61 |
+
qwen3.5-4b,unsloth,Qwen3.5-4B-Q4_K_M.gguf,qwen3.5-4b/unsloth,comparable,1,1,2740937888,2740937888,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,5.213694667313015,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf""]","[""Qwen3.5-4B-Q4_K_M.gguf""]"
|
| 62 |
+
qwen3.5-4b,unsloth,Qwen3.5-4B-Q4_K_S.gguf,qwen3.5-4b/unsloth,comparable,1,1,2590430368,2590430368,unsloth/Qwen3.5-4B-GGUF,e87f176479d0855a907a41277aca2f8ee7a09523,4205751296,4.927405708394984,"[""/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf""]","[""Qwen3.5-4B-Q4_K_S.gguf""]"
|
| 63 |
+
qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf,qwen3.6-35b-a3b/bartowski,comparable,1,1,19699553920,19699553920,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,4.438679488168163,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf""]","[""Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf""]"
|
| 64 |
+
qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf,qwen3.6-35b-a3b/bartowski,comparable,1,1,22662526592,22662526592,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,5.106292880665185,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf""]","[""Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf""]"
|
| 65 |
+
qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf,qwen3.6-35b-a3b/bartowski,comparable,1,1,22285080192,22285080192,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,5.021247117681588,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf""]","[""Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf""]"
|
| 66 |
+
qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf,qwen3.6-35b-a3b/bartowski,comparable,1,1,21486360192,21486360192,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,4.841280500407562,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf""]","[""Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf""]"
|
| 67 |
+
qwen3.6-35b-a3b,bartowski,Qwen_Qwen3.6-35B-A3B-bf16.gguf,qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16,comparable,2,2,71065941536,71065941536,bartowski/Qwen_Qwen3.6-35B-A3B-GGUF,5c2410d71524f4f72b023ce8daf7a80528226d5f,35505251456,16.012491363215652,"[""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf"", ""/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf""]","[""Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf"", ""Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf""]"
|
| 68 |
+
qwen3.6-35b-a3b,unsloth,Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf,qwen3.6-35b-a3b/unsloth,comparable,1,1,16845511648,16845511648,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c,34660610688,3.8881049845627,"[""/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf""]","[""Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf""]"
|
| 69 |
+
qwen3.6-35b-a3b,unsloth,Qwen3.6-35B-A3B-UD-Q4_K_M.gguf,qwen3.6-35b-a3b/unsloth,comparable,1,1,22134528992,22134528992,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c,34660610688,5.108860704445301,"[""/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf""]","[""Qwen3.6-35B-A3B-UD-Q4_K_M.gguf""]"
|
| 70 |
+
qwen3.6-35b-a3b,unsloth,Qwen3.6-35B-A3B-UD-Q4_K_S.gguf,qwen3.6-35b-a3b/unsloth,comparable,1,1,20893015008,20893015008,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c,34660610688,4.822307418889988,"[""/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf""]","[""Qwen3.6-35B-A3B-UD-Q4_K_S.gguf""]"
|
| 71 |
+
qwen3.6-35b-a3b,unsloth,Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf,qwen3.6-35b-a3b/unsloth,comparable,1,1,22360456160,22360456160,unsloth/Qwen3.6-35B-A3B-GGUF,a483e9e6cbd595906af30beda3187c2663a1118c,34660610688,5.161006852713419,"[""/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf""]","[""Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf""]"
|
bpw/hf/hf-bpw-estimates.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
bpw/hf/inventory.json
ADDED
|
@@ -0,0 +1,668 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[
|
| 2 |
+
{
|
| 3 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf",
|
| 4 |
+
"relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-IQ4_XS.gguf",
|
| 5 |
+
"family": "gemma-4-31b-it",
|
| 6 |
+
"publisher": "bartowski",
|
| 7 |
+
"basename": "google_gemma-4-31B-it-IQ4_XS.gguf",
|
| 8 |
+
"size": 17155893600,
|
| 9 |
+
"publisher_relative_path": "google_gemma-4-31B-it-IQ4_XS.gguf"
|
| 10 |
+
},
|
| 11 |
+
{
|
| 12 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf",
|
| 13 |
+
"relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q3_K_XL.gguf",
|
| 14 |
+
"family": "gemma-4-31b-it",
|
| 15 |
+
"publisher": "bartowski",
|
| 16 |
+
"basename": "google_gemma-4-31B-it-Q3_K_XL.gguf",
|
| 17 |
+
"size": 17151936864,
|
| 18 |
+
"publisher_relative_path": "google_gemma-4-31B-it-Q3_K_XL.gguf"
|
| 19 |
+
},
|
| 20 |
+
{
|
| 21 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf",
|
| 22 |
+
"relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_M.gguf",
|
| 23 |
+
"family": "gemma-4-31b-it",
|
| 24 |
+
"publisher": "bartowski",
|
| 25 |
+
"basename": "google_gemma-4-31B-it-Q4_K_M.gguf",
|
| 26 |
+
"size": 19598489952,
|
| 27 |
+
"publisher_relative_path": "google_gemma-4-31B-it-Q4_K_M.gguf"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf",
|
| 31 |
+
"relative_path": "gemma-4-31b-it/bartowski/google_gemma-4-31B-it-Q4_K_S.gguf",
|
| 32 |
+
"family": "gemma-4-31b-it",
|
| 33 |
+
"publisher": "bartowski",
|
| 34 |
+
"basename": "google_gemma-4-31B-it-Q4_K_S.gguf",
|
| 35 |
+
"size": 18195655008,
|
| 36 |
+
"publisher_relative_path": "google_gemma-4-31B-it-Q4_K_S.gguf"
|
| 37 |
+
},
|
| 38 |
+
{
|
| 39 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf",
|
| 40 |
+
"relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf",
|
| 41 |
+
"family": "gemma-4-31b-it",
|
| 42 |
+
"publisher": "bartowski",
|
| 43 |
+
"basename": "google_gemma-4-31B-it-bf16-00001-of-00002.gguf",
|
| 44 |
+
"size": 39996137216,
|
| 45 |
+
"publisher_relative_path": "bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf",
|
| 49 |
+
"relative_path": "gemma-4-31b-it/bartowski/bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf",
|
| 50 |
+
"family": "gemma-4-31b-it",
|
| 51 |
+
"publisher": "bartowski",
|
| 52 |
+
"basename": "google_gemma-4-31B-it-bf16-00002-of-00002.gguf",
|
| 53 |
+
"size": 21417052704,
|
| 54 |
+
"publisher_relative_path": "bf16/google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf"
|
| 55 |
+
},
|
| 56 |
+
{
|
| 57 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf",
|
| 58 |
+
"relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-IQ4_NL.gguf",
|
| 59 |
+
"family": "gemma-4-31b-it",
|
| 60 |
+
"publisher": "unsloth",
|
| 61 |
+
"basename": "gemma-4-31B-it-IQ4_NL.gguf",
|
| 62 |
+
"size": 17287670720,
|
| 63 |
+
"publisher_relative_path": "gemma-4-31B-it-IQ4_NL.gguf"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf",
|
| 67 |
+
"relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_1.gguf",
|
| 68 |
+
"family": "gemma-4-31b-it",
|
| 69 |
+
"publisher": "unsloth",
|
| 70 |
+
"basename": "gemma-4-31B-it-Q4_1.gguf",
|
| 71 |
+
"size": 19118091200,
|
| 72 |
+
"publisher_relative_path": "gemma-4-31B-it-Q4_1.gguf"
|
| 73 |
+
},
|
| 74 |
+
{
|
| 75 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf",
|
| 76 |
+
"relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_M.gguf",
|
| 77 |
+
"family": "gemma-4-31b-it",
|
| 78 |
+
"publisher": "unsloth",
|
| 79 |
+
"basename": "gemma-4-31B-it-Q4_K_M.gguf",
|
| 80 |
+
"size": 18323733440,
|
| 81 |
+
"publisher_relative_path": "gemma-4-31B-it-Q4_K_M.gguf"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf",
|
| 85 |
+
"relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-Q4_K_S.gguf",
|
| 86 |
+
"family": "gemma-4-31b-it",
|
| 87 |
+
"publisher": "unsloth",
|
| 88 |
+
"basename": "gemma-4-31B-it-Q4_K_S.gguf",
|
| 89 |
+
"size": 17399835584,
|
| 90 |
+
"publisher_relative_path": "gemma-4-31B-it-Q4_K_S.gguf"
|
| 91 |
+
},
|
| 92 |
+
{
|
| 93 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf",
|
| 94 |
+
"relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q3_K_XL.gguf",
|
| 95 |
+
"family": "gemma-4-31b-it",
|
| 96 |
+
"publisher": "unsloth",
|
| 97 |
+
"basename": "gemma-4-31B-it-UD-Q3_K_XL.gguf",
|
| 98 |
+
"size": 15380222912,
|
| 99 |
+
"publisher_relative_path": "gemma-4-31B-it-UD-Q3_K_XL.gguf"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"local_path": "/home/ubuntu/models/gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf",
|
| 103 |
+
"relative_path": "gemma-4-31b-it/unsloth/gemma-4-31B-it-UD-Q4_K_XL.gguf",
|
| 104 |
+
"family": "gemma-4-31b-it",
|
| 105 |
+
"publisher": "unsloth",
|
| 106 |
+
"basename": "gemma-4-31B-it-UD-Q4_K_XL.gguf",
|
| 107 |
+
"size": 18822970304,
|
| 108 |
+
"publisher_relative_path": "gemma-4-31B-it-UD-Q4_K_XL.gguf"
|
| 109 |
+
},
|
| 110 |
+
{
|
| 111 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf",
|
| 112 |
+
"relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_0.gguf",
|
| 113 |
+
"family": "gemma-4-e4b-it",
|
| 114 |
+
"publisher": "bartowski",
|
| 115 |
+
"basename": "google_gemma-4-E4B-it-Q4_0.gguf",
|
| 116 |
+
"size": 5223860704,
|
| 117 |
+
"publisher_relative_path": "google_gemma-4-E4B-it-Q4_0.gguf"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf",
|
| 121 |
+
"relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_1.gguf",
|
| 122 |
+
"family": "gemma-4-e4b-it",
|
| 123 |
+
"publisher": "bartowski",
|
| 124 |
+
"basename": "google_gemma-4-E4B-it-Q4_1.gguf",
|
| 125 |
+
"size": 5458479584,
|
| 126 |
+
"publisher_relative_path": "google_gemma-4-E4B-it-Q4_1.gguf"
|
| 127 |
+
},
|
| 128 |
+
{
|
| 129 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf",
|
| 130 |
+
"relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-Q4_K_M.gguf",
|
| 131 |
+
"family": "gemma-4-e4b-it",
|
| 132 |
+
"publisher": "bartowski",
|
| 133 |
+
"basename": "google_gemma-4-E4B-it-Q4_K_M.gguf",
|
| 134 |
+
"size": 5405170144,
|
| 135 |
+
"publisher_relative_path": "google_gemma-4-E4B-it-Q4_K_M.gguf"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf",
|
| 139 |
+
"relative_path": "gemma-4-e4b-it/bartowski/google_gemma-4-E4B-it-bf16.gguf",
|
| 140 |
+
"family": "gemma-4-e4b-it",
|
| 141 |
+
"publisher": "bartowski",
|
| 142 |
+
"basename": "google_gemma-4-E4B-it-bf16.gguf",
|
| 143 |
+
"size": 15053097184,
|
| 144 |
+
"publisher_relative_path": "google_gemma-4-E4B-it-bf16.gguf"
|
| 145 |
+
},
|
| 146 |
+
{
|
| 147 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf",
|
| 148 |
+
"relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-BF16.gguf",
|
| 149 |
+
"family": "gemma-4-e4b-it",
|
| 150 |
+
"publisher": "unsloth",
|
| 151 |
+
"basename": "gemma-4-E4B-it-BF16.gguf",
|
| 152 |
+
"size": 15053097856,
|
| 153 |
+
"publisher_relative_path": "gemma-4-E4B-it-BF16.gguf"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf",
|
| 157 |
+
"relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-IQ4_NL.gguf",
|
| 158 |
+
"family": "gemma-4-e4b-it",
|
| 159 |
+
"publisher": "unsloth",
|
| 160 |
+
"basename": "gemma-4-E4B-it-IQ4_NL.gguf",
|
| 161 |
+
"size": 4835839104,
|
| 162 |
+
"publisher_relative_path": "gemma-4-E4B-it-IQ4_NL.gguf"
|
| 163 |
+
},
|
| 164 |
+
{
|
| 165 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf",
|
| 166 |
+
"relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_M.gguf",
|
| 167 |
+
"family": "gemma-4-e4b-it",
|
| 168 |
+
"publisher": "unsloth",
|
| 169 |
+
"basename": "gemma-4-E4B-it-Q4_K_M.gguf",
|
| 170 |
+
"size": 4977171584,
|
| 171 |
+
"publisher_relative_path": "gemma-4-E4B-it-Q4_K_M.gguf"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"local_path": "/home/ubuntu/models/gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf",
|
| 175 |
+
"relative_path": "gemma-4-e4b-it/unsloth/gemma-4-E4B-it-Q4_K_S.gguf",
|
| 176 |
+
"family": "gemma-4-e4b-it",
|
| 177 |
+
"publisher": "unsloth",
|
| 178 |
+
"basename": "gemma-4-E4B-it-Q4_K_S.gguf",
|
| 179 |
+
"size": 4844850304,
|
| 180 |
+
"publisher_relative_path": "gemma-4-E4B-it-Q4_K_S.gguf"
|
| 181 |
+
},
|
| 182 |
+
{
|
| 183 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 184 |
+
"relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 185 |
+
"family": "glm-4.6v-flash",
|
| 186 |
+
"publisher": "bartowski",
|
| 187 |
+
"basename": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 188 |
+
"size": 5465179264,
|
| 189 |
+
"publisher_relative_path": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf",
|
| 193 |
+
"relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf",
|
| 194 |
+
"family": "glm-4.6v-flash",
|
| 195 |
+
"publisher": "bartowski",
|
| 196 |
+
"basename": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf",
|
| 197 |
+
"size": 5739775104,
|
| 198 |
+
"publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf"
|
| 199 |
+
},
|
| 200 |
+
{
|
| 201 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf",
|
| 202 |
+
"relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_0.gguf",
|
| 203 |
+
"family": "glm-4.6v-flash",
|
| 204 |
+
"publisher": "bartowski",
|
| 205 |
+
"basename": "zai-org_GLM-4.6V-Flash-Q4_0.gguf",
|
| 206 |
+
"size": 5477467264,
|
| 207 |
+
"publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_0.gguf"
|
| 208 |
+
},
|
| 209 |
+
{
|
| 210 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf",
|
| 211 |
+
"relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_1.gguf",
|
| 212 |
+
"family": "glm-4.6v-flash",
|
| 213 |
+
"publisher": "bartowski",
|
| 214 |
+
"basename": "zai-org_GLM-4.6V-Flash-Q4_1.gguf",
|
| 215 |
+
"size": 6008603776,
|
| 216 |
+
"publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_1.gguf"
|
| 217 |
+
},
|
| 218 |
+
{
|
| 219 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 220 |
+
"relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 221 |
+
"family": "glm-4.6v-flash",
|
| 222 |
+
"publisher": "bartowski",
|
| 223 |
+
"basename": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 224 |
+
"size": 6166578304,
|
| 225 |
+
"publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf"
|
| 226 |
+
},
|
| 227 |
+
{
|
| 228 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 229 |
+
"relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 230 |
+
"family": "glm-4.6v-flash",
|
| 231 |
+
"publisher": "bartowski",
|
| 232 |
+
"basename": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 233 |
+
"size": 5758485632,
|
| 234 |
+
"publisher_relative_path": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf"
|
| 235 |
+
},
|
| 236 |
+
{
|
| 237 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 238 |
+
"relative_path": "glm-4.6v-flash/bartowski/zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 239 |
+
"family": "glm-4.6v-flash",
|
| 240 |
+
"publisher": "bartowski",
|
| 241 |
+
"basename": "zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 242 |
+
"size": 18811585376,
|
| 243 |
+
"publisher_relative_path": "zai-org_GLM-4.6V-Flash-bf16.gguf"
|
| 244 |
+
},
|
| 245 |
+
{
|
| 246 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 247 |
+
"relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 248 |
+
"family": "glm-4.6v-flash",
|
| 249 |
+
"publisher": "unsloth",
|
| 250 |
+
"basename": "GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 251 |
+
"size": 5465179744,
|
| 252 |
+
"publisher_relative_path": "GLM-4.6V-Flash-IQ4_NL.gguf"
|
| 253 |
+
},
|
| 254 |
+
{
|
| 255 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf",
|
| 256 |
+
"relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_0.gguf",
|
| 257 |
+
"family": "glm-4.6v-flash",
|
| 258 |
+
"publisher": "unsloth",
|
| 259 |
+
"basename": "GLM-4.6V-Flash-Q4_0.gguf",
|
| 260 |
+
"size": 5477467744,
|
| 261 |
+
"publisher_relative_path": "GLM-4.6V-Flash-Q4_0.gguf"
|
| 262 |
+
},
|
| 263 |
+
{
|
| 264 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf",
|
| 265 |
+
"relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_1.gguf",
|
| 266 |
+
"family": "glm-4.6v-flash",
|
| 267 |
+
"publisher": "unsloth",
|
| 268 |
+
"basename": "GLM-4.6V-Flash-Q4_1.gguf",
|
| 269 |
+
"size": 6008604256,
|
| 270 |
+
"publisher_relative_path": "GLM-4.6V-Flash-Q4_1.gguf"
|
| 271 |
+
},
|
| 272 |
+
{
|
| 273 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 274 |
+
"relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 275 |
+
"family": "glm-4.6v-flash",
|
| 276 |
+
"publisher": "unsloth",
|
| 277 |
+
"basename": "GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 278 |
+
"size": 6166578784,
|
| 279 |
+
"publisher_relative_path": "GLM-4.6V-Flash-Q4_K_M.gguf"
|
| 280 |
+
},
|
| 281 |
+
{
|
| 282 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 283 |
+
"relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 284 |
+
"family": "glm-4.6v-flash",
|
| 285 |
+
"publisher": "unsloth",
|
| 286 |
+
"basename": "GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 287 |
+
"size": 5758486112,
|
| 288 |
+
"publisher_relative_path": "GLM-4.6V-Flash-Q4_K_S.gguf"
|
| 289 |
+
},
|
| 290 |
+
{
|
| 291 |
+
"local_path": "/home/ubuntu/models/glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf",
|
| 292 |
+
"relative_path": "glm-4.6v-flash/unsloth/GLM-4.6V-Flash-UD-Q4_K_XL.gguf",
|
| 293 |
+
"family": "glm-4.6v-flash",
|
| 294 |
+
"publisher": "unsloth",
|
| 295 |
+
"basename": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf",
|
| 296 |
+
"size": 6187353696,
|
| 297 |
+
"publisher_relative_path": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf"
|
| 298 |
+
},
|
| 299 |
+
{
|
| 300 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf",
|
| 301 |
+
"relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf",
|
| 302 |
+
"family": "internvl3.5-30b-a3b",
|
| 303 |
+
"publisher": "bartowski",
|
| 304 |
+
"basename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf",
|
| 305 |
+
"size": 14855269280,
|
| 306 |
+
"publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf"
|
| 307 |
+
},
|
| 308 |
+
{
|
| 309 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf",
|
| 310 |
+
"relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf",
|
| 311 |
+
"family": "internvl3.5-30b-a3b",
|
| 312 |
+
"publisher": "bartowski",
|
| 313 |
+
"basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf",
|
| 314 |
+
"size": 17631642528,
|
| 315 |
+
"publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf"
|
| 316 |
+
},
|
| 317 |
+
{
|
| 318 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf",
|
| 319 |
+
"relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf",
|
| 320 |
+
"family": "internvl3.5-30b-a3b",
|
| 321 |
+
"publisher": "bartowski",
|
| 322 |
+
"basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf",
|
| 323 |
+
"size": 19214517152,
|
| 324 |
+
"publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf"
|
| 325 |
+
},
|
| 326 |
+
{
|
| 327 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf",
|
| 328 |
+
"relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf",
|
| 329 |
+
"family": "internvl3.5-30b-a3b",
|
| 330 |
+
"publisher": "bartowski",
|
| 331 |
+
"basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf",
|
| 332 |
+
"size": 18632180640,
|
| 333 |
+
"publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf"
|
| 334 |
+
},
|
| 335 |
+
{
|
| 336 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf",
|
| 337 |
+
"relative_path": "internvl3.5-30b-a3b/bartowski/OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf",
|
| 338 |
+
"family": "internvl3.5-30b-a3b",
|
| 339 |
+
"publisher": "bartowski",
|
| 340 |
+
"basename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf",
|
| 341 |
+
"size": 17984488352,
|
| 342 |
+
"publisher_relative_path": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf"
|
| 343 |
+
},
|
| 344 |
+
{
|
| 345 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf",
|
| 346 |
+
"relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf",
|
| 347 |
+
"family": "internvl3.5-30b-a3b",
|
| 348 |
+
"publisher": "bartowski",
|
| 349 |
+
"basename": "OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf",
|
| 350 |
+
"size": 39717427296,
|
| 351 |
+
"publisher_relative_path": "bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf"
|
| 352 |
+
},
|
| 353 |
+
{
|
| 354 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf",
|
| 355 |
+
"relative_path": "internvl3.5-30b-a3b/bartowski/bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf",
|
| 356 |
+
"family": "internvl3.5-30b-a3b",
|
| 357 |
+
"publisher": "bartowski",
|
| 358 |
+
"basename": "OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf",
|
| 359 |
+
"size": 21378372352,
|
| 360 |
+
"publisher_relative_path": "bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf"
|
| 361 |
+
},
|
| 362 |
+
{
|
| 363 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf",
|
| 364 |
+
"relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_M.gguf",
|
| 365 |
+
"family": "internvl3.5-30b-a3b",
|
| 366 |
+
"publisher": "mradermacher",
|
| 367 |
+
"basename": "InternVL3_5-30B-A3B.Q4_K_M.gguf",
|
| 368 |
+
"size": 18556683552,
|
| 369 |
+
"publisher_relative_path": "InternVL3_5-30B-A3B.Q4_K_M.gguf"
|
| 370 |
+
},
|
| 371 |
+
{
|
| 372 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf",
|
| 373 |
+
"relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.Q4_K_S.gguf",
|
| 374 |
+
"family": "internvl3.5-30b-a3b",
|
| 375 |
+
"publisher": "mradermacher",
|
| 376 |
+
"basename": "InternVL3_5-30B-A3B.Q4_K_S.gguf",
|
| 377 |
+
"size": 17456006432,
|
| 378 |
+
"publisher_relative_path": "InternVL3_5-30B-A3B.Q4_K_S.gguf"
|
| 379 |
+
},
|
| 380 |
+
{
|
| 381 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf",
|
| 382 |
+
"relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_0.gguf",
|
| 383 |
+
"family": "internvl3.5-30b-a3b",
|
| 384 |
+
"publisher": "mradermacher",
|
| 385 |
+
"basename": "InternVL3_5-30B-A3B.i1-Q4_0.gguf",
|
| 386 |
+
"size": 17379984928,
|
| 387 |
+
"publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_0.gguf"
|
| 388 |
+
},
|
| 389 |
+
{
|
| 390 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf",
|
| 391 |
+
"relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_1.gguf",
|
| 392 |
+
"family": "internvl3.5-30b-a3b",
|
| 393 |
+
"publisher": "mradermacher",
|
| 394 |
+
"basename": "InternVL3_5-30B-A3B.i1-Q4_1.gguf",
|
| 395 |
+
"size": 19192497696,
|
| 396 |
+
"publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_1.gguf"
|
| 397 |
+
},
|
| 398 |
+
{
|
| 399 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf",
|
| 400 |
+
"relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_M.gguf",
|
| 401 |
+
"family": "internvl3.5-30b-a3b",
|
| 402 |
+
"publisher": "mradermacher",
|
| 403 |
+
"basename": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf",
|
| 404 |
+
"size": 18556683808,
|
| 405 |
+
"publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf"
|
| 406 |
+
},
|
| 407 |
+
{
|
| 408 |
+
"local_path": "/home/ubuntu/models/internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf",
|
| 409 |
+
"relative_path": "internvl3.5-30b-a3b/mradermacher/InternVL3_5-30B-A3B.i1-Q4_K_S.gguf",
|
| 410 |
+
"family": "internvl3.5-30b-a3b",
|
| 411 |
+
"publisher": "mradermacher",
|
| 412 |
+
"basename": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf",
|
| 413 |
+
"size": 17456006688,
|
| 414 |
+
"publisher_relative_path": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf"
|
| 415 |
+
},
|
| 416 |
+
{
|
| 417 |
+
"local_path": "/home/ubuntu/models/kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 418 |
+
"relative_path": "kimi-vl-a3b-separate/kimi-vl-a3b-thinking-2506/ggml-org/Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 419 |
+
"family": "kimi-vl-a3b-separate",
|
| 420 |
+
"publisher": "ggml-org",
|
| 421 |
+
"basename": "Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 422 |
+
"size": 31934229408,
|
| 423 |
+
"publisher_relative_path": "Kimi-VL-A3B-Thinking-2506-bf16.gguf"
|
| 424 |
+
},
|
| 425 |
+
{
|
| 426 |
+
"local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf",
|
| 427 |
+
"relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_0.gguf",
|
| 428 |
+
"family": "muse-glimmer-30b",
|
| 429 |
+
"publisher": "bartowski",
|
| 430 |
+
"basename": "Muse-Glimmer-30B-Q4_0.gguf",
|
| 431 |
+
"size": 16265565216,
|
| 432 |
+
"publisher_relative_path": "Muse-Glimmer-30B-Q4_0.gguf"
|
| 433 |
+
},
|
| 434 |
+
{
|
| 435 |
+
"local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf",
|
| 436 |
+
"relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_1.gguf",
|
| 437 |
+
"family": "muse-glimmer-30b",
|
| 438 |
+
"publisher": "bartowski",
|
| 439 |
+
"basename": "Muse-Glimmer-30B-Q4_1.gguf",
|
| 440 |
+
"size": 17828207648,
|
| 441 |
+
"publisher_relative_path": "Muse-Glimmer-30B-Q4_1.gguf"
|
| 442 |
+
},
|
| 443 |
+
{
|
| 444 |
+
"local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf",
|
| 445 |
+
"relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_M.gguf",
|
| 446 |
+
"family": "muse-glimmer-30b",
|
| 447 |
+
"publisher": "bartowski",
|
| 448 |
+
"basename": "Muse-Glimmer-30B-Q4_K_M.gguf",
|
| 449 |
+
"size": 17306324000,
|
| 450 |
+
"publisher_relative_path": "Muse-Glimmer-30B-Q4_K_M.gguf"
|
| 451 |
+
},
|
| 452 |
+
{
|
| 453 |
+
"local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf",
|
| 454 |
+
"relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-Q4_K_S.gguf",
|
| 455 |
+
"family": "muse-glimmer-30b",
|
| 456 |
+
"publisher": "bartowski",
|
| 457 |
+
"basename": "Muse-Glimmer-30B-Q4_K_S.gguf",
|
| 458 |
+
"size": 16320943136,
|
| 459 |
+
"publisher_relative_path": "Muse-Glimmer-30B-Q4_K_S.gguf"
|
| 460 |
+
},
|
| 461 |
+
{
|
| 462 |
+
"local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf",
|
| 463 |
+
"relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf",
|
| 464 |
+
"family": "muse-glimmer-30b",
|
| 465 |
+
"publisher": "bartowski",
|
| 466 |
+
"basename": "Muse-Glimmer-30B-bf16-00001-of-00002.gguf",
|
| 467 |
+
"size": 39750446272,
|
| 468 |
+
"publisher_relative_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf"
|
| 469 |
+
},
|
| 470 |
+
{
|
| 471 |
+
"local_path": "/home/ubuntu/models/muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf",
|
| 472 |
+
"relative_path": "muse-glimmer-30b/bartowski/Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf",
|
| 473 |
+
"family": "muse-glimmer-30b",
|
| 474 |
+
"publisher": "bartowski",
|
| 475 |
+
"basename": "Muse-Glimmer-30B-bf16-00002-of-00002.gguf",
|
| 476 |
+
"size": 15975065088,
|
| 477 |
+
"publisher_relative_path": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf"
|
| 478 |
+
},
|
| 479 |
+
{
|
| 480 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf",
|
| 481 |
+
"relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_0.gguf",
|
| 482 |
+
"family": "qwen3.5-4b",
|
| 483 |
+
"publisher": "bartowski",
|
| 484 |
+
"basename": "Qwen_Qwen3.5-4B-Q4_0.gguf",
|
| 485 |
+
"size": 2776033248,
|
| 486 |
+
"publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_0.gguf"
|
| 487 |
+
},
|
| 488 |
+
{
|
| 489 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf",
|
| 490 |
+
"relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_1.gguf",
|
| 491 |
+
"family": "qwen3.5-4b",
|
| 492 |
+
"publisher": "bartowski",
|
| 493 |
+
"basename": "Qwen_Qwen3.5-4B-Q4_1.gguf",
|
| 494 |
+
"size": 2979850208,
|
| 495 |
+
"publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_1.gguf"
|
| 496 |
+
},
|
| 497 |
+
{
|
| 498 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf",
|
| 499 |
+
"relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_M.gguf",
|
| 500 |
+
"family": "qwen3.5-4b",
|
| 501 |
+
"publisher": "bartowski",
|
| 502 |
+
"basename": "Qwen_Qwen3.5-4B-Q4_K_M.gguf",
|
| 503 |
+
"size": 3013027808,
|
| 504 |
+
"publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_K_M.gguf"
|
| 505 |
+
},
|
| 506 |
+
{
|
| 507 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf",
|
| 508 |
+
"relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-Q4_K_S.gguf",
|
| 509 |
+
"family": "qwen3.5-4b",
|
| 510 |
+
"publisher": "bartowski",
|
| 511 |
+
"basename": "Qwen_Qwen3.5-4B-Q4_K_S.gguf",
|
| 512 |
+
"size": 2846156768,
|
| 513 |
+
"publisher_relative_path": "Qwen_Qwen3.5-4B-Q4_K_S.gguf"
|
| 514 |
+
},
|
| 515 |
+
{
|
| 516 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf",
|
| 517 |
+
"relative_path": "qwen3.5-4b/bartowski/Qwen_Qwen3.5-4B-bf16.gguf",
|
| 518 |
+
"family": "qwen3.5-4b",
|
| 519 |
+
"publisher": "bartowski",
|
| 520 |
+
"basename": "Qwen_Qwen3.5-4B-bf16.gguf",
|
| 521 |
+
"size": 8665620192,
|
| 522 |
+
"publisher_relative_path": "Qwen_Qwen3.5-4B-bf16.gguf"
|
| 523 |
+
},
|
| 524 |
+
{
|
| 525 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf",
|
| 526 |
+
"relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-BF16.gguf",
|
| 527 |
+
"family": "qwen3.5-4b",
|
| 528 |
+
"publisher": "unsloth",
|
| 529 |
+
"basename": "Qwen3.5-4B-BF16.gguf",
|
| 530 |
+
"size": 8424393632,
|
| 531 |
+
"publisher_relative_path": "Qwen3.5-4B-BF16.gguf"
|
| 532 |
+
},
|
| 533 |
+
{
|
| 534 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf",
|
| 535 |
+
"relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-IQ4_NL.gguf",
|
| 536 |
+
"family": "qwen3.5-4b",
|
| 537 |
+
"publisher": "unsloth",
|
| 538 |
+
"basename": "Qwen3.5-4B-IQ4_NL.gguf",
|
| 539 |
+
"size": 2579944608,
|
| 540 |
+
"publisher_relative_path": "Qwen3.5-4B-IQ4_NL.gguf"
|
| 541 |
+
},
|
| 542 |
+
{
|
| 543 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf",
|
| 544 |
+
"relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_0.gguf",
|
| 545 |
+
"family": "qwen3.5-4b",
|
| 546 |
+
"publisher": "unsloth",
|
| 547 |
+
"basename": "Qwen3.5-4B-Q4_0.gguf",
|
| 548 |
+
"size": 2583221408,
|
| 549 |
+
"publisher_relative_path": "Qwen3.5-4B-Q4_0.gguf"
|
| 550 |
+
},
|
| 551 |
+
{
|
| 552 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf",
|
| 553 |
+
"relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_1.gguf",
|
| 554 |
+
"family": "qwen3.5-4b",
|
| 555 |
+
"publisher": "unsloth",
|
| 556 |
+
"basename": "Qwen3.5-4B-Q4_1.gguf",
|
| 557 |
+
"size": 2784416928,
|
| 558 |
+
"publisher_relative_path": "Qwen3.5-4B-Q4_1.gguf"
|
| 559 |
+
},
|
| 560 |
+
{
|
| 561 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf",
|
| 562 |
+
"relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_M.gguf",
|
| 563 |
+
"family": "qwen3.5-4b",
|
| 564 |
+
"publisher": "unsloth",
|
| 565 |
+
"basename": "Qwen3.5-4B-Q4_K_M.gguf",
|
| 566 |
+
"size": 2740937888,
|
| 567 |
+
"publisher_relative_path": "Qwen3.5-4B-Q4_K_M.gguf"
|
| 568 |
+
},
|
| 569 |
+
{
|
| 570 |
+
"local_path": "/home/ubuntu/models/qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf",
|
| 571 |
+
"relative_path": "qwen3.5-4b/unsloth/Qwen3.5-4B-Q4_K_S.gguf",
|
| 572 |
+
"family": "qwen3.5-4b",
|
| 573 |
+
"publisher": "unsloth",
|
| 574 |
+
"basename": "Qwen3.5-4B-Q4_K_S.gguf",
|
| 575 |
+
"size": 2590430368,
|
| 576 |
+
"publisher_relative_path": "Qwen3.5-4B-Q4_K_S.gguf"
|
| 577 |
+
},
|
| 578 |
+
{
|
| 579 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf",
|
| 580 |
+
"relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf",
|
| 581 |
+
"family": "qwen3.6-35b-a3b",
|
| 582 |
+
"publisher": "bartowski",
|
| 583 |
+
"basename": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf",
|
| 584 |
+
"size": 19699553920,
|
| 585 |
+
"publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf"
|
| 586 |
+
},
|
| 587 |
+
{
|
| 588 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf",
|
| 589 |
+
"relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf",
|
| 590 |
+
"family": "qwen3.6-35b-a3b",
|
| 591 |
+
"publisher": "bartowski",
|
| 592 |
+
"basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf",
|
| 593 |
+
"size": 22662526592,
|
| 594 |
+
"publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf"
|
| 595 |
+
},
|
| 596 |
+
{
|
| 597 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf",
|
| 598 |
+
"relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf",
|
| 599 |
+
"family": "qwen3.6-35b-a3b",
|
| 600 |
+
"publisher": "bartowski",
|
| 601 |
+
"basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf",
|
| 602 |
+
"size": 22285080192,
|
| 603 |
+
"publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf"
|
| 604 |
+
},
|
| 605 |
+
{
|
| 606 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf",
|
| 607 |
+
"relative_path": "qwen3.6-35b-a3b/bartowski/Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf",
|
| 608 |
+
"family": "qwen3.6-35b-a3b",
|
| 609 |
+
"publisher": "bartowski",
|
| 610 |
+
"basename": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf",
|
| 611 |
+
"size": 21486360192,
|
| 612 |
+
"publisher_relative_path": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf"
|
| 613 |
+
},
|
| 614 |
+
{
|
| 615 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf",
|
| 616 |
+
"relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf",
|
| 617 |
+
"family": "qwen3.6-35b-a3b",
|
| 618 |
+
"publisher": "bartowski",
|
| 619 |
+
"basename": "Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf",
|
| 620 |
+
"size": 39753375712,
|
| 621 |
+
"publisher_relative_path": "BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf"
|
| 622 |
+
},
|
| 623 |
+
{
|
| 624 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf",
|
| 625 |
+
"relative_path": "qwen3.6-35b-a3b/bartowski/BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf",
|
| 626 |
+
"family": "qwen3.6-35b-a3b",
|
| 627 |
+
"publisher": "bartowski",
|
| 628 |
+
"basename": "Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf",
|
| 629 |
+
"size": 31312565824,
|
| 630 |
+
"publisher_relative_path": "BF16/Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf"
|
| 631 |
+
},
|
| 632 |
+
{
|
| 633 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf",
|
| 634 |
+
"relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf",
|
| 635 |
+
"family": "qwen3.6-35b-a3b",
|
| 636 |
+
"publisher": "unsloth",
|
| 637 |
+
"basename": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf",
|
| 638 |
+
"size": 16845511648,
|
| 639 |
+
"publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf"
|
| 640 |
+
},
|
| 641 |
+
{
|
| 642 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf",
|
| 643 |
+
"relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf",
|
| 644 |
+
"family": "qwen3.6-35b-a3b",
|
| 645 |
+
"publisher": "unsloth",
|
| 646 |
+
"basename": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf",
|
| 647 |
+
"size": 22134528992,
|
| 648 |
+
"publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf"
|
| 649 |
+
},
|
| 650 |
+
{
|
| 651 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf",
|
| 652 |
+
"relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_S.gguf",
|
| 653 |
+
"family": "qwen3.6-35b-a3b",
|
| 654 |
+
"publisher": "unsloth",
|
| 655 |
+
"basename": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf",
|
| 656 |
+
"size": 20893015008,
|
| 657 |
+
"publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf"
|
| 658 |
+
},
|
| 659 |
+
{
|
| 660 |
+
"local_path": "/home/ubuntu/models/qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf",
|
| 661 |
+
"relative_path": "qwen3.6-35b-a3b/unsloth/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf",
|
| 662 |
+
"family": "qwen3.6-35b-a3b",
|
| 663 |
+
"publisher": "unsloth",
|
| 664 |
+
"basename": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf",
|
| 665 |
+
"size": 22360456160,
|
| 666 |
+
"publisher_relative_path": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf"
|
| 667 |
+
}
|
| 668 |
+
]
|
bpw/hf/repo-metadata/bartowski__Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF.json
ADDED
|
@@ -0,0 +1,192 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-GGUF",
|
| 4 |
+
"commit_sha": "b640dc2edd797ba606aa37481e9e0a94d248234a",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30697345596,
|
| 7 |
+
"architecture": "gemma4",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/gemma-4-31B-it-SDFT-Heretic-RP-GGUF/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-imatrix.gguf",
|
| 10 |
+
"chat_template": "{%- macro format_parameters(properties, required) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'OBJECT' -%}\n ,properties:{\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n {%- elif value is mapping -%}\n {{- format_parameters(value, value['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- if value['required'] -%}\n ,required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n ,items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('<channel|>') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- set ns = namespace(prev_message_type=None) -%}\n{%- set loop_messages = messages -%}\n{{ bos_token }}\n{#- Handle System/Tool Definitions Block -#}\n{%- if (enable_thinking is defined and enable_thinking) or tools or messages[0]['role'] in ['system', 'developer'] -%}\n {{- '<|turn>system\\n' -}}\n\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking is defined and enable_thinking -%}\n {{- '<|think|>' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n\n {%- if messages[0]['role'] in ['system', 'developer'] -%}\n {{- messages[0]['content'] | trim -}}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '<tool|>' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n\n {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {{- '<|turn>' + role + '\\n' }}\n\n {%- if message['tool_calls'] -%}\n {%- for tool_call in message['tool_calls'] -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is string -%}\n {{- function['arguments'] -}}\n {%- endif -%}\n {{- '}<tool_call|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- if message['tool_responses'] -%}\n {#- Tool Response handling -#}\n {%- for tool_response in message['tool_responses'] -%}\n {{- '<|tool_response>' -}}\n {%- if tool_response['response'] is mapping -%}\n {{- 'response:' + tool_response['name'] | default('unknown') + '{' -}}\n {%- for key, value in tool_response['response'] | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_response['name'] | default('unknown') + '{value:' + format_argument(tool_response['response'], escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '<tool_response|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n\n {%- if message['content'] is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message['content'] is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item['type'] == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item['type'] == 'image' -%}\n {{- '\\n\\n<|image|>\\n\\n' -}}\n {%- set ns.prev_message_type = 'image' -%}\n {%- elif item['type'] == 'audio' -%}\n {{- '<|audio|>' -}}\n {%- set ns.prev_message_type = 'audio' -%}\n {%- elif item['type'] == 'video' -%}\n {{- '\\n\\n<|video|>\\n\\n' -}}\n {%- set ns.prev_message_type = 'video' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- if not (message['tool_responses'] and not message['content']) -%}\n {{- '<turn|>\\n' -}}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' -%}\n {{- '<|turn>model\\n' -}}\n {%- endif -%}\n {%- if not enable_thinking | default(false) -%}\n {{- '<|channel>thought\\n<channel|>' -}}\n {%- endif -%}\n{%- endif -%}\n",
|
| 11 |
+
"bos_token": "<bos>",
|
| 12 |
+
"eos_token": "<eos>",
|
| 13 |
+
"totalFileSize": 12649767072
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.239945+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ2_M.gguf",
|
| 19 |
+
"size": 12649767072,
|
| 20 |
+
"blob_id": "14ecb00e7292addfc4639bb58921d0105ce46ab8",
|
| 21 |
+
"lfs_sha256": "55a49b11f26673fde09ab5cfd8a4ae885fb50885a05123aceaa68e2a3baab8c0"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ2_S.gguf",
|
| 25 |
+
"size": 12075352224,
|
| 26 |
+
"blob_id": "af09c79fca1bbbbee9613f78e32acfba92653183",
|
| 27 |
+
"lfs_sha256": "3765c4379801ad4e62f07a457647a265eee7d490e73b9bebe868402b9f41fca8"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ2_XS.gguf",
|
| 31 |
+
"size": 11500937376,
|
| 32 |
+
"blob_id": "1916fd6d3d623c030383847fb3c503ef82b8fef5",
|
| 33 |
+
"lfs_sha256": "6c8975f7f1af3dde6ad4d62914884a6e6ab89f28379ebde8ae321acce7a0d4e5"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ2_XXS.gguf",
|
| 37 |
+
"size": 10830184608,
|
| 38 |
+
"blob_id": "6642c7aeaf4d9ece530ae8d835b8144428faad75",
|
| 39 |
+
"lfs_sha256": "c4065eadd5fd373bca8490c0940c79e3b2a007bc46ef98bdd4fbdc147a43855a"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ3_M.gguf",
|
| 43 |
+
"size": 15129823392,
|
| 44 |
+
"blob_id": "a90b39f46dd1faea9024b8fd2b6b845d86814dd6",
|
| 45 |
+
"lfs_sha256": "b3cc388a8b4bdf9e47b9da7e04449f2c63d9f6a49c39bd6168f3fd412b703ee2"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ3_XS.gguf",
|
| 49 |
+
"size": 13841346720,
|
| 50 |
+
"blob_id": "03defdf602713df7a7e200cd45ea0a2b1a0c52fd",
|
| 51 |
+
"lfs_sha256": "1ae7144f8c1ff2bcf0f370ac0d9718cdcfdbdd4353b2a2eae8ab4b4b3ed1f760"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ3_XXS.gguf",
|
| 55 |
+
"size": 12981702816,
|
| 56 |
+
"blob_id": "45682e85bec9f5e36ffb90d039b5929cb270709d",
|
| 57 |
+
"lfs_sha256": "d995def263dd44ee743bad7649d322d60ca518927c6cb28db25a648c302495b8"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ4_NL.gguf",
|
| 61 |
+
"size": 18025681056,
|
| 62 |
+
"blob_id": "2c2fb842216654a285c56e0cd327500c550e57aa",
|
| 63 |
+
"lfs_sha256": "44b07662209a93e5157eb12047a7e33886bdefc31666d3a839dcfac43e3d74f6"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-IQ4_XS.gguf",
|
| 67 |
+
"size": 17155887264,
|
| 68 |
+
"blob_id": "4fbe4a3219c65bd0ad064c6eb06d79426ce4754a",
|
| 69 |
+
"lfs_sha256": "52ca836c369ce8f2ff037d721f3efc396e46209653cb98a3cba1113273b082cf"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q2_K.gguf",
|
| 73 |
+
"size": 12631617696,
|
| 74 |
+
"blob_id": "a47c0aab70a50ccc52a734ae8d459e46827e671b",
|
| 75 |
+
"lfs_sha256": "7e42e1787a73698d6760c6a5cc4153a2e89f756ba3ac9583e6ccd8e10a5d0b1a"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q2_K_L.gguf",
|
| 79 |
+
"size": 12972929184,
|
| 80 |
+
"blob_id": "156e7627cb43393ad40e9470b86b14b55ec3ce73",
|
| 81 |
+
"lfs_sha256": "f50f3d90fd26571688e49499584419f8be4c20335d652f25b4b9624e1bf6755c"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q3_K_L.gguf",
|
| 85 |
+
"size": 16810619040,
|
| 86 |
+
"blob_id": "71cf43704a821450f4649c441dd5c18d990cb090",
|
| 87 |
+
"lfs_sha256": "195e51bc44a9dcd2a5b6ced3b2a9adedb959e376ca28caee196e781c4800240e"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q3_K_M.gguf",
|
| 91 |
+
"size": 15918117024,
|
| 92 |
+
"blob_id": "edaebfb9910975fc92d6be4c4cfe13a02cf84560",
|
| 93 |
+
"lfs_sha256": "380de2521a640ec2317cb4125c4aeb12f7b97a49544ec2390dd6dd5cf5ff1cba"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q3_K_S.gguf",
|
| 97 |
+
"size": 14329057440,
|
| 98 |
+
"blob_id": "541d7d80150d3aa34fa20c17a091e00e89853582",
|
| 99 |
+
"lfs_sha256": "688864d2e287f429df504dab117c5d251ecf36a3c9834da2507ea02f1a6f9062"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q3_K_XL.gguf",
|
| 103 |
+
"size": 17151930528,
|
| 104 |
+
"blob_id": "c36ba28cafd7d2d09cc5e0f6727602953b2fed6f",
|
| 105 |
+
"lfs_sha256": "736a4cab5116a8624ec5885cf720967df9b39a0b7e09951338da3b4c907a9d20"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_0.gguf",
|
| 109 |
+
"size": 18076258464,
|
| 110 |
+
"blob_id": "15dd22bfc3612c7b0ac3c43f50640efa3004ea95",
|
| 111 |
+
"lfs_sha256": "666b7d150f1702d6339df32d7823cc4a1988408dc70ff5626bf28bfd356e6734"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_1.gguf",
|
| 115 |
+
"size": 19765268640,
|
| 116 |
+
"blob_id": "5d48a4e3f4e3c4433deefa477941a80d6f1d633e",
|
| 117 |
+
"lfs_sha256": "ff60c0ea65e48c8eb18833d1eb76650a73a1c26e537b879d265934e669068287"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_K_L.gguf",
|
| 121 |
+
"size": 19939795104,
|
| 122 |
+
"blob_id": "e546742e1986f8a924bbf3265d8fd30a4a839dc8",
|
| 123 |
+
"lfs_sha256": "95bd84cd967a480401108505fbc9a0b4769e8077d6c25654c06655ae6dce491b"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_K_M.gguf",
|
| 127 |
+
"size": 19598483616,
|
| 128 |
+
"blob_id": "2cbeb2af13ed3befb9402d43453ad28cac5fb068",
|
| 129 |
+
"lfs_sha256": "2666824f3cb8fd4225a1403f556e3aea8054cbe41edc0da28258a04204247d1b"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q4_K_S.gguf",
|
| 133 |
+
"size": 18195648672,
|
| 134 |
+
"blob_id": "31c5826b2b8d59fbbaf74c64f1084b458fe07712",
|
| 135 |
+
"lfs_sha256": "90f5d39c94f6c95e1abdf2c4d7b7796844096a4ec5b488c7c22272b5132735bd"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q5_K_L.gguf",
|
| 139 |
+
"size": 22950183072,
|
| 140 |
+
"blob_id": "b1c21812ebc03b15b8ae949afec7dd0b329a3020",
|
| 141 |
+
"lfs_sha256": "3b2dfdb09868e48c7ce93fd5c93859fb1a80f763aad9e09557f25585b5dc69e2"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q5_K_M.gguf",
|
| 145 |
+
"size": 22608871584,
|
| 146 |
+
"blob_id": "d6c6aec87ce7d70d93336a72c94ec4793a824c94",
|
| 147 |
+
"lfs_sha256": "4a5ba66b05f63e7426f5e42964efdad17925777a25169df488d109eef165b8e6"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q5_K_S.gguf",
|
| 151 |
+
"size": 21504856224,
|
| 152 |
+
"blob_id": "a7d931e6d3b00bdc6bfce5ee5ad560f07b2bcd79",
|
| 153 |
+
"lfs_sha256": "0323792fd9c31edfd7eb1bfb2a7ce23e2d04b5b2916650e37441dd31410f2134"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q6_K.gguf",
|
| 157 |
+
"size": 26726715552,
|
| 158 |
+
"blob_id": "1843864bb54620d2ddcd5af5972791a966557d26",
|
| 159 |
+
"lfs_sha256": "371c22ab732e88e6c3de86f4760c5f014fa64ab11954f010c89edc0d452b517b"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q6_K_L.gguf",
|
| 163 |
+
"size": 27068027040,
|
| 164 |
+
"blob_id": "b8ba05bbd5a7bf9dbf1f2ceb6b8b43993b03fcd4",
|
| 165 |
+
"lfs_sha256": "c110254f1c0be37abbbc8df21f478ce361f08185b92c0842389b89d24bec1803"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-Q8_0.gguf",
|
| 169 |
+
"size": 32635670688,
|
| 170 |
+
"blob_id": "0175c8d50952a61977c8ebfb95ecac3cdaaa437c",
|
| 171 |
+
"lfs_sha256": "f1f6b0b8e60f0cd42334a034086b902f6bf46dd9188d27c9264875da66d7883f"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-bf16/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-bf16-00001-of-00002.gguf",
|
| 175 |
+
"size": 39897585184,
|
| 176 |
+
"blob_id": "522d0fdb7a7e46c852c8c883c6ce04e4f9a5c501",
|
| 177 |
+
"lfs_sha256": "e890a0ba36451fb3ad546c10b156f57eb7daaa27c8b58a58c20b6d86e762c461"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-bf16/Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-bf16-00002-of-00002.gguf",
|
| 181 |
+
"size": 21515598368,
|
| 182 |
+
"blob_id": "d16c511ad1eb2b3d73f37d4088af6ec9fb42a567",
|
| 183 |
+
"lfs_sha256": "afcde166963c04e07308c40040384679dd56d4bb16793c88c839ef6a697844ed"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "Ilya626_gemma-4-31B-it-SDFT-Heretic-RP-imatrix.gguf",
|
| 187 |
+
"size": 13753952,
|
| 188 |
+
"blob_id": "aab5ddeb89e9dc1af94e85cdbf41906494387dc6",
|
| 189 |
+
"lfs_sha256": "58e6b4df839e2b61c6d1f60f4ddf5e067e3dc2bd15794ffe2bd050377c16b1d1"
|
| 190 |
+
}
|
| 191 |
+
]
|
| 192 |
+
}
|
bpw/hf/repo-metadata/bartowski__Jackrong_Qwen3.5-4B-Neo-GGUF.json
ADDED
|
@@ -0,0 +1,178 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/Jackrong_Qwen3.5-4B-Neo-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/Jackrong_Qwen3.5-4B-Neo-GGUF",
|
| 4 |
+
"commit_sha": "f4e97623ade9e56f8b2b2638c2ca6b3dac79d420",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 4205751296,
|
| 7 |
+
"architecture": "qwen35",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {{- messages[0].content + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0].content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" and message.content is string and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if message.content is string %}\n {%- set content = message.content %}\n {%- else %}\n {%- set content = '' %}\n {%- endif %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- if loop.index0 > ns.last_query_index %}\n {%- if loop.last or (not loop.last and reasoning_content) %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content.strip('\\n') + '\\n</think>\\n\\n' + content.lstrip('\\n') }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\n<think>\n' }}\n{%- endif %}",
|
| 10 |
+
"eos_token": "<|im_end|>",
|
| 11 |
+
"totalFileSize": 8424390400
|
| 12 |
+
},
|
| 13 |
+
"fetched_at_utc": "2026-09-06T11:32:08.134311+00:00",
|
| 14 |
+
"siblings": [
|
| 15 |
+
{
|
| 16 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ2_M.gguf",
|
| 17 |
+
"size": 1825570816,
|
| 18 |
+
"blob_id": "d874590d2b5fb87166dc70f932e0f5175195b478",
|
| 19 |
+
"lfs_sha256": "df4a00d5464ce73f61d40349f003d4704e2403932856b04632b5df5a3041a0ee"
|
| 20 |
+
},
|
| 21 |
+
{
|
| 22 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ3_M.gguf",
|
| 23 |
+
"size": 2355152896,
|
| 24 |
+
"blob_id": "1a9bf2f1a74b00e0a4cd5cff858df10f126adc2c",
|
| 25 |
+
"lfs_sha256": "3b4b7c2f874f494ef4ec7f3815fd95477561484f836bf29b3bc5897ed32b686d"
|
| 26 |
+
},
|
| 27 |
+
{
|
| 28 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ3_XS.gguf",
|
| 29 |
+
"size": 2275772416,
|
| 30 |
+
"blob_id": "dacf2f63cc9691d76854efb52ffbc65d80c4fe92",
|
| 31 |
+
"lfs_sha256": "85531556f84e0f4272a8a04c051248784fa4a5ee91f88e61248de6edf4c8d2df"
|
| 32 |
+
},
|
| 33 |
+
{
|
| 34 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ3_XXS.gguf",
|
| 35 |
+
"size": 2115649536,
|
| 36 |
+
"blob_id": "07846c81c25678cbb04b21c9fe59d784ee0205c3",
|
| 37 |
+
"lfs_sha256": "e6bd7340e26cf0d5a05da484821b23fd83f279042106ba82fc67adf304340359"
|
| 38 |
+
},
|
| 39 |
+
{
|
| 40 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ4_NL.gguf",
|
| 41 |
+
"size": 2647361536,
|
| 42 |
+
"blob_id": "08fba606f76f2b37ae4ddd7c3b3d0f691548ecc2",
|
| 43 |
+
"lfs_sha256": "7571e623dafdfb08e8d3df7e12cc782e7675d2426b7f98dde537e18f495e595c"
|
| 44 |
+
},
|
| 45 |
+
{
|
| 46 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-IQ4_XS.gguf",
|
| 47 |
+
"size": 2543159296,
|
| 48 |
+
"blob_id": "7bdf114601260391fbec6f562cf79a6dc77907d5",
|
| 49 |
+
"lfs_sha256": "e18e64e83f03c678101246757f8265e7008b588a5c3b4521b0f77789430ff328"
|
| 50 |
+
},
|
| 51 |
+
{
|
| 52 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q2_K.gguf",
|
| 53 |
+
"size": 2063599616,
|
| 54 |
+
"blob_id": "5ecbd521d9c2b10f0c926004bc0ce8ea1ed50608",
|
| 55 |
+
"lfs_sha256": "ae669306da9c337a93812b187db841d71052bc1f78910c178f7b1338f2315756"
|
| 56 |
+
},
|
| 57 |
+
{
|
| 58 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q2_K_L.gguf",
|
| 59 |
+
"size": 2217558016,
|
| 60 |
+
"blob_id": "d8410777d0efe889100a68583087d06dd8183a12",
|
| 61 |
+
"lfs_sha256": "54a00a30f18ff3790b0767e6e12700cdd5f500c53820a847f62b61d39bc3ef43"
|
| 62 |
+
},
|
| 63 |
+
{
|
| 64 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q3_K_L.gguf",
|
| 65 |
+
"size": 2537261056,
|
| 66 |
+
"blob_id": "81ddc81ea1cd6ff28c0905b20f445cde9d07ef49",
|
| 67 |
+
"lfs_sha256": "b50ee50b21cd65b63480d9e31211fc7465803e05447f5cee37c47bf6af572c9a"
|
| 68 |
+
},
|
| 69 |
+
{
|
| 70 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q3_K_M.gguf",
|
| 71 |
+
"size": 2447476736,
|
| 72 |
+
"blob_id": "4151f683f7ca190eb3f306264af8088e5c24a41b",
|
| 73 |
+
"lfs_sha256": "8e9286b1c28634afe4e3b4b0ae941c2568254b3d94562d8f4ce4faa3f92de24d"
|
| 74 |
+
},
|
| 75 |
+
{
|
| 76 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q3_K_S.gguf",
|
| 77 |
+
"size": 2326071296,
|
| 78 |
+
"blob_id": "b95bfd829b4c1c17282c2cfc446ccb5e0ea6370b",
|
| 79 |
+
"lfs_sha256": "187c8988b0d2d9c6993af06b2eb7f09fe9511979d388aa7108ce25bde9300e2f"
|
| 80 |
+
},
|
| 81 |
+
{
|
| 82 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q3_K_XL.gguf",
|
| 83 |
+
"size": 2691219456,
|
| 84 |
+
"blob_id": "c38f3f1d4486fff85f55c2fe08c421412146a23a",
|
| 85 |
+
"lfs_sha256": "8dba7a54a6d50297dea858d48e43157d740b154d25b4ff6f0b8333e4ce530ea2"
|
| 86 |
+
},
|
| 87 |
+
{
|
| 88 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_0.gguf",
|
| 89 |
+
"size": 2647853056,
|
| 90 |
+
"blob_id": "257cacb9f975b3791d20425cdbd996fb55069e95",
|
| 91 |
+
"lfs_sha256": "f7e2446e4182b0b9074d4a22cf1e46a83cd950f26d0db38590017543bd23fe9f"
|
| 92 |
+
},
|
| 93 |
+
{
|
| 94 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_1.gguf",
|
| 95 |
+
"size": 2851670016,
|
| 96 |
+
"blob_id": "c195f8e8c14920db79c5d97afb22fdd88f91e590",
|
| 97 |
+
"lfs_sha256": "71d1fedca2d4f558cfe879d903988fee42baa9c0463c3473a85756d5b74e304d"
|
| 98 |
+
},
|
| 99 |
+
{
|
| 100 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_K_L.gguf",
|
| 101 |
+
"size": 3038806016,
|
| 102 |
+
"blob_id": "dc74561ff4675df02316d1d216f9f16e6862120a",
|
| 103 |
+
"lfs_sha256": "63b209a71ac4c2a23f1ef68e8e7ce71b03fa8d8b10f26deb9adaf73ca2275b02"
|
| 104 |
+
},
|
| 105 |
+
{
|
| 106 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_K_M.gguf",
|
| 107 |
+
"size": 2884847616,
|
| 108 |
+
"blob_id": "00f5a7a90b85707aa2e310067c0a2f35569df128",
|
| 109 |
+
"lfs_sha256": "b18d3aa8f3ca8239515838e80d815cd6d2d4221255c4f1db13d804d5a0cf3a2a"
|
| 110 |
+
},
|
| 111 |
+
{
|
| 112 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q4_K_S.gguf",
|
| 113 |
+
"size": 2717976576,
|
| 114 |
+
"blob_id": "2130c938471ca660370fcdbe7b5c0cddc674dcbe",
|
| 115 |
+
"lfs_sha256": "c1a2a9d5ff82135a9699f57f3bf0c84d1996bb1eff4268373fe16cb4a256b7de"
|
| 116 |
+
},
|
| 117 |
+
{
|
| 118 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q5_K_L.gguf",
|
| 119 |
+
"size": 3469541376,
|
| 120 |
+
"blob_id": "b0af7dfa024ba1bc3c1e49c88d23c2c6188847d7",
|
| 121 |
+
"lfs_sha256": "36d439943ddfd2242491d5b763b2d7a01cfdad4c06a015c69784a680d54e56ab"
|
| 122 |
+
},
|
| 123 |
+
{
|
| 124 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q5_K_M.gguf",
|
| 125 |
+
"size": 3315582976,
|
| 126 |
+
"blob_id": "cf4cb9ea707065a8ce67ba61cc509a2804035747",
|
| 127 |
+
"lfs_sha256": "9cc15cb014245cd19273d766a5745f87a9087f54e78f57ecdc7e92b8bf1487af"
|
| 128 |
+
},
|
| 129 |
+
{
|
| 130 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q5_K_S.gguf",
|
| 131 |
+
"size": 3128231936,
|
| 132 |
+
"blob_id": "c065ee95c6ae4b94fd2e96511fa7efa26742a77b",
|
| 133 |
+
"lfs_sha256": "95543271ffa2ed21298183b8b493f3814bd95b6ee9de58cee6fbe185bfd4c58c"
|
| 134 |
+
},
|
| 135 |
+
{
|
| 136 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q6_K.gguf",
|
| 137 |
+
"size": 3677177856,
|
| 138 |
+
"blob_id": "d203a117f7c800ae7b923a425d1b61a38c44892d",
|
| 139 |
+
"lfs_sha256": "247c8d61f01c82f5468169f9f3bb832121626351f954d65cc76f146893745606"
|
| 140 |
+
},
|
| 141 |
+
{
|
| 142 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q6_K_L.gguf",
|
| 143 |
+
"size": 3831136256,
|
| 144 |
+
"blob_id": "595a70660f7b7ce5940d49cd5c137741d91f8699",
|
| 145 |
+
"lfs_sha256": "809f2465c330d44b6c9fd609ea63aa7a683c4782893a41b6feda760e68e78f60"
|
| 146 |
+
},
|
| 147 |
+
{
|
| 148 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-Q8_0.gguf",
|
| 149 |
+
"size": 4493950976,
|
| 150 |
+
"blob_id": "13f084bd493017558f5755c8cb2ca56823c371d2",
|
| 151 |
+
"lfs_sha256": "6283a7041646eab8cddec26ead89f84ef7badb34cdcecb02299ea27d59ad7a85"
|
| 152 |
+
},
|
| 153 |
+
{
|
| 154 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-bf16.gguf",
|
| 155 |
+
"size": 8424390400,
|
| 156 |
+
"blob_id": "eb8755f41b8cb129505b6646ebc08afa7708502e",
|
| 157 |
+
"lfs_sha256": "ec1f125483930cde203cfe318297d40ad9512c52491932a7c0d64557be948f29"
|
| 158 |
+
},
|
| 159 |
+
{
|
| 160 |
+
"rfilename": "Jackrong_Qwen3.5-4B-Neo-imatrix.gguf",
|
| 161 |
+
"size": 3626496,
|
| 162 |
+
"blob_id": "4839210600cefeb7a177bdb048b143baed68db23",
|
| 163 |
+
"lfs_sha256": "eef6a861b82a29fe0fa686c0bae29917dc96f30e6a3f28ec8db436d457169a55"
|
| 164 |
+
},
|
| 165 |
+
{
|
| 166 |
+
"rfilename": "mmproj-Jackrong_Qwen3.5-4B-Neo-bf16.gguf",
|
| 167 |
+
"size": 675569824,
|
| 168 |
+
"blob_id": "ae2b2903be94c04679a3377fd0ff86b73c64f447",
|
| 169 |
+
"lfs_sha256": "b20af89d1fecfa4301989b33b8b5abd38ffb5003fc5b0e5b31e89313eced58bd"
|
| 170 |
+
},
|
| 171 |
+
{
|
| 172 |
+
"rfilename": "mmproj-Jackrong_Qwen3.5-4B-Neo-f16.gguf",
|
| 173 |
+
"size": 672424096,
|
| 174 |
+
"blob_id": "3d9a8a9b5cfa13c1abcf84ad66cd651d179f6c8f",
|
| 175 |
+
"lfs_sha256": "19a8f418c003b9ab141d09bb2e0479f0f6a98a152970297d5dfaa18a1cbe771c"
|
| 176 |
+
}
|
| 177 |
+
]
|
| 178 |
+
}
|
bpw/hf/repo-metadata/bartowski__Muse-Glimmer-30B-GGUF.json
ADDED
|
@@ -0,0 +1,216 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/Muse-Glimmer-30B-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/Muse-Glimmer-30B-GGUF",
|
| 4 |
+
"commit_sha": "01e1b7c30e19e1823ee9a73dec51d12f59ec4857",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 27854794240,
|
| 7 |
+
"architecture": "muse-glimmer",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/Muse-Glimmer-30B-GGUF/Muse-Glimmer-30B-imatrix.gguf",
|
| 10 |
+
"chat_template": "{%- macro render_content(content) -%}{%- if content is string -%}{{- content -}}{%- elif content is not none -%}{%- for part in content -%}{%- if part['type'] == 'image' -%}{{- '<|patch|>' -}}{%- elif part['type'] == 'video' -%}{{- '<|video|>' -}}{%- elif part['type'] == 'text' -%}{{- part['text'] -}}{%- endif -%}{%- endfor -%}{%- endif -%}{%- endmacro -%}{%- macro render_atem(tc) -%}{%- set args = tc.function.arguments -%}{%- if args is not mapping -%}{{- raise_exception('Onyx ATEM chat template requires tool_call.function.arguments to be a dict (mapping); a JSON string cannot be parsed in the HF jinja sandbox.') -}}{%- endif -%}{{- '<atem:function_calls>\\n<atem:invoke name=\"' + tc.function.name + '\">\\n' -}}{%- for k, v in args.items() -%}{{- '<atem:parameter name=\"' + k + '\">' -}}{%- if v is boolean -%}{%- if v -%}true{%- else -%}false{%- endif -%}{%- elif v is none -%}null{%- elif v is mapping or (v is iterable and v is not string) -%}{{- v | tojson -}}{%- else -%}{{- v -}}{%- endif -%}{{- '</atem:parameter>\\n' -}}{%- endfor -%}{{- '</atem:invoke>\\n</atem:function_calls>' -}}{%- endmacro -%}{%- macro render_tool_defs(tools) -%}{{- 'In this environment you have access to a set of tools you can use to answer the user\\'s question.\\n\\n' -}}{{- 'You can invoke a function by writing a \"<atem:function_calls>\" block like the following:\\n' -}}{{- '<atem:function_calls>\\n<atem:invoke name=\"$FUNCTION_NAME\">\\n<atem:parameter name=\"$PARAMETER_NAME\">$PARAMETER_VALUE</atem:parameter>\\n...\\n</atem:invoke>\\n</atem:function_calls>\\n\\n' -}}{{- 'String and scalar parameters should be specified as is, while lists and objects should use JSON format. Note that spaces for string values are not stripped. The output is not expected to be valid XML and is parsed with regular expressions.\\n' -}}{{- 'Here are the functions available in JSONSchema format:\\n' -}}{{- '// Tool metadata\\n' -}}{%- set nsns = namespace(seen=[]) -%}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{%- set tns = fn.name.split('.')[0] -%}{%- if tns not in nsns.seen -%}{%- set nsns.seen = nsns.seen + [tns] -%}{%- endif -%}{%- endfor -%}{%- set nd = tool_namespace_descriptions if tool_namespace_descriptions is defined else {} -%}{%- for tns in nsns.seen -%}{{- '{\"name\": ' + (tns | tojson) + ', \"description\": ' + ((nd[tns] if tns in nd else '') | tojson) + '}\\n' -}}{%- endfor -%}{{- '// Function schemas' -}}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{{- '\\n{\"name\": ' + (fn.name | tojson) + ', \"description\": ' + (fn.description | tojson) + ', \"parameters\": ' + (fn.parameters | tojson) + '}' -}}{%- endfor -%}{{- '\\n\\nHere\\'s an example of how to call a function in the tool set:\\n' -}}{{- '(If the tool namespace is not specified, invoke the function directly as `example_function_name` rather than `example_tool_name.example_function_name`)\\n\\n' -}}{{- 'to=example_tool_name.example_function_name\\n\\n' -}}{{- '<atem:function_calls>\\n<atem:invoke name=\"example_tool_name.example_function_name\">\\n' -}}{{- '<atem:parameter name=\"example_parameter_1\">value_1</atem:parameter>\\n' -}}{{- '<atem:parameter name=\"example_parameter_2\">This is the value for the second parameter\\nthat can span\\n\"multiple\" lines\\n</atem:parameter>\\n' -}}{{- '</atem:invoke>\\n</atem:function_calls>' -}}{%- endmacro -%}{%- macro render_reasoning() -%}{%- set rs = reasoning_strength if reasoning_strength is defined and reasoning_strength else 'high' -%}{{- 'Reasoning strength: ' + rs + '.' -}}{%- endmacro -%}{%- macro render_system_meta(tools) -%}{%- set rns = namespace(recipients=['\"self\"'], nslist=[]) -%}{%- if tools -%}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{%- set tns = fn.name.split('.')[0] -%}{%- if tns not in rns.nslist -%}{%- set rns.nslist = rns.nslist + [tns] -%}{%- endif -%}{%- endfor -%}{%- for tns in rns.nslist -%}{%- set rns.recipients = rns.recipients + ['\"' + tns + '.*\"'] -%}{%- endfor -%}{%- endif -%}{%- set rns.recipients = rns.recipients + ['\"user\"'] -%}{{- '# Valid recipients: ' + rns.recipients | join(', ') + '.' -}}{%- endmacro -%}{{- bos_token -}}{%- set ns = namespace(has_system=false) -%}{%- for m in messages -%}{%- if m['role'] == 'system' -%}{%- set ns.has_system = true -%}{%- endif -%}{%- endfor -%}{%- if not ns.has_system -%}{{- '<|start|>system<|message|>You are a helpful AI assistant.' -}}{%- set kc = knowledge_cutoff if knowledge_cutoff is defined and knowledge_cutoff else '2026-01-04' -%}{{- '\\nKnowledge cutoff: ' + kc + '.' -}}{%- if current_date is defined and current_date -%}{{- '\\nCurrent date: ' + current_date + '.' -}}{%- elif strftime_now is defined -%}{{- '\\nCurrent date: ' + strftime_now('%Y-%m-%d') + '.' -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_reasoning() -}}{%- if tools -%}{{- '\\n\\n' -}}{{- render_tool_defs(tools) -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_system_meta(tools) -}}{{- '<|eot|>' -}}{%- endif -%}{%- for message in messages -%}{%- set role = message['role'] -%}{%- set end_token = '<|eom|>' if (not loop.last and messages[loop.index0 + 1]['role'] == role) else '<|eot|>' -%}{%- if role == 'system' -%}{{- '<|start|>system<|message|>' -}}{{- render_content(message['content']) -}}{{- '\\n\\n' -}}{{- render_reasoning() -}}{%- if tools -%}{{- '\\n\\n' -}}{{- render_tool_defs(tools) -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_system_meta(tools) -}}{{- '<|eot|>' -}}{%- elif role == 'user' -%}{{- '<|start|>user<|message|>' -}}{{- render_content(message['content']) -}}{{- '<|eot|>' -}}{%- elif role == 'tool' -%}{%- set tname = message.get('name') -%}{%- if not tname -%}{%- set tcid = message.get('tool_call_id') -%}{%- set rns = namespace(name=tcid if tcid else '') -%}{%- for m in messages -%}{%- if m.get('tool_calls') -%}{%- for tc in m['tool_calls'] -%}{%- if tcid is not none and tc.id is defined and tc.id == tcid -%}{%- set rns.name = tc.function.name -%}{%- endif -%}{%- endfor -%}{%- endif -%}{%- endfor -%}{%- set tname = rns.name -%}{%- endif -%}{{- '<|start|>tool ' + tname + '<|message|><tool_output name=\"' + tname + '\">\\n' -}}{{- render_content(message['content']) -}}{{- '\\n</tool_output><|eot|>' -}}{%- elif role == 'assistant' -%}{%- if message.get('reasoning_content') -%}{{- '<|start|>assistant to=self<|message|>' + message['reasoning_content'] + '<|eom|>' -}}{%- endif -%}{%- if message.get('tool_calls') -%}{%- for tc in message['tool_calls'] -%}{{- '<|start|>assistant to=' + tc.function.name + '<|message|>' -}}{{- render_atem(tc) -}}{%- if loop.last -%}{{- end_token -}}{%- else -%}{{- '<|eom|>' -}}{%- endif -%}{%- endfor -%}{%- else -%}{%- set recipient = message.get('recipient') or 'user' -%}{%- set end_turn = message.get('end_turn') -%}{%- if end_turn is none -%}{%- set end_turn = not (recipient and recipient != 'user') -%}{%- endif -%}{{- '<|start|>assistant' -}}{%- if recipient -%}{{- ' to=' + recipient -}}{%- endif -%}{{- '<|message|>' -}}{{- render_content(message['content']) -}}{{- ('<|eot|>' if end_turn else '<|eom|>') -}}{%- endif -%}{%- endif -%}{%- endfor -%}{%- if add_generation_prompt -%}{{- '<|start|>assistant' -}}{%- endif -%}",
|
| 11 |
+
"bos_token": "<|begin_of_text|>",
|
| 12 |
+
"eos_token": "<|end_of_text|>",
|
| 13 |
+
"totalFileSize": 10657479200
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.050208+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "Muse-Glimmer-30B-IQ2_M.gguf",
|
| 19 |
+
"size": 10657479200,
|
| 20 |
+
"blob_id": "c72e654763800ac1bfd1bec4d6ecf153c18bce75",
|
| 21 |
+
"lfs_sha256": "67a24245fb600a01668163b7afb5287c0413eff21f326b482da45b8fa0727e7d"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "Muse-Glimmer-30B-IQ2_S.gguf",
|
| 25 |
+
"size": 10040015392,
|
| 26 |
+
"blob_id": "457a940e88218e0d5a74c9d56ee2ab353176d2cb",
|
| 27 |
+
"lfs_sha256": "0b90658c21b28cecc6ae636e605e63f0128c0d9767d8f6fc6a38e30263d8b50b"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "Muse-Glimmer-30B-IQ2_XS.gguf",
|
| 31 |
+
"size": 9582585120,
|
| 32 |
+
"blob_id": "426f81c4b90f2c6ad4cddbc8c669f9e2cbdeef74",
|
| 33 |
+
"lfs_sha256": "8091b165a8b55a1480ba1bf28488046d9de09e774c6a8a5c538773a073f64eaf"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "Muse-Glimmer-30B-IQ2_XXS.gguf",
|
| 37 |
+
"size": 8920818976,
|
| 38 |
+
"blob_id": "900492424729b378904c4864b08b0233a061b54e",
|
| 39 |
+
"lfs_sha256": "88c81796351de47a21c67c8089c2a2111e160a96da8266b413d4fc8afbad89d8"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "Muse-Glimmer-30B-IQ3_M.gguf",
|
| 43 |
+
"size": 13106238240,
|
| 44 |
+
"blob_id": "6c6eaaccd3f8ae7554d70225860d1cb0d1911fb5",
|
| 45 |
+
"lfs_sha256": "bc867ee4fc139be474cc4e6c1794ac584507ec510bcfdefe9772a61779181b6f"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "Muse-Glimmer-30B-IQ3_XS.gguf",
|
| 49 |
+
"size": 12315026208,
|
| 50 |
+
"blob_id": "7af768df430987f39299c8cb0929c54f3f884cbb",
|
| 51 |
+
"lfs_sha256": "35b02cd38f9b34ec6f8caa0f7e0b78ba6f58c876276bfeceebef84fb2d460b87"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "Muse-Glimmer-30B-IQ3_XXS.gguf",
|
| 55 |
+
"size": 11546640928,
|
| 56 |
+
"blob_id": "4a57b788f53d158ef650dc6502cadd145918393f",
|
| 57 |
+
"lfs_sha256": "bc489d8df5a3bdf85ef200bd1dcec9a436290502354810163549cac328dac90a"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "Muse-Glimmer-30B-IQ4_NL.gguf",
|
| 61 |
+
"size": 16238568480,
|
| 62 |
+
"blob_id": "004cc26a3f95b102410e68e9f3bd3614200b9840",
|
| 63 |
+
"lfs_sha256": "8ccfdf140472a18928bb867e05f69c215fb7eb6e9c16a212b0ffa76f2eb023e0"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "Muse-Glimmer-30B-IQ4_XS.gguf",
|
| 67 |
+
"size": 15435096096,
|
| 68 |
+
"blob_id": "44059ee0d61eb3548930e61fdaa6d4e4dc72b64e",
|
| 69 |
+
"lfs_sha256": "b3c03d94c007ae487fd5259b340ad23286190b62b0d4d452f06bc1cf8840a7da"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "Muse-Glimmer-30B-Q2_K.gguf",
|
| 73 |
+
"size": 11035579936,
|
| 74 |
+
"blob_id": "667837639e93746fb13a21ac5a507498de31debd",
|
| 75 |
+
"lfs_sha256": "af4b15f0f3268d23e0f48f796a4ab563454b9cf8bab60d2bbe251b314b342fb5"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "Muse-Glimmer-30B-Q2_K_L.gguf",
|
| 79 |
+
"size": 12348891936,
|
| 80 |
+
"blob_id": "f272bd029b2779d4f50defa0c7b8725d723683c1",
|
| 81 |
+
"lfs_sha256": "b4abbaaa9d582bc1a75f63b73c04ce51db03a9016c22ddc7b1402350c44e1f55"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "Muse-Glimmer-30B-Q3_K_L.gguf",
|
| 85 |
+
"size": 14782112544,
|
| 86 |
+
"blob_id": "8792888b4b7699c268bf404fb8b77b8840c8f706",
|
| 87 |
+
"lfs_sha256": "43a26da94c1df72d5fd2f6edf9136c06b0acdc43a86fa5acfaf2b220c45c9916"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "Muse-Glimmer-30B-Q3_K_M.gguf",
|
| 91 |
+
"size": 13962519328,
|
| 92 |
+
"blob_id": "c0cde285705e9ef9a574224933ed558ad443763b",
|
| 93 |
+
"lfs_sha256": "de551709c7977735a4012323b82ba34a5756127c6b03a730753a37a318f02872"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "Muse-Glimmer-30B-Q3_K_S.gguf",
|
| 97 |
+
"size": 12789199648,
|
| 98 |
+
"blob_id": "4850823591d759ff48e07ff79a91ae5a7899269d",
|
| 99 |
+
"lfs_sha256": "1466205e255af9f7d13eecc4a9d392e7a674d03ee19f60640d56dee76e2460e7"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "Muse-Glimmer-30B-Q3_K_XL.gguf",
|
| 103 |
+
"size": 15958840096,
|
| 104 |
+
"blob_id": "ad7d98a834ee8d105ffb123b5e7a41bf2cb2162f",
|
| 105 |
+
"lfs_sha256": "b747e9b261591bc2e4dfef216c9c27333d730e8cf58902f45362934fff1bf12d"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "Muse-Glimmer-30B-Q4_0.gguf",
|
| 109 |
+
"size": 16265565216,
|
| 110 |
+
"blob_id": "bc9a7c091e24d8c749d16fb865d3b9975c42ab08",
|
| 111 |
+
"lfs_sha256": "95fd818c08f2030a51805548269690e1915fc84088e4322273c5f317e2696999"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "Muse-Glimmer-30B-Q4_1.gguf",
|
| 115 |
+
"size": 17828207648,
|
| 116 |
+
"blob_id": "3e7362eaec8b4f850e870d57d74bf15033e9d335",
|
| 117 |
+
"lfs_sha256": "91dbd9bfd1458aa6d94e38e908fa1e320fae737955f045850fc8aa72acc462e4"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "Muse-Glimmer-30B-Q4_K_L.gguf",
|
| 121 |
+
"size": 18304441120,
|
| 122 |
+
"blob_id": "5c6a20ca176190ab4d6c95382d62aabd5ec212c0",
|
| 123 |
+
"lfs_sha256": "c4f08081d05e0fabc5e48b3309998a73b0dfb811765d960b540926e3ab411f4b"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "Muse-Glimmer-30B-Q4_K_M.gguf",
|
| 127 |
+
"size": 17306324000,
|
| 128 |
+
"blob_id": "e1a6606b0213fddd4469cf461e9e404ae4b8c608",
|
| 129 |
+
"lfs_sha256": "0d3fc85f61d10fdc84072f0bba6005d61c1ac5605a2627b0fd5ea4ff8194c384"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "Muse-Glimmer-30B-Q4_K_S.gguf",
|
| 133 |
+
"size": 16320943136,
|
| 134 |
+
"blob_id": "6104f8008f85a28c64e7a9e411c62e6e4289c1fb",
|
| 135 |
+
"lfs_sha256": "1d80ea8cc0c195ad357f88e7e4fb4d95b907168688087cfb8e1cc92caef2bdde"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "Muse-Glimmer-30B-Q5_K_L.gguf",
|
| 139 |
+
"size": 20935584544,
|
| 140 |
+
"blob_id": "5bfdfcaff7c52e320b1d5c410052f3c415602894",
|
| 141 |
+
"lfs_sha256": "9c46396848f82de76cd5b45ca052d218d20e0c56fb1e47db8243e58bf38d20f1"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "Muse-Glimmer-30B-Q5_K_M.gguf",
|
| 145 |
+
"size": 20105571360,
|
| 146 |
+
"blob_id": "81ee88014a21df961d903a96a1619d1f361c4abb",
|
| 147 |
+
"lfs_sha256": "ab27b43f9c6af4a0fbb3359aba06b030837526a3e24fd24a64468040e196ecb2"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "Muse-Glimmer-30B-Q5_K_S.gguf",
|
| 151 |
+
"size": 19440690208,
|
| 152 |
+
"blob_id": "d66f9e5ea42c0c9203c926240bb92d11b58ca35a",
|
| 153 |
+
"lfs_sha256": "0c89eb14e704832ae8ce9e992e563de794f0700de3a2c8a50d2918a851581452"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "Muse-Glimmer-30B-Q6_K.gguf",
|
| 157 |
+
"size": 23414418720,
|
| 158 |
+
"blob_id": "fdac8ae400ea37aad405f5e47b55d0f3a54bdc8b",
|
| 159 |
+
"lfs_sha256": "7746e3dafcece07236a3826c8c3ee149a682d6f7fc9f0da9e24a4e481ccdb0bc"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "Muse-Glimmer-30B-Q6_K_L.gguf",
|
| 163 |
+
"size": 24065821472,
|
| 164 |
+
"blob_id": "5c98b76678b4c13f9c9994ee35922cc2bda14cb1",
|
| 165 |
+
"lfs_sha256": "7e799aa9fec19af01161bb06bd7907db54d11f482ca1ab7f72a2d022cf3ccf87"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "Muse-Glimmer-30B-Q8_0.gguf",
|
| 169 |
+
"size": 29612958496,
|
| 170 |
+
"blob_id": "957a65cf104f13e3505f3508c70ed5dcaf8da69f",
|
| 171 |
+
"lfs_sha256": "5425d1755c977c103c9134dc182f63e2eaa12365d90f59bc7f1c12f9d7e7307d"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00001-of-00002.gguf",
|
| 175 |
+
"size": 39750446272,
|
| 176 |
+
"blob_id": "4490005af495ff3d816b93c401c12d8339d0d4d7",
|
| 177 |
+
"lfs_sha256": "bee9afa70ebaa476b07abaebd4376a37c8b5c4d33fbed7e39bda4e43e0477860"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "Muse-Glimmer-30B-bf16/Muse-Glimmer-30B-bf16-00002-of-00002.gguf",
|
| 181 |
+
"size": 15975065088,
|
| 182 |
+
"blob_id": "ed596016d8debaaa1bda34b640b3d36d6e105915",
|
| 183 |
+
"lfs_sha256": "e7bc887eec50cd0a77f1888c4110b17602193cb073e40c9e73df2648c4ff3d16"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "Muse-Glimmer-30B-imatrix.gguf",
|
| 187 |
+
"size": 13376128,
|
| 188 |
+
"blob_id": "14467ee380f945134da3192e098f9aae2bc8e356",
|
| 189 |
+
"lfs_sha256": "31c5d105b701a3c4db9ac1f597a9aa93d58107184df6d3a2f9d369e054ff7dfd"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"rfilename": "dflash-Muse-Glimmer-30B-Q4_0.gguf",
|
| 193 |
+
"size": 1451094176,
|
| 194 |
+
"blob_id": "d64aa9f86c81b79a198419dcdb27a5cb575e0494",
|
| 195 |
+
"lfs_sha256": "5815f3918ba4ef81f0c32cdd49fea04c141919245eac22ba028bec57ed198ba3"
|
| 196 |
+
},
|
| 197 |
+
{
|
| 198 |
+
"rfilename": "dflash-Muse-Glimmer-30B-Q8_0.gguf",
|
| 199 |
+
"size": 2729046176,
|
| 200 |
+
"blob_id": "413c70ecaef4cb993c7bf91c3720293402fb1804",
|
| 201 |
+
"lfs_sha256": "787e0708e439f0caa8e6caaafa5f0fec38e112766c150f313ac074e5cab087fc"
|
| 202 |
+
},
|
| 203 |
+
{
|
| 204 |
+
"rfilename": "mmproj-Muse-Glimmer-30B-bf16.gguf",
|
| 205 |
+
"size": 3849173920,
|
| 206 |
+
"blob_id": "2f6540ba0c2190e920357267b1f96e0fd0be1b22",
|
| 207 |
+
"lfs_sha256": "3727a47650ae65be12e91aae49f9b9f4bef09dc6c401a54ca1bd3d1a6160f35a"
|
| 208 |
+
},
|
| 209 |
+
{
|
| 210 |
+
"rfilename": "mmproj-Muse-Glimmer-30B-f16.gguf",
|
| 211 |
+
"size": 3847367584,
|
| 212 |
+
"blob_id": "bd107f5c5bb65701e4c35bde87620702efaf5a69",
|
| 213 |
+
"lfs_sha256": "b94be96afc13120bf0636728b75ad568bb4eba5b2096438b009ed032d8cef4ea"
|
| 214 |
+
}
|
| 215 |
+
]
|
| 216 |
+
}
|
bpw/hf/repo-metadata/bartowski__OpenGVLab_InternVL3_5-30B-A3B-GGUF.json
ADDED
|
@@ -0,0 +1,203 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/OpenGVLab_InternVL3_5-30B-A3B-GGUF",
|
| 4 |
+
"commit_sha": "a6824f88ffe59c72fc9864a87d40753556cba5d9",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30532122624,
|
| 7 |
+
"architecture": "qwen3moe",
|
| 8 |
+
"context_length": 40960,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/InternVL3_5-30B-A3B-GGUF/OpenGVLab_InternVL3_5-30B-A3B-imatrix.gguf",
|
| 10 |
+
"chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n'}}{% if message['content'] is string %}{{ message['content'] }}{% else %}{% for content in message['content'] %}{% if content['type'] == 'image' %}{{ '<image>\n' }}{% elif content['type'] == 'video' %}{{ '<video>\n' }}{% elif content['type'] == 'text' %}{{ content['text'] }}{% endif %}{% endfor %}{% endif %}{{'<|im_end|>\n'}}{% endfor %}{% if add_generation_prompt %}{{'<|im_start|>assistant\n' }}{% endif %}",
|
| 11 |
+
"eos_token": "<|im_end|>",
|
| 12 |
+
"totalFileSize": 9870267296
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.049491+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ2_M.gguf",
|
| 18 |
+
"size": 9870267296,
|
| 19 |
+
"blob_id": "0de9e4b1a8b3f34134238101e500ceb35dc2ec17",
|
| 20 |
+
"lfs_sha256": "5816a7d8af0f9f2ad160b8af4da4a71a4685d47b5c151526e4f3166f47aae003"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ2_S.gguf",
|
| 24 |
+
"size": 8744096672,
|
| 25 |
+
"blob_id": "0f67a2da5041e3b229c36d7b12fbbce7f36bbe49",
|
| 26 |
+
"lfs_sha256": "612dca4635563e2e925d991a713a7236f5d358c8a13f539ec19947afcb7b88c4"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ2_XS.gguf",
|
| 30 |
+
"size": 8662162336,
|
| 31 |
+
"blob_id": "ef5834615e82d7ab25976c654c4f233012ce9e4a",
|
| 32 |
+
"lfs_sha256": "5163261b93f431630f409ed6dc9255250587a9b0ce08e2323f714466b724692f"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ2_XXS.gguf",
|
| 36 |
+
"size": 7569021856,
|
| 37 |
+
"blob_id": "a1f1edaeaefc0f6f23620b9c51ea60737cb8f59c",
|
| 38 |
+
"lfs_sha256": "0c6a4d6c5bc827c1f4ae1c2a74a1ac278620b91bc90167a59f9c6cc499dcab71"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ3_M.gguf",
|
| 42 |
+
"size": 14076537760,
|
| 43 |
+
"blob_id": "7db8f99120419fed8d8a478e1c6b781840fae466",
|
| 44 |
+
"lfs_sha256": "cab7f7b65d63b9c78000d011eb92da13eaf9cb2b28fecd1e35bb0ce4d6b9944c"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ3_XS.gguf",
|
| 48 |
+
"size": 12736457632,
|
| 49 |
+
"blob_id": "8cfe96c627c30cdab41558ec384c41a95dc2a07c",
|
| 50 |
+
"lfs_sha256": "9a306de88b48813b8f6006bcb0843750fe52cc43139d257923129b2cc4dbbdfe"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ3_XXS.gguf",
|
| 54 |
+
"size": 12216980384,
|
| 55 |
+
"blob_id": "94ee601ecbceb64f1593fdd7c2f824b7bfa9bcef",
|
| 56 |
+
"lfs_sha256": "f26e1ff394f4dfe300112ab5fc3f7d2510e4db484718be1cf4237df1c6f1649b"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ4_NL.gguf",
|
| 60 |
+
"size": 17386275744,
|
| 61 |
+
"blob_id": "c9d8db0e103864d744926fa9cdd2b3771edf3c45",
|
| 62 |
+
"lfs_sha256": "bf516e4962edd42afebb1f2dd1cbe9f5223863adec745bc4d81a0b1211ca5111"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-IQ4_XS.gguf",
|
| 66 |
+
"size": 16457999264,
|
| 67 |
+
"blob_id": "eca5f63638edcf360b6636eb34b61123b793805d",
|
| 68 |
+
"lfs_sha256": "c686a3a767fb94ef19499815036fdfb63213664cf0d5867c63848c7ec532d69c"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q2_K.gguf",
|
| 72 |
+
"size": 10908644256,
|
| 73 |
+
"blob_id": "adfe4f1a088c35e778db78b14af723a698ea5419",
|
| 74 |
+
"lfs_sha256": "b9eaf077982b4162517309b2d3f55688fac4558b6cebc98589890b5e761feeb0"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q2_K_L.gguf",
|
| 78 |
+
"size": 11212516256,
|
| 79 |
+
"blob_id": "7313c16b03b0bf7e042d11cfddacf9403adfaf8f",
|
| 80 |
+
"lfs_sha256": "fa33203013f76740fc000de0c2b91c103cb6c31469633e50637b8b3f538f45e2"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_L.gguf",
|
| 84 |
+
"size": 14582999968,
|
| 85 |
+
"blob_id": "c623cdbc205f585a82e6a49af1f81b64ec639b82",
|
| 86 |
+
"lfs_sha256": "9670250d2f9cb430cf6c48152d703d0b9c23289d624cd9965c37adfef972ef40"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_M.gguf",
|
| 90 |
+
"size": 14076799904,
|
| 91 |
+
"blob_id": "4eddd5a22ee61d41c82c9a8502ce53f04e7dc31d",
|
| 92 |
+
"lfs_sha256": "fd9f2de2695a8b4dd47213d61f000d4d2827200c82cd19ef381a8ab1fc704027"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_S.gguf",
|
| 96 |
+
"size": 13428124576,
|
| 97 |
+
"blob_id": "4f0344044aa11c8abf08516441b9ceec757e55cc",
|
| 98 |
+
"lfs_sha256": "7c24ba63f15f95bed3f1cde67808b6a3b3d8e788a92f2d99a2db5a9d029a6af4"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q3_K_XL.gguf",
|
| 102 |
+
"size": 14855269280,
|
| 103 |
+
"blob_id": "c74b09bbbc14d180ae861bc610b0be33aa2eee35",
|
| 104 |
+
"lfs_sha256": "c22f12df2b59c497711eb71338c891e6d0cfd1328c7b70e9bbe37f0779558145"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_0.gguf",
|
| 108 |
+
"size": 17631642528,
|
| 109 |
+
"blob_id": "6e83f4c8eddcf8dfbcecba901c501512e3b32e0a",
|
| 110 |
+
"lfs_sha256": "b389e27eaaefb5bd6abeff8ee129be754575d853f615cb006d940b6348021988"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_1.gguf",
|
| 114 |
+
"size": 19214517152,
|
| 115 |
+
"blob_id": "d48268046b31030fa93e3af1eb9398b03b05d1c2",
|
| 116 |
+
"lfs_sha256": "f53648a2c25a9469c84bd61c33044ccb64fe9e18e0988b0e87edfbafa6c2a572"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_L.gguf",
|
| 120 |
+
"size": 18863123360,
|
| 121 |
+
"blob_id": "23236779ca2dd9dbe6ac3b6162ae757e6963eabf",
|
| 122 |
+
"lfs_sha256": "78afdd10ee3f75878a9bb7a4a48e558a62c3061681d299e0c0cfb8c579be9ada"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_M.gguf",
|
| 126 |
+
"size": 18632180640,
|
| 127 |
+
"blob_id": "25c97c2a9aa4d0b5875e7ba7fcbe9d5072407754",
|
| 128 |
+
"lfs_sha256": "c352004ac811cf9aa198e11f698ebd5fd3c49b483cb31a2b081fb415dd8347c2"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q4_K_S.gguf",
|
| 132 |
+
"size": 17984488352,
|
| 133 |
+
"blob_id": "4b50bec5eaa72692d6d0f11eb5a90fa23611348f",
|
| 134 |
+
"lfs_sha256": "a7b6bb7b7cf31ecb4822d25c017e2163b8e40570a72186f67ae8d76919feae95"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q5_K_L.gguf",
|
| 138 |
+
"size": 21936499616,
|
| 139 |
+
"blob_id": "428ecb5918df13a54e7d2bf67840a0261a92660b",
|
| 140 |
+
"lfs_sha256": "9371eef0ca3d9d13c778f325c991d7ec40fff386f9b2f0adcb63ead4b22e9e3a"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q5_K_M.gguf",
|
| 144 |
+
"size": 21744452512,
|
| 145 |
+
"blob_id": "684dccbd5358ada80c9792533b5317ae8ad3ea1e",
|
| 146 |
+
"lfs_sha256": "3285a7ac7613aa9eb24b36f1bb9be4c964044a5490a9ecd7cec834c7688b4c67"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q5_K_S.gguf",
|
| 150 |
+
"size": 21099381664,
|
| 151 |
+
"blob_id": "5906ab5574e4476c83d0f2e4ccfca452694ec33d",
|
| 152 |
+
"lfs_sha256": "26a528b05489e9e61521584027cff17005291a48c9a776762af29ca4760b9c54"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q6_K.gguf",
|
| 156 |
+
"size": 25104718752,
|
| 157 |
+
"blob_id": "2be2e627f7194d18e225eebaf9be916b508d29b1",
|
| 158 |
+
"lfs_sha256": "da97acf78e622ebeed78598cfc633977d621f1ccbfd44efbd522199c8534e57e"
|
| 159 |
+
},
|
| 160 |
+
{
|
| 161 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q6_K_L.gguf",
|
| 162 |
+
"size": 25255439264,
|
| 163 |
+
"blob_id": "da057d111fc18a1293a7e860eb16b5ded545aa6e",
|
| 164 |
+
"lfs_sha256": "3aa1bc0646b326462236af643bf1f0f6e548747ecc57e59abad120ea9df4dfde"
|
| 165 |
+
},
|
| 166 |
+
{
|
| 167 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-Q8_0.gguf",
|
| 168 |
+
"size": 32483928992,
|
| 169 |
+
"blob_id": "dd33ba54761f0ee07cee2f01282307c3ee078cc5",
|
| 170 |
+
"lfs_sha256": "79ac13df1d3f784cd5702b2835ede749cdfd274f141d1e0df25581af2a2a6720"
|
| 171 |
+
},
|
| 172 |
+
{
|
| 173 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00001-of-00002.gguf",
|
| 174 |
+
"size": 39717427296,
|
| 175 |
+
"blob_id": "259b297cd5a66e38467f8945904e0a4ccb940350",
|
| 176 |
+
"lfs_sha256": "37ab465cd0c2b47b6b68e17f6e1f3ffd48701a27518c71ad7ac21b7f5a8d9f24"
|
| 177 |
+
},
|
| 178 |
+
{
|
| 179 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-bf16/OpenGVLab_InternVL3_5-30B-A3B-bf16-00002-of-00002.gguf",
|
| 180 |
+
"size": 21378372352,
|
| 181 |
+
"blob_id": "c71100e275ac1dbeb6f08e60f212f8d6202f41ed",
|
| 182 |
+
"lfs_sha256": "469c362f36f7ad24dec0da0c75b2ebc681f60b160cee303421388b8375fc2161"
|
| 183 |
+
},
|
| 184 |
+
{
|
| 185 |
+
"rfilename": "OpenGVLab_InternVL3_5-30B-A3B-imatrix.gguf",
|
| 186 |
+
"size": 122029312,
|
| 187 |
+
"blob_id": "191231406c6e96fdc2c264e6f01e3c6773e80b49",
|
| 188 |
+
"lfs_sha256": "35aeb64a9cdbe43ff2908b36c28aa822cf1966560f5e7f85c042e8ec1748341e"
|
| 189 |
+
},
|
| 190 |
+
{
|
| 191 |
+
"rfilename": "mmproj-OpenGVLab_InternVL3_5-30B-A3B-bf16.gguf",
|
| 192 |
+
"size": 637310368,
|
| 193 |
+
"blob_id": "745b06863424985ec16e4c30610d5325a9f58b86",
|
| 194 |
+
"lfs_sha256": "d7b31eac832bb0d9adac61b3d5c81071df31ce1ad710d0e5758564e377bb14ea"
|
| 195 |
+
},
|
| 196 |
+
{
|
| 197 |
+
"rfilename": "mmproj-OpenGVLab_InternVL3_5-30B-A3B-f16.gguf",
|
| 198 |
+
"size": 636106144,
|
| 199 |
+
"blob_id": "a172cd2ee15aaabe89a71bed106790d52058c108",
|
| 200 |
+
"lfs_sha256": "fa362a7396c3dddecf6f9a714144ed86207211d6c68ef39ea0d7dfe21b969b8d"
|
| 201 |
+
}
|
| 202 |
+
]
|
| 203 |
+
}
|
bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.5-4B-GGUF.json
ADDED
|
@@ -0,0 +1,178 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/Qwen_Qwen3.5-4B-GGUF",
|
| 4 |
+
"commit_sha": "4168f45a16a1290d65a4ec0fa312ae917a4c15d6",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 4326350848,
|
| 7 |
+
"architecture": "qwen35",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {{- '<|im_start|>system\\n' + content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if loop.index0 > ns.last_query_index %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}",
|
| 10 |
+
"eos_token": "<|im_end|>",
|
| 11 |
+
"totalFileSize": 8665620192
|
| 12 |
+
},
|
| 13 |
+
"fetched_at_utc": "2026-09-06T11:32:08.101620+00:00",
|
| 14 |
+
"siblings": [
|
| 15 |
+
{
|
| 16 |
+
"rfilename": "Qwen_Qwen3.5-4B-IQ2_M.gguf",
|
| 17 |
+
"size": 1953751008,
|
| 18 |
+
"blob_id": "5ac8b231fc2e229598023aac244c7d8004780251",
|
| 19 |
+
"lfs_sha256": "fd6c12b5d4f76be174edbf4769d2a27b0384da020f5cf1241463679798a9f4ec"
|
| 20 |
+
},
|
| 21 |
+
{
|
| 22 |
+
"rfilename": "Qwen_Qwen3.5-4B-IQ3_M.gguf",
|
| 23 |
+
"size": 2483333088,
|
| 24 |
+
"blob_id": "b6a045aa6bb1775aee9d0e3418e8ba10b6596d0a",
|
| 25 |
+
"lfs_sha256": "5ad76abae6b7a27d1463d90e6d86886850769e34906a88cfa4347cae72c91502"
|
| 26 |
+
},
|
| 27 |
+
{
|
| 28 |
+
"rfilename": "Qwen_Qwen3.5-4B-IQ3_XS.gguf",
|
| 29 |
+
"size": 2403952608,
|
| 30 |
+
"blob_id": "fff451e8c441278493bdf2e3c76f8146e7bdfa71",
|
| 31 |
+
"lfs_sha256": "ecb30836d260d1e44f09edd2d814c473637ba12345ab474c6cde07af3b84b9be"
|
| 32 |
+
},
|
| 33 |
+
{
|
| 34 |
+
"rfilename": "Qwen_Qwen3.5-4B-IQ3_XXS.gguf",
|
| 35 |
+
"size": 2243829728,
|
| 36 |
+
"blob_id": "73c0e5bc86f45870ca63eff6b2ce9d7b0e662309",
|
| 37 |
+
"lfs_sha256": "37046243577d6b44e98137680623b807ae92b147982a91d5726e4c0c64e7508e"
|
| 38 |
+
},
|
| 39 |
+
{
|
| 40 |
+
"rfilename": "Qwen_Qwen3.5-4B-IQ4_NL.gguf",
|
| 41 |
+
"size": 2775541728,
|
| 42 |
+
"blob_id": "9285a1a5c8d67ec0cf441eca566849fb2a015a7d",
|
| 43 |
+
"lfs_sha256": "f007c3dbf67df668354d37ae13d87fd5789059704977959187e8342aec03b66f"
|
| 44 |
+
},
|
| 45 |
+
{
|
| 46 |
+
"rfilename": "Qwen_Qwen3.5-4B-IQ4_XS.gguf",
|
| 47 |
+
"size": 2671339488,
|
| 48 |
+
"blob_id": "4031fca06038aa3d7e413f687754e81bdf101ee2",
|
| 49 |
+
"lfs_sha256": "628124c61a806897d3f28dcd416be6daff94f62f731eb900d4381875eac9e412"
|
| 50 |
+
},
|
| 51 |
+
{
|
| 52 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q2_K.gguf",
|
| 53 |
+
"size": 2191779808,
|
| 54 |
+
"blob_id": "c2be0339e3fc0da3594849d18ecfa4d62ccc701f",
|
| 55 |
+
"lfs_sha256": "8875934081d3b9b51b41de628e34d964a15d3fac5b5592baf2c01c5a04460c9a"
|
| 56 |
+
},
|
| 57 |
+
{
|
| 58 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q2_K_L.gguf",
|
| 59 |
+
"size": 2345738208,
|
| 60 |
+
"blob_id": "7531f8e7fbbbe4b104f88e26f645a2edc0bcd128",
|
| 61 |
+
"lfs_sha256": "63d3cbc85cb8531175566c006970974d992943888da55a1c83aa76c05137d93d"
|
| 62 |
+
},
|
| 63 |
+
{
|
| 64 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q3_K_L.gguf",
|
| 65 |
+
"size": 2665441248,
|
| 66 |
+
"blob_id": "0dcc41bcdd29c05efa9b9c7401a5b466606cf7c9",
|
| 67 |
+
"lfs_sha256": "41c3f1bf47e477693dab332e73347c7138d5e9fbfe74c6d2eaba590be1f3d20a"
|
| 68 |
+
},
|
| 69 |
+
{
|
| 70 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q3_K_M.gguf",
|
| 71 |
+
"size": 2575656928,
|
| 72 |
+
"blob_id": "56b374ea519cfe45918a6a47685e09b1c47ab156",
|
| 73 |
+
"lfs_sha256": "049c71be191fb980a2851ee4d141f437feb50f001191e9b51bd4f6ab2b04146a"
|
| 74 |
+
},
|
| 75 |
+
{
|
| 76 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q3_K_S.gguf",
|
| 77 |
+
"size": 2454251488,
|
| 78 |
+
"blob_id": "4fdb07fac2d7b827ecf326c1f2bed5995b20f6b3",
|
| 79 |
+
"lfs_sha256": "b4fd1933335ebefeb0cc3fde07a439485f3d5b16a21c25e1b9afdaa165492017"
|
| 80 |
+
},
|
| 81 |
+
{
|
| 82 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q3_K_XL.gguf",
|
| 83 |
+
"size": 2819399648,
|
| 84 |
+
"blob_id": "067dfd358da779b20f7695f9af8b13cbacc9bc93",
|
| 85 |
+
"lfs_sha256": "f124b26768806bdfda0ff97d0f6c27c3fa489e0fcedc439927256baf74d40a33"
|
| 86 |
+
},
|
| 87 |
+
{
|
| 88 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q4_0.gguf",
|
| 89 |
+
"size": 2776033248,
|
| 90 |
+
"blob_id": "d99923baae4377dfacde1835903f5f6a030758a3",
|
| 91 |
+
"lfs_sha256": "3e977de32dfb9377ff827f210091cce5d3c05c7b0f0b9b0c8005df7c0677a49b"
|
| 92 |
+
},
|
| 93 |
+
{
|
| 94 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q4_1.gguf",
|
| 95 |
+
"size": 2979850208,
|
| 96 |
+
"blob_id": "257cc1a56f0656265b91426b76c885181ad1ddfd",
|
| 97 |
+
"lfs_sha256": "3ff4832c848351354ee0d9c6d87d80485e36dbb6419dd22acf46b82ffb94ef7a"
|
| 98 |
+
},
|
| 99 |
+
{
|
| 100 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q4_K_L.gguf",
|
| 101 |
+
"size": 3166986208,
|
| 102 |
+
"blob_id": "57fef4c809f96737105a2b658d81eac27db8ebf6",
|
| 103 |
+
"lfs_sha256": "2986654fa857ff6c7a0ebe8957e11c1a376b43be9d3bd905285d778342da22b8"
|
| 104 |
+
},
|
| 105 |
+
{
|
| 106 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q4_K_M.gguf",
|
| 107 |
+
"size": 3013027808,
|
| 108 |
+
"blob_id": "a859bab891c07bf7d86a7833bfe00db732b8e44e",
|
| 109 |
+
"lfs_sha256": "13c16f426047e2de38cd075bdade4a7bcbc8c774384876f677740cda65f8a983"
|
| 110 |
+
},
|
| 111 |
+
{
|
| 112 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q4_K_S.gguf",
|
| 113 |
+
"size": 2846156768,
|
| 114 |
+
"blob_id": "465792bff758fc83c337bc828cdcc830a7e5de5a",
|
| 115 |
+
"lfs_sha256": "3a6e5e8144696a87d17f136b06fce7fe5008a42737938056df13e11ddba4a01b"
|
| 116 |
+
},
|
| 117 |
+
{
|
| 118 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q5_K_L.gguf",
|
| 119 |
+
"size": 3597721568,
|
| 120 |
+
"blob_id": "09706ab4ae39d49041eebf966862fcf2b1070888",
|
| 121 |
+
"lfs_sha256": "4e10523c570b7f5c680a7e74c61a19b82c7546c88bb3ec5fcc525d03bc345551"
|
| 122 |
+
},
|
| 123 |
+
{
|
| 124 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q5_K_M.gguf",
|
| 125 |
+
"size": 3443763168,
|
| 126 |
+
"blob_id": "0a9c2c4f528e512dd29ad5fb17de606d6bb7a19c",
|
| 127 |
+
"lfs_sha256": "21c4643259ce62ffd979848e5819ce03823fd9e9902279ab54cc0d572d83d33e"
|
| 128 |
+
},
|
| 129 |
+
{
|
| 130 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q5_K_S.gguf",
|
| 131 |
+
"size": 3256412128,
|
| 132 |
+
"blob_id": "e6d75ff3839ae44aa2d1ca46362f5aa835546007",
|
| 133 |
+
"lfs_sha256": "e4b59fdb8cd1dedb2591dc4eb368b63cb8c321447ff9512e33b7d42fd3f35e12"
|
| 134 |
+
},
|
| 135 |
+
{
|
| 136 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q6_K.gguf",
|
| 137 |
+
"size": 3805358048,
|
| 138 |
+
"blob_id": "0086804cdf3afbd8d28ba7f2be6e425d99d55ead",
|
| 139 |
+
"lfs_sha256": "5a5bc7a3f9375b395e9f81fb69109038cf160c84606b8192f13cbb8355ca59f2"
|
| 140 |
+
},
|
| 141 |
+
{
|
| 142 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q6_K_L.gguf",
|
| 143 |
+
"size": 3959316448,
|
| 144 |
+
"blob_id": "6e6e2c33cae01f898a6ca758aee7ad1816389f79",
|
| 145 |
+
"lfs_sha256": "0d7931a7f143ccfdf675c0d84d542c387cd9255af94ee9c8fb5fa6f6df7c08a0"
|
| 146 |
+
},
|
| 147 |
+
{
|
| 148 |
+
"rfilename": "Qwen_Qwen3.5-4B-Q8_0.gguf",
|
| 149 |
+
"size": 4622131168,
|
| 150 |
+
"blob_id": "9136ee39b0abc864657ec4269e8708cb6840f47a",
|
| 151 |
+
"lfs_sha256": "5c74c0ede371924357dff0cb6ba145bd67208b9b2389ded681adfff3f7608db7"
|
| 152 |
+
},
|
| 153 |
+
{
|
| 154 |
+
"rfilename": "Qwen_Qwen3.5-4B-bf16.gguf",
|
| 155 |
+
"size": 8665620192,
|
| 156 |
+
"blob_id": "27404ded60603d64482251716890d3ab148c425c",
|
| 157 |
+
"lfs_sha256": "714270d4eb1d336bca9a8dcf0446982e45721be0399d810586a6b82e727dfee5"
|
| 158 |
+
},
|
| 159 |
+
{
|
| 160 |
+
"rfilename": "Qwen_Qwen3.5-4B-imatrix.gguf",
|
| 161 |
+
"size": 3626496,
|
| 162 |
+
"blob_id": "2dde414d2c7c8fe214e9952c5dc74f6757e325e2",
|
| 163 |
+
"lfs_sha256": "f1dba8ed29370cd5a8c0ba9438edb130f9895599a0b1a657c939d27a12c41b6b"
|
| 164 |
+
},
|
| 165 |
+
{
|
| 166 |
+
"rfilename": "mmproj-Qwen_Qwen3.5-4B-bf16.gguf",
|
| 167 |
+
"size": 675569216,
|
| 168 |
+
"blob_id": "9b2d24bf8b97401ca4e63ef46fe52c59dac727ce",
|
| 169 |
+
"lfs_sha256": "463f39bd1c291c1186c319a8c90ff8640aafa678b14cbee2232d695113dfbb66"
|
| 170 |
+
},
|
| 171 |
+
{
|
| 172 |
+
"rfilename": "mmproj-Qwen_Qwen3.5-4B-f16.gguf",
|
| 173 |
+
"size": 672423488,
|
| 174 |
+
"blob_id": "dd8cfac5ccb0ad91bdc09b9fa2fbf7d1566757c1",
|
| 175 |
+
"lfs_sha256": "659b59dd44b73b1cd34af6cc424669484b06dc80f4340adf8ea84ad776eef813"
|
| 176 |
+
}
|
| 177 |
+
]
|
| 178 |
+
}
|
bpw/hf/repo-metadata/bartowski__Qwen_Qwen3.6-35B-A3B-GGUF.json
ADDED
|
@@ -0,0 +1,222 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/Qwen_Qwen3.6-35B-A3B-GGUF",
|
| 4 |
+
"commit_sha": "5c2410d71524f4f72b023ce8daf7a80528226d5f",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 35505251456,
|
| 7 |
+
"architecture": "qwen35moe",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/Qwen3.6-35B-A3B-GGUF/Qwen_Qwen3.6-35B-A3B-imatrix.gguf",
|
| 10 |
+
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {{- '<|im_start|>system\\n' + content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if (preserve_thinking is defined and preserve_thinking is true) or (loop.index0 > ns.last_query_index) %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}",
|
| 11 |
+
"bos_token": "<|endoftext|>",
|
| 12 |
+
"eos_token": "<|im_end|>",
|
| 13 |
+
"totalFileSize": 9421649536
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.141765+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ1_M.gguf",
|
| 19 |
+
"size": 9421649536,
|
| 20 |
+
"blob_id": "df06a2b9b24ea318ce320f6a196f4e1523e51bb1",
|
| 21 |
+
"lfs_sha256": "d291e12a0f693b5f14c11bb1278ba43b432b2b6f6c33c7fdaf750c214ff83f28"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ2_M.gguf",
|
| 25 |
+
"size": 12964402816,
|
| 26 |
+
"blob_id": "dcf94ea0bdc1654154e52cf1e4aa77ca74c9df95",
|
| 27 |
+
"lfs_sha256": "faae766ad5d1e09551a0f4deff9a3e8aa49618515d10e9fcae79f4e96ad4c178"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ2_S.gguf",
|
| 31 |
+
"size": 11907962496,
|
| 32 |
+
"blob_id": "0e987b392608afe82ad2776e6db3f63febb832ec",
|
| 33 |
+
"lfs_sha256": "52ac86b61423aff6721d59586ddc16f87983c5b3719c2a26c3bdbf403544f775"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ2_XS.gguf",
|
| 37 |
+
"size": 11694831232,
|
| 38 |
+
"blob_id": "3270834343c29a419aabf1a769c77cc188be78b2",
|
| 39 |
+
"lfs_sha256": "a873df6cd354f49c87d4ab0382d5301b3fe9bb16ba68577a70efe6a57a2bd23d"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ2_XXS.gguf",
|
| 43 |
+
"size": 10676139648,
|
| 44 |
+
"blob_id": "2e0031e3ffe1a02da28634a9b560c861bf57a4d0",
|
| 45 |
+
"lfs_sha256": "aa4a46af613699d81841505974c91c877139c713e9e1f25b7708471e0542e85b"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ3_M.gguf",
|
| 49 |
+
"size": 17791661696,
|
| 50 |
+
"blob_id": "edc3527243babea8d9f3ba5260bf66841cd05bcc",
|
| 51 |
+
"lfs_sha256": "aedaa7010e09065d3a4129a624e45804ccfa1950838e67ee935b87d1e71a3d1f"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ3_XS.gguf",
|
| 55 |
+
"size": 17110087296,
|
| 56 |
+
"blob_id": "3e3af5d1498870eb990190848db2228b7fe8ff5d",
|
| 57 |
+
"lfs_sha256": "815607fc5ce720f30552d6aa901633629560daaeb76dc14ddaab3c14628559e7"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ3_XXS.gguf",
|
| 61 |
+
"size": 15761446528,
|
| 62 |
+
"blob_id": "9c4723661ce00454cc73ba2149769f1612398a9e",
|
| 63 |
+
"lfs_sha256": "4eb30af2df0dde76fe8d0a60f0e88f285ee668dcb1b8da892ee5c13dd6b00399"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ4_NL.gguf",
|
| 67 |
+
"size": 20754978432,
|
| 68 |
+
"blob_id": "918483ba768e3828b6c5132051b523dd0f683922",
|
| 69 |
+
"lfs_sha256": "41e9f836690bde9619928538cb4dd170472d2e851243637f7092937a151297ad"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-IQ4_XS.gguf",
|
| 73 |
+
"size": 19699553920,
|
| 74 |
+
"blob_id": "d9bd471618a7e5ab71afbb724ade44d3c13b5c10",
|
| 75 |
+
"lfs_sha256": "afc7238af403ed454b7846454091b5e38b07575bdbb64c3e86777414dde4193c"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q2_K.gguf",
|
| 79 |
+
"size": 13506778752,
|
| 80 |
+
"blob_id": "748b7939129a30f2954e584ff1db280c345b631f",
|
| 81 |
+
"lfs_sha256": "673142cca6255bbb19774c8d438220d9ecfc3c8b215bc619d5e801bc37a35405"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q2_K_L.gguf",
|
| 85 |
+
"size": 14003418752,
|
| 86 |
+
"blob_id": "6fe6b88185ec167be8076012d4c11374e10e35d6",
|
| 87 |
+
"lfs_sha256": "bcecb058c4b349b2df86353ae16538b0787a5704cafe412a79600696ea9234ef"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q3_K_L.gguf",
|
| 91 |
+
"size": 17777899136,
|
| 92 |
+
"blob_id": "06f5c051fa5141dd6ca1ff455a35bbb58eff21c5",
|
| 93 |
+
"lfs_sha256": "8fecfc2c33a3f78f37cab7c1d1684c0ee28fa983058d68a8b3f36a440a0e9909"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q3_K_M.gguf",
|
| 97 |
+
"size": 17117951616,
|
| 98 |
+
"blob_id": "cc16fabf27b211a1071fc22ced86cb015fca9699",
|
| 99 |
+
"lfs_sha256": "17350b1355d32397cffe7d4b446fd9361dbb01aa26bbf41fc950aa595033794f"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q3_K_S.gguf",
|
| 103 |
+
"size": 16404919936,
|
| 104 |
+
"blob_id": "c63fa4616293414bfdfb74bdaa593240cf04c5ae",
|
| 105 |
+
"lfs_sha256": "699b1e56ee8e0975facc98c2a947c6a5a8c2874695e6fb8df8780dac19077417"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q3_K_XL.gguf",
|
| 109 |
+
"size": 18222888576,
|
| 110 |
+
"blob_id": "a838400391fb8fb833af0c408a222c56e80d30ff",
|
| 111 |
+
"lfs_sha256": "1451710903a99bfe99edb7b4de3f12ae80e0ef4d90cd6c64c774a4bde8b7f8ad"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_0.gguf",
|
| 115 |
+
"size": 20836243072,
|
| 116 |
+
"blob_id": "d6bb9941e090b86f70c9ed4454dfd0bd5d0dbf6f",
|
| 117 |
+
"lfs_sha256": "52312daa5b2190c1f5723d33c3315c01c55af4206f6c6e6eb63f3d8dd52bb85e"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_1.gguf",
|
| 121 |
+
"size": 22868448896,
|
| 122 |
+
"blob_id": "8ccb5cfedd72033119ed412a225b07739bc2b7c6",
|
| 123 |
+
"lfs_sha256": "8babe2c6f46b43815cae7ec2b970be8508d6867234ebf16c376bd9cc79477354"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_K_L.gguf",
|
| 127 |
+
"size": 22662526592,
|
| 128 |
+
"blob_id": "a104ff60c09688ebc136afe3333cc718ef3f2ac6",
|
| 129 |
+
"lfs_sha256": "49418000a889fef4b4353f36f598ad5a668c6ae374ac791bf923f76395a1bceb"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_K_M.gguf",
|
| 133 |
+
"size": 22285080192,
|
| 134 |
+
"blob_id": "575cec93b791a88843798d81530b0de25857dc33",
|
| 135 |
+
"lfs_sha256": "b46fedd33e0bfb0cae308aa3c158d0a4b2c4a1d2185a1ed6f093cdaf39064772"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q4_K_S.gguf",
|
| 139 |
+
"size": 21486360192,
|
| 140 |
+
"blob_id": "77b8190905b0f4942290d9e29e59c159f98a1b54",
|
| 141 |
+
"lfs_sha256": "20933baa65d05b0c3b3958d3006a4485b8abbae1850c1f0a43c77c8316e9531c"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q5_K_L.gguf",
|
| 145 |
+
"size": 26227062400,
|
| 146 |
+
"blob_id": "76db8b244e1ddbc5132d13b9eb9334ebf5199040",
|
| 147 |
+
"lfs_sha256": "8b062b51562496de4b228961afa8004850d30c80507e53ff48f91be318784526"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q5_K_M.gguf",
|
| 151 |
+
"size": 25913185920,
|
| 152 |
+
"blob_id": "42b5a8ef72dc5f03e4a42ca2f68ab9ebc4cdc808",
|
| 153 |
+
"lfs_sha256": "ec438d1326eb11d8bb94785c54739cd4b60b01ae32bd8532e232a046b19d296d"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q5_K_S.gguf",
|
| 157 |
+
"size": 25051879040,
|
| 158 |
+
"blob_id": "846a8b9ce9aa18c2ae2ec80b67e824da4eaa9769",
|
| 159 |
+
"lfs_sha256": "c2c80fca38e0a91709ac2365b77c69936f03d6305ad188ac206583db5826f3d0"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q6_K.gguf",
|
| 163 |
+
"size": 30947309184,
|
| 164 |
+
"blob_id": "65220376fbd5f713df654917e416589472cbb019",
|
| 165 |
+
"lfs_sha256": "a97ef79439194d8ec722bc0b6c316f0c41c0b477b35bbae8177c772ecbb0eb91"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q6_K_L.gguf",
|
| 169 |
+
"size": 31193642624,
|
| 170 |
+
"blob_id": "50b91c31cad31775a4c86d0942445011aa5d1961",
|
| 171 |
+
"lfs_sha256": "51c8ecf2867186ddba4e0441a5925663688c84539a0b3be04ba8131da888fec7"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-Q8_0.gguf",
|
| 175 |
+
"size": 37812647552,
|
| 176 |
+
"blob_id": "41cd2dfe70d9a74414589772f859b74484258e19",
|
| 177 |
+
"lfs_sha256": "bc57de096ec30e45773aa86103f35a8a32cea01f2193a53a3c636d618e4434e9"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00001-of-00002.gguf",
|
| 181 |
+
"size": 39753375712,
|
| 182 |
+
"blob_id": "404ec955102e16f240dbc43fab222e216e1da403",
|
| 183 |
+
"lfs_sha256": "dbe8742f9ecf1624ac99577e174c7ae0642162232a47774c9d7fad45fbd0a75b"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-bf16/Qwen_Qwen3.6-35B-A3B-bf16-00002-of-00002.gguf",
|
| 187 |
+
"size": 31312565824,
|
| 188 |
+
"blob_id": "7a1cfdb41ac0b7fc48d0e555625d215da31cfe74",
|
| 189 |
+
"lfs_sha256": "c895ee5a12392ede7ae7e9f554ed9f3d9430e8a7efc9c2c553e598b2a6108df9"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"rfilename": "Qwen_Qwen3.6-35B-A3B-imatrix.gguf",
|
| 193 |
+
"size": 192223904,
|
| 194 |
+
"blob_id": "8aa868be9ae936edefb10ece3ff2b54d54e23f0f",
|
| 195 |
+
"lfs_sha256": "e860d71bd40c83378a06da0407cd5cbfe61b9330784781a047f07a5348d8fd8c"
|
| 196 |
+
},
|
| 197 |
+
{
|
| 198 |
+
"rfilename": "mmproj-Qwen_Qwen3.6-35B-A3B-bf16.gguf",
|
| 199 |
+
"size": 902822240,
|
| 200 |
+
"blob_id": "d660b6c510a19e2f3aedfcebaae500fd48e08e49",
|
| 201 |
+
"lfs_sha256": "1c625f05cd52e90abc76a5f756226c3a5fe279593379c22f6c6846c970a0cd18"
|
| 202 |
+
},
|
| 203 |
+
{
|
| 204 |
+
"rfilename": "mmproj-Qwen_Qwen3.6-35B-A3B-f16.gguf",
|
| 205 |
+
"size": 899283296,
|
| 206 |
+
"blob_id": "50314fc4bc2cd4ac50fb7b3220461794baf69f51",
|
| 207 |
+
"lfs_sha256": "67924785ff1885c2b34c15d0e52979e991acca64221694ba2cc3a6474a053fb4"
|
| 208 |
+
},
|
| 209 |
+
{
|
| 210 |
+
"rfilename": "mtp-Qwen_Qwen3.6-35B-A3B-Q4_0.gguf",
|
| 211 |
+
"size": 1190098816,
|
| 212 |
+
"blob_id": "f1d75dd3206e780714c12ae1f21ad9ea0c31983a",
|
| 213 |
+
"lfs_sha256": "623351aeccfb9a26991ea6a7f0d24ef993a975fb2a508e4d95d3be1f72bf58da"
|
| 214 |
+
},
|
| 215 |
+
{
|
| 216 |
+
"rfilename": "mtp-Qwen_Qwen3.6-35B-A3B-Q8_0.gguf",
|
| 217 |
+
"size": 1989597056,
|
| 218 |
+
"blob_id": "099483ad8d95dd187dd8550448008c32d3b537e5",
|
| 219 |
+
"lfs_sha256": "7f72d7cc4a9ff28cf0bd98a4e6e95e6869efa3b70c7244075376335f38109330"
|
| 220 |
+
}
|
| 221 |
+
]
|
| 222 |
+
}
|
bpw/hf/repo-metadata/bartowski__ReadyArt_gemma-4-31B-it-scotoma-2-GGUF.json
ADDED
|
@@ -0,0 +1,204 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/ReadyArt_gemma-4-31B-it-scotoma-2-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/ReadyArt_gemma-4-31B-it-scotoma-2-GGUF",
|
| 4 |
+
"commit_sha": "1bd76301df1928dd66c7a97631f8c66ccf32238c",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30697345596,
|
| 7 |
+
"architecture": "gemma4",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/gemma-4-31B-it-scotoma-2-GGUF/ReadyArt_gemma-4-31B-it-scotoma-2-imatrix.gguf",
|
| 10 |
+
"chat_template": "{#\n Template: Google Gemma 4 Canonical Chat Template\n Author: Google Gemma Engineering Team\n Published: 2026-07-09\n Context: Fixed tool-calling loops, turn closures, and thinking content-ordering.\n#}\n{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('<channel|>') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '<tool_response|>' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '<tool|>' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n<channel|>' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- else -%}\n {{- raise_exception(\n \"chat_template: tool_calls[].function.arguments must be a \"\n \"JSON object (mapping), not a string. Deserialize arguments \"\n \"before passing to the template.\"\n ) -}}\n {%- endif -%}\n {{- '}<tool_call|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '<turn|>\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- if not enable_thinking -%}\n {{- '<|channel>thought\\n<channel|>' -}}\n {%- endif -%}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n",
|
| 11 |
+
"bos_token": "<bos>",
|
| 12 |
+
"eos_token": "<eos>",
|
| 13 |
+
"totalFileSize": 12649773728
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.147566+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ2_M.gguf",
|
| 19 |
+
"size": 12649773728,
|
| 20 |
+
"blob_id": "d9bbd0d6b85629c8946329d1ac6c78a70462e105",
|
| 21 |
+
"lfs_sha256": "31915f04e69a374fbc2f1d42141cade4c088583f9d002125b298828e5d5718e5"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ2_S.gguf",
|
| 25 |
+
"size": 12075358880,
|
| 26 |
+
"blob_id": "67411fe453eb30b19390d9a404046658cb1848dc",
|
| 27 |
+
"lfs_sha256": "41b93854a1d55bf8bac9508eda31a70c3c66bcc1fda876d7172351f6a746efba"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ2_XS.gguf",
|
| 31 |
+
"size": 11500944032,
|
| 32 |
+
"blob_id": "d6bde02072814e4f44dc98561e7e7d6e07576946",
|
| 33 |
+
"lfs_sha256": "ba3f9880cc4201d0b3ba1abe55810c44d27a8bd8f4c3c54dec2e86eef7fc9d8d"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ2_XXS.gguf",
|
| 37 |
+
"size": 10830191264,
|
| 38 |
+
"blob_id": "2f496a2ac4c0542270ae1a49d805fe3789d1f73f",
|
| 39 |
+
"lfs_sha256": "a2db744d4d07860ea92e4bb1dd11fdac013f51c3f7f76bec431d7d5864269eed"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ3_M.gguf",
|
| 43 |
+
"size": 15129830048,
|
| 44 |
+
"blob_id": "400046813465603023eb69f3ce7069764f24b71b",
|
| 45 |
+
"lfs_sha256": "ca770223875f3586e9c9807195b665d05bfd67b932ef7a0d4d4b65b885a62bbf"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ3_XS.gguf",
|
| 49 |
+
"size": 13841353376,
|
| 50 |
+
"blob_id": "4dea4906068f6525ecf1a5fb9449d08b6e0d8624",
|
| 51 |
+
"lfs_sha256": "4c53708310445cccf3726cc5a89db69cbc985c0f105522a5892496057ff231f0"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ3_XXS.gguf",
|
| 55 |
+
"size": 12981709472,
|
| 56 |
+
"blob_id": "6187b59cdbca1085a22d922cb72202d211318a15",
|
| 57 |
+
"lfs_sha256": "a7070d2b2d0a765d51b48e3e5cc7cf4db3c4b0f3379f70e78883a935fb2a5ae5"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ4_NL.gguf",
|
| 61 |
+
"size": 18025687712,
|
| 62 |
+
"blob_id": "58b4ca9b7078940163b6d05eda31929f6cde0d02",
|
| 63 |
+
"lfs_sha256": "341633b99bfb4fc6d08e078f60258856c2599eac6ac15a01119590d4361c5fa0"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-IQ4_XS.gguf",
|
| 67 |
+
"size": 17155893920,
|
| 68 |
+
"blob_id": "befc7758423296a8dab464f1cea3bb6668449f90",
|
| 69 |
+
"lfs_sha256": "0913e4cbe8f33f6ae7fd5a3480fff0dd3bc52575e7cb478a5f82f4cb28558c3d"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q2_K.gguf",
|
| 73 |
+
"size": 12631624352,
|
| 74 |
+
"blob_id": "57f6c8dfe577c2bfd0ef46e7e5040313e41c1319",
|
| 75 |
+
"lfs_sha256": "68715d70f65a27adae9bb319ab48d065e28c927bf010f5f990c780d94fc39b7f"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q2_K_L.gguf",
|
| 79 |
+
"size": 12972935840,
|
| 80 |
+
"blob_id": "d918b37418ab25d1988a65dd36f0b84551852001",
|
| 81 |
+
"lfs_sha256": "e7100faea89c242ed5885f0635559d3539bb16b324f033101bedda491c8f1a3f"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q3_K_L.gguf",
|
| 85 |
+
"size": 16810625696,
|
| 86 |
+
"blob_id": "f1f9bf55ac5603e91f8ddd4c7948ec28c96bd049",
|
| 87 |
+
"lfs_sha256": "610372b82c3c1069415f53f45ac2c24456ca52eaa01877b251c9887f7fb0783b"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q3_K_M.gguf",
|
| 91 |
+
"size": 15918123680,
|
| 92 |
+
"blob_id": "b68697beb54c83b3582763b478c0f5c55eecc5c2",
|
| 93 |
+
"lfs_sha256": "d62529e606c9ae056908436ba6f5a97a47bde5df87ecd182ae46fd0b69c5957e"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q3_K_S.gguf",
|
| 97 |
+
"size": 14329064096,
|
| 98 |
+
"blob_id": "43eab5baf5c1c70fa835f8a176c42774d5891f7e",
|
| 99 |
+
"lfs_sha256": "8a6e3e1d1bbfebe2200cf7572c04d46ed96035d8fc73f95fbba8a15a32e61866"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q3_K_XL.gguf",
|
| 103 |
+
"size": 17151937184,
|
| 104 |
+
"blob_id": "0f69c43433835ee458c14cdd5588eebc7f84180a",
|
| 105 |
+
"lfs_sha256": "ec20d29c4ac90aa1f9d923dca103f1a193bad2fd0fede9c433e8913e05a05bb1"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_0.gguf",
|
| 109 |
+
"size": 18076265120,
|
| 110 |
+
"blob_id": "14093de9a28195a40141c383f1a4eb6f44d66962",
|
| 111 |
+
"lfs_sha256": "b070189768c7c2d22f8b0204d59ed262845bf6deff59a36c84e80a7a0957f866"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_1.gguf",
|
| 115 |
+
"size": 19765275296,
|
| 116 |
+
"blob_id": "47535c0e2cf4fe90737d97c33c71b0bae8f0b5f2",
|
| 117 |
+
"lfs_sha256": "76b6e84d172b6b9e79210af7afa21d4cda5b95de3a29ea6f36f75f5395e01bc7"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_K_L.gguf",
|
| 121 |
+
"size": 19939801760,
|
| 122 |
+
"blob_id": "baf3c4f007bf190e4f6191c91a9bbe83371bbf01",
|
| 123 |
+
"lfs_sha256": "4506db57f0ec642455170c93d7ea48db9f8e2ff8b41856211594129e17bd7e52"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_K_M.gguf",
|
| 127 |
+
"size": 19598490272,
|
| 128 |
+
"blob_id": "a8c8b13c7363828741927268db87840aa514606d",
|
| 129 |
+
"lfs_sha256": "48415d6be6a28393ff2dfac18c01384de119201cedf2f0738b2b5cb2db9c8665"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q4_K_S.gguf",
|
| 133 |
+
"size": 18195655328,
|
| 134 |
+
"blob_id": "638c0fa1f0935ba34a609c5b67d64abbefc98b5f",
|
| 135 |
+
"lfs_sha256": "598b39db075ceddb28dd909efebd56ef7573171fc115ca18cb67e7521dcbcd31"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q5_K_L.gguf",
|
| 139 |
+
"size": 22950189728,
|
| 140 |
+
"blob_id": "adec58358fc5608bd3cd55818a1dac7ddad4aab6",
|
| 141 |
+
"lfs_sha256": "83b2303490feb8ed92a721e27583c0ca196063262a56ce6ab6715387e39bfbbb"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q5_K_M.gguf",
|
| 145 |
+
"size": 22608878240,
|
| 146 |
+
"blob_id": "5ff0ebc87f19667657ba26d822d2bd9b851de494",
|
| 147 |
+
"lfs_sha256": "881a34a7f209715eb5c97920fe70f528b21b0ef604e7df4748638038b629e0c0"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q5_K_S.gguf",
|
| 151 |
+
"size": 21504862880,
|
| 152 |
+
"blob_id": "7e349a84a2d8ec142c5574ececbb46a942d74bb5",
|
| 153 |
+
"lfs_sha256": "af1150bc86d6539ac894602ac4b380159750571b124b63b5b6f07262a5511ecc"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q6_K.gguf",
|
| 157 |
+
"size": 26726722208,
|
| 158 |
+
"blob_id": "ddcf6526670465bbf0600b15eb97f08e6f071ce0",
|
| 159 |
+
"lfs_sha256": "fa972ac60bcb40c215abccdcaa1cec121b71686a4d890a2e1fb77caec4ff59b4"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q6_K_L.gguf",
|
| 163 |
+
"size": 27068033696,
|
| 164 |
+
"blob_id": "5181b409cdfaf6e60c6b9eac6a8b5199a59d8f5d",
|
| 165 |
+
"lfs_sha256": "5a8b4e9b8c9102c7afd0dd903b451b18c3203c28049658de76920bdd71a35485"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-Q8_0.gguf",
|
| 169 |
+
"size": 32635677344,
|
| 170 |
+
"blob_id": "ae35114a661511646c8a8260e5ebda7cbe4ae2f5",
|
| 171 |
+
"lfs_sha256": "41887a4b71f47df9f56c9fe9f154626edb0fa92e3e6949ae3e389f15fff6248f"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-bf16/ReadyArt_gemma-4-31B-it-scotoma-2-bf16-00001-of-00002.gguf",
|
| 175 |
+
"size": 39897591936,
|
| 176 |
+
"blob_id": "2ddc16d2301f74a0b2ff4a243927bc5de8398c07",
|
| 177 |
+
"lfs_sha256": "d305b95ef3602b2ee3902f3676c183a27f02691fee82982c466124adef76985f"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-bf16/ReadyArt_gemma-4-31B-it-scotoma-2-bf16-00002-of-00002.gguf",
|
| 181 |
+
"size": 21515598272,
|
| 182 |
+
"blob_id": "69dc4ee214d1c36975851b51b6857b636bfa6524",
|
| 183 |
+
"lfs_sha256": "450fb7c9f38bf803843a2987325746ba307cf45fb118d9bd719d7ce9f5567c88"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "ReadyArt_gemma-4-31B-it-scotoma-2-imatrix.gguf",
|
| 187 |
+
"size": 13753952,
|
| 188 |
+
"blob_id": "4e432f0e1d6e3c830b9f7eb25e584e23e88d23e5",
|
| 189 |
+
"lfs_sha256": "68cf452e31a7880e66149f16f099a9bef6835675b8a686cf605744490e832b6e"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"rfilename": "mmproj-ReadyArt_gemma-4-31B-it-scotoma-2-bf16.gguf",
|
| 193 |
+
"size": 1200726528,
|
| 194 |
+
"blob_id": "d6f209ddd6ee7d02935cc4fa87b672e08b700d14",
|
| 195 |
+
"lfs_sha256": "31c7be59edf33a19a3fad53e738a059b8830cf1c9de70c7ad8e76c05b2f2f32e"
|
| 196 |
+
},
|
| 197 |
+
{
|
| 198 |
+
"rfilename": "mmproj-ReadyArt_gemma-4-31B-it-scotoma-2-f16.gguf",
|
| 199 |
+
"size": 1198957056,
|
| 200 |
+
"blob_id": "5e15f945474fd8755d6bbe53def99d576f459c54",
|
| 201 |
+
"lfs_sha256": "0c0a14f977e392a8f148bddf6986ccf7f18a7f1a4e6e8d9f2b354eaac4010e67"
|
| 202 |
+
}
|
| 203 |
+
]
|
| 204 |
+
}
|
bpw/hf/repo-metadata/bartowski__ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF.json
ADDED
|
@@ -0,0 +1,204 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/ValiantLabs_Muse-Glimmer-30B-Esper4-GGUF",
|
| 4 |
+
"commit_sha": "5e3faf47c4ca462d35d351c53d0f7e8731e1b829",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 27854794240,
|
| 7 |
+
"architecture": "muse-glimmer",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/Muse-Glimmer-30B-Esper4-GGUF/ValiantLabs_Muse-Glimmer-30B-Esper4-imatrix.gguf",
|
| 10 |
+
"chat_template": "{#\n Template: Muse Glimmer ATEM Chat Template\n Renders the ATEM tool-calling protocol: reasoning channel (to=self), tool\n channels (to=<tool>), and the user channel, plus tool definitions and the\n valid-recipient list in the system block.\n\n Whitespace note: every tag uses the {%- -%} / {{- -}} stripping markers, so\n the indentation below is purely for readability and contributes nothing to\n the rendered output.\n#}\n{%- macro render_content(content) -%}\n {%- if content is string -%}\n {{- content -}}\n {%- elif content is not none -%}\n {%- for part in content -%}\n {%- if part['type'] == 'image' -%}\n {{- '<|patch|>' -}}\n {%- elif part['type'] == 'video' -%}\n {{- '<|video|>' -}}\n {%- elif part['type'] == 'text' -%}\n {{- part['text'] -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro render_atem(tc) -%}\n {%- set args = tc.function.arguments -%}\n {%- if args is not mapping -%}\n {{- raise_exception('Muse Glimmer ATEM chat template requires tool_call.function.arguments to be a dict (mapping); a JSON string cannot be parsed in the HF jinja sandbox.') -}}\n {%- endif -%}\n {{- '<atem:function_calls>\\n<atem:invoke name=\"' + tc.function.name + '\">\\n' -}}\n {%- for k, v in args.items() -%}\n {{- '<atem:parameter name=\"' + k + '\">' -}}\n {%- if v is boolean -%}\n {%- if v -%}\n true\n {%- else -%}\n false\n {%- endif -%}\n {%- elif v is none -%}\n null\n {%- elif v is mapping or (v is iterable and v is not string) -%}\n {{- v | tojson -}}\n {%- else -%}\n {{- v -}}\n {%- endif -%}\n {{- '</atem:parameter>\\n' -}}\n {%- endfor -%}\n {{- '</atem:invoke>\\n</atem:function_calls>' -}}\n{%- endmacro -%}\n{%- macro render_tool_defs(tools) -%}\n {{- 'In this environment you have access to a set of tools you can use to answer the user\\'s question.\\n\\n' -}}\n {{- 'You can invoke a function by writing a \"<atem:function_calls>\" block like the following:\\n' -}}\n {{- '<atem:function_calls>\\n<atem:invoke name=\"$FUNCTION_NAME\">\\n<atem:parameter name=\"$PARAMETER_NAME\">$PARAMETER_VALUE</atem:parameter>\\n...\\n</atem:invoke>\\n</atem:function_calls>\\n\\n' -}}\n {{- 'String and scalar parameters should be specified as is, while lists and objects should use JSON format. Note that spaces for string values are not stripped. The output is not expected to be valid XML and is parsed with regular expressions.\\n' -}}\n {{- 'Here are the functions available in JSONSchema format:\\n' -}}\n {{- '// Tool metadata\\n' -}}\n {%- set nsns = namespace(seen=[]) -%}\n {%- for tool in tools -%}\n {%- set fn = tool.function if tool.function is defined else tool -%}\n {%- set tns = fn.name.split('.')[0] -%}\n {%- if tns not in nsns.seen -%}\n {%- set nsns.seen = nsns.seen + [tns] -%}\n {%- endif -%}\n {%- endfor -%}\n {%- set nd = tool_namespace_descriptions if tool_namespace_descriptions is defined else {} -%}\n {%- for tns in nsns.seen -%}\n {{- '{\"name\": ' + (tns | tojson) + ', \"description\": ' + ((nd[tns] if tns in nd else '') | tojson) + '}\\n' -}}\n {%- endfor -%}\n {{- '// Function schemas' -}}\n {%- for tool in tools -%}\n {%- set fn = tool.function if tool.function is defined else tool -%}\n {{- '\\n{\"name\": ' + (fn.name | tojson) + ', \"description\": ' + (fn.description | tojson) + ', \"parameters\": ' + (fn.parameters | tojson) + '}' -}}\n {%- endfor -%}\n {{- '\\n\\nHere\\'s an example of how to call a function in the tool set:\\n' -}}\n {{- '(If the tool namespace is not specified, invoke the function directly as `example_function_name` rather than `example_tool_name.example_function_name`)\\n\\n' -}}\n {{- 'to=example_tool_name.example_function_name\\n\\n' -}}\n {{- '<atem:function_calls>\\n<atem:invoke name=\"example_tool_name.example_function_name\">\\n' -}}\n {{- '<atem:parameter name=\"example_parameter_1\">value_1</atem:parameter>\\n' -}}\n {{- '<atem:parameter name=\"example_parameter_2\">This is the value for the second parameter\\nthat can span\\n\"multiple\" lines\\n</atem:parameter>\\n' -}}\n {{- '</atem:invoke>\\n</atem:function_calls>' -}}\n{%- endmacro -%}\n{%- macro render_reasoning() -%}\n {%- set rs = reasoning_strength if reasoning_strength is defined and reasoning_strength else 'high' -%}\n {{- 'Reasoning strength: ' + rs + '.' -}}\n{%- endmacro -%}\n{%- macro render_system_meta(tools) -%}\n {%- set rns = namespace(recipients=['\"self\"'], nslist=[]) -%}\n {%- if tools -%}\n {%- for tool in tools -%}\n {%- set fn = tool.function if tool.function is defined else tool -%}\n {%- set tns = fn.name.split('.')[0] -%}\n {%- if tns not in rns.nslist -%}\n {%- set rns.nslist = rns.nslist + [tns] -%}\n {%- endif -%}\n {%- endfor -%}\n {%- for tns in rns.nslist -%}\n {%- set rns.recipients = rns.recipients + ['\"' + tns + '.*\"'] -%}\n {%- endfor -%}\n {%- endif -%}\n {%- set rns.recipients = rns.recipients + ['\"user\"'] -%}\n {{- '# Valid recipients: ' + rns.recipients | join(', ') + '.' -}}\n{%- endmacro -%}\n{{- bos_token -}}\n{%- set ns = namespace(has_system=false) -%}\n{%- for m in messages -%}\n {%- if m['role'] == 'system' -%}\n {%- set ns.has_system = true -%}\n {%- endif -%}\n{%- endfor -%}\n{%- if not ns.has_system -%}\n {{- '<|start|>system<|message|>You are a helpful AI assistant.' -}}\n {%- set kc = knowledge_cutoff if knowledge_cutoff is defined and knowledge_cutoff else '2026-01-04' -%}\n {{- '\\nKnowledge cutoff: ' + kc + '.' -}}\n {%- if current_date is defined and current_date -%}\n {{- '\\nCurrent date: ' + current_date + '.' -}}\n {%- elif strftime_now is defined -%}\n {{- '\\nCurrent date: ' + strftime_now('%Y-%m-%d') + '.' -}}\n {%- endif -%}\n {{- '\\n\\n' -}}\n {{- render_reasoning() -}}\n {%- if tools -%}\n {{- '\\n\\n' -}}\n {{- render_tool_defs(tools) -}}\n {%- endif -%}\n {{- '\\n\\n' -}}\n {{- render_system_meta(tools) -}}\n {{- '<|eot|>' -}}\n{%- endif -%}\n{%- for message in messages -%}\n {%- set role = message['role'] -%}\n {%- set end_token = '<|eom|>' if (not loop.last and messages[loop.index0 + 1]['role'] == role) else '<|eot|>' -%}\n {%- if role == 'system' -%}\n {#- Callers sometimes write the directive into the system prompt themselves.\n Normalise \"Reasoning effort\" to \"Reasoning strength\" (jinja has no\n case-insensitive replace, hence the four realistic casings), then skip\n the kwarg-driven line below if the prompt already carries one. -#}\n {%- set sys_text = render_content(message['content'])\n | replace('Reasoning effort', 'Reasoning strength')\n | replace('Reasoning Effort', 'Reasoning Strength')\n | replace('reasoning effort', 'reasoning strength')\n | replace('REASONING EFFORT', 'REASONING STRENGTH') -%}\n {{- '<|start|>system<|message|>' -}}\n {{- sys_text -}}\n {%- if 'reasoning strength' not in (sys_text | lower) -%}\n {{- '\\n\\n' -}}\n {{- render_reasoning() -}}\n {%- endif -%}\n {%- if tools -%}\n {{- '\\n\\n' -}}\n {{- render_tool_defs(tools) -}}\n {%- endif -%}\n {{- '\\n\\n' -}}\n {{- render_system_meta(tools) -}}\n {{- '<|eot|>' -}}\n {%- elif role == 'user' -%}\n {{- '<|start|>user<|message|>' -}}\n {{- render_content(message['content']) -}}\n {{- '<|eot|>' -}}\n {%- elif role == 'tool' -%}\n {%- set tname = message.get('name') -%}\n {%- if not tname -%}\n {%- set tcid = message.get('tool_call_id') -%}\n {%- set rns = namespace(name=tcid if tcid else '') -%}\n {%- for m in messages -%}\n {%- if m.get('tool_calls') -%}\n {%- for tc in m['tool_calls'] -%}\n {%- if tcid is not none and tc.id is defined and tc.id == tcid -%}\n {%- set rns.name = tc.function.name -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endfor -%}\n {%- set tname = rns.name -%}\n {%- endif -%}\n {{- '<|start|>tool ' + tname + '<|message|><tool_output name=\"' + tname + '\">\\n' -}}\n {{- render_content(message['content']) -}}\n {{- '\\n</tool_output><|eot|>' -}}\n {%- elif role == 'assistant' -%}\n {%- if message.get('reasoning_content') -%}\n {{- '<|start|>assistant to=self<|message|>' + message['reasoning_content'] + '<|eom|>' -}}\n {%- endif -%}\n {%- if message.get('tool_calls') -%}\n {%- for tc in message['tool_calls'] -%}\n {{- '<|start|>assistant to=' + tc.function.name + '<|message|>' -}}\n {{- render_atem(tc) -}}\n {%- if loop.last -%}\n {{- end_token -}}\n {%- else -%}\n {{- '<|eom|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {%- set recipient = message.get('recipient') or 'user' -%}\n {%- set end_turn = message.get('end_turn') -%}\n {%- if end_turn is none -%}\n {%- set end_turn = not (recipient and recipient != 'user') -%}\n {%- endif -%}\n {{- '<|start|>assistant' -}}\n {%- if recipient -%}\n {{- ' to=' + recipient -}}\n {%- endif -%}\n {{- '<|message|>' -}}\n {{- render_content(message['content']) -}}\n {{- ('<|eot|>' if end_turn else '<|eom|>') -}}\n {%- endif -%}\n {%- endif -%}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n {{- '<|start|>assistant' -}}\n{%- endif -%}\n",
|
| 11 |
+
"bos_token": "<|begin_of_text|>",
|
| 12 |
+
"eos_token": "<|end_of_text|>",
|
| 13 |
+
"totalFileSize": 10657484064
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.215584+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ2_M.gguf",
|
| 19 |
+
"size": 10657484064,
|
| 20 |
+
"blob_id": "f5c75f96168d6a556caafef56e4259227e15210f",
|
| 21 |
+
"lfs_sha256": "428e2799d21f69980eaf5984879339d291eb0fe0d839a98f45e2a51cc185f459"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ2_S.gguf",
|
| 25 |
+
"size": 10040020256,
|
| 26 |
+
"blob_id": "ab9102ea9c02b7e48b2864fec8d02cc5a19c55ee",
|
| 27 |
+
"lfs_sha256": "086f43a6d786e3140e527100ab5091feeb6af3822a777377b95b6794be27a28c"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ2_XS.gguf",
|
| 31 |
+
"size": 9582589984,
|
| 32 |
+
"blob_id": "3b005e09303a0b26cf572df0c80d2505d490cdee",
|
| 33 |
+
"lfs_sha256": "1591f28a013bf6ed9307f1426342c7b6d13f3d540360c2f8b4fb9c27782aa9f0"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ2_XXS.gguf",
|
| 37 |
+
"size": 8920823840,
|
| 38 |
+
"blob_id": "8ac18981fbf00ba039f4e71b5eb6000f9be83ba4",
|
| 39 |
+
"lfs_sha256": "16bd7df0a27548ccd14d8d85007822f36363f17ff3656ff5a9bca684369d9eff"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ3_M.gguf",
|
| 43 |
+
"size": 13106243104,
|
| 44 |
+
"blob_id": "2fe17bf6c95c3b5c8a40ea33d590ae1f58761cb4",
|
| 45 |
+
"lfs_sha256": "81a879c1c9b0bbd168ed56273209f1efb205362a1fb5e96ec306bab3683c401f"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ3_XS.gguf",
|
| 49 |
+
"size": 12315031072,
|
| 50 |
+
"blob_id": "ef088e2c2070188b5ec8163c1c5128a1b3dd0097",
|
| 51 |
+
"lfs_sha256": "000fcd60618664745578c82a5129bdd6dbe656c764398e2e1a6c272b008b50e8"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ3_XXS.gguf",
|
| 55 |
+
"size": 11546645792,
|
| 56 |
+
"blob_id": "384f8ccb854f16dbada9883a6ad86e5734eb46ee",
|
| 57 |
+
"lfs_sha256": "4886c586e9146cb0df458445e2fa9bd4f0d270b3aff80bfb22542411515bf5a6"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ4_NL.gguf",
|
| 61 |
+
"size": 16238573344,
|
| 62 |
+
"blob_id": "3cc635f68c99aa5bf82c54abf2bcfcac9e6974da",
|
| 63 |
+
"lfs_sha256": "04b60fcecca94b61552196ad20df82d51272791b2d811786df33b56257b0b426"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-IQ4_XS.gguf",
|
| 67 |
+
"size": 15435100960,
|
| 68 |
+
"blob_id": "06c1a4045896de30c979a63174ccc3287c7a7686",
|
| 69 |
+
"lfs_sha256": "0eab4c6e57f88423f8dc2e9bcc94f2c76ad16d4eb340c66fbce83b636716d8fa"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q2_K.gguf",
|
| 73 |
+
"size": 11035584800,
|
| 74 |
+
"blob_id": "e3706d541b62fb157abdae411ad0c9aff0400a33",
|
| 75 |
+
"lfs_sha256": "b394f4961d631b9be48557f8df3fc9b2b2e5e80b9d15daa24c09c73620096f8c"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q2_K_L.gguf",
|
| 79 |
+
"size": 12348896800,
|
| 80 |
+
"blob_id": "3e77a43046269ab22d3c2e109dc9dc6189f8cd51",
|
| 81 |
+
"lfs_sha256": "d6796f64d1d324f30f22dea612beb7534566d76498deef84b59cc6c87a6ac33f"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q3_K_L.gguf",
|
| 85 |
+
"size": 14782117408,
|
| 86 |
+
"blob_id": "022aca959722087a90c0754444c8e982c89ec1a6",
|
| 87 |
+
"lfs_sha256": "047ff64d7f3af9e624382ceefe519f2a435bc980095893fa7d29d786da72221d"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q3_K_M.gguf",
|
| 91 |
+
"size": 13962524192,
|
| 92 |
+
"blob_id": "86a495a411ae1394c21c6883bc0edef11369b45e",
|
| 93 |
+
"lfs_sha256": "61451c59c0750467057d3ebf6fa8ab97f16abece428e6108dda8169acfe8a0d9"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q3_K_S.gguf",
|
| 97 |
+
"size": 12789204512,
|
| 98 |
+
"blob_id": "bba92e97abcf7ce6eafe3eaf8774efcfbc71b9ef",
|
| 99 |
+
"lfs_sha256": "396cf4c38a71b0f4a667e0d2d6cbaf3d8d0d0c819a42f446a306ab442d7007a7"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q3_K_XL.gguf",
|
| 103 |
+
"size": 15958844960,
|
| 104 |
+
"blob_id": "536cde238e865bb17beddb40ac327936054d3916",
|
| 105 |
+
"lfs_sha256": "04eedf4ee0244f3ef3871d8254c8ce992534d5c18306f88c8dc2b039d7d41121"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_0.gguf",
|
| 109 |
+
"size": 16265570080,
|
| 110 |
+
"blob_id": "5d082764c35447c019ab6cd64e51e4f218d2f930",
|
| 111 |
+
"lfs_sha256": "2fb7e9632e29dbe4c97c0f18913bb11ccb55028afd613b1f68550cd6a2ac81a8"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_1.gguf",
|
| 115 |
+
"size": 17828212512,
|
| 116 |
+
"blob_id": "ec1219ab32e395e37bf7c2cfd50a82d17b44db91",
|
| 117 |
+
"lfs_sha256": "45e3439468087fca8dd9a8ef1831a2662ffbc8a1197bfaa9b0287a79eba18315"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_K_L.gguf",
|
| 121 |
+
"size": 18304445984,
|
| 122 |
+
"blob_id": "44f224be01311d80f7ebe74507cdfc7faa7b2807",
|
| 123 |
+
"lfs_sha256": "edf9c88e5d7f12cdbd0067f9b4a9cd39b03557ffa152fa61e7eced3e1a7b9cc9"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_K_M.gguf",
|
| 127 |
+
"size": 17306328864,
|
| 128 |
+
"blob_id": "dd2d0487aabc2bbcf130878a23604da4c4156dc9",
|
| 129 |
+
"lfs_sha256": "6a9e5b7ccd7eb0a624808f1457f0e9d94500c688cd488f538ad8a1439f50c46f"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q4_K_S.gguf",
|
| 133 |
+
"size": 16320948000,
|
| 134 |
+
"blob_id": "21825ee09c31dfd4a0cdaccd3f398230f953ce8f",
|
| 135 |
+
"lfs_sha256": "d95a5e8bff048b2e3cb4e9b78644d5cbfe41c574e46d032170116568049c9f03"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q5_K_L.gguf",
|
| 139 |
+
"size": 20935589408,
|
| 140 |
+
"blob_id": "e58a69dfaf86100619605017d620dc5708bb84e5",
|
| 141 |
+
"lfs_sha256": "954c9690ada12da5e42b54af6cb952a04b8e43e9cdc90b21a1d14ac72709bc2a"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q5_K_M.gguf",
|
| 145 |
+
"size": 20105576224,
|
| 146 |
+
"blob_id": "0884093979a35db9eb2d3ad4046767162691d5ae",
|
| 147 |
+
"lfs_sha256": "68d65f6f6bc7b1265b3ae4a9aaea18d6d9814bea2f4a0389921719cbe9458c08"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q5_K_S.gguf",
|
| 151 |
+
"size": 19440695072,
|
| 152 |
+
"blob_id": "45bae62a1a1b658dd120f1a7f04252b14ad62626",
|
| 153 |
+
"lfs_sha256": "f193c69818d11c4d0888037636059e7253bcc0575014c8de73cc4c059595c158"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q6_K.gguf",
|
| 157 |
+
"size": 23414423584,
|
| 158 |
+
"blob_id": "1be4dfccb4968f7d0f589df2456ff27cb27f7257",
|
| 159 |
+
"lfs_sha256": "3f191c7940aa8d95f472576ece05ca365b7f24fdf2cbc00a4bd75e0bb7c07d56"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q6_K_L.gguf",
|
| 163 |
+
"size": 24065826336,
|
| 164 |
+
"blob_id": "4005b6cce59cf46af19dffb1b140a01b33a86c47",
|
| 165 |
+
"lfs_sha256": "85c72518f9187ae5a3e7082a9b8d7ac06aba3c36bde5629e1a186da15e10c92d"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-Q8_0.gguf",
|
| 169 |
+
"size": 29612963360,
|
| 170 |
+
"blob_id": "72c489fcc60104d4696e9da7b750346ff77a1658",
|
| 171 |
+
"lfs_sha256": "156ad787c0b35a448aa0640c60a607322ef80f25f8e617010392a667add46b42"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-bf16/ValiantLabs_Muse-Glimmer-30B-Esper4-bf16-00001-of-00002.gguf",
|
| 175 |
+
"size": 39750451040,
|
| 176 |
+
"blob_id": "31cdb7f3a9edef4063c739e106ca51e30c3a208d",
|
| 177 |
+
"lfs_sha256": "4b17e0f2d1dd6cdfdbd948935dc03837ad73ba881e6d55f1b1d2907b06b357d2"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-bf16/ValiantLabs_Muse-Glimmer-30B-Esper4-bf16-00002-of-00002.gguf",
|
| 181 |
+
"size": 15975065152,
|
| 182 |
+
"blob_id": "a24564e91b97893a7b6d94479d1c14035814584d",
|
| 183 |
+
"lfs_sha256": "7861ca53f47228f3e37f6b67ff56907e29e81a3bd907f43d5d47f62b44b7a322"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "ValiantLabs_Muse-Glimmer-30B-Esper4-imatrix.gguf",
|
| 187 |
+
"size": 13376128,
|
| 188 |
+
"blob_id": "088a2b9bd35a3c857e809a31dbfb8deced372747",
|
| 189 |
+
"lfs_sha256": "11e27f33d3f97254162d4415bbec1b452da2f02f6e92691e14b69d147e1646c3"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"rfilename": "mmproj-ValiantLabs_Muse-Glimmer-30B-Esper4-bf16.gguf",
|
| 193 |
+
"size": 3849175904,
|
| 194 |
+
"blob_id": "4ad503eec1a4b924fa817edccb149aee136e137f",
|
| 195 |
+
"lfs_sha256": "41b998dc6080e98e53ea1da0972cfe600dcc47bf4d47f4e239ade8636469d7b0"
|
| 196 |
+
},
|
| 197 |
+
{
|
| 198 |
+
"rfilename": "mmproj-ValiantLabs_Muse-Glimmer-30B-Esper4-f16.gguf",
|
| 199 |
+
"size": 3847369568,
|
| 200 |
+
"blob_id": "6976e19c7e182f17c00928e4f19d91c107925b58",
|
| 201 |
+
"lfs_sha256": "7269444a0139bdabba4719566617462d965991e3d36f45e22a28baf6e9ff5670"
|
| 202 |
+
}
|
| 203 |
+
]
|
| 204 |
+
}
|
bpw/hf/repo-metadata/bartowski__allura-org_Qwen3.6-35B-A3B-Anko-GGUF.json
ADDED
|
@@ -0,0 +1,204 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/allura-org_Qwen3.6-35B-A3B-Anko-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/allura-org_Qwen3.6-35B-A3B-Anko-GGUF",
|
| 4 |
+
"commit_sha": "13f18e6d67716b2702480449bd8b4b55f6677c38",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 34660610688,
|
| 7 |
+
"architecture": "qwen35moe",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/Qwen3.6-35B-A3B-Anko-GGUF/allura-org_Qwen3.6-35B-A3B-Anko-imatrix.gguf",
|
| 10 |
+
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {{- '<|im_start|>system\\n' + content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if (preserve_thinking is defined and preserve_thinking is true) or (loop.index0 > ns.last_query_index) %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}",
|
| 11 |
+
"bos_token": "<|endoftext|>",
|
| 12 |
+
"eos_token": "<|im_end|>",
|
| 13 |
+
"totalFileSize": 12066716128
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.196082+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ2_M.gguf",
|
| 19 |
+
"size": 12066716128,
|
| 20 |
+
"blob_id": "759ca68b0c4c1500a0757680f6ec99724bb8ca08",
|
| 21 |
+
"lfs_sha256": "23fde034ea14f9515f6d3984c30b01eb8def725465156549079b11910851836c"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ2_S.gguf",
|
| 25 |
+
"size": 11010275808,
|
| 26 |
+
"blob_id": "213d5e955691e545e65e498414ee9ec232e1ad31",
|
| 27 |
+
"lfs_sha256": "92a54bb08352f63794803c9af69825e3b4ef4918ac0cace790ad989db5c9b594"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ2_XS.gguf",
|
| 31 |
+
"size": 10797144544,
|
| 32 |
+
"blob_id": "5629583b7c9782c7ebea1b73aac76b138a6379c0",
|
| 33 |
+
"lfs_sha256": "d1d4742613156bb7d92db983329dfeaba4b111545801483931b8080d6331ddd3"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ2_XXS.gguf",
|
| 37 |
+
"size": 9778452960,
|
| 38 |
+
"blob_id": "b91be0596ed7473d258727f8a51c1e62cd12fbe4",
|
| 39 |
+
"lfs_sha256": "3b158f25403208857cbe43faabb80314453e43fe6e70324a702996cea28f220c"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ3_M.gguf",
|
| 43 |
+
"size": 16900258272,
|
| 44 |
+
"blob_id": "4475ea6bb847420eed621209ad5310a5d766a720",
|
| 45 |
+
"lfs_sha256": "f5fc9e7582f272803e949c56737250c96584f630a155b02ee5a4d63c68e9c7ae"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ3_XS.gguf",
|
| 49 |
+
"size": 16218683872,
|
| 50 |
+
"blob_id": "74959804dc3b371a448f310091acd97990d13e0e",
|
| 51 |
+
"lfs_sha256": "c639687a4db6a7bc015c13e09c30a0628988388ab621cb30060c2bba5d718c0a"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ3_XXS.gguf",
|
| 55 |
+
"size": 14870829536,
|
| 56 |
+
"blob_id": "b221d1fcb47bcca493c7ed83b803db2efd06b73d",
|
| 57 |
+
"lfs_sha256": "71eb418de48b7216d1d8a3ec85da3c1293f385619ed9c5039b87fc3c185bf8e6"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ4_NL.gguf",
|
| 61 |
+
"size": 19861346784,
|
| 62 |
+
"blob_id": "1a0c9af90426ca6cf3481986bc58fe6b547d1304",
|
| 63 |
+
"lfs_sha256": "e063998ed01c6dfcab8c74810b0754f057010d77832064fe20259e8b8a1d2d87"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-IQ4_XS.gguf",
|
| 67 |
+
"size": 18806446560,
|
| 68 |
+
"blob_id": "582c5e9fcef4782af72bd0289e84868b30403050",
|
| 69 |
+
"lfs_sha256": "51ce7389defeb19e74574636ede2606ea91bc8c20a6bf92db4d6eb8f78074d51"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q2_K.gguf",
|
| 73 |
+
"size": 12617079264,
|
| 74 |
+
"blob_id": "35579bbb5fb183ae52d0edc86d6b091660cea883",
|
| 75 |
+
"lfs_sha256": "8c054b20577f89c2653afe7b43fa61523256767578431d8a747b7374dcd491f3"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q2_K_L.gguf",
|
| 79 |
+
"size": 13113719264,
|
| 80 |
+
"blob_id": "26a7aad30e7819c0099fcb46dc4b78d1fdfbe0fe",
|
| 81 |
+
"lfs_sha256": "a967518e7ffa6576d96bc7b4c072d621fe9539e6732139c0588a67cc73970d23"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q3_K_L.gguf",
|
| 85 |
+
"size": 16886495712,
|
| 86 |
+
"blob_id": "2c553922496c2e72f3f42f32d74bb31be16d799e",
|
| 87 |
+
"lfs_sha256": "0373b291779838ee682c34b1790bd8de8766b6ee7bef961e6c84463a003d39bb"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q3_K_M.gguf",
|
| 91 |
+
"size": 16226548192,
|
| 92 |
+
"blob_id": "0d2ae5ad648e17baf2c6ab1aea611b36e1de17b3",
|
| 93 |
+
"lfs_sha256": "af82648fceadc5f9119326a6b4bd06f88752240172e3c336bcb9828fc952489f"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q3_K_S.gguf",
|
| 97 |
+
"size": 15513516512,
|
| 98 |
+
"blob_id": "39a14460f117e981bc6cc934eb60f36aa90c8a59",
|
| 99 |
+
"lfs_sha256": "6ad31e0001adef3bf1fea91c803107a04ddf1685e706c65dc8d66153e3d38e74"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q3_K_XL.gguf",
|
| 103 |
+
"size": 17331485152,
|
| 104 |
+
"blob_id": "a0da596da8f0952329b8df8459c229d744997767",
|
| 105 |
+
"lfs_sha256": "a66b73f1fd057987b8ec5cf7f3ac65fbac3a7e46ec7017c07c5dd93d70cb01a2"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_0.gguf",
|
| 109 |
+
"size": 19942611424,
|
| 110 |
+
"blob_id": "f5e2fb7fc1931384a5e0b2cd5f3b1accfc623817",
|
| 111 |
+
"lfs_sha256": "72467da57bf63f2224a21d35ed4c3158ade3fe8fd7e3d9c338dde2302ade623f"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_1.gguf",
|
| 115 |
+
"size": 21973768672,
|
| 116 |
+
"blob_id": "302ba34e3c3fa0553ba6b6224a35a320e09f0394",
|
| 117 |
+
"lfs_sha256": "8b7398f3edf2ca17f74a922546ea8bd9ce3dd00b98b6e34665e8315eb6d7304c"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_K_L.gguf",
|
| 121 |
+
"size": 21768894944,
|
| 122 |
+
"blob_id": "e7afe3026684fcffa829eb94bc2502905837b8a9",
|
| 123 |
+
"lfs_sha256": "132a394f4671491ed2985c6319ed0b4aad848e3739dfaf4ddb739d7ebacca7a2"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_K_M.gguf",
|
| 127 |
+
"size": 21391448544,
|
| 128 |
+
"blob_id": "5a07d6d38f38b2fa77ca5c7f15b7e135ea4e41ed",
|
| 129 |
+
"lfs_sha256": "c56a7714fdcca7c62fd680f966c7ba31b033533183728944ab0327c7e6c4402c"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q4_K_S.gguf",
|
| 133 |
+
"size": 20592728544,
|
| 134 |
+
"blob_id": "b72e4fc3ea81928d832c0164f0ccc4b188122617",
|
| 135 |
+
"lfs_sha256": "03335870d1a728f2d8dd300c51bb39f1b662fd049870639db1b00f11b49cbc25"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q5_K_L.gguf",
|
| 139 |
+
"size": 25331333600,
|
| 140 |
+
"blob_id": "84f609cbce6fe8875fa007fe4ec3c32ba5b9ba77",
|
| 141 |
+
"lfs_sha256": "d2e680d0afc0b5ed4bbf24e44c5e63132518f7b5bce23ff482111447aacf29b5"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q5_K_M.gguf",
|
| 145 |
+
"size": 25017457120,
|
| 146 |
+
"blob_id": "fbc43c51d7081172a9f82463b3c65f9ed68014f6",
|
| 147 |
+
"lfs_sha256": "9c97afdfca80cf69e6c014623ed9015578284e78d08dd33d87e5595109d0554a"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q5_K_S.gguf",
|
| 151 |
+
"size": 24156150240,
|
| 152 |
+
"blob_id": "57d9ea84780e803549c89593c5e7229140b4422a",
|
| 153 |
+
"lfs_sha256": "bd90b9e3fe09bae6bb08c3a9f278517727704d79b75bfab5911312b0071dc22e"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q6_K.gguf",
|
| 157 |
+
"size": 30053415392,
|
| 158 |
+
"blob_id": "8c253fe9cd135abd586b7388d8cfefdb2a8f1db4",
|
| 159 |
+
"lfs_sha256": "b789562923de187419655a88403d7ec7cfa6b812a87eeb0a022baddc0291949f"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q6_K_L.gguf",
|
| 163 |
+
"size": 30299748832,
|
| 164 |
+
"blob_id": "564f1863548fb6356273e92e019761711852d791",
|
| 165 |
+
"lfs_sha256": "87460fb6d6613704a43c8f038029ee406ac489b5259d67688fb82330eb733274"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-Q8_0.gguf",
|
| 169 |
+
"size": 36914690528,
|
| 170 |
+
"blob_id": "11e4f0ce9ff9816e16107cf3e4d1582bd989f3e6",
|
| 171 |
+
"lfs_sha256": "9cb6c976f76dda5c1720f65b11412753c413bbefa98e0a015f6f75e9fc93db7c"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-bf16/allura-org_Qwen3.6-35B-A3B-Anko-bf16-00001-of-00002.gguf",
|
| 175 |
+
"size": 39742883936,
|
| 176 |
+
"blob_id": "6b1f242f3c05a0e822e924f8f47936f2b97eb414",
|
| 177 |
+
"lfs_sha256": "02ed2d77519a37c1ffc3be30ef21eb9acfede6290b527f07f8a9706a28d5f44c"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-bf16/allura-org_Qwen3.6-35B-A3B-Anko-bf16-00002-of-00002.gguf",
|
| 181 |
+
"size": 29633753376,
|
| 182 |
+
"blob_id": "da87a970339e957d3b6ce7d721796fa9ccb71d55",
|
| 183 |
+
"lfs_sha256": "15a10d1b159525bdbf4658c35c86c86c25d6257d73a86edaea8d65c082c3e080"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "allura-org_Qwen3.6-35B-A3B-Anko-imatrix.gguf",
|
| 187 |
+
"size": 192223904,
|
| 188 |
+
"blob_id": "c93558d288023076c501e5154196c8f48079bc52",
|
| 189 |
+
"lfs_sha256": "3b3fe9001d774a26764637b41a7994f41d56f4a7551af0d878959061e5d7e7f4"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"rfilename": "mmproj-allura-org_Qwen3.6-35B-A3B-Anko-bf16.gguf",
|
| 193 |
+
"size": 902822240,
|
| 194 |
+
"blob_id": "d660b6c510a19e2f3aedfcebaae500fd48e08e49",
|
| 195 |
+
"lfs_sha256": "1c625f05cd52e90abc76a5f756226c3a5fe279593379c22f6c6846c970a0cd18"
|
| 196 |
+
},
|
| 197 |
+
{
|
| 198 |
+
"rfilename": "mmproj-allura-org_Qwen3.6-35B-A3B-Anko-f16.gguf",
|
| 199 |
+
"size": 899283296,
|
| 200 |
+
"blob_id": "50314fc4bc2cd4ac50fb7b3220461794baf69f51",
|
| 201 |
+
"lfs_sha256": "67924785ff1885c2b34c15d0e52979e991acca64221694ba2cc3a6474a053fb4"
|
| 202 |
+
}
|
| 203 |
+
]
|
| 204 |
+
}
|
bpw/hf/repo-metadata/bartowski__darkc0de_Muse-Glimmer-30B-heretic-GGUF.json
ADDED
|
@@ -0,0 +1,204 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/darkc0de_Muse-Glimmer-30B-heretic-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/darkc0de_Muse-Glimmer-30B-heretic-GGUF",
|
| 4 |
+
"commit_sha": "49f757ea312905be72d0e7dc331caec1f656f764",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 27854794240,
|
| 7 |
+
"architecture": "muse-glimmer",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/Muse-Glimmer-30B-heretic-GGUF/darkc0de_Muse-Glimmer-30B-heretic-imatrix.gguf",
|
| 10 |
+
"chat_template": "{%- macro render_content(content) -%}{%- if content is string -%}{{- content -}}{%- elif content is not none -%}{%- for part in content -%}{%- if part['type'] == 'image' -%}{{- '<|patch|>' -}}{%- elif part['type'] == 'video' -%}{{- '<|video|>' -}}{%- elif part['type'] == 'text' -%}{{- part['text'] -}}{%- endif -%}{%- endfor -%}{%- endif -%}{%- endmacro -%}{%- macro render_atem(tc) -%}{%- set args = tc.function.arguments -%}{%- if args is not mapping -%}{{- raise_exception('Onyx ATEM chat template requires tool_call.function.arguments to be a dict (mapping); a JSON string cannot be parsed in the HF jinja sandbox.') -}}{%- endif -%}{{- '<atem:function_calls>\\n<atem:invoke name=\"' + tc.function.name + '\">\\n' -}}{%- for k, v in args.items() -%}{{- '<atem:parameter name=\"' + k + '\">' -}}{%- if v is boolean -%}{%- if v -%}true{%- else -%}false{%- endif -%}{%- elif v is none -%}null{%- elif v is mapping or (v is iterable and v is not string) -%}{{- v | tojson -}}{%- else -%}{{- v -}}{%- endif -%}{{- '</atem:parameter>\\n' -}}{%- endfor -%}{{- '</atem:invoke>\\n</atem:function_calls>' -}}{%- endmacro -%}{%- macro render_tool_defs(tools) -%}{{- 'In this environment you have access to a set of tools you can use to answer the user\\'s question.\\n\\n' -}}{{- 'You can invoke a function by writing a \"<atem:function_calls>\" block like the following:\\n' -}}{{- '<atem:function_calls>\\n<atem:invoke name=\"$FUNCTION_NAME\">\\n<atem:parameter name=\"$PARAMETER_NAME\">$PARAMETER_VALUE</atem:parameter>\\n...\\n</atem:invoke>\\n</atem:function_calls>\\n\\n' -}}{{- 'String and scalar parameters should be specified as is, while lists and objects should use JSON format. Note that spaces for string values are not stripped. The output is not expected to be valid XML and is parsed with regular expressions.\\n' -}}{{- 'Here are the functions available in JSONSchema format:\\n' -}}{{- '// Tool metadata\\n' -}}{%- set nsns = namespace(seen=[]) -%}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{%- set tns = fn.name.split('.')[0] -%}{%- if tns not in nsns.seen -%}{%- set nsns.seen = nsns.seen + [tns] -%}{%- endif -%}{%- endfor -%}{%- set nd = tool_namespace_descriptions if tool_namespace_descriptions is defined else {} -%}{%- for tns in nsns.seen -%}{{- '{\"name\": ' + (tns | tojson) + ', \"description\": ' + ((nd[tns] if tns in nd else '') | tojson) + '}\\n' -}}{%- endfor -%}{{- '// Function schemas' -}}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{{- '\\n{\"name\": ' + (fn.name | tojson) + ', \"description\": ' + (fn.description | tojson) + ', \"parameters\": ' + (fn.parameters | tojson) + '}' -}}{%- endfor -%}{{- '\\n\\nHere\\'s an example of how to call a function in the tool set:\\n' -}}{{- '(If the tool namespace is not specified, invoke the function directly as `example_function_name` rather than `example_tool_name.example_function_name`)\\n\\n' -}}{{- 'to=example_tool_name.example_function_name\\n\\n' -}}{{- '<atem:function_calls>\\n<atem:invoke name=\"example_tool_name.example_function_name\">\\n' -}}{{- '<atem:parameter name=\"example_parameter_1\">value_1</atem:parameter>\\n' -}}{{- '<atem:parameter name=\"example_parameter_2\">This is the value for the second parameter\\nthat can span\\n\"multiple\" lines\\n</atem:parameter>\\n' -}}{{- '</atem:invoke>\\n</atem:function_calls>' -}}{%- endmacro -%}{%- macro render_reasoning() -%}{%- set rs = reasoning_strength if reasoning_strength is defined and reasoning_strength else 'high' -%}{{- 'Reasoning strength: ' + rs + '.' -}}{%- endmacro -%}{%- macro render_system_meta(tools) -%}{%- set rns = namespace(recipients=['\"self\"'], nslist=[]) -%}{%- if tools -%}{%- for tool in tools -%}{%- set fn = tool.function if tool.function is defined else tool -%}{%- set tns = fn.name.split('.')[0] -%}{%- if tns not in rns.nslist -%}{%- set rns.nslist = rns.nslist + [tns] -%}{%- endif -%}{%- endfor -%}{%- for tns in rns.nslist -%}{%- set rns.recipients = rns.recipients + ['\"' + tns + '.*\"'] -%}{%- endfor -%}{%- endif -%}{%- set rns.recipients = rns.recipients + ['\"user\"'] -%}{{- '# Valid recipients: ' + rns.recipients | join(', ') + '.' -}}{%- endmacro -%}{{- bos_token -}}{%- set ns = namespace(has_system=false) -%}{%- for m in messages -%}{%- if m['role'] == 'system' -%}{%- set ns.has_system = true -%}{%- endif -%}{%- endfor -%}{%- if not ns.has_system -%}{{- '<|start|>system<|message|>You are a helpful AI assistant.' -}}{%- set kc = knowledge_cutoff if knowledge_cutoff is defined and knowledge_cutoff else '2026-01-04' -%}{{- '\\nKnowledge cutoff: ' + kc + '.' -}}{%- if current_date is defined and current_date -%}{{- '\\nCurrent date: ' + current_date + '.' -}}{%- elif strftime_now is defined -%}{{- '\\nCurrent date: ' + strftime_now('%Y-%m-%d') + '.' -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_reasoning() -}}{%- if tools -%}{{- '\\n\\n' -}}{{- render_tool_defs(tools) -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_system_meta(tools) -}}{{- '<|eot|>' -}}{%- endif -%}{%- for message in messages -%}{%- set role = message['role'] -%}{%- set end_token = '<|eom|>' if (not loop.last and messages[loop.index0 + 1]['role'] == role) else '<|eot|>' -%}{%- if role == 'system' -%}{{- '<|start|>system<|message|>' -}}{{- render_content(message['content']) -}}{{- '\\n\\n' -}}{{- render_reasoning() -}}{%- if tools -%}{{- '\\n\\n' -}}{{- render_tool_defs(tools) -}}{%- endif -%}{{- '\\n\\n' -}}{{- render_system_meta(tools) -}}{{- '<|eot|>' -}}{%- elif role == 'user' -%}{{- '<|start|>user<|message|>' -}}{{- render_content(message['content']) -}}{{- '<|eot|>' -}}{%- elif role == 'tool' -%}{%- set tname = message.get('name') -%}{%- if not tname -%}{%- set tcid = message.get('tool_call_id') -%}{%- set rns = namespace(name=tcid if tcid else '') -%}{%- for m in messages -%}{%- if m.get('tool_calls') -%}{%- for tc in m['tool_calls'] -%}{%- if tcid is not none and tc.id is defined and tc.id == tcid -%}{%- set rns.name = tc.function.name -%}{%- endif -%}{%- endfor -%}{%- endif -%}{%- endfor -%}{%- set tname = rns.name -%}{%- endif -%}{{- '<|start|>tool ' + tname + '<|message|><tool_output name=\"' + tname + '\">\\n' -}}{{- render_content(message['content']) -}}{{- '\\n</tool_output><|eot|>' -}}{%- elif role == 'assistant' -%}{%- if message.get('reasoning_content') -%}{{- '<|start|>assistant to=self<|message|>' + message['reasoning_content'] + '<|eom|>' -}}{%- endif -%}{%- if message.get('tool_calls') -%}{%- for tc in message['tool_calls'] -%}{{- '<|start|>assistant to=' + tc.function.name + '<|message|>' -}}{{- render_atem(tc) -}}{%- if loop.last -%}{{- end_token -}}{%- else -%}{{- '<|eom|>' -}}{%- endif -%}{%- endfor -%}{%- else -%}{%- set recipient = message.get('recipient') or 'user' -%}{%- set end_turn = message.get('end_turn') -%}{%- if end_turn is none -%}{%- set end_turn = not (recipient and recipient != 'user') -%}{%- endif -%}{{- '<|start|>assistant' -}}{%- if recipient -%}{{- ' to=' + recipient -}}{%- endif -%}{{- '<|message|>' -}}{{- render_content(message['content']) -}}{{- ('<|eot|>' if end_turn else '<|eom|>') -}}{%- endif -%}{%- endif -%}{%- endfor -%}{%- if add_generation_prompt -%}{{- '<|start|>assistant' -}}{%- endif -%}",
|
| 11 |
+
"bos_token": "<|begin_of_text|>",
|
| 12 |
+
"eos_token": "<|end_of_text|>",
|
| 13 |
+
"totalFileSize": 10657479360
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.222166+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ2_M.gguf",
|
| 19 |
+
"size": 10657479360,
|
| 20 |
+
"blob_id": "3abcdd15f266fecf1c124b464ad1350570a7626b",
|
| 21 |
+
"lfs_sha256": "e128ba75bcdcf0d473dbbc68ed8af3c99c94cf75118ad116364ba8637f869c4a"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ2_S.gguf",
|
| 25 |
+
"size": 10040015552,
|
| 26 |
+
"blob_id": "56acb1d6c2d4be2b894603688a02f92d17fcc868",
|
| 27 |
+
"lfs_sha256": "805564efe7375fff8164508ee6daf2d106f04ba706a5c0b4ccca90cb2bad93a0"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ2_XS.gguf",
|
| 31 |
+
"size": 9582585280,
|
| 32 |
+
"blob_id": "b97d3d4f62aa93f0f82e49ffdf98fcb2c0b16898",
|
| 33 |
+
"lfs_sha256": "8e40248c39e2f12df634380dbc3a9cdca3f4a307b2c341cee6318c6709aba72c"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ2_XXS.gguf",
|
| 37 |
+
"size": 8920819136,
|
| 38 |
+
"blob_id": "f399ee8e60475026f3b9daffd06ce5ccb844fc2d",
|
| 39 |
+
"lfs_sha256": "d985136d1e5ff6a6a7afc2e1b0840dee2729d11e151827b5e5190500f533a3d5"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ3_M.gguf",
|
| 43 |
+
"size": 13106238400,
|
| 44 |
+
"blob_id": "6986517061e58db05bd24be41fb0d1044e86774d",
|
| 45 |
+
"lfs_sha256": "f0de67a2dabc2d1c9df57d3241f48c5222fb4b26d50826b7e26eb1ce8c4a8ee6"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ3_XS.gguf",
|
| 49 |
+
"size": 12315026368,
|
| 50 |
+
"blob_id": "06bf59cd99ab2accd67f013cff4ba6f1c90d6e82",
|
| 51 |
+
"lfs_sha256": "0b95665a1ee46afd01e43650ea9012711dfd20967857929a7b033b820cedeb2b"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ3_XXS.gguf",
|
| 55 |
+
"size": 11546641088,
|
| 56 |
+
"blob_id": "0e1e6a4e940bc21b2af14060f48417dd9a5989df",
|
| 57 |
+
"lfs_sha256": "cc1ef554f3fbf7555e2a0b1b32f77b2011805b18d93320e6bf5c0a44ad1de008"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ4_NL.gguf",
|
| 61 |
+
"size": 16238568640,
|
| 62 |
+
"blob_id": "04d1542cf2030d78137917bc8efc1d866a9a42d0",
|
| 63 |
+
"lfs_sha256": "ae4e2f65ea2ef62c99e935a7577b0a5dcee285f0fc45f61b5883da0ced7f552e"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-IQ4_XS.gguf",
|
| 67 |
+
"size": 15435096256,
|
| 68 |
+
"blob_id": "00e8b22d4307e032d58602dbad7a16c6f954dee2",
|
| 69 |
+
"lfs_sha256": "f4405e4c4496a225dd765dc4603c14de80afa41ac70816faaf32284ed87069db"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q2_K.gguf",
|
| 73 |
+
"size": 11035580096,
|
| 74 |
+
"blob_id": "3206808b41a77611b62fc3247ecc70be8418feb9",
|
| 75 |
+
"lfs_sha256": "cd2fbe6c9a3e2ed66144cfc25903e6f6db917bd17a0f610e82d9d7b78bcaaef4"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q2_K_L.gguf",
|
| 79 |
+
"size": 12348892096,
|
| 80 |
+
"blob_id": "c6e868131372589c310f2aab259d3e2cfe65b0de",
|
| 81 |
+
"lfs_sha256": "5c20f5ee96aafaf00124bd53bb2c654dbc60ea03d6584da95eb466ec7b4d0b1c"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q3_K_L.gguf",
|
| 85 |
+
"size": 14782112704,
|
| 86 |
+
"blob_id": "ca455056c56f677470ea19f56082553eb2058485",
|
| 87 |
+
"lfs_sha256": "b9d2c7ddc3bbbce58431b1f8ae77f046c3fa4d4dcaa2982272f2d2b395389763"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q3_K_M.gguf",
|
| 91 |
+
"size": 13962519488,
|
| 92 |
+
"blob_id": "1648c8b0c6c19d3bd13a79a4097f6f9eb4f8778b",
|
| 93 |
+
"lfs_sha256": "259623bc1946bd02393c964e3628280be0809f108421055be9cec900097b5633"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q3_K_S.gguf",
|
| 97 |
+
"size": 12789199808,
|
| 98 |
+
"blob_id": "ab1e07cd808ebf6b5b0198340429b2ac53f2d498",
|
| 99 |
+
"lfs_sha256": "0130e6f1c7a2e6aff914c6caed580a43ddf33b0a7978f5555a18314d28a8c471"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q3_K_XL.gguf",
|
| 103 |
+
"size": 15958840256,
|
| 104 |
+
"blob_id": "f006b95b4d65c31c1e93deb2650eeefc11239fb0",
|
| 105 |
+
"lfs_sha256": "3bb484e03eedaea0d1d3c4fcc917b4a747cc87471eeebccc9c18ad56593b54f5"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_0.gguf",
|
| 109 |
+
"size": 16265565376,
|
| 110 |
+
"blob_id": "b1003a024eb8cc0bc03f69c89c60819e91f9cb2b",
|
| 111 |
+
"lfs_sha256": "c3353fa5aef514606e4ed27aadb421dd1ab82047c27c7394a53d31bbce8c70d4"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_1.gguf",
|
| 115 |
+
"size": 17828207808,
|
| 116 |
+
"blob_id": "7761fd25d2d0e235fa2b667a6c218006d9b8ec22",
|
| 117 |
+
"lfs_sha256": "1aa21d1dc4db5286aa62b48c3b084be52308ea1ed75df8cec29d1e602deb6343"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_K_L.gguf",
|
| 121 |
+
"size": 18304441280,
|
| 122 |
+
"blob_id": "ac91940aa12a9d39af7dfa8eeba2906795b5f96b",
|
| 123 |
+
"lfs_sha256": "ab5c0cbde145c3a14c7578b1c65265c0665cedd219c9614560e7ab0a3a013bf5"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_K_M.gguf",
|
| 127 |
+
"size": 17306324160,
|
| 128 |
+
"blob_id": "7c62c8ab1faf5d9732bba021bac2071acc0e8ae7",
|
| 129 |
+
"lfs_sha256": "728cdea6a1c4add69ac878574db05505b2475ca5366480ef7f720b2c2b263ed9"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q4_K_S.gguf",
|
| 133 |
+
"size": 16320943296,
|
| 134 |
+
"blob_id": "dc0701b1dc67e95bc22d3a00b6448e90b4c0585a",
|
| 135 |
+
"lfs_sha256": "55bc86d5028b19c9a4a38ff22db3009f81cce39bd1d5aac634bea6df7daba147"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q5_K_L.gguf",
|
| 139 |
+
"size": 20935584704,
|
| 140 |
+
"blob_id": "1361a5649c6d94c45ed227f4f6b10bf3ccd57e67",
|
| 141 |
+
"lfs_sha256": "4adb06ca0516891e4b77bcd41185eab03571c7fbc244e99cde18403c50657d43"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q5_K_M.gguf",
|
| 145 |
+
"size": 20105571520,
|
| 146 |
+
"blob_id": "2466634573e142ff6b9d02c7e60eb47463335ce6",
|
| 147 |
+
"lfs_sha256": "725022bb8d7351993318cad45a6ede40a8247f6723457f8c0f364aef39482ef1"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q5_K_S.gguf",
|
| 151 |
+
"size": 19440690368,
|
| 152 |
+
"blob_id": "d9c47b0e1a0432786fd5130e00aa9ed733a7948b",
|
| 153 |
+
"lfs_sha256": "775df11fb4aca114585fc2b3b3617f0b2990cd07f36b92cf9cd7eafc78934d74"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q6_K.gguf",
|
| 157 |
+
"size": 23414418880,
|
| 158 |
+
"blob_id": "97485ab849d7ea4b53228234a8f0d64fd8dcf6f9",
|
| 159 |
+
"lfs_sha256": "8ef0557c91c7b21bf572231524c789f8b049c838d2ce3b00c6c0f487a19ddfd6"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q6_K_L.gguf",
|
| 163 |
+
"size": 24065821632,
|
| 164 |
+
"blob_id": "9ab31cebbc695112dcd0eab85185ecc7008e91df",
|
| 165 |
+
"lfs_sha256": "b8f1451c723d3d7afd57a3968000654b179eebae008de95ac8c0dbc956fa48c5"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-Q8_0.gguf",
|
| 169 |
+
"size": 29612958368,
|
| 170 |
+
"blob_id": "b2808ada0a2918190fbd30156b728edec9b5e5e4",
|
| 171 |
+
"lfs_sha256": "a501532b4a1f02341ff96a19321a2682f4b1ada1ee29b688edc217ca035448f5"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-bf16/darkc0de_Muse-Glimmer-30B-heretic-bf16-00001-of-00002.gguf",
|
| 175 |
+
"size": 39802091424,
|
| 176 |
+
"blob_id": "dfceb16643eeedbd91bce1d092924c9e088b3c03",
|
| 177 |
+
"lfs_sha256": "591f100d7c2462ce514851245bf7f8aaef4348f459b4f43b6f7062c86d51c9b0"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-bf16/darkc0de_Muse-Glimmer-30B-heretic-bf16-00002-of-00002.gguf",
|
| 181 |
+
"size": 15923420064,
|
| 182 |
+
"blob_id": "5d8717c1c612304d3c8cc290c31fc2f87c46ac5c",
|
| 183 |
+
"lfs_sha256": "bbe38f5854574be49705dd65b2a613335721a82f6a0c5a38be0ec823ae479e14"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "darkc0de_Muse-Glimmer-30B-heretic-imatrix.gguf",
|
| 187 |
+
"size": 13376128,
|
| 188 |
+
"blob_id": "7d00c166f85bf034710bbfdab959b98e5cf3f2b5",
|
| 189 |
+
"lfs_sha256": "92b7dd5a2edc16fa5db1fb7561ef6238213e25102ef4afe953d63b23fd6904c3"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"rfilename": "mmproj-darkc0de_Muse-Glimmer-30B-heretic-bf16.gguf",
|
| 193 |
+
"size": 3849174048,
|
| 194 |
+
"blob_id": "dd1a1f5ca4e052a257ef554c0b50d1214ee4489f",
|
| 195 |
+
"lfs_sha256": "3e39cb6b42ef57d17cdde58a92b73749e61ff24656f1c7b8abf964e9e4a6f723"
|
| 196 |
+
},
|
| 197 |
+
{
|
| 198 |
+
"rfilename": "mmproj-darkc0de_Muse-Glimmer-30B-heretic-f16.gguf",
|
| 199 |
+
"size": 3847367712,
|
| 200 |
+
"blob_id": "3250629acda75aee2ed5238e00d38b4dcc08903e",
|
| 201 |
+
"lfs_sha256": "ecf13cbfe622f1f321fa31dc0d20337446b129f16e172ba6d6062358052902a1"
|
| 202 |
+
}
|
| 203 |
+
]
|
| 204 |
+
}
|
bpw/hf/repo-metadata/bartowski__google_gemma-3n-E4B-it-GGUF.json
ADDED
|
@@ -0,0 +1,144 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/google_gemma-3n-E4B-it-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/google_gemma-3n-E4B-it-GGUF",
|
| 4 |
+
"commit_sha": "6dd3cb1e6c463bf6982385d1fdb2f23754cf2b29",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 6866172400,
|
| 7 |
+
"architecture": "gemma3n",
|
| 8 |
+
"context_length": 32768,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/gemma-3n-E4B-it-GGUF/google_gemma-3n-E4B-it.imatrix",
|
| 10 |
+
"chat_template": "{{ bos_token }}\n{%- if messages[0]['role'] == 'system' -%}\n {%- if messages[0]['content'] is string -%}\n {%- set first_user_prefix = messages[0]['content'] + '\n\n' -%}\n {%- else -%}\n {%- set first_user_prefix = messages[0]['content'][0]['text'] + '\n\n' -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n{%- else -%}\n {%- set first_user_prefix = \"\" -%}\n {%- set loop_messages = messages -%}\n{%- endif -%}\n{%- for message in loop_messages -%}\n {%- if (message['role'] == 'user') != (loop.index0 % 2 == 0) -%}\n {{ raise_exception(\"Conversation roles must alternate user/assistant/user/assistant/...\") }}\n {%- endif -%}\n {%- if (message['role'] == 'assistant') -%}\n {%- set role = \"model\" -%}\n {%- else -%}\n {%- set role = message['role'] -%}\n {%- endif -%}\n {{ '<start_of_turn>' + role + '\n' + (first_user_prefix if loop.first else \"\") }}\n {%- if message['content'] is string -%}\n {{ message['content'] | trim }}\n {%- elif message['content'] is iterable -%}\n {%- for item in message['content'] -%}\n {%- if item['type'] == 'audio' -%}\n {{ '<audio_soft_token>' }}\n {%- elif item['type'] == 'image' -%}\n {{ '<image_soft_token>' }}\n {%- elif item['type'] == 'text' -%}\n {{ item['text'] | trim }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{ raise_exception(\"Invalid content type\") }}\n {%- endif -%}\n {{ '<end_of_turn>\n' }}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n {{'<start_of_turn>model\n'}}\n{%- endif -%}\n",
|
| 11 |
+
"bos_token": "<bos>",
|
| 12 |
+
"eos_token": "<eos>",
|
| 13 |
+
"totalFileSize": 3294107520
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.257124+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "google_gemma-3n-E4B-it-IQ3_M.gguf",
|
| 19 |
+
"size": 3294107520,
|
| 20 |
+
"blob_id": "d17ae5c5504a5a83fafd411409b576b6488f4d2d",
|
| 21 |
+
"lfs_sha256": "a3935bbb5cc6e0ee476fed039089dc5123bc4dd1064785d1016af4ca14da1c8d"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "google_gemma-3n-E4B-it-IQ3_XS.gguf",
|
| 25 |
+
"size": 3166394240,
|
| 26 |
+
"blob_id": "3dbb706dd3cb099ae562ca2baca021b6639c31af",
|
| 27 |
+
"lfs_sha256": "fdfb502901b7e819f2ba7291d1de240f2121525d0428394cb894da5e6342f8a1"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "google_gemma-3n-E4B-it-IQ4_NL.gguf",
|
| 31 |
+
"size": 4089993088,
|
| 32 |
+
"blob_id": "008baa63f8af4e078724606bb540dc4c880a134d",
|
| 33 |
+
"lfs_sha256": "5aa73eb6bdb9eecdf82850221821c59086f8c6948de80c418976cd85e7c443c1"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "google_gemma-3n-E4B-it-IQ4_XS.gguf",
|
| 37 |
+
"size": 3895023488,
|
| 38 |
+
"blob_id": "003d112069c7278e61a9ab7ee93289ed61447a9f",
|
| 39 |
+
"lfs_sha256": "ec43a69462be559e6c48f6ededc417039f81b5fb9faab2e09748ce841ebb7a1f"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "google_gemma-3n-E4B-it-Q2_K.gguf",
|
| 43 |
+
"size": 2757318528,
|
| 44 |
+
"blob_id": "c1ee0fc005d0e8122a8b7f03005e3eed59dacba7",
|
| 45 |
+
"lfs_sha256": "18c2788c41c435c5e26ca5007b81c4da17a6687d2cd9e315a1125ace62006bc2"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "google_gemma-3n-E4B-it-Q2_K_L.gguf",
|
| 49 |
+
"size": 4612249472,
|
| 50 |
+
"blob_id": "713409e87daac7a81a8a730d9dff39688668bd2e",
|
| 51 |
+
"lfs_sha256": "e9c390a8a3a81b04d9ee7674f357a69bcaa58f05a9bfe180cbb990d00b89a131"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "google_gemma-3n-E4B-it-Q3_K_L.gguf",
|
| 55 |
+
"size": 3601995648,
|
| 56 |
+
"blob_id": "a1d5b2a3f231f8a6ab4a682cdd869bfa5d732b9d",
|
| 57 |
+
"lfs_sha256": "1b4270aa3dbe43ef6e430f5645f43942e72777d92493c4496779968c8236840a"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "google_gemma-3n-E4B-it-Q3_K_M.gguf",
|
| 61 |
+
"size": 3440908160,
|
| 62 |
+
"blob_id": "1f0ba1af241ba0984c83b75fb799923f37f76908",
|
| 63 |
+
"lfs_sha256": "13bae2b95d94e7ef64f81cdef9a0b469cfc485e39d422cd94e86d1b5bdbcf567"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "google_gemma-3n-E4B-it-Q3_K_S.gguf",
|
| 67 |
+
"size": 3251910528,
|
| 68 |
+
"blob_id": "897556d625a7813c4872c478c1f11da03a1148f6",
|
| 69 |
+
"lfs_sha256": "a5f98949558e9305330860fad1ca33bab488acbb4b3c683c08e9a7fb885a3e1f"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "google_gemma-3n-E4B-it-Q3_K_XL.gguf",
|
| 73 |
+
"size": 5218375552,
|
| 74 |
+
"blob_id": "3d1fe5d644ac57ae0ec57806eb34d526ddd2cd1a",
|
| 75 |
+
"lfs_sha256": "3dbd58aaec14b44387bfdcc5cb77f79d3202956cad8e928d28c5a85055614ca6"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "google_gemma-3n-E4B-it-Q4_0.gguf",
|
| 79 |
+
"size": 4093794176,
|
| 80 |
+
"blob_id": "d16c78b9e9381f5ce64e406c0fd22aaf9a26d5ab",
|
| 81 |
+
"lfs_sha256": "e0fb08521de84554c14c131d6fd09d065c852ab76b0f84bd965dbc9948a668e2"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "google_gemma-3n-E4B-it-Q4_1.gguf",
|
| 85 |
+
"size": 4477638528,
|
| 86 |
+
"blob_id": "1f1b66aa83b132f91ddaf059268e824beca5f22b",
|
| 87 |
+
"lfs_sha256": "520c56c672a5ec3323fb3c06b97bf5c5098fba698dce956b8dd68c16e6c3e91e"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "google_gemma-3n-E4B-it-Q4_K_L.gguf",
|
| 91 |
+
"size": 5541492608,
|
| 92 |
+
"blob_id": "2442f123458bc9d4663f785922a98d22af8eecb4",
|
| 93 |
+
"lfs_sha256": "36a20030b46a51d5b3059dc47fea5b6196578a9de9e128a6c745c5bc0fee8e8a"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "google_gemma-3n-E4B-it-Q4_K_M.gguf",
|
| 97 |
+
"size": 4237064064,
|
| 98 |
+
"blob_id": "dcb36d188964bb2fa70ea5431388f15cdfd76ce9",
|
| 99 |
+
"lfs_sha256": "70b4129714d30cfd7d36ff449257a2633485693ea6f5da9c2057f20fb7cbe1f8"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "google_gemma-3n-E4B-it-Q4_K_S.gguf",
|
| 103 |
+
"size": 4102707072,
|
| 104 |
+
"blob_id": "1c8abb1fc2c798579282c3dc29164a77c867cb4e",
|
| 105 |
+
"lfs_sha256": "a54fe35f559e2060256acad4dcf992635c187e6768ff12fabe4c0d2465a3509f"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "google_gemma-3n-E4B-it-Q5_K_L.gguf",
|
| 109 |
+
"size": 5958825856,
|
| 110 |
+
"blob_id": "27b177e2f6e456088b8af634e11045f9730518ab",
|
| 111 |
+
"lfs_sha256": "28f529f2bba68e11c491c5282b6ea3f9073dbace3d0ec592b8436a821a92520e"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "google_gemma-3n-E4B-it-Q5_K_M.gguf",
|
| 115 |
+
"size": 4947998592,
|
| 116 |
+
"blob_id": "c7217b0bbc36686df61d68a04a67d16184c63101",
|
| 117 |
+
"lfs_sha256": "6c63ee24020ff14efa35edf8f5cc6dec96960d2c69e1c65a3e68459d75559f45"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "google_gemma-3n-E4B-it-Q5_K_S.gguf",
|
| 121 |
+
"size": 4869871488,
|
| 122 |
+
"blob_id": "56cfa80e01da60f9727ebe4b71e2168a7b8aae6b",
|
| 123 |
+
"lfs_sha256": "ed89e1ce214c7bbc6c7f5f607593b15f0338a3211314515493e6956d45a5b2eb"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "google_gemma-3n-E4B-it-Q6_K.gguf",
|
| 127 |
+
"size": 5703366528,
|
| 128 |
+
"blob_id": "5276d2c55da8f97fa8dd3e5b8d81e6552fcaca32",
|
| 129 |
+
"lfs_sha256": "a3c33c4a0a01b86d3e509acab4335a9acfc59948955581b4a91025089cefd49f"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "google_gemma-3n-E4B-it-Q6_K_L.gguf",
|
| 133 |
+
"size": 6402242432,
|
| 134 |
+
"blob_id": "348ef8dfd474c586ea706ebdb8bf5b518abec46e",
|
| 135 |
+
"lfs_sha256": "535ce46cd3e26fd9bf60be0ad877b3e65829eb925b8f12dd60e15eabe06ddc5e"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "google_gemma-3n-E4B-it-Q8_0.gguf",
|
| 139 |
+
"size": 7353292672,
|
| 140 |
+
"blob_id": "07373926a5c04806885c3f296814b68b9363711d",
|
| 141 |
+
"lfs_sha256": "e2c69d482d1a7dae9d3b1e477626e30c0c29825ea2dc05e4ef55159230a07c80"
|
| 142 |
+
}
|
| 143 |
+
]
|
| 144 |
+
}
|
bpw/hf/repo-metadata/bartowski__google_gemma-4-31B-it-GGUF.json
ADDED
|
@@ -0,0 +1,222 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/google_gemma-4-31B-it-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/google_gemma-4-31B-it-GGUF",
|
| 4 |
+
"commit_sha": "619aca7589c72be65dd968de8602ad23d68b5c14",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30697345596,
|
| 7 |
+
"architecture": "gemma4",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"quantize_imatrix_file": "/models_out/gemma-4-31B-it-GGUF/google_gemma-4-31B-it-imatrix.gguf",
|
| 10 |
+
"chat_template": "{#\n Template: Google Gemma 4 Canonical Chat Template\n Author: Google Gemma Engineering Team\n Published: 2026-07-09\n Context: Fixed tool-calling loops, turn closures, and thinking content-ordering.\n#}\n{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('<channel|>') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '<tool_response|>' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '<tool|>' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n<channel|>' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- else -%}\n {{- raise_exception(\n \"chat_template: tool_calls[].function.arguments must be a \"\n \"JSON object (mapping), not a string. Deserialize arguments \"\n \"before passing to the template.\"\n ) -}}\n {%- endif -%}\n {{- '}<tool_call|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '<turn|>\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- if not enable_thinking -%}\n {{- '<|channel>thought\\n<channel|>' -}}\n {%- endif -%}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n",
|
| 11 |
+
"bos_token": "<bos>",
|
| 12 |
+
"eos_token": "<eos>",
|
| 13 |
+
"totalFileSize": 10112172384
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.259208+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "google_gemma-4-31B-it-IQ1_M.gguf",
|
| 19 |
+
"size": 10112172384,
|
| 20 |
+
"blob_id": "d2f0f6c615b92584cd6ac1b4ae8f47c2d0589b1c",
|
| 21 |
+
"lfs_sha256": "99870ee4aeeab03532bbb72f0af7332d6f2e3f9de4a4ba26c6aff8b906a8a201"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "google_gemma-4-31B-it-IQ2_M.gguf",
|
| 25 |
+
"size": 12649773408,
|
| 26 |
+
"blob_id": "73437320ecd6874a9e842277e2cedc1274e15d5c",
|
| 27 |
+
"lfs_sha256": "3f98b832e1a097356f55fc40a44c6193a877ce0467eea38e7001fb96e9cd9a8f"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "google_gemma-4-31B-it-IQ2_S.gguf",
|
| 31 |
+
"size": 12075358560,
|
| 32 |
+
"blob_id": "b567d6a239a499d9464381808290e2f97fba2490",
|
| 33 |
+
"lfs_sha256": "26c268ebddd0c4315dc57a0846e74bee8cb99836f186b4ce561eaae9e8755066"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "google_gemma-4-31B-it-IQ2_XS.gguf",
|
| 37 |
+
"size": 11500943712,
|
| 38 |
+
"blob_id": "9fedc43ec2b21bd7a0500986d8fd30a83cd714ea",
|
| 39 |
+
"lfs_sha256": "8c4abed66c765ff6ebb96ee257a65018f3d800351cc6e0db288735bc05919d43"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "google_gemma-4-31B-it-IQ2_XXS.gguf",
|
| 43 |
+
"size": 10830190944,
|
| 44 |
+
"blob_id": "cac8a61d61d428982f42b40073016eaa70cf4d97",
|
| 45 |
+
"lfs_sha256": "3023b2dc6f8719ada9536c22a5b57408ddb1f18d4377de8efa7997237329ec3f"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "google_gemma-4-31B-it-IQ3_M.gguf",
|
| 49 |
+
"size": 15129829728,
|
| 50 |
+
"blob_id": "6715bd34589438b76e6110db75197ecaf2d523bb",
|
| 51 |
+
"lfs_sha256": "34fee56068a087c32e753ac1c25d45e329bc3e5c6a768279e20ff4f107ca7802"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "google_gemma-4-31B-it-IQ3_XS.gguf",
|
| 55 |
+
"size": 13841353056,
|
| 56 |
+
"blob_id": "925498d3a30f35e5a318b6b620af62e53ed96b20",
|
| 57 |
+
"lfs_sha256": "9919f8d192412bad9161890a3c5ac748d553b9018e6856de47bc2a4fe91401e1"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "google_gemma-4-31B-it-IQ3_XXS.gguf",
|
| 61 |
+
"size": 12981709152,
|
| 62 |
+
"blob_id": "19b3ee0a13ed232a38d5873c9985e682aee5d0c4",
|
| 63 |
+
"lfs_sha256": "c9f34994715a016cd0bcd7ff4c1f5710718bbcc25d40796302db0a89b6d0d8ea"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "google_gemma-4-31B-it-IQ4_NL.gguf",
|
| 67 |
+
"size": 18025687392,
|
| 68 |
+
"blob_id": "1f4f2711d7358c5d26b4104b9e1c256120ab184b",
|
| 69 |
+
"lfs_sha256": "95cf739e546a1c8ade9b84ce4cd0358a5c87f69c450e04d768126acbd2f17723"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "google_gemma-4-31B-it-IQ4_XS.gguf",
|
| 73 |
+
"size": 17155893600,
|
| 74 |
+
"blob_id": "b59383c6b45db1b193770bb20171294913929b21",
|
| 75 |
+
"lfs_sha256": "05e0fa1452e73e1b43bdfd378b82b488f57eb63db2bc5e4209f458e08d0542a7"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "google_gemma-4-31B-it-Q2_K.gguf",
|
| 79 |
+
"size": 12631624032,
|
| 80 |
+
"blob_id": "325896cc7d478d3e147bdcac94c7a7b90816cf8a",
|
| 81 |
+
"lfs_sha256": "0c9ac8f56177147f30a8845b3637e119ee5c0ba528af73cd363fb486f05ef0c7"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "google_gemma-4-31B-it-Q2_K_L.gguf",
|
| 85 |
+
"size": 12972935520,
|
| 86 |
+
"blob_id": "47eb49bef2a849a1f1ec7482015e9c082ff57810",
|
| 87 |
+
"lfs_sha256": "a0ca05763da9239a8ac4b4c267a43a1abd8dbfe3e373181d6f4ad837b81578fb"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "google_gemma-4-31B-it-Q3_K_L.gguf",
|
| 91 |
+
"size": 16810625376,
|
| 92 |
+
"blob_id": "4c0c275e630c8a92cdb2ca10ac300072d5d7e51e",
|
| 93 |
+
"lfs_sha256": "a61e2576c8d95ee021f162462555e17b4b02c1f72691e69edc85c01e81151e70"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "google_gemma-4-31B-it-Q3_K_M.gguf",
|
| 97 |
+
"size": 15918123360,
|
| 98 |
+
"blob_id": "2fd1df519f200327a692a5e2e4d3ea0f48851e74",
|
| 99 |
+
"lfs_sha256": "eafa3499f35610f0c71af7b688328692f710d01283e140b5089991cf6478f486"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "google_gemma-4-31B-it-Q3_K_S.gguf",
|
| 103 |
+
"size": 14329063776,
|
| 104 |
+
"blob_id": "a2cf56f8ca22f1c3c91be65ee1ba63e8224b60cc",
|
| 105 |
+
"lfs_sha256": "99398bdab6241b3e513c129a4c24e8047bee51026585bfaa9eee80f656154789"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "google_gemma-4-31B-it-Q3_K_XL.gguf",
|
| 109 |
+
"size": 17151936864,
|
| 110 |
+
"blob_id": "ec0fddb2eac8df7bba5bfed79638da7e6f0cc3fc",
|
| 111 |
+
"lfs_sha256": "0831a19763d76da64f15cd2448ab881a9058cc47cdeb778116bbf3794853725d"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "google_gemma-4-31B-it-Q4_0.gguf",
|
| 115 |
+
"size": 18076264800,
|
| 116 |
+
"blob_id": "23f5b60f840a5af9d76c470c2867078145284e7d",
|
| 117 |
+
"lfs_sha256": "4591e5ee10527739514d6db436b51169c882949e3858d30285aa997b0b253554"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "google_gemma-4-31B-it-Q4_1.gguf",
|
| 121 |
+
"size": 19765274976,
|
| 122 |
+
"blob_id": "607b1f4fa00b0674fcb8a54062c98c841e8a923b",
|
| 123 |
+
"lfs_sha256": "567d744757d575d84c0a42278091223aa2351cdae8f375d4962eec44272659be"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "google_gemma-4-31B-it-Q4_K_L.gguf",
|
| 127 |
+
"size": 19939801440,
|
| 128 |
+
"blob_id": "8bc880b18d5d191bccd731649264250a02a2abf5",
|
| 129 |
+
"lfs_sha256": "805ecb7f3d6b2cca58f31a6bc3579716173ec21f310e3af62c2b728c51488057"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "google_gemma-4-31B-it-Q4_K_M.gguf",
|
| 133 |
+
"size": 19598489952,
|
| 134 |
+
"blob_id": "7594698d77f635be3502d0c8d96d932471e31152",
|
| 135 |
+
"lfs_sha256": "2959c1b0a4f792493bb0092846ea06aec54547e47be979c282634d938d501b75"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "google_gemma-4-31B-it-Q4_K_S.gguf",
|
| 139 |
+
"size": 18195655008,
|
| 140 |
+
"blob_id": "95c7ba769a21639e6ae01e8e8b52dc72213869e2",
|
| 141 |
+
"lfs_sha256": "a8f81e34d3720884355b3b220ae58c8f8cbf7d1f5bdab0f073a681fb768c9d52"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "google_gemma-4-31B-it-Q5_K_L.gguf",
|
| 145 |
+
"size": 22950189408,
|
| 146 |
+
"blob_id": "43c1e4b482b60dd0b4da6696cb993e9945513129",
|
| 147 |
+
"lfs_sha256": "ca773a604cd05507c95d671119a83a010ba0bda42e4c715b542be32ed68ad649"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "google_gemma-4-31B-it-Q5_K_M.gguf",
|
| 151 |
+
"size": 22608877920,
|
| 152 |
+
"blob_id": "7a963084f6cdcb7da40cf2a3f81463e751c5a543",
|
| 153 |
+
"lfs_sha256": "9f6882d4780880c96f2292c7daf5d5f18fa7e3678cecc47fc22649e93ce6f693"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "google_gemma-4-31B-it-Q5_K_S.gguf",
|
| 157 |
+
"size": 21504862560,
|
| 158 |
+
"blob_id": "b1a6fe63eaaeb44e120be1f343c863ecd6a93df1",
|
| 159 |
+
"lfs_sha256": "7761c1ff2f0ec42fb5aa510f0c6b172d9042e94b289d9a9b73ce63ea5f6f7b0d"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "google_gemma-4-31B-it-Q6_K.gguf",
|
| 163 |
+
"size": 26726721888,
|
| 164 |
+
"blob_id": "31800ae3368a423eb734c6de73ace1229e1090de",
|
| 165 |
+
"lfs_sha256": "3ddedb5dbd39acced499c489181983f27bd6e6bd3cd5d4a367696eeda3d1e397"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "google_gemma-4-31B-it-Q6_K_L.gguf",
|
| 169 |
+
"size": 27068033376,
|
| 170 |
+
"blob_id": "6800429d54d33bddd56d3a8bd6af1bac1728cf2a",
|
| 171 |
+
"lfs_sha256": "f77819db7b83a145425084048efec024b5efbc175bc0fdc4bc4bfe7d4b5802df"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "google_gemma-4-31B-it-Q8_0.gguf",
|
| 175 |
+
"size": 32635677024,
|
| 176 |
+
"blob_id": "45cd238bdf89e32c18c21a471fd9c76c09d0d444",
|
| 177 |
+
"lfs_sha256": "b2021742dad920260eea1a2fe3f7ebacc6f4963b4242ea3211f6bdb46e494a8e"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00001-of-00002.gguf",
|
| 181 |
+
"size": 39996137216,
|
| 182 |
+
"blob_id": "68120905430cc3810b9c0e3d69c1773194a19317",
|
| 183 |
+
"lfs_sha256": "00d6ab955e63cde6d0306adb99455c3fab96c3254b2fbfe750b65e8e4543485a"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "google_gemma-4-31B-it-bf16/google_gemma-4-31B-it-bf16-00002-of-00002.gguf",
|
| 187 |
+
"size": 21417052704,
|
| 188 |
+
"blob_id": "f0c9f314dfeac9e2d7e5d4b98cae84337247628f",
|
| 189 |
+
"lfs_sha256": "ed3ed48c668ef6b7a14ec06a56554deea9f3af5d2f245560f450ab7f25756e29"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"rfilename": "google_gemma-4-31B-it-imatrix.gguf",
|
| 193 |
+
"size": 13753952,
|
| 194 |
+
"blob_id": "4865396c0e2aadc94d7104e5d8cecd758f10612e",
|
| 195 |
+
"lfs_sha256": "f749aac429f5a1fd6fda4bc10823682669b8f45a10805230442a7a648ac70620"
|
| 196 |
+
},
|
| 197 |
+
{
|
| 198 |
+
"rfilename": "mmproj-google_gemma-4-31B-it-bf16.gguf",
|
| 199 |
+
"size": 1200726208,
|
| 200 |
+
"blob_id": "c9a5b8f86a5fc67382932fe4ab6d6b80e94788ef",
|
| 201 |
+
"lfs_sha256": "21487ff26d08f7ddd1d654d3bbfc1ae1020aab3119f5bf654742ce4697732e4e"
|
| 202 |
+
},
|
| 203 |
+
{
|
| 204 |
+
"rfilename": "mmproj-google_gemma-4-31B-it-f16.gguf",
|
| 205 |
+
"size": 1198956736,
|
| 206 |
+
"blob_id": "ea9623d5bfc1de80b5f7e6fcca391a292772de2d",
|
| 207 |
+
"lfs_sha256": "3e3f3f593b34bb4f518ada3e7999e4cbcd2a5864fa86ebc23fad3cbc4fbeba40"
|
| 208 |
+
},
|
| 209 |
+
{
|
| 210 |
+
"rfilename": "mtp-google_gemma-4-31B-it-Q4_0.gguf",
|
| 211 |
+
"size": 349161984,
|
| 212 |
+
"blob_id": "ff73b1b2549086cfc7cf96a3c72a085671798225",
|
| 213 |
+
"lfs_sha256": "3103d6e845443e3a6156704aa84feeb43bb7ffef96a47a522ad6449c342b6809"
|
| 214 |
+
},
|
| 215 |
+
{
|
| 216 |
+
"rfilename": "mtp-google_gemma-4-31B-it-Q8_0.gguf",
|
| 217 |
+
"size": 514705920,
|
| 218 |
+
"blob_id": "7918f333efcb8f9a3d7725bd15fba8335e7df31a",
|
| 219 |
+
"lfs_sha256": "743b2b719e448f9a06e774b4f33dd7a391a73e94d32297c7590256484562eb52"
|
| 220 |
+
}
|
| 221 |
+
]
|
| 222 |
+
}
|
bpw/hf/repo-metadata/bartowski__google_gemma-4-E4B-it-GGUF.json
ADDED
|
@@ -0,0 +1,173 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/google_gemma-4-E4B-it-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/google_gemma-4-E4B-it-GGUF",
|
| 4 |
+
"commit_sha": "029e94146666900b08caf49a3b47b413dfa8ec66",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 7518069290,
|
| 7 |
+
"architecture": "gemma4",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"chat_template": "{#\n Template: Google Gemma 4 Canonical Chat Template\n Author: Google Gemma Engineering Team\n Published: 2026-07-09\n Context: Fixed tool-calling loops, turn closures, and thinking content-ordering.\n#}\n{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('<channel|>') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '<tool_response|>' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '<tool|>' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n<channel|>' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- else -%}\n {{- raise_exception(\n \"chat_template: tool_calls[].function.arguments must be a \"\n \"JSON object (mapping), not a string. Deserialize arguments \"\n \"before passing to the template.\"\n ) -}}\n {%- endif -%}\n {{- '}<tool_call|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '<turn|>\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n",
|
| 10 |
+
"bos_token": "<bos>",
|
| 11 |
+
"eos_token": "<eos>",
|
| 12 |
+
"totalFileSize": 15053097184
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.266683+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "google_gemma-4-E4B-it-IQ2_M.gguf",
|
| 18 |
+
"size": 3959908832,
|
| 19 |
+
"blob_id": "a9b3039b66548f63060fdf484b23d9610f76fad4",
|
| 20 |
+
"lfs_sha256": "190322506e26415013651e5023fe744b0501a81d4ad37aa7017bb81214cbdbb5"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "google_gemma-4-E4B-it-IQ3_M.gguf",
|
| 24 |
+
"size": 4767781344,
|
| 25 |
+
"blob_id": "c0a7da1eecc209d1abf32fb1b9fc990bcb227aaa",
|
| 26 |
+
"lfs_sha256": "6d54d6921059d70e140b164b9e5968e2328d9a9cb0933b5a8c87b82c1bdda53a"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "google_gemma-4-E4B-it-IQ3_XS.gguf",
|
| 30 |
+
"size": 4632039904,
|
| 31 |
+
"blob_id": "c41fcfa3772452c515b91d11433ff02ff0e486d5",
|
| 32 |
+
"lfs_sha256": "80b0047ff8508575c6ad408798331f4dd7a5242b33111cc7818b94b774ab32de"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "google_gemma-4-E4B-it-IQ4_NL.gguf",
|
| 36 |
+
"size": 5232226784,
|
| 37 |
+
"blob_id": "e739f2a476b937551820af70f720d948d5b1595d",
|
| 38 |
+
"lfs_sha256": "b56f70624694ca5f2362cdafe6acffe35c5e0f44693c568f3f09fa83b968fb74"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "google_gemma-4-E4B-it-IQ4_XS.gguf",
|
| 42 |
+
"size": 5112828384,
|
| 43 |
+
"blob_id": "df0608ab7841f710ec1eaa2c95b482edb0f92c31",
|
| 44 |
+
"lfs_sha256": "a24429604e6f680e7bdf087b863a6cecc90f80b3d908f95d888f4f05003fdee3"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "google_gemma-4-E4B-it-Q2_K.gguf",
|
| 48 |
+
"size": 4458093024,
|
| 49 |
+
"blob_id": "6b7a06e2f11c1f107304fcc2e7ca853b6866d686",
|
| 50 |
+
"lfs_sha256": "f4346a0965c793a99afd787d5f1c88afe8f75e6235ffcc35f043ed546c9d7bf4"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "google_gemma-4-E4B-it-Q2_K_L.gguf",
|
| 54 |
+
"size": 5303245280,
|
| 55 |
+
"blob_id": "37168dce0ebe7db6745e57af45d2576174984df9",
|
| 56 |
+
"lfs_sha256": "8126ce4d0ce855795cd5195bdcf1e50c1c7a8e5fdcd64d55bb7dff3db11d53a7"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "google_gemma-4-E4B-it-Q3_K_L.gguf",
|
| 60 |
+
"size": 5034226144,
|
| 61 |
+
"blob_id": "665bdbd28fb4c9f4b402ef650c2b30626f309720",
|
| 62 |
+
"lfs_sha256": "488ade6a569eaef44abbd0312ae7b34c924026d94cb6a0eb41fb2bd2be73ceb5"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "google_gemma-4-E4B-it-Q3_K_M.gguf",
|
| 66 |
+
"size": 4898730464,
|
| 67 |
+
"blob_id": "0a7b6b8b3f634956a977b12205c94ca6ac00dc0f",
|
| 68 |
+
"lfs_sha256": "f60327936976524fbb9119a20e72819ea2369e0811de2b572eb0a2a21ecad71e"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "google_gemma-4-E4B-it-Q3_K_S.gguf",
|
| 72 |
+
"size": 4699695584,
|
| 73 |
+
"blob_id": "3463fca4206d7d89f2f0fd2dd7bbfef1582b74ab",
|
| 74 |
+
"lfs_sha256": "19a50462126b053de22a9cc9085aad3cc2241c9de55129f12bde7924a67e48ef"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "google_gemma-4-E4B-it-Q3_K_XL.gguf",
|
| 78 |
+
"size": 5879378400,
|
| 79 |
+
"blob_id": "65a30ee76c98d4ae13da837778480cee2549ac06",
|
| 80 |
+
"lfs_sha256": "00c50656f4b16b98ff9e07199e3c9fb5e776c159a62aaae9f56628b375f689f7"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "google_gemma-4-E4B-it-Q4_0.gguf",
|
| 84 |
+
"size": 5223860704,
|
| 85 |
+
"blob_id": "21180eb13fa7c952c5e52de9ea61dac354898c66",
|
| 86 |
+
"lfs_sha256": "604e903d29d2e0bbcee3dad449adc3e022299bf8a2d1dc7bc0166470e88d2203"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "google_gemma-4-E4B-it-Q4_1.gguf",
|
| 90 |
+
"size": 5458479584,
|
| 91 |
+
"blob_id": "d85882e4154c7386450d5dfea46c7dde456d7c01",
|
| 92 |
+
"lfs_sha256": "be1bb39dbacc2e3c151f214970edb2a4524fb7a1fa9d8e4f6869e9c0b7d25849"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "google_gemma-4-E4B-it-Q4_K_L.gguf",
|
| 96 |
+
"size": 6250322400,
|
| 97 |
+
"blob_id": "1af0b02f042e0f56196e469bef37916ea918b94a",
|
| 98 |
+
"lfs_sha256": "675f1326a7bc3e3971d7cc1b9003bd14e41a5c6c733ac0f1833fc993188fc92e"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "google_gemma-4-E4B-it-Q4_K_M.gguf",
|
| 102 |
+
"size": 5405170144,
|
| 103 |
+
"blob_id": "d3d38b7aebbcc982083c3a555da0f137c6026af2",
|
| 104 |
+
"lfs_sha256": "d35a3aa7a6d47de237fd488bb6f7f3efd62908d828f85a63da0ee93acdbefe9f"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "google_gemma-4-E4B-it-Q4_K_S.gguf",
|
| 108 |
+
"size": 5235657184,
|
| 109 |
+
"blob_id": "296eba9cd1e1f59d67e41db61fc0632189923823",
|
| 110 |
+
"lfs_sha256": "81508a92a401ccd81292b0da59f43af7360b7b2215a67bc7901830d58bfdf260"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "google_gemma-4-E4B-it-Q5_K_L.gguf",
|
| 114 |
+
"size": 6666035680,
|
| 115 |
+
"blob_id": "6a3df0fa59715c6496909439395856f1247c7311",
|
| 116 |
+
"lfs_sha256": "847e2dc03edd61b6a3a05e0c25c858e971ac897f53aad0351b282897d2ab1db4"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "google_gemma-4-E4B-it-Q5_K_M.gguf",
|
| 120 |
+
"size": 5820883424,
|
| 121 |
+
"blob_id": "3960e83c3dcc1bd61906da38c7d4940e9018765c",
|
| 122 |
+
"lfs_sha256": "1c57b87a06a7c0fd1b9fa8f5d5e505b720c15099648e0dcdc78acd857f72a7cc"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "google_gemma-4-E4B-it-Q5_K_S.gguf",
|
| 126 |
+
"size": 5701290464,
|
| 127 |
+
"blob_id": "5f5b48819af1664dfa8e15819d2496d2d79426d4",
|
| 128 |
+
"lfs_sha256": "ad6dfecd1d11c18e62047d6c93777d927ce8cfff7de99289773d3a197887a140"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "google_gemma-4-E4B-it-Q6_K.gguf",
|
| 132 |
+
"size": 6329954784,
|
| 133 |
+
"blob_id": "c4b45ac409e881cdab9bbd06f845ede7f679eff8",
|
| 134 |
+
"lfs_sha256": "bea1c94443c91fff61a722d9da5cd3f1cf0196d1e914798ee89d3c00ea365df9"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "google_gemma-4-E4B-it-Q6_K_L.gguf",
|
| 138 |
+
"size": 7175107040,
|
| 139 |
+
"blob_id": "7d55615c43438af82758da0970d84b5c9118f76a",
|
| 140 |
+
"lfs_sha256": "d31cc5eb279a992932e3cbde4d3ba9a3ba9b8cb41c16087561e5dadb88c0e4dc"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "google_gemma-4-E4B-it-Q8_0.gguf",
|
| 144 |
+
"size": 8031242720,
|
| 145 |
+
"blob_id": "8ae83d8caa8c4fab040a99cc39118688bcc3a3bc",
|
| 146 |
+
"lfs_sha256": "6a6eba0d36a051b5d924211a889c1436717006e7c5d413830c47caa1d46cb598"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "google_gemma-4-E4B-it-bf16.gguf",
|
| 150 |
+
"size": 15053097184,
|
| 151 |
+
"blob_id": "357095828759635a5a7ae49c861e2b9399deb6c2",
|
| 152 |
+
"lfs_sha256": "af40178d97d8d083836ef3db24ee48cbb705710e7292d870d0233d91fba0b6ac"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "google_gemma-4-E4B-it-imatrix.gguf",
|
| 156 |
+
"size": 4429024,
|
| 157 |
+
"blob_id": "41d3ec1b34856a3dfc7e8eb63a62d9b7d9674a66",
|
| 158 |
+
"lfs_sha256": "d7419858304e589b410a20e6343e8065eed9a8064f64b73eb689c6a488d699a9"
|
| 159 |
+
},
|
| 160 |
+
{
|
| 161 |
+
"rfilename": "mmproj-google_gemma-4-E4B-it-bf16.gguf",
|
| 162 |
+
"size": 991552000,
|
| 163 |
+
"blob_id": "617fec9fe639b7a8acb48866fdef6d05f7b199b1",
|
| 164 |
+
"lfs_sha256": "ffa64aebf7144bbadd5a1e143b77794d88e76a81cc0168d91de0770eb49e88e0"
|
| 165 |
+
},
|
| 166 |
+
{
|
| 167 |
+
"rfilename": "mmproj-google_gemma-4-E4B-it-f16.gguf",
|
| 168 |
+
"size": 990372352,
|
| 169 |
+
"blob_id": "a9c0f391f947bfd18d3ac9c0a02dfe7fbfc96982",
|
| 170 |
+
"lfs_sha256": "fd29ffa385f51ed8df3e8f48a865c7997ff6d01ed50c11bed2ae90f0d75f104e"
|
| 171 |
+
}
|
| 172 |
+
]
|
| 173 |
+
}
|
bpw/hf/repo-metadata/bartowski__huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF.json
ADDED
|
@@ -0,0 +1,149 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF",
|
| 4 |
+
"commit_sha": "19d84eb522d97e9e16eecaf49662f9f84404eefa",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 6866172400,
|
| 7 |
+
"architecture": "gemma3n",
|
| 8 |
+
"context_length": 32768,
|
| 9 |
+
"chat_template": "{{ bos_token }}\n{%- if messages[0]['role'] == 'system' -%}\n {%- if messages[0]['content'] is string -%}\n {%- set first_user_prefix = messages[0]['content'] + '\n\n' -%}\n {%- else -%}\n {%- set first_user_prefix = messages[0]['content'][0]['text'] + '\n\n' -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n{%- else -%}\n {%- set first_user_prefix = \"\" -%}\n {%- set loop_messages = messages -%}\n{%- endif -%}\n{%- for message in loop_messages -%}\n {%- if (message['role'] == 'user') != (loop.index0 % 2 == 0) -%}\n {{ raise_exception(\"Conversation roles must alternate user/assistant/user/assistant/...\") }}\n {%- endif -%}\n {%- if (message['role'] == 'assistant') -%}\n {%- set role = \"model\" -%}\n {%- else -%}\n {%- set role = message['role'] -%}\n {%- endif -%}\n {{ '<start_of_turn>' + role + '\n' + (first_user_prefix if loop.first else \"\") }}\n {%- if message['content'] is string -%}\n {{ message['content'] | trim }}\n {%- elif message['content'] is iterable -%}\n {%- for item in message['content'] -%}\n {%- if item['type'] == 'audio' -%}\n {{ '<audio_soft_token>' }}\n {%- elif item['type'] == 'image' -%}\n {{ '<image_soft_token>' }}\n {%- elif item['type'] == 'text' -%}\n {{ item['text'] | trim }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{ raise_exception(\"Invalid content type\") }}\n {%- endif -%}\n {{ '<end_of_turn>\n' }}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n {{'<start_of_turn>model\n'}}\n{%- endif -%}\n",
|
| 10 |
+
"bos_token": "<bos>",
|
| 11 |
+
"eos_token": "<eos>",
|
| 12 |
+
"totalFileSize": 13740103360
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.311173+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-IQ3_M.gguf",
|
| 18 |
+
"size": 3294107648,
|
| 19 |
+
"blob_id": "64c70264cc60e60110f8957f3120a2fca627343e",
|
| 20 |
+
"lfs_sha256": "5bc269673469f974e6aa7128cc3b537a141f4540638dcb4f00a5fbca70598db7"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-IQ3_XS.gguf",
|
| 24 |
+
"size": 3166394368,
|
| 25 |
+
"blob_id": "40180e93ef28cf8059d5ee2ec8abac4a977f8e4b",
|
| 26 |
+
"lfs_sha256": "aec38012151f7ee99e2514a3cf3483b48d2514e475964ab628bed457525eda02"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-IQ4_NL.gguf",
|
| 30 |
+
"size": 4089993216,
|
| 31 |
+
"blob_id": "a00a43327870da4eb795fe8dbedeaca4a40d0fe7",
|
| 32 |
+
"lfs_sha256": "e4ea418676b3aca05f5bf7edf86dfedffea9d6139b9e48f3edc8cc016bfdf86e"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-IQ4_XS.gguf",
|
| 36 |
+
"size": 3895023616,
|
| 37 |
+
"blob_id": "b30fc91b9eca9a37dcaa68e2000d8c1cdc6d3d7e",
|
| 38 |
+
"lfs_sha256": "4798aedca19326b9d38fdd529d7e0b3008e918a596f41082d581c978694414ff"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q2_K.gguf",
|
| 42 |
+
"size": 2757318656,
|
| 43 |
+
"blob_id": "f8fb884f7d8026af740a77a86c660b1f7a1733e9",
|
| 44 |
+
"lfs_sha256": "8f7bc62c252b5c387849f2671a04c476913037047e39ff12f175e99849600ec4"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q2_K_L.gguf",
|
| 48 |
+
"size": 4612249600,
|
| 49 |
+
"blob_id": "ea7029a1738d8345ef7dc26c794e3a223a0a2abf",
|
| 50 |
+
"lfs_sha256": "50c2fbafc97b0f3bcb8dfd7dc8e8f62e74ac04831fd6d9451be0165ee0aa884b"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q3_K_L.gguf",
|
| 54 |
+
"size": 3601995776,
|
| 55 |
+
"blob_id": "fefcbe333d44815282972decbb84f27a9c82724d",
|
| 56 |
+
"lfs_sha256": "2e7fb8fb4e6faf453bdde6b753b3461d77a71ae27697f1e3be2545d333b50e23"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q3_K_M.gguf",
|
| 60 |
+
"size": 3440908288,
|
| 61 |
+
"blob_id": "7decfc9ca4a707699595003ce8b6b4b1a8a200fa",
|
| 62 |
+
"lfs_sha256": "41b7e8f8bd74cc2abec6833f01584ad961c2b548ea46016e886917d567d4e7e4"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q3_K_S.gguf",
|
| 66 |
+
"size": 3251910656,
|
| 67 |
+
"blob_id": "8ed99bc824e9a5fc021835774477e883e1f86673",
|
| 68 |
+
"lfs_sha256": "2f32c94b82730ef568e5d71fa87866edae30cdbeb9f234415647a8bf8191e975"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q3_K_XL.gguf",
|
| 72 |
+
"size": 5218375680,
|
| 73 |
+
"blob_id": "2d9718108fab3f6d6d76e131aafd40daba520ccf",
|
| 74 |
+
"lfs_sha256": "58bcf322c54f1612c6e4add5271e55baf7181a9bc9054e88b28fb5b67a74363c"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_0.gguf",
|
| 78 |
+
"size": 4093794304,
|
| 79 |
+
"blob_id": "a13d8210509bc27d885fdf78d0d0c3b6c5481c6b",
|
| 80 |
+
"lfs_sha256": "2ae26ec4f6deadee4c2648ea8fda85adacefccf4ec5d305a9feb7197068536b8"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_1.gguf",
|
| 84 |
+
"size": 4477638656,
|
| 85 |
+
"blob_id": "cb6d590acdb27eb21a03009fe1f1fe7b848baa5c",
|
| 86 |
+
"lfs_sha256": "3f9c07aa01f884fd7c28ee39c1afe00720c1ed48ef2ea4322fa190daec55d257"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_L.gguf",
|
| 90 |
+
"size": 5541492736,
|
| 91 |
+
"blob_id": "57507811eeaaee016a7256acb693b7d4fa244e40",
|
| 92 |
+
"lfs_sha256": "528473be2cb9a09e4d9f4844f224860e75a1bfd450cfabe017d277d11e1e44cf"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_M.gguf",
|
| 96 |
+
"size": 4237064192,
|
| 97 |
+
"blob_id": "58b06fe6c6409efe32281d80c58c25511ca65c5f",
|
| 98 |
+
"lfs_sha256": "bf3f41f5d90c30777054d5cc23c10a31f08a833e774a014733f918b5c73f2265"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_S.gguf",
|
| 102 |
+
"size": 4102707200,
|
| 103 |
+
"blob_id": "5b76c9d4f211f89cc7606538207ad795fa3503f5",
|
| 104 |
+
"lfs_sha256": "33771ed0dc774badaed690f13230fadd475a2dc2b2f45cb58333ec794b8ba052"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q5_K_L.gguf",
|
| 108 |
+
"size": 5958825984,
|
| 109 |
+
"blob_id": "de108763791d4783790b5425181e3aafc19c1266",
|
| 110 |
+
"lfs_sha256": "85ca58bc53c2d7ed826c1bb98a947ebb46fce50fba1c2c8929a9c854db59dfed"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q5_K_M.gguf",
|
| 114 |
+
"size": 4947998720,
|
| 115 |
+
"blob_id": "374ee67d8c4235720c642557c86d39e2dd0e916b",
|
| 116 |
+
"lfs_sha256": "1becd929c03776a8b75f6e5cdac8cca02ac2154c4ad1921f872944478bb7e9ac"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q5_K_S.gguf",
|
| 120 |
+
"size": 4869871616,
|
| 121 |
+
"blob_id": "4df751cdba424c455247acea53e4233032c76b60",
|
| 122 |
+
"lfs_sha256": "2a4d2a838a250e6809adf997234bf4cc51651cd891191ead0f058b5e40df407a"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q6_K.gguf",
|
| 126 |
+
"size": 5703366656,
|
| 127 |
+
"blob_id": "e1e7c7ab6e075b35945b9b2273b770e752c63fcb",
|
| 128 |
+
"lfs_sha256": "23ee86ce074b772639d21b7e56e0102cf2f4196de10955843795311ebf16b32b"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q6_K_L.gguf",
|
| 132 |
+
"size": 6402242560,
|
| 133 |
+
"blob_id": "7db7b87e467f1c575b396c6816025ff858913d5f",
|
| 134 |
+
"lfs_sha256": "deb5fa3ab2d2377936dc34dbdf17ec86d55a24a09f98200a33978463d6059cb9"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q8_0.gguf",
|
| 138 |
+
"size": 7353292800,
|
| 139 |
+
"blob_id": "13c879e70e7a0a05f1ecd69c45cb1596bfeaccea",
|
| 140 |
+
"lfs_sha256": "4980dba55c9d9892a99d527a4ebb791f54996abdb93783f8e2d9cbec381ee35d"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-bf16.gguf",
|
| 144 |
+
"size": 13740103360,
|
| 145 |
+
"blob_id": "e38b6cae9e3ff999d79f1a026d1a244b61097c95",
|
| 146 |
+
"lfs_sha256": "c00edf1e08c781e07370db0f2f6dc3e81dec7a9920da6d93a268caf33f2d69fb"
|
| 147 |
+
}
|
| 148 |
+
]
|
| 149 |
+
}
|
bpw/hf/repo-metadata/bartowski__zai-org_GLM-4.6V-Flash-GGUF.json
ADDED
|
@@ -0,0 +1,185 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 3 |
+
"requested_repo_id": "bartowski/zai-org_GLM-4.6V-Flash-GGUF",
|
| 4 |
+
"commit_sha": "6a3b3ca7bbda9a5495091faa7421ebb30365f6aa",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 9400279040,
|
| 7 |
+
"architecture": "glm4",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"chat_template": "[gMASK]<sop>\n{%- if tools -%}\n<|system|>\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>\n{% for tool in tools %}\n{{ tool | tojson(ensure_ascii=False) }}\n{% endfor %}\n</tools>\n\nFor each function call, output the function name and arguments within the following XML format:\n<tool_call>{function-name}\n<arg_key>{arg-key-1}</arg_key>\n<arg_value>{arg-value-1}</arg_value>\n<arg_key>{arg-key-2}</arg_key>\n<arg_value>{arg-value-2}</arg_value>\n...\n</tool_call>{%- endif -%}\n{%- macro visible_text(content) -%}\n {%- if content is string -%}\n {{- content }}\n {%- elif content is iterable and content is not mapping -%}\n {%- for item in content -%}\n {%- if item is mapping and item.type == 'text' -%}\n {{- item.text }}\n {%- elif item is mapping and (item.type == 'image' or 'image' in item) -%}\n <|begin_of_image|><|image|><|end_of_image|>\n {%- elif item is mapping and (item.type == 'video' or 'video' in item) -%}\n <|begin_of_video|><|video|><|end_of_video|>\n {%- elif item is string -%}\n {{- item }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- content }}\n {%- endif -%}\n{%- endmacro -%}\n{%- set ns = namespace(last_user_index=-1) %}\n{%- for m in messages %}\n {%- if m.role == 'user' %}\n {% set ns.last_user_index = loop.index0 -%}\n {%- endif %}\n{%- endfor %}\n{% for m in messages %}\n{%- if m.role == 'user' -%}<|user|>\n{% if m.content is string %}\n{{ m.content }}\n{%- else %}\n{%- for item in m.content %}\n{% if item.type == 'video' or 'video' in item %}\n<|begin_of_video|><|video|><|end_of_video|>{% elif item.type == 'image' or 'image' in item %}\n<|begin_of_image|><|image|><|end_of_image|>{% elif item.type == 'text' %}\n{{ item.text }}\n{%- endif %}\n{%- endfor %}\n{%- endif %}\n{{- '/nothink' if (enable_thinking is defined and not enable_thinking and not visible_text(m.content).endswith(\"/nothink\")) else '' -}}\n{%- elif m.role == 'assistant' -%}\n<|assistant|>\n{%- set reasoning_content = '' %}\n{%- set content = visible_text(m.content) %}\n{%- if m.reasoning_content is string %}\n {%- set reasoning_content = m.reasoning_content %}\n{%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n{%- endif %}\n{%- if loop.index0 > ns.last_user_index and reasoning_content -%}\n{{ '\\n<think>' + reasoning_content.strip() + '</think>'}}\n{%- else -%}\n{{ '\\n<think></think>' }}\n{%- endif -%}\n{%- if content.strip() -%}\n{{ '\\n' + content.strip() }}\n{%- endif -%}\n{% if m.tool_calls %}\n{% for tc in m.tool_calls %}\n{%- if tc.function %}\n {%- set tc = tc.function %}\n{%- endif %}\n{{ '\\n<tool_call>' + tc.name }}\n{% set _args = tc.arguments %}\n{% for k, v in _args.items() %}\n<arg_key>{{ k }}</arg_key>\n<arg_value>{{ v | tojson(ensure_ascii=False) if v is not string else v }}</arg_value>\n{% endfor %}\n</tool_call>{% endfor %}\n{% endif %}\n{%- elif m.role == 'tool' -%}\n{%- if m.content is string -%}\n{%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|observation|>' }}\n{%- endif %}\n{{- '\\n<tool_response>\\n' }}\n{{- m.content }}\n{{- '\\n</tool_response>' }}\n{% elif m.content is iterable and m.content is not mapping %}\n{%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n{{- '<|observation|>' }}\n{%- endif %}\n{{- '\\n<tool_response>\\n' }}\n{%- for tr in m.content -%}\n {%- if tr is mapping and tr.type is defined -%}\n {%- set t = tr.type | lower -%}\n {%- if t == 'text' and tr.text is defined -%}\n{{ tr.text }}\n {%- elif t in ['image', 'image_url'] -%}\n<|begin_of_image|><|image|><|end_of_image|>\n {%- elif t in ['video', 'video_url'] -%}\n<|begin_of_video|><|video|><|end_of_video|>\n {%- else -%}\n{{ tr | tojson(ensure_ascii=False) }}\n {%- endif -%}\n {%- else -%}\n{{ tr.output if tr.output is defined else tr }}\n {%- endif -%}\n{%- endfor -%}\n{{- '\\n</tool_response>' }}\n{%- else -%}\n<|observation|>{% for tr in m.content %}\n\n<tool_response>\n{{ tr.output if tr.output is defined else tr }}\n</tool_response>{% endfor -%}\n{% endif -%}\n{%- elif m.role == 'system' -%}\n<|system|>\n{{ visible_text(m.content) }}\n{%- endif -%}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n<|assistant|>\n{{'<think></think>\\n' if (enable_thinking is defined and not enable_thinking) else ''}}\n{%- endif -%}",
|
| 10 |
+
"bos_token": "<|endoftext|>",
|
| 11 |
+
"eos_token": "<|endoftext|>",
|
| 12 |
+
"totalFileSize": 18811585376
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.295151+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "mmproj-zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 18 |
+
"size": 1840903936,
|
| 19 |
+
"blob_id": "81b6f9a8d790bf6e4d407259d5fde274d6693eb4",
|
| 20 |
+
"lfs_sha256": "219b0fcf326d8d023004ce9fc27fa643bd73ebfb73684e8e0af742c1fd755b63"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "mmproj-zai-org_GLM-4.6V-Flash-f16.gguf",
|
| 24 |
+
"size": 1786959616,
|
| 25 |
+
"blob_id": "baef217c6a87ce9ebfe630de348e070fa72b74ea",
|
| 26 |
+
"lfs_sha256": "fc35333718b524d7f43ff0ec6d0c1b9d05e673815c1dec641c04b9bef91e1cd6"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-IQ2_M.gguf",
|
| 30 |
+
"size": 3946316928,
|
| 31 |
+
"blob_id": "977e8cd7f187e0307251192f19e00da6b658aa4f",
|
| 32 |
+
"lfs_sha256": "83828fa39ac228d2a3e498c8e2e379ea0fba57fd57101e9bedb9a58fb7550ca1"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-IQ2_S.gguf",
|
| 36 |
+
"size": 3783787648,
|
| 37 |
+
"blob_id": "1039b808dc61508c6c67d891c5969d4e8ffc98fa",
|
| 38 |
+
"lfs_sha256": "d73fa5f46fa464b614e20b36e404a4839bdc67330c32420ed9962ff6c02e0644"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-IQ3_M.gguf",
|
| 42 |
+
"size": 4721804416,
|
| 43 |
+
"blob_id": "679efc7468034d1aa7951465483224e3d36da9b6",
|
| 44 |
+
"lfs_sha256": "aaa6ca968711b6c4ec278dceb13e41003031e3918301fc244bee05f05b622d23"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-IQ3_XS.gguf",
|
| 48 |
+
"size": 4406412416,
|
| 49 |
+
"blob_id": "02b99f319c974e9bf74dad71c481e623ea74a416",
|
| 50 |
+
"lfs_sha256": "c71d7cace201af737168600bc602a48208213d255f0319696fb3f0e25f6b4dd2"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-IQ3_XXS.gguf",
|
| 54 |
+
"size": 4226811008,
|
| 55 |
+
"blob_id": "71472b457021d53e4c1614c8e29d8d3a7b7dc874",
|
| 56 |
+
"lfs_sha256": "fc2675945e56f766dc7f3f7574a6c3f2a3029cc65f4ecaf0d950daf04946a8ab"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 60 |
+
"size": 5465179264,
|
| 61 |
+
"blob_id": "49570bb7e8757e22a59333fde0a5144e25a72947",
|
| 62 |
+
"lfs_sha256": "107d3e77b654d8e06517425b7a02877b1bb2f6a89ce71de941ad96f5a46d0455"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-IQ4_XS.gguf",
|
| 66 |
+
"size": 5262279808,
|
| 67 |
+
"blob_id": "2a69beb03c90c1d959a3e8abcc402953e4ee7ce9",
|
| 68 |
+
"lfs_sha256": "4342477286625c4cfcd70d0023bdb3ac30613fcce729123e0277097c7dc42e2d"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q2_K.gguf",
|
| 72 |
+
"size": 4006347904,
|
| 73 |
+
"blob_id": "b81c6c2b5320e0dcc55b724639d9903b802b865e",
|
| 74 |
+
"lfs_sha256": "cf1424d416359cf024f3af12483e91e5677e36d4095dfa3ce362d50326803e34"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q2_K_L.gguf",
|
| 78 |
+
"size": 4612555904,
|
| 79 |
+
"blob_id": "52567ab27a8442442300ac1b9e34a2209750c869",
|
| 80 |
+
"lfs_sha256": "998ebfc475c04dc1312a99393f2aeb284c8409fb749094a6a9aa624a1f663ced"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q3_K_L.gguf",
|
| 84 |
+
"size": 5196612736,
|
| 85 |
+
"blob_id": "b341a26528f2924890886c73f08e16ce24281df1",
|
| 86 |
+
"lfs_sha256": "4edc500ea49c378697226f8aff14b5cc7c29fd6bef852a0b6271d4251b531ee6"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q3_K_M.gguf",
|
| 90 |
+
"size": 4974511232,
|
| 91 |
+
"blob_id": "9502c9f3fc305712cfe5bc751a8de0927f9188fa",
|
| 92 |
+
"lfs_sha256": "c980955e1ab069b3ff2260c0622fa2e4809c6b1cdc5b3283eca27c89015988ec"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q3_K_S.gguf",
|
| 96 |
+
"size": 4592043136,
|
| 97 |
+
"blob_id": "63920a8eb836dd57c6b321acf2d0d917f2811448",
|
| 98 |
+
"lfs_sha256": "d9640d8e2db2e23042ee0612d304dbace1f691690a95a462641810fc6396d8c3"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q3_K_XL.gguf",
|
| 102 |
+
"size": 5739775104,
|
| 103 |
+
"blob_id": "befe54a6d9afe5e9e9eca35f00544e621164b07e",
|
| 104 |
+
"lfs_sha256": "e3184715d7a0dda579bdbb74edcba006c3fbab16e7743fb15bb955d8a64e550e"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q4_0.gguf",
|
| 108 |
+
"size": 5477467264,
|
| 109 |
+
"blob_id": "1635a36bcafd855a2516ace9746de81b132393ff",
|
| 110 |
+
"lfs_sha256": "6916c9d7b4b134da8b0b8ff44f23fec71d7a331881b17beb892305001f18484d"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q4_1.gguf",
|
| 114 |
+
"size": 6008603776,
|
| 115 |
+
"blob_id": "6f0dcfd50881f35f248ede021bb2976e4ea2583e",
|
| 116 |
+
"lfs_sha256": "bda1979fd3433042fd2baad81a409ab5bea36635ecf5bfed1e4c750462440612"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q4_K_L.gguf",
|
| 120 |
+
"size": 6627296384,
|
| 121 |
+
"blob_id": "ada4ea1b80a9a5c207eb6d09aab944380d241a09",
|
| 122 |
+
"lfs_sha256": "37a557ff039803e7092bc5b76383a2284799188307383f609c34ef3c5cb67170"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 126 |
+
"size": 6166578304,
|
| 127 |
+
"blob_id": "c1fcc0d4a0c20bc65dc67fbd2cc4fc53b95fdbf5",
|
| 128 |
+
"lfs_sha256": "1d807dab274a2d77026fc593020591b730dd0d381c831736feeefe8e165dfe85"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 132 |
+
"size": 5758485632,
|
| 133 |
+
"blob_id": "0c5a38a22b322a74c18d2360f4fda3cecb332151",
|
| 134 |
+
"lfs_sha256": "66bb642bb2660be3a8d1219c5e7ebf1c9c1a0cb5e5327e27ed685a3296651ca3"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q5_K_L.gguf",
|
| 138 |
+
"size": 7434044544,
|
| 139 |
+
"blob_id": "acfbddd1c7bf6059607790c0ee4e567fdb05b1e4",
|
| 140 |
+
"lfs_sha256": "4fd99fbced488a1f9d5dc00089f62cc194b793c3a42c4e3c6a827c497a45c48d"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q5_K_M.gguf",
|
| 144 |
+
"size": 7050921088,
|
| 145 |
+
"blob_id": "9bb11aee590bca36681c72ab4d1321cbb0478c3d",
|
| 146 |
+
"lfs_sha256": "40101581d76a68bcc475e7938f17a92fec99c5759b88f84a5ec51592cead4b81"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q5_K_S.gguf",
|
| 150 |
+
"size": 6697518208,
|
| 151 |
+
"blob_id": "164812897eba63959f4627bcb383dafa511f1936",
|
| 152 |
+
"lfs_sha256": "381e3182e731a9c57bef65307ef162ab1dcdaaa400f549a2f62cda3a98977e0f"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q6_K.gguf",
|
| 156 |
+
"size": 8266646656,
|
| 157 |
+
"blob_id": "921b106335f4eaacceb67942305d062c985b03f0",
|
| 158 |
+
"lfs_sha256": "db13135801258f338179d35c9183481b875939a2d2531d926e42a085fb4513b4"
|
| 159 |
+
},
|
| 160 |
+
{
|
| 161 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q6_K_L.gguf",
|
| 162 |
+
"size": 8567325824,
|
| 163 |
+
"blob_id": "6517686dc4eb9ffde81cf6c78bfe7a8d2b024dbb",
|
| 164 |
+
"lfs_sha256": "de1e44e36c16e7c7fdd3039d051d8481949ca520bca3be4c144a3842d58e31fc"
|
| 165 |
+
},
|
| 166 |
+
{
|
| 167 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-Q8_0.gguf",
|
| 168 |
+
"size": 9999615104,
|
| 169 |
+
"blob_id": "ccac462cce7b39f160145fe9216141d6b2a37070",
|
| 170 |
+
"lfs_sha256": "dc4226a14195bbaec623ceb404e4049b66ff937b5ab23044319909164e6e899c"
|
| 171 |
+
},
|
| 172 |
+
{
|
| 173 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-bf16.gguf",
|
| 174 |
+
"size": 18811585376,
|
| 175 |
+
"blob_id": "f1d785aa7f6181dbe97fc2f011604e7ebafeb216",
|
| 176 |
+
"lfs_sha256": "d3e0598b2a7071190f69309f91514596389e5b893a28a4441eb02e0606a6ec5f"
|
| 177 |
+
},
|
| 178 |
+
{
|
| 179 |
+
"rfilename": "zai-org_GLM-4.6V-Flash-imatrix.gguf",
|
| 180 |
+
"size": 5505056,
|
| 181 |
+
"blob_id": "4fe3b2b270f92952950f195610b9990a1a82bd2b",
|
| 182 |
+
"lfs_sha256": "c8a2a26bf670e3a695b5e50e9a541996fb9eef9f9ec8488be1a6d7d96f111a8d"
|
| 183 |
+
}
|
| 184 |
+
]
|
| 185 |
+
}
|
bpw/hf/repo-metadata/ggml-org__Kimi-VL-A3B-Thinking-2506-GGUF.json
ADDED
|
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF",
|
| 3 |
+
"requested_repo_id": "ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF",
|
| 4 |
+
"commit_sha": "e7dcd093335f922a057772febc7ab27eda985b40",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 15960110208,
|
| 7 |
+
"architecture": "deepseek2",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"chat_template": "{%- for message in messages -%}{%- if loop.first and messages[0]['role'] != 'system' -%}{{'<|im_system|>system<|im_middle|>You are a helpful assistant<|im_end|>'}}{%- endif -%}{%- if message['role'] == 'system' -%}{{'<|im_system|>'}}{%- endif -%}{%- if message['role'] == 'user' -%}{{'<|im_user|>'}}{%- endif -%}{%- if message['role'] == 'assistant' -%}{{'<|im_assistant|>'}}{%- endif -%}{{- message['role'] -}}{{'<|im_middle|>'}}{%- if message['content'] is string -%}{{- message['content'] + '<|im_end|>' -}}{%- else -%}{%- for content in message['content'] -%}{%- if content['type'] == 'image' or 'image' in content or 'image_url' in content -%}{{'<|media_start|>image<|media_content|><|media_pad|><|media_end|>'}}{%- else -%}{{content['text']}}{%- endif -%}{%- endfor -%}{{'<|im_end|>'}}{%- endif -%}{%- endfor -%}{%- if add_generation_prompt -%}{{'<|im_assistant|>assistant<|im_middle|>'}}{%- endif -%}",
|
| 10 |
+
"bos_token": "[BOS]",
|
| 11 |
+
"eos_token": "[EOS]",
|
| 12 |
+
"totalFileSize": 31934229408
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.297763+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "Kimi-VL-A3B-Thinking-2506-Q4_K_M.gguf",
|
| 18 |
+
"size": 10540747680,
|
| 19 |
+
"blob_id": "d571446ed6b1e018b02f80a43f24963c6cb3ddca",
|
| 20 |
+
"lfs_sha256": "72253d82d21c546587139dfd12597d491c25a13c6540d2ce18ca1581967338c5"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "Kimi-VL-A3B-Thinking-2506-Q8_0.gguf",
|
| 24 |
+
"size": 16974941088,
|
| 25 |
+
"blob_id": "006c73cabb329c52494eea103b2dc885a776d8a7",
|
| 26 |
+
"lfs_sha256": "ffcfd257855ee9f16243d8d16b4d74fcb106d3dc1fd65f466d1c089bf320b377"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 30 |
+
"size": 31934229408,
|
| 31 |
+
"blob_id": "31f87edc3afad1f5d97969393881f624a73a438d",
|
| 32 |
+
"lfs_sha256": "952f3faa372910984089d16db89927548c0f11dab36ee21f57ea79df23b32378"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "Kimi-VL-A3B-Thinking-2506-f16.gguf",
|
| 36 |
+
"size": 31934229408,
|
| 37 |
+
"blob_id": "9e5dccb871561453073d44465b29da1a53480713",
|
| 38 |
+
"lfs_sha256": "00dc49807794d7368aca96898a6bf6f5e4bbe60fa539ddc0464a8e531b8f08f5"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "mmproj-Kimi-VL-A3B-Thinking-2506-Q8_0.gguf",
|
| 42 |
+
"size": 618098624,
|
| 43 |
+
"blob_id": "66261f6c3f607f90f814f248fb4d289ff54d55aa",
|
| 44 |
+
"lfs_sha256": "5af5e5fc0ad5e2348f5227ddfa97e9241d453020c149dbe0e920ed603189ca15"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "mmproj-Kimi-VL-A3B-Thinking-2506-bf16.gguf",
|
| 48 |
+
"size": 906726464,
|
| 49 |
+
"blob_id": "26f2b6422d7d898fad42d3dad9822c0901d24142",
|
| 50 |
+
"lfs_sha256": "fc9b4043c3cd9a4649eec121b688e0e3bf609f6b3f836e45282f8a34f3ffee39"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "mmproj-Kimi-VL-A3B-Thinking-2506-f16.gguf",
|
| 54 |
+
"size": 905371712,
|
| 55 |
+
"blob_id": "378856d2a23831ea2d5b4fcf08d076b54ea52fda",
|
| 56 |
+
"lfs_sha256": "1386854a5031970a92ec458ddcc2dfce575f28edf6463643e50ac2f008068fb3"
|
| 57 |
+
}
|
| 58 |
+
]
|
| 59 |
+
}
|
bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF.json
ADDED
|
@@ -0,0 +1,82 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "mradermacher/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF",
|
| 3 |
+
"requested_repo_id": "mradermacher/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-GGUF",
|
| 4 |
+
"commit_sha": "ec81e38fab4c2b75f64e7457dafdf66e88e427c2",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30532122624,
|
| 7 |
+
"architecture": "qwen3moe",
|
| 8 |
+
"context_length": 40960,
|
| 9 |
+
"chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {{- messages[0].content + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0].content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" and message.content is string and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if message.content is string %}\n {%- set content = message.content %}\n {%- else %}\n {%- set content = '' %}\n {%- endif %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- if loop.index0 > ns.last_query_index %}\n {%- if loop.last or (not loop.last and reasoning_content) %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content.strip('\\n') + '\\n</think>\\n\\n' + content.lstrip('\\n') }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- endif %}\n{%- endif %}",
|
| 10 |
+
"eos_token": "<|im_end|>",
|
| 11 |
+
"totalFileSize": 16557093472
|
| 12 |
+
},
|
| 13 |
+
"fetched_at_utc": "2026-09-06T11:32:08.339231+00:00",
|
| 14 |
+
"siblings": [
|
| 15 |
+
{
|
| 16 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.IQ4_XS.gguf",
|
| 17 |
+
"size": 16557093472,
|
| 18 |
+
"blob_id": "6f063a807e7ac8a7822b3098e925c8dcdae77ce1",
|
| 19 |
+
"lfs_sha256": "3910cdd866a76adbf4ae29448a45b438c500005e35e06ba38bdab55f4bb1c8cd"
|
| 20 |
+
},
|
| 21 |
+
{
|
| 22 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q2_K.gguf",
|
| 23 |
+
"size": 11258610272,
|
| 24 |
+
"blob_id": "2676e1cc448a4cecda04f945722d41009d62ebed",
|
| 25 |
+
"lfs_sha256": "1354a707f5f7e10672d4fe171dfcb0c0a25307036ec094ccacac54585040d1e3"
|
| 26 |
+
},
|
| 27 |
+
{
|
| 28 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q3_K_L.gguf",
|
| 29 |
+
"size": 15900670560,
|
| 30 |
+
"blob_id": "e83b2bd64a598075781bdd155f3b538504f0a977",
|
| 31 |
+
"lfs_sha256": "015288f4a8e83a6ed7263bfb22cd13358dcce1e2046f85619c189635a0743253"
|
| 32 |
+
},
|
| 33 |
+
{
|
| 34 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q3_K_M.gguf",
|
| 35 |
+
"size": 14711847520,
|
| 36 |
+
"blob_id": "bf9c562a3cc91ad839fb05e6c8ce3061a33a802c",
|
| 37 |
+
"lfs_sha256": "b476ee669abb7c8bdcd191bf9536903ebd96ef7d26cca46f5cc64464c3dca299"
|
| 38 |
+
},
|
| 39 |
+
{
|
| 40 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q3_K_S.gguf",
|
| 41 |
+
"size": 13292468832,
|
| 42 |
+
"blob_id": "d74089bcce5f1afb95bfb0a136ddbaa979d51fce",
|
| 43 |
+
"lfs_sha256": "e42881424efcd8d045e49067e1ef161a14865cc05d24a364df8d7331765af297"
|
| 44 |
+
},
|
| 45 |
+
{
|
| 46 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q4_K_M.gguf",
|
| 47 |
+
"size": 18556686944,
|
| 48 |
+
"blob_id": "37bf5077e32243fcd0603fac7296d82c497fa2b6",
|
| 49 |
+
"lfs_sha256": "6683808ce05b9b87b78e9adae36d0a9da86673db7a5293f9ea8f1c5572f7d821"
|
| 50 |
+
},
|
| 51 |
+
{
|
| 52 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q4_K_S.gguf",
|
| 53 |
+
"size": 17456009824,
|
| 54 |
+
"blob_id": "cbc7786203912c031def29031edd3be66df1950c",
|
| 55 |
+
"lfs_sha256": "d10be56dad3c6c7a4b30f8ed4db2a6c1c2195c3c93c8da9a84d73aea52c8a28d"
|
| 56 |
+
},
|
| 57 |
+
{
|
| 58 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q5_K_M.gguf",
|
| 59 |
+
"size": 21725581920,
|
| 60 |
+
"blob_id": "d6654b7b966f2a214484e95902c38396ac058882",
|
| 61 |
+
"lfs_sha256": "c046ce0619cc7e57682ac9998df4946cff4c123fe80dd0eedfd94334fe574afc"
|
| 62 |
+
},
|
| 63 |
+
{
|
| 64 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q5_K_S.gguf",
|
| 65 |
+
"size": 21080511072,
|
| 66 |
+
"blob_id": "94adfe0c737cecbb24c4d346e2b0f3b75d293341",
|
| 67 |
+
"lfs_sha256": "20c7a94b43506f91ed4f77ec005787299d33f36054e296cdeed4e4e160aa5ffe"
|
| 68 |
+
},
|
| 69 |
+
{
|
| 70 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q6_K.gguf",
|
| 71 |
+
"size": 25092532832,
|
| 72 |
+
"blob_id": "326abc9897e8e3bdabb3ec20b3dfa2eba41b6e49",
|
| 73 |
+
"lfs_sha256": "2aa8901a579864699b7b8e5dc27419eda35859fc44f55883f8f1f84a5c2c7617"
|
| 74 |
+
},
|
| 75 |
+
{
|
| 76 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.Q8_0.gguf",
|
| 77 |
+
"size": 32483932768,
|
| 78 |
+
"blob_id": "c9212fac5c22ebb110a690d003ac18c5188eab1c",
|
| 79 |
+
"lfs_sha256": "7180a59c7992c1245a88502c82cd1dc820f2de0fb46623454b96d376d36feb51"
|
| 80 |
+
}
|
| 81 |
+
]
|
| 82 |
+
}
|
bpw/hf/repo-metadata/mradermacher__Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF.json
ADDED
|
@@ -0,0 +1,161 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "mradermacher/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF",
|
| 3 |
+
"requested_repo_id": "mradermacher/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF",
|
| 4 |
+
"commit_sha": "71a2191afbbdcf8ed15a11528d98f9c0747150f5",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30532122624,
|
| 7 |
+
"architecture": "qwen3moe",
|
| 8 |
+
"context_length": 40960,
|
| 9 |
+
"quantize_imatrix_file": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated-i1-GGUF/Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.imatrix.gguf",
|
| 10 |
+
"chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {{- messages[0].content + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0].content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" and message.content is string and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if message.content is string %}\n {%- set content = message.content %}\n {%- else %}\n {%- set content = '' %}\n {%- endif %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- if loop.index0 > ns.last_query_index %}\n {%- if loop.last or (not loop.last and reasoning_content) %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content.strip('\\n') + '\\n</think>\\n\\n' + content.lstrip('\\n') }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- endif %}\n{%- endif %}",
|
| 11 |
+
"eos_token": "<|im_end|>",
|
| 12 |
+
"totalFileSize": 7078292384
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.403992+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ1_M.gguf",
|
| 18 |
+
"size": 7078292384,
|
| 19 |
+
"blob_id": "8170f46cb460497b686c4322a70acaafc4e7b83e",
|
| 20 |
+
"lfs_sha256": "e3a098819dff4b93c3ce27e24983d42898ef0fe1dd041c66c6125c06258a98e4"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ1_S.gguf",
|
| 24 |
+
"size": 6416509856,
|
| 25 |
+
"blob_id": "99be3f73d73dc607784cc2805d63f5e23428b81a",
|
| 26 |
+
"lfs_sha256": "03fc643bca35fa368e9707c14dcff7af57a82a9d57a8e3cb00080455a6616f9e"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ2_M.gguf",
|
| 30 |
+
"size": 10169508768,
|
| 31 |
+
"blob_id": "eadd35adcc0c4173161474203718f33db8614c53",
|
| 32 |
+
"lfs_sha256": "0730026e9e1b00bc93cb3fafa5978a225385c88927233e89d4a192334d90b579"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ2_S.gguf",
|
| 36 |
+
"size": 9287132064,
|
| 37 |
+
"blob_id": "1c53e1eaed13ea57fdcab6177870dbd56063e8e5",
|
| 38 |
+
"lfs_sha256": "520816ec6fd95ffaa5b6f5f0b0e2445018adbd407d0ec735e02f62882e2b3655"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ2_XS.gguf",
|
| 42 |
+
"size": 9076222880,
|
| 43 |
+
"blob_id": "7a43f9e93a0e777deb7a8a4f8cd7955cbc207ab6",
|
| 44 |
+
"lfs_sha256": "48f3321ec5c53d8f9dcc3a788fdab5103fe3c5e4574241d29a2d33412f3233f7"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ2_XXS.gguf",
|
| 48 |
+
"size": 8181263264,
|
| 49 |
+
"blob_id": "a654c7a4b1e982620e9e931d179ecc96c62f4d41",
|
| 50 |
+
"lfs_sha256": "ca800b4d45134cdf26bbe084bf0f103b31c393b5d63562e1e7cfb129cbd2f5d5"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ3_M.gguf",
|
| 54 |
+
"size": 13513063328,
|
| 55 |
+
"blob_id": "78e58500bb60e56c7596037fd943a00991562940",
|
| 56 |
+
"lfs_sha256": "625bc7b45ff8a1d1107a166cfee6afe31f717aeeddc5af253520fd8b4c56c452"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ3_S.gguf",
|
| 60 |
+
"size": 13299153824,
|
| 61 |
+
"blob_id": "77ea7e1eb09f2f1bea0f575ff30295b953ee9e63",
|
| 62 |
+
"lfs_sha256": "baa007e33bb2f0af5fa9a1d6280e8d6d8f3d62be124f566b3688439b0053ae52"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ3_XS.gguf",
|
| 66 |
+
"size": 12598442912,
|
| 67 |
+
"blob_id": "e0196ce2835730599ac51e0959e744bcc90ed2f5",
|
| 68 |
+
"lfs_sha256": "6f3b0f9ac7b60c08c57ac1f9c92afce9a457d4d1a623b9e8cd195662229b3d2b"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ3_XXS.gguf",
|
| 72 |
+
"size": 11849327520,
|
| 73 |
+
"blob_id": "6f13e37f2a68ee952ffe4e415e784ad502730ab5",
|
| 74 |
+
"lfs_sha256": "64713833a8ec5b9d556c3f9ba5fdf6ea4853b9946af3915c67697e749b2b6da5"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-IQ4_XS.gguf",
|
| 78 |
+
"size": 16368350112,
|
| 79 |
+
"blob_id": "8123e21b72ea342e5c61516d3ca823ebb86ff06a",
|
| 80 |
+
"lfs_sha256": "67ac0904b5b599a9c377ca966da32e427fc08c8380afa78a4ade60af9ace7d95"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q2_K.gguf",
|
| 84 |
+
"size": 11258610592,
|
| 85 |
+
"blob_id": "94935d543939bbc064b71eff2485d3aad6433cca",
|
| 86 |
+
"lfs_sha256": "70d70bbb6adcb4cc96ca927598f4878508bc762e1746fcec423eeb58c68f533f"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q2_K_S.gguf",
|
| 90 |
+
"size": 10519364512,
|
| 91 |
+
"blob_id": "8ec9f6e3926db2f95c783b9833fe28f97765e649",
|
| 92 |
+
"lfs_sha256": "6ef8c0280c210e75dc05e9e4e984526c4aee396dfb0b54413276039642329d8d"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q3_K_L.gguf",
|
| 96 |
+
"size": 15900670880,
|
| 97 |
+
"blob_id": "bc3065b27c80e6bf9a9db10d506a99279e00dde7",
|
| 98 |
+
"lfs_sha256": "8b361b8e4e690cd7f3f70a1a0f183e2b5e59e3e148ced181263dc081533b227f"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q3_K_M.gguf",
|
| 102 |
+
"size": 14711847840,
|
| 103 |
+
"blob_id": "f023e6c1e510bd3bf70869690d8634c4148288fc",
|
| 104 |
+
"lfs_sha256": "cb7ac37d6f98b410d795785b2f8f7225ad90461461c4fc0931f6ae29cd6cfde8"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q3_K_S.gguf",
|
| 108 |
+
"size": 13292469152,
|
| 109 |
+
"blob_id": "458b6a7eb031ff1b4912ea65f1f295be545ea7fc",
|
| 110 |
+
"lfs_sha256": "ceb1043b73facadafed47ccecf50cd623908ebc382629bf365a0376c9b3096bd"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q4_0.gguf",
|
| 114 |
+
"size": 17379988384,
|
| 115 |
+
"blob_id": "cae8587dbd1a858884af5d0b57e3e17afb950fb5",
|
| 116 |
+
"lfs_sha256": "fb580b5752b458cb9bffd0de462ef8d5734145faba6e6ce185ab44b8ec8ccc69"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q4_1.gguf",
|
| 120 |
+
"size": 19192501152,
|
| 121 |
+
"blob_id": "695ccefec7ec8a4e3e13769cbd94e3084179b88d",
|
| 122 |
+
"lfs_sha256": "1e351aaabad9f01242582bd1c42d6677f5ad6b80ded04fb7d8ef9d3f22dc3adc"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q4_K_M.gguf",
|
| 126 |
+
"size": 18556687264,
|
| 127 |
+
"blob_id": "2896c6cd792f84e571edb701b86b89caa6cba2f5",
|
| 128 |
+
"lfs_sha256": "bc19804d636e9ddcbf2f10c45537692ef0a4cb7703ff5133d5c4834517d9dad6"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q4_K_S.gguf",
|
| 132 |
+
"size": 17456010144,
|
| 133 |
+
"blob_id": "1dd59eba076c98ae95639708e608d2ee4199fab7",
|
| 134 |
+
"lfs_sha256": "a9f66a6fd5c5121e151feea777c3da7d95b0b46f5fff11da4b8108a2ce1d0842"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q5_K_M.gguf",
|
| 138 |
+
"size": 21725582240,
|
| 139 |
+
"blob_id": "ce8ff79f729234d16ede45b606ba8f10cc4f98a9",
|
| 140 |
+
"lfs_sha256": "b4197528852f4337fbef77d4ed7c65d24b53db935ac8bf4c22389c2dab81574b"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q5_K_S.gguf",
|
| 144 |
+
"size": 21080511392,
|
| 145 |
+
"blob_id": "da1ed69b15d82868205b689e310ba8bbe8db7f46",
|
| 146 |
+
"lfs_sha256": "2b17e366f568dcd4f8ac2abf576dfccdbf875a017d3eae1e74fc3b369ceff0dd"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.i1-Q6_K.gguf",
|
| 150 |
+
"size": 25092533152,
|
| 151 |
+
"blob_id": "f2194e697d2eba7e06aa6d4b62f7832cfb6b712e",
|
| 152 |
+
"lfs_sha256": "54345129259a01b79cb37c06e08de394ef88979e9a5acec3eae5f595c456edbc"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "Huihui-InternVL3_5-30B-A3B-Instruct-abliterated.imatrix.gguf",
|
| 156 |
+
"size": 122029312,
|
| 157 |
+
"blob_id": "b75869a3bd1af77fb8d56f89d10950d9fd4acaef",
|
| 158 |
+
"lfs_sha256": "35240639f078793bcb93c62bfdd9a5ebf878d7eb35ab74ec86a3ddd153c98992"
|
| 159 |
+
}
|
| 160 |
+
]
|
| 161 |
+
}
|
bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-GGUF.json
ADDED
|
@@ -0,0 +1,94 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF",
|
| 3 |
+
"requested_repo_id": "mradermacher/InternVL3_5-30B-A3B-GGUF",
|
| 4 |
+
"commit_sha": "21b0a0caee18e68b38b257a60ac86f883cd65059",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30532122624,
|
| 7 |
+
"architecture": "qwen3moe",
|
| 8 |
+
"context_length": 40960,
|
| 9 |
+
"chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n'}}{% if message['content'] is string %}{{ message['content'] }}{% else %}{% for content in message['content'] %}{% if content['type'] == 'image' %}{{ '<image>\n' }}{% elif content['type'] == 'video' %}{{ '<video>\n' }}{% elif content['type'] == 'text' %}{{ content['text'] }}{% endif %}{% endfor %}{% endif %}{{'<|im_end|>\n'}}{% endfor %}{% if add_generation_prompt %}{{'<|im_start|>assistant\n' }}{% endif %}",
|
| 10 |
+
"eos_token": "<|im_end|>",
|
| 11 |
+
"totalFileSize": 16557090080
|
| 12 |
+
},
|
| 13 |
+
"fetched_at_utc": "2026-09-06T11:32:08.421033+00:00",
|
| 14 |
+
"siblings": [
|
| 15 |
+
{
|
| 16 |
+
"rfilename": "InternVL3_5-30B-A3B.IQ4_XS.gguf",
|
| 17 |
+
"size": 16557090080,
|
| 18 |
+
"blob_id": "4c5dca7045c71e5d2f955fb4e338f0d627265a7c",
|
| 19 |
+
"lfs_sha256": "be28be57166c9903fe701c99596aa3c7df9f8c834f3109e6e9b4668d72cc646f"
|
| 20 |
+
},
|
| 21 |
+
{
|
| 22 |
+
"rfilename": "InternVL3_5-30B-A3B.Q2_K.gguf",
|
| 23 |
+
"size": 11258606880,
|
| 24 |
+
"blob_id": "98c9fe8c6f8a05c6bb1bd8c15e9f4f5e41b3263b",
|
| 25 |
+
"lfs_sha256": "7c24b9b49c8850768e79191a2b1d3934c1fdafea449bb148378836e6cf5a6376"
|
| 26 |
+
},
|
| 27 |
+
{
|
| 28 |
+
"rfilename": "InternVL3_5-30B-A3B.Q3_K_L.gguf",
|
| 29 |
+
"size": 15900667168,
|
| 30 |
+
"blob_id": "fa958c79d282ff00d46cf8fac9dad50cc092e650",
|
| 31 |
+
"lfs_sha256": "ff7f0bcbbf7b27838776e16cacb5c1fb8e8d2e148030dfa4bc0b83c625adbced"
|
| 32 |
+
},
|
| 33 |
+
{
|
| 34 |
+
"rfilename": "InternVL3_5-30B-A3B.Q3_K_M.gguf",
|
| 35 |
+
"size": 14711844128,
|
| 36 |
+
"blob_id": "cdf99fd571b4bcb50dc9694dc8084b52bf25c400",
|
| 37 |
+
"lfs_sha256": "069eea2ac26ab75c6a363cf89c31e7bd0b44a4793d32d1467243d2a7c7052d75"
|
| 38 |
+
},
|
| 39 |
+
{
|
| 40 |
+
"rfilename": "InternVL3_5-30B-A3B.Q3_K_S.gguf",
|
| 41 |
+
"size": 13292465440,
|
| 42 |
+
"blob_id": "52918c6824f5c5340488c057a2c61e29a09ae4ae",
|
| 43 |
+
"lfs_sha256": "689b500b71db95201635fc5ac2dc7fe86ecf354c0211cda650eec2e881c6b8f0"
|
| 44 |
+
},
|
| 45 |
+
{
|
| 46 |
+
"rfilename": "InternVL3_5-30B-A3B.Q4_K_M.gguf",
|
| 47 |
+
"size": 18556683552,
|
| 48 |
+
"blob_id": "8556d6682480976546c58d8ac23100b20772ac4d",
|
| 49 |
+
"lfs_sha256": "497eb3396933ba4f5d437990eabf2974df957c95b780dc7f49232bfc928e78b2"
|
| 50 |
+
},
|
| 51 |
+
{
|
| 52 |
+
"rfilename": "InternVL3_5-30B-A3B.Q4_K_S.gguf",
|
| 53 |
+
"size": 17456006432,
|
| 54 |
+
"blob_id": "bac2e3a5ad7b29b2e6975d10483aa4be17c7b4fc",
|
| 55 |
+
"lfs_sha256": "adde27b61e2bbc95bdc66323e080356c77a9a8b8a8b182c5b0a42d99d0d6b74d"
|
| 56 |
+
},
|
| 57 |
+
{
|
| 58 |
+
"rfilename": "InternVL3_5-30B-A3B.Q5_K_M.gguf",
|
| 59 |
+
"size": 21725578528,
|
| 60 |
+
"blob_id": "5a177876b89bb004990c62be781a35cb65052cd9",
|
| 61 |
+
"lfs_sha256": "c5289d7a9ff1480d2b231e7839f71a5aef904c73a8bab1e880c885d0b0f163c6"
|
| 62 |
+
},
|
| 63 |
+
{
|
| 64 |
+
"rfilename": "InternVL3_5-30B-A3B.Q5_K_S.gguf",
|
| 65 |
+
"size": 21080507680,
|
| 66 |
+
"blob_id": "1298eecb35b6bfa0ba189d427eea72b9ec3f13c1",
|
| 67 |
+
"lfs_sha256": "0bf0c2ebd63134217805d9bc9e0e27d4caeb0afc3a33927ab1e1eb094c5425be"
|
| 68 |
+
},
|
| 69 |
+
{
|
| 70 |
+
"rfilename": "InternVL3_5-30B-A3B.Q6_K.gguf",
|
| 71 |
+
"size": 25092529440,
|
| 72 |
+
"blob_id": "3e996c1a5496c1ddcf5a1b5331b9f44eaf986d8e",
|
| 73 |
+
"lfs_sha256": "6f4dfa56201dacd61a0c1abece7ebc46ab2f2a11e5c28e7f2d24d2b5c7b7447b"
|
| 74 |
+
},
|
| 75 |
+
{
|
| 76 |
+
"rfilename": "InternVL3_5-30B-A3B.Q8_0.gguf",
|
| 77 |
+
"size": 32483929376,
|
| 78 |
+
"blob_id": "e1297f7cf556bcd6822d3f48b68b8e8cd80a020c",
|
| 79 |
+
"lfs_sha256": "6ebefbe0bf1b936f1d1c6a6543dcf4981b3fad602674330e5c656dade1948b86"
|
| 80 |
+
},
|
| 81 |
+
{
|
| 82 |
+
"rfilename": "InternVL3_5-30B-A3B.mmproj-Q8_0.gguf",
|
| 83 |
+
"size": 342398560,
|
| 84 |
+
"blob_id": "558114e652dad611ba12dc0af55fced875b62421",
|
| 85 |
+
"lfs_sha256": "33a44d3b3ec1c4861decb9f87c49fffae83f67f7bd620ab9c0e22dad8056fd8a"
|
| 86 |
+
},
|
| 87 |
+
{
|
| 88 |
+
"rfilename": "InternVL3_5-30B-A3B.mmproj-f16.gguf",
|
| 89 |
+
"size": 636106336,
|
| 90 |
+
"blob_id": "75d2e3db808a830e3956ca1e3a72770aa634c6ea",
|
| 91 |
+
"lfs_sha256": "06f4f7fa1e43a8ef3a1bca3ccb3411392506e4ca5b090fb15d1dbf4f4e1cd84a"
|
| 92 |
+
}
|
| 93 |
+
]
|
| 94 |
+
}
|
bpw/hf/repo-metadata/mradermacher__InternVL3_5-30B-A3B-i1-GGUF.json
ADDED
|
@@ -0,0 +1,161 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF",
|
| 3 |
+
"requested_repo_id": "mradermacher/InternVL3_5-30B-A3B-i1-GGUF",
|
| 4 |
+
"commit_sha": "120d600e464788a15e2140e1c9650c543d575d95",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30532122624,
|
| 7 |
+
"architecture": "qwen3moe",
|
| 8 |
+
"context_length": 40960,
|
| 9 |
+
"quantize_imatrix_file": "InternVL3_5-30B-A3B-i1-GGUF/InternVL3_5-30B-A3B.imatrix.gguf",
|
| 10 |
+
"chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n'}}{% if message['content'] is string %}{{ message['content'] }}{% else %}{% for content in message['content'] %}{% if content['type'] == 'image' %}{{ '<image>\n' }}{% elif content['type'] == 'video' %}{{ '<video>\n' }}{% elif content['type'] == 'text' %}{{ content['text'] }}{% endif %}{% endfor %}{% endif %}{{'<|im_end|>\n'}}{% endfor %}{% if add_generation_prompt %}{{'<|im_start|>assistant\n' }}{% endif %}",
|
| 11 |
+
"eos_token": "<|im_end|>",
|
| 12 |
+
"totalFileSize": 7078288928
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.444929+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ1_M.gguf",
|
| 18 |
+
"size": 7078288928,
|
| 19 |
+
"blob_id": "6629f85dbc327584b60c18f912c20908d8156e71",
|
| 20 |
+
"lfs_sha256": "50a80671deb86a5b0c9411f47619d8e6c791ab3a800a6e1d227bb4698fc5c128"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ1_S.gguf",
|
| 24 |
+
"size": 6416506400,
|
| 25 |
+
"blob_id": "d7bfccf0155efc7d6866f32859f575f96b790357",
|
| 26 |
+
"lfs_sha256": "027bfb158f945737574eae2e9d3c3a35620226edf0f586249977ff8a82435380"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ2_M.gguf",
|
| 30 |
+
"size": 10169505312,
|
| 31 |
+
"blob_id": "0a60d00d79078ba62c3c963915490b02b4ee67e7",
|
| 32 |
+
"lfs_sha256": "a5e2f7300c57389b2fb3aaa7b956f28123fefa381d93d501e1d9c4057ebbdea9"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ2_S.gguf",
|
| 36 |
+
"size": 9287128608,
|
| 37 |
+
"blob_id": "f157efb60daff49e16dae89c8c63eb9d0b187446",
|
| 38 |
+
"lfs_sha256": "ccb11280c641bd87c62d167152a426d359bb1334a7a63c906aaa3271dd5db773"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ2_XS.gguf",
|
| 42 |
+
"size": 9076219424,
|
| 43 |
+
"blob_id": "cbd570e1ec9e3a54b0046150a9f9765a99ed8a82",
|
| 44 |
+
"lfs_sha256": "b9eaa79966d63cb0eb0eff99d13f6b9737e8e217ecdd4ed440bcf2f3badd8320"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ2_XXS.gguf",
|
| 48 |
+
"size": 8181259808,
|
| 49 |
+
"blob_id": "60adac189926950bd1ddd6c06cec97698783ddbb",
|
| 50 |
+
"lfs_sha256": "2673fef1d6366be451f2fde1502da5b0dcf7d6647020ce88bde71b7c608d1e3b"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ3_M.gguf",
|
| 54 |
+
"size": 13513059872,
|
| 55 |
+
"blob_id": "ade4d9a33a74bfd4f7c30f1ba5b4261a28719d35",
|
| 56 |
+
"lfs_sha256": "56966a2caf37d3d3ff5e62a4c54b9873411a249b18c435c41c395c444082bfb6"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ3_S.gguf",
|
| 60 |
+
"size": 13299150368,
|
| 61 |
+
"blob_id": "1de214b3b72d7aa3f7dbd5cd35abf3860cadd147",
|
| 62 |
+
"lfs_sha256": "7881e5c578070e5749654214083a5a30ec1fde2f69a797a6054d79a09c947ed6"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ3_XS.gguf",
|
| 66 |
+
"size": 12598439456,
|
| 67 |
+
"blob_id": "b53bbf33d02b98f9bbb878d71bd8f015d6a58ae7",
|
| 68 |
+
"lfs_sha256": "c7c5e4aaf3a88275fede33dc530c238c4e1d89a7e0b272c2b91c10afad2b93d1"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ3_XXS.gguf",
|
| 72 |
+
"size": 11849324064,
|
| 73 |
+
"blob_id": "a8f2e476ec87d2c330634dec1f90b527ee039b1d",
|
| 74 |
+
"lfs_sha256": "de44b8a7d28d482c2d9b364cb2c7ddcd00401ec58d4bc52d1ee92c45bf8d042f"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-IQ4_XS.gguf",
|
| 78 |
+
"size": 16368346656,
|
| 79 |
+
"blob_id": "f2dfe4203ebfa0ad7bcbd92429a6ad01c3723115",
|
| 80 |
+
"lfs_sha256": "d768d7983f8bb8e7804812679b0626a2fc8a87383461b0285ee5e23370143f2b"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q2_K.gguf",
|
| 84 |
+
"size": 11258607136,
|
| 85 |
+
"blob_id": "89876af9f906b9a0190ad39b10f5c40be79a6e43",
|
| 86 |
+
"lfs_sha256": "2acc6a7ab47017f5d7e78212519cda4b6c30f8af5c9c3af288d83383af961fc4"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q2_K_S.gguf",
|
| 90 |
+
"size": 10519361056,
|
| 91 |
+
"blob_id": "157de2e5b7d82c86704fe5b9477eb599646aeb8e",
|
| 92 |
+
"lfs_sha256": "b05eb9c8dffc25cbccb0488e97596ff927c42e1b2eac9d3a0a387a3291bc74cf"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q3_K_L.gguf",
|
| 96 |
+
"size": 15900667424,
|
| 97 |
+
"blob_id": "090b3cc43ae69cf26b7f52b8f421a9110c2f4e4d",
|
| 98 |
+
"lfs_sha256": "74b8ee78388eb2fb898c27566d8054a7a4e9cc6046b0738b55e5de23bf0954b2"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q3_K_M.gguf",
|
| 102 |
+
"size": 14711844384,
|
| 103 |
+
"blob_id": "9a42d4368c43bb11dc41587d86c52aa18a2e3dbe",
|
| 104 |
+
"lfs_sha256": "6f7e0aa028fc29792fb1456f23f3a360a4a054995fe79376c0298be181c96e85"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q3_K_S.gguf",
|
| 108 |
+
"size": 13292465696,
|
| 109 |
+
"blob_id": "9ccce052c89ec46160314e17491de6872b8b80b6",
|
| 110 |
+
"lfs_sha256": "a773a1d17704f02a12e73901d7d1aad427fc927ceda058c9e17461f6840686bf"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q4_0.gguf",
|
| 114 |
+
"size": 17379984928,
|
| 115 |
+
"blob_id": "8d2e32e041ec3b22946366699d6363c2eee004bf",
|
| 116 |
+
"lfs_sha256": "6d94ea57b8f5fee86aa616119f6e6c8935102d0e218ebe405ba5f608de0738a9"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q4_1.gguf",
|
| 120 |
+
"size": 19192497696,
|
| 121 |
+
"blob_id": "f95942ad2e88911065bde56f2e33dfb476339f82",
|
| 122 |
+
"lfs_sha256": "cad58446e4727877d3116b2acce524ab60e973a4a1bf9a9a41d854f144618e27"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q4_K_M.gguf",
|
| 126 |
+
"size": 18556683808,
|
| 127 |
+
"blob_id": "9adeffbb5b9449d8843684fe44234f0e028685cc",
|
| 128 |
+
"lfs_sha256": "97cfeb41eb4aa7dcfe411aaf4e879c7bd00931a4850dbc79a768848a87188d80"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q4_K_S.gguf",
|
| 132 |
+
"size": 17456006688,
|
| 133 |
+
"blob_id": "0b5d27d2c4c1f2706e20c0759cd6ffaee5ed58f4",
|
| 134 |
+
"lfs_sha256": "30d2ae092e19c7eb69b4d59d4d98b658c3fa9e5ea0b42ab56a955ced3c2f603a"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q5_K_M.gguf",
|
| 138 |
+
"size": 21725578784,
|
| 139 |
+
"blob_id": "45db5f20893c659eab275564037dca9c15dbc6e3",
|
| 140 |
+
"lfs_sha256": "d67f4f3ec8925950951a4bc0c3f0f4642d81b0d2e530b08368a4982dd3742511"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q5_K_S.gguf",
|
| 144 |
+
"size": 21080507936,
|
| 145 |
+
"blob_id": "4a1d92c9db53009770518036c78ed29d80c0ff56",
|
| 146 |
+
"lfs_sha256": "680488bbe7b509379bcce13034991439bcc522b4b1b7a12287519666c11ea966"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "InternVL3_5-30B-A3B.i1-Q6_K.gguf",
|
| 150 |
+
"size": 25092529696,
|
| 151 |
+
"blob_id": "5f82c9e85b88041909b358ae8ab28889570e26a3",
|
| 152 |
+
"lfs_sha256": "23e30fabf477fc9996adc5e82c47e5f25c53fdc63501dfab4603a1f9fb36a327"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "InternVL3_5-30B-A3B.imatrix.gguf",
|
| 156 |
+
"size": 122029312,
|
| 157 |
+
"blob_id": "d1956cf755c60fc6003ab16a53833276820f8b20",
|
| 158 |
+
"lfs_sha256": "95b8ebd1ef60264ce580e7d99ef8e5a51c91ee5fe3f4067cace73e9254eba7c2"
|
| 159 |
+
}
|
| 160 |
+
]
|
| 161 |
+
}
|
bpw/hf/repo-metadata/unsloth__GLM-4.6V-Flash-GGUF.json
ADDED
|
@@ -0,0 +1,191 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/GLM-4.6V-Flash-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/GLM-4.6V-Flash-GGUF",
|
| 4 |
+
"commit_sha": "c78a0727cb5ee489db2f218a212f613943023ee8",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 9400279040,
|
| 7 |
+
"architecture": "glm4",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"chat_template": "{# Unsloth template fixes #}\n[gMASK]<sop>\n{%- if tools -%}\n<|system|>\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>\n{% for tool in tools %}\n{{ tool | tojson(ensure_ascii=False) }}\n{% endfor %}\n</tools>\n\nFor each function call, output the function name and arguments within the following XML format:\n<tool_call>{function-name}\n<arg_key>{arg-key-1}</arg_key>\n<arg_value>{arg-value-1}</arg_value>\n<arg_key>{arg-key-2}</arg_key>\n<arg_value>{arg-value-2}</arg_value>\n...\n</tool_call>{%- endif -%}\n{%- macro visible_text(content) -%}\n {%- if content is string -%}\n {{- content }}\n {%- elif content is iterable and content is not mapping -%}\n {%- for item in content -%}\n {%- if item is mapping and item.type == 'text' -%}\n {{- item.text }}\n {%- elif item is mapping and (item.type == 'image' or 'image' in item) -%}\n <|begin_of_image|><|image|><|end_of_image|>\n {%- elif item is mapping and (item.type == 'video' or 'video' in item) -%}\n <|begin_of_video|><|video|><|end_of_video|>\n {%- elif item is string -%}\n {{- item }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- content }}\n {%- endif -%}\n{%- endmacro -%}\n{%- set ns = namespace(last_user_index=-1) %}\n{%- for m in messages %}\n {%- if m.role == 'user' %}\n {% set ns.last_user_index = loop.index0 -%}\n {%- endif %}\n{%- endfor %}\n{% for m in messages %}\n{%- if m.role == 'user' -%}<|user|>\n{% if m.content is string %}\n{{ m.content }}\n{%- else %}\n{%- for item in m.content %}\n{% if item.type == 'video' or 'video' in item %}\n<|begin_of_video|><|video|><|end_of_video|>{% elif item.type == 'image' or 'image' in item %}\n<|begin_of_image|><|image|><|end_of_image|>{% elif item.type == 'text' %}\n{{ item.text }}\n{%- endif %}\n{%- endfor %}\n{%- endif %}\n{{- '/nothink' if (enable_thinking is defined and not enable_thinking and not visible_text(m.content).endswith(\"/nothink\")) else '' -}}\n{%- elif m.role == 'assistant' -%}\n<|assistant|>\n{%- set reasoning_content = '' %}\n{%- set content = visible_text(m.content) %}\n{%- if m.reasoning_content is string %}\n {%- set reasoning_content = m.reasoning_content %}\n{%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n{%- endif %}\n{%- if loop.index0 > ns.last_user_index and reasoning_content -%}\n{{ '\\n<think>' + reasoning_content.strip() + '</think>'}}\n{%- else -%}\n{{ '\\n<think></think>' }}\n{%- endif -%}\n{%- if content.strip() -%}\n{{ '\\n' + content.strip() }}\n{%- endif -%}\n{% if m.tool_calls %}\n{% for tc in m.tool_calls %}\n{%- if tc.function %}\n {%- set tc = tc.function %}\n{%- endif %}\n{{ '\\n<tool_call>' + tc.name }}\n{% set _args = tc.arguments %}{% if _args is mapping %}\n{% for k, v in _args|items %}\n<arg_key>{{ k }}</arg_key>\n<arg_value>{{ v | tojson(ensure_ascii=False) if v is not string else v }}</arg_value>\n{% endfor %}{%- endif %}\n</tool_call>{% endfor %}\n{% endif %}\n{%- elif m.role == 'tool' -%}\n{%- if m.content is string -%}\n{%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|observation|>' }}\n{%- endif %}\n{{- '\\n<tool_response>\\n' }}\n{{- m.content }}\n{{- '\\n</tool_response>' }}\n{% elif m.content is iterable and m.content is not mapping %}\n{%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n{{- '<|observation|>' }}\n{%- endif %}\n{{- '\\n<tool_response>\\n' }}\n{%- for tr in m.content -%}\n {%- if tr is mapping and tr.type is defined -%}\n {%- set t = tr.type | lower -%}\n {%- if t == 'text' and tr.text is defined -%}\n{{ tr.text }}\n {%- elif t in ['image', 'image_url'] -%}\n<|begin_of_image|><|image|><|end_of_image|>\n {%- elif t in ['video', 'video_url'] -%}\n<|begin_of_video|><|video|><|end_of_video|>\n {%- else -%}\n{{ tr | tojson(ensure_ascii=False) }}\n {%- endif -%}\n {%- else -%}\n{{ tr.output if tr.output is defined else tr }}\n {%- endif -%}\n{%- endfor -%}\n{{- '\\n</tool_response>' }}\n{%- else -%}\n<|observation|>{% for tr in m.content %}\n\n<tool_response>\n{{ tr.output if tr.output is defined else tr }}\n</tool_response>{% endfor -%}\n{% endif -%}\n{%- elif m.role == 'system' -%}\n<|system|>\n{{ visible_text(m.content) }}\n{%- endif -%}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n<|assistant|>\n{{'<think></think>\\n' if (enable_thinking is defined and not enable_thinking) else ''}}\n{%- endif -%}\n{# Copyright 2025-present Unsloth. Apache 2.0 License. #}",
|
| 10 |
+
"bos_token": "<|endoftext|>",
|
| 11 |
+
"eos_token": "<|endoftext|>",
|
| 12 |
+
"totalFileSize": 18811585888
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.381013+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "GLM-4.6V-Flash-BF16.gguf",
|
| 18 |
+
"size": 18811585888,
|
| 19 |
+
"blob_id": "bc7ec796cdba6c9caf64b6d78662f367441f4c19",
|
| 20 |
+
"lfs_sha256": "ae16d59cc54631c619bb83238af25b169de77d6549eeaa4a89e1ca8f318a4bc0"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "GLM-4.6V-Flash-IQ4_NL.gguf",
|
| 24 |
+
"size": 5465179744,
|
| 25 |
+
"blob_id": "80cab8541cb83d605613f640c331e3bceb97661a",
|
| 26 |
+
"lfs_sha256": "d8c440ad41fc7cd8ed54a53fe53246e3b10bdb2617a1b0b46b35cd962ab4a53f"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "GLM-4.6V-Flash-IQ4_XS.gguf",
|
| 30 |
+
"size": 5281678944,
|
| 31 |
+
"blob_id": "91194d66c50f8d845001ff8ee7c9e7d3fdf5e264",
|
| 32 |
+
"lfs_sha256": "23ea7196ed6f595c44591266a1b4b90d56db5a66c5223d49a41a587b81ace35d"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "GLM-4.6V-Flash-Q2_K.gguf",
|
| 36 |
+
"size": 4006348384,
|
| 37 |
+
"blob_id": "ac04e69dab692af070ecc872b3f74af4fe5e6dc8",
|
| 38 |
+
"lfs_sha256": "237f13f2d5e128f0b6c815cb8e43767f0965d82efa9292cb8ead5c0a470542cd"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "GLM-4.6V-Flash-Q2_K_L.gguf",
|
| 42 |
+
"size": 4151838304,
|
| 43 |
+
"blob_id": "97005ec0e2fd7be6f2ea0373f4f6c368d30fb6d7",
|
| 44 |
+
"lfs_sha256": "75dd5ccfaff8bf6d323bd5597d9df9f11bf3126d844bcf03ad1cb91aed502bbb"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "GLM-4.6V-Flash-Q3_K_M.gguf",
|
| 48 |
+
"size": 4974511712,
|
| 49 |
+
"blob_id": "6c0b75a2651f0371ec02d95c65a64030a679bf06",
|
| 50 |
+
"lfs_sha256": "44d20d36df429a7c77c91d6b3d9830d4169d5b03804355d4ffd0aa6bceed6c87"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "GLM-4.6V-Flash-Q3_K_S.gguf",
|
| 54 |
+
"size": 4592043616,
|
| 55 |
+
"blob_id": "98487b28b519c7a14c473b4390b8154ce97a7295",
|
| 56 |
+
"lfs_sha256": "fb8ccc2492fcfecb1ccf4ba0f940a8dc59127055771eef49f86428f99c7e894c"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "GLM-4.6V-Flash-Q4_0.gguf",
|
| 60 |
+
"size": 5477467744,
|
| 61 |
+
"blob_id": "eb24e9672b17f80cbb3a998bae9189e6307bb2f0",
|
| 62 |
+
"lfs_sha256": "c725c1f372976607849d41432606b1f4dcccf17aa0858510fb05f2a396692f84"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "GLM-4.6V-Flash-Q4_1.gguf",
|
| 66 |
+
"size": 6008604256,
|
| 67 |
+
"blob_id": "a447dc4ac89888c583f60da28341be6cd313c048",
|
| 68 |
+
"lfs_sha256": "66e75621da9a37d242971d6d26fbbd0eee3005e0b70a478094103ac4e69ae9e5"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "GLM-4.6V-Flash-Q4_K_M.gguf",
|
| 72 |
+
"size": 6166578784,
|
| 73 |
+
"blob_id": "b7fe560dba98eaf5b4847b8278954bcac283f7fa",
|
| 74 |
+
"lfs_sha256": "4f06cac67c0ad96cabe4b6a99123f02393e63a4aaacc03486e0939dac0df0f31"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "GLM-4.6V-Flash-Q4_K_S.gguf",
|
| 78 |
+
"size": 5758486112,
|
| 79 |
+
"blob_id": "9d2a77ed2b1e5f06296342d227029c3948106d75",
|
| 80 |
+
"lfs_sha256": "258e9d7ea3e9b1f9812cebc5a3f85e3f55e39b8a442f52b9b0728d20a4223515"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "GLM-4.6V-Flash-Q5_K_M.gguf",
|
| 84 |
+
"size": 7050921568,
|
| 85 |
+
"blob_id": "67df74e9b59eb3a5f6a02b1e2ebe906d316852a5",
|
| 86 |
+
"lfs_sha256": "6f57c86b70df9070a7c516e689e05236776da09dd20dd2fadbcf2285320674c4"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "GLM-4.6V-Flash-Q5_K_S.gguf",
|
| 90 |
+
"size": 6697518688,
|
| 91 |
+
"blob_id": "833738301176ce324dd81132ebec662c24ee7201",
|
| 92 |
+
"lfs_sha256": "bb677e96438260fccb5b2d624b01cd05d70dd5a60b95f8fb19385f5eff251f4d"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "GLM-4.6V-Flash-Q6_K.gguf",
|
| 96 |
+
"size": 8266647136,
|
| 97 |
+
"blob_id": "0800873a6ce9b9baee6764e225b31d113d6872f8",
|
| 98 |
+
"lfs_sha256": "5444e60efdb01905e027c5895ca03447b8bd23659acd99745ec30e7d9d5ae2e9"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "GLM-4.6V-Flash-Q8_0.gguf",
|
| 102 |
+
"size": 9999615584,
|
| 103 |
+
"blob_id": "2b93a2f7a98c513c29e654a56851c2e093356206",
|
| 104 |
+
"lfs_sha256": "cc88082a299dbe1671a6cd074dbc2fa5da53e5e3f227901a35417552fe722628"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "GLM-4.6V-Flash-UD-IQ1_M.gguf",
|
| 108 |
+
"size": 3318154848,
|
| 109 |
+
"blob_id": "9f3f54bdfa6d254a8852ea995a41130c9e2ae697",
|
| 110 |
+
"lfs_sha256": "9de7da24e14031555375cda9668cfd8475cd0cd81fb14e3d6d8fc4ee6f4c5fe0"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "GLM-4.6V-Flash-UD-IQ1_S.gguf",
|
| 114 |
+
"size": 3204204128,
|
| 115 |
+
"blob_id": "add66edc667d6f3e7a72da9750e6b28ffd3f4a0b",
|
| 116 |
+
"lfs_sha256": "11bbf650cbed4b925dd78d21da5117fc2a86c83f89051e42b9dd802c23b459d1"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "GLM-4.6V-Flash-UD-IQ2_M.gguf",
|
| 120 |
+
"size": 3992028768,
|
| 121 |
+
"blob_id": "0a6e88fcb21287bc70f0efaba831132e71d60108",
|
| 122 |
+
"lfs_sha256": "68991b24a64508d77aa47f0df5474f0ac2cf944309d1a313322fa9b945fddb2f"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "GLM-4.6V-Flash-UD-IQ2_XXS.gguf",
|
| 126 |
+
"size": 3511158368,
|
| 127 |
+
"blob_id": "5cabf0b99ab12a0475a0d3664fb7131aaf380ff3",
|
| 128 |
+
"lfs_sha256": "da170235d991ecb24121d53dcfdcac8935353eadb5919d7b6f4201e7c08ecc83"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "GLM-4.6V-Flash-UD-IQ3_XXS.gguf",
|
| 132 |
+
"size": 4234839648,
|
| 133 |
+
"blob_id": "663578f1022846acb8e0d15155b15a563f69a199",
|
| 134 |
+
"lfs_sha256": "a711386bbdefb20109919d23154b519085c4e2cc67444ac1b66c5c097047389c"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "GLM-4.6V-Flash-UD-Q2_K_XL.gguf",
|
| 138 |
+
"size": 4211066464,
|
| 139 |
+
"blob_id": "bfc96a448e8b570e8fab8e61ec5ab374b2b039c6",
|
| 140 |
+
"lfs_sha256": "fa5d710366fee280c16c533c1d5ea87ead1a7704ae2c9bf71e0178a6aa3633ea"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "GLM-4.6V-Flash-UD-Q3_K_XL.gguf",
|
| 144 |
+
"size": 5139875424,
|
| 145 |
+
"blob_id": "eba3440a558821c56c0d85cae011cbb5df0197a7",
|
| 146 |
+
"lfs_sha256": "04b5e126ff9fc77c6fd6fc0a17f1e9979cc8dadf2b83b855b3d3b9b9f4c1c4f2"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "GLM-4.6V-Flash-UD-Q4_K_XL.gguf",
|
| 150 |
+
"size": 6187353696,
|
| 151 |
+
"blob_id": "c343e34b4b807d959011d95aae517cd933cfb602",
|
| 152 |
+
"lfs_sha256": "b23279d78decbf1e598be58f05837306f8bddca39bc27a64463636916815d628"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "GLM-4.6V-Flash-UD-Q5_K_XL.gguf",
|
| 156 |
+
"size": 7006193248,
|
| 157 |
+
"blob_id": "7be1286505b7d1ef90a2b441ee96bd9c88b578bb",
|
| 158 |
+
"lfs_sha256": "3176fbda5792bdcc251d34d46d9f69fae9ce9fae4cb201896f1a39ef4ba3be3d"
|
| 159 |
+
},
|
| 160 |
+
{
|
| 161 |
+
"rfilename": "GLM-4.6V-Flash-UD-Q6_K_XL.gguf",
|
| 162 |
+
"size": 8886036064,
|
| 163 |
+
"blob_id": "8767e8ba766b4589ccd9ba3ad38503455a311e56",
|
| 164 |
+
"lfs_sha256": "ece6f62ed7bcf2b88171af4b636bcfae1c62291c02291765662011aa2d943e52"
|
| 165 |
+
},
|
| 166 |
+
{
|
| 167 |
+
"rfilename": "GLM-4.6V-Flash-UD-Q8_K_XL.gguf",
|
| 168 |
+
"size": 12075304544,
|
| 169 |
+
"blob_id": "1051520bb3ccc7a968b72fb598ce5ba55e222f8f",
|
| 170 |
+
"lfs_sha256": "cd495faae7b84624a2c5b0e492c4aa26b82fc81ef850aced56dbe76cf4dd72ec"
|
| 171 |
+
},
|
| 172 |
+
{
|
| 173 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 174 |
+
"size": 1840904320,
|
| 175 |
+
"blob_id": "33a4b9c04320bc4ad185e1ef2695f320cc2b95c3",
|
| 176 |
+
"lfs_sha256": "74c30227dc957ed360a29b6002622472ec6fcc6a5105a1ba9a5b2a331e3a7833"
|
| 177 |
+
},
|
| 178 |
+
{
|
| 179 |
+
"rfilename": "mmproj-F16.gguf",
|
| 180 |
+
"size": 1786960000,
|
| 181 |
+
"blob_id": "513905cf66474557cc218527c07a9d3a7e96a4f0",
|
| 182 |
+
"lfs_sha256": "cbdf92acdfd2cbe3db4a94141d5e9dc60aa39bd7d365da5b3e3bc7366b007761"
|
| 183 |
+
},
|
| 184 |
+
{
|
| 185 |
+
"rfilename": "mmproj-F32.gguf",
|
| 186 |
+
"size": 3570006144,
|
| 187 |
+
"blob_id": "7e18298988fe76c004588bdfd7a366f900bd99d8",
|
| 188 |
+
"lfs_sha256": "f46c0d228fe2b3a72f19bf9a0719903c4195457cb57b780f8b5444f209d321eb"
|
| 189 |
+
}
|
| 190 |
+
]
|
| 191 |
+
}
|
bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-GGUF.json
ADDED
|
@@ -0,0 +1,166 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/Qwen3.5-4B-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/Qwen3.5-4B-GGUF",
|
| 4 |
+
"commit_sha": "e87f176479d0855a907a41277aca2f8ee7a09523",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 4205751296,
|
| 7 |
+
"architecture": "qwen35",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {{- '<|im_start|>system\\n' + content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if loop.index0 > ns.last_query_index %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is mapping %}\n {%- for args_name in tool_call.arguments %}\n {%- set args_value = tool_call.arguments[args_name] %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is true %}\n {{- '<think>\\n' }}\n {%- else %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- endif %}\n{%- endif %}",
|
| 10 |
+
"eos_token": "<|im_end|>",
|
| 11 |
+
"totalFileSize": 8424393632
|
| 12 |
+
},
|
| 13 |
+
"fetched_at_utc": "2026-09-06T11:32:08.427926+00:00",
|
| 14 |
+
"siblings": [
|
| 15 |
+
{
|
| 16 |
+
"rfilename": "Qwen3.5-4B-BF16.gguf",
|
| 17 |
+
"size": 8424393632,
|
| 18 |
+
"blob_id": "60d6faa77f0534c585542c7b845a93e394ede42c",
|
| 19 |
+
"lfs_sha256": "9e6e2841a75f503ccb330831832fd7861266e187e0dbf149a954219ccb8c197a"
|
| 20 |
+
},
|
| 21 |
+
{
|
| 22 |
+
"rfilename": "Qwen3.5-4B-IQ4_NL.gguf",
|
| 23 |
+
"size": 2579944608,
|
| 24 |
+
"blob_id": "b72e76b9a262e679f41f6f01ead031b3fbd52cfa",
|
| 25 |
+
"lfs_sha256": "ff5c3e9740a5aa53f04fdf3b0b8cc75da556bf8948cdb19d61c512d3a43465d9"
|
| 26 |
+
},
|
| 27 |
+
{
|
| 28 |
+
"rfilename": "Qwen3.5-4B-IQ4_XS.gguf",
|
| 29 |
+
"size": 2477053088,
|
| 30 |
+
"blob_id": "09d5aae9fc0b42b0a475e3827b09399a714029f8",
|
| 31 |
+
"lfs_sha256": "658a9e7e406deb06d0179755e3c14f6a82915a4be4962a2f92a64d948d2e572f"
|
| 32 |
+
},
|
| 33 |
+
{
|
| 34 |
+
"rfilename": "Qwen3.5-4B-Q3_K_M.gguf",
|
| 35 |
+
"size": 2293388448,
|
| 36 |
+
"blob_id": "dcf0727ddb539ad33338782905646da6be8efb9d",
|
| 37 |
+
"lfs_sha256": "d6981ab4d77ba712b48ef69d69042d75b5e39b9dce5fb5a5b054fd08e06afb95"
|
| 38 |
+
},
|
| 39 |
+
{
|
| 40 |
+
"rfilename": "Qwen3.5-4B-Q3_K_S.gguf",
|
| 41 |
+
"size": 2105791648,
|
| 42 |
+
"blob_id": "300c9c72af94f6ce42249290b56dc74a85a07abc",
|
| 43 |
+
"lfs_sha256": "7e2dd96b6141226b62fa88c775db06e0e9ff0aa84130805d7091a768868a3353"
|
| 44 |
+
},
|
| 45 |
+
{
|
| 46 |
+
"rfilename": "Qwen3.5-4B-Q4_0.gguf",
|
| 47 |
+
"size": 2583221408,
|
| 48 |
+
"blob_id": "74d884178d928595eee50a590ef778cd97f09bc4",
|
| 49 |
+
"lfs_sha256": "298fcb5fe7a77ccc79745ae24751560c5ac56874caff4bb39b1f2055bd72b8bb"
|
| 50 |
+
},
|
| 51 |
+
{
|
| 52 |
+
"rfilename": "Qwen3.5-4B-Q4_1.gguf",
|
| 53 |
+
"size": 2784416928,
|
| 54 |
+
"blob_id": "2a286c165e21bc32e775e92951b934bca8636ff8",
|
| 55 |
+
"lfs_sha256": "af1fa652b5c78980b105a2ffef954bfa724bc4d69d2d44463e27c4f3c2953bbd"
|
| 56 |
+
},
|
| 57 |
+
{
|
| 58 |
+
"rfilename": "Qwen3.5-4B-Q4_K_M.gguf",
|
| 59 |
+
"size": 2740937888,
|
| 60 |
+
"blob_id": "4ca59aa028e499c9351f394e844f5e27056e5846",
|
| 61 |
+
"lfs_sha256": "00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4"
|
| 62 |
+
},
|
| 63 |
+
{
|
| 64 |
+
"rfilename": "Qwen3.5-4B-Q4_K_S.gguf",
|
| 65 |
+
"size": 2590430368,
|
| 66 |
+
"blob_id": "fa4da4a0fb5c0d8ea9b790fd4ab440fee0932642",
|
| 67 |
+
"lfs_sha256": "27caeb0e4b999d92ce0a9fdbdd1a7ba5112908d9de125645883732274be2ea77"
|
| 68 |
+
},
|
| 69 |
+
{
|
| 70 |
+
"rfilename": "Qwen3.5-4B-Q5_K_M.gguf",
|
| 71 |
+
"size": 3143656608,
|
| 72 |
+
"blob_id": "70e40ee1a3b4a6ab98839781accccfc2187348cf",
|
| 73 |
+
"lfs_sha256": "8814232b85594dcd46c50e5b8b29324a7efe9e746edbe8a3d1df3d3fce7aad39"
|
| 74 |
+
},
|
| 75 |
+
{
|
| 76 |
+
"rfilename": "Qwen3.5-4B-Q5_K_S.gguf",
|
| 77 |
+
"size": 3024934048,
|
| 78 |
+
"blob_id": "88f3e622d934a54ccb42168ae8dfd19add022b45",
|
| 79 |
+
"lfs_sha256": "161be121617c45ea247eae0fd4477d26f287a368b52702e3fc99c9bc52f23061"
|
| 80 |
+
},
|
| 81 |
+
{
|
| 82 |
+
"rfilename": "Qwen3.5-4B-Q6_K.gguf",
|
| 83 |
+
"size": 3525956768,
|
| 84 |
+
"blob_id": "8b46ce5a77cd55feaa51a05c649176784a2b034f",
|
| 85 |
+
"lfs_sha256": "fdedd781c9ce676ab66b018ca247ff78e8a33c98098a822c1e2d5075e7718f66"
|
| 86 |
+
},
|
| 87 |
+
{
|
| 88 |
+
"rfilename": "Qwen3.5-4B-Q8_0.gguf",
|
| 89 |
+
"size": 4482403488,
|
| 90 |
+
"blob_id": "871df22fc125cd971cc5c8aaee7d16b1e9ef9c68",
|
| 91 |
+
"lfs_sha256": "10cc391b403021dd11c614679d2fd92f611c3681d29e29651b717316965d61e1"
|
| 92 |
+
},
|
| 93 |
+
{
|
| 94 |
+
"rfilename": "Qwen3.5-4B-UD-IQ2_M.gguf",
|
| 95 |
+
"size": 1759997088,
|
| 96 |
+
"blob_id": "12b299eac42398b29defe48ef99a11497eee9af3",
|
| 97 |
+
"lfs_sha256": "cb4c45ca42c0d7777667e94e3963f8e59e939b3665098328ce601feb5be129c1"
|
| 98 |
+
},
|
| 99 |
+
{
|
| 100 |
+
"rfilename": "Qwen3.5-4B-UD-IQ2_XXS.gguf",
|
| 101 |
+
"size": 1520217248,
|
| 102 |
+
"blob_id": "1acab0ccc8460ef4b900e9b2dc718e13d2858b10",
|
| 103 |
+
"lfs_sha256": "4c1ba794e8d6098f4fb6482b4db6e880c80b5ee0b4c64d8668afaf9541163677"
|
| 104 |
+
},
|
| 105 |
+
{
|
| 106 |
+
"rfilename": "Qwen3.5-4B-UD-IQ3_XXS.gguf",
|
| 107 |
+
"size": 1949047968,
|
| 108 |
+
"blob_id": "a7689b79e1bea2cfc86cec8c287f9ebafc66255d",
|
| 109 |
+
"lfs_sha256": "00aab66a2359a9afc52f0ab757e61f9be1656e6fcaba8468bd95579a8b2cbc40"
|
| 110 |
+
},
|
| 111 |
+
{
|
| 112 |
+
"rfilename": "Qwen3.5-4B-UD-Q2_K_XL.gguf",
|
| 113 |
+
"size": 1940825248,
|
| 114 |
+
"blob_id": "2bcb744472a4bc6f9ad13b78d5152788ae649e36",
|
| 115 |
+
"lfs_sha256": "79aa0b583c888976013002f66b9f617070d91cf8de6a09dc775983640ac59463"
|
| 116 |
+
},
|
| 117 |
+
{
|
| 118 |
+
"rfilename": "Qwen3.5-4B-UD-Q3_K_XL.gguf",
|
| 119 |
+
"size": 2436420768,
|
| 120 |
+
"blob_id": "9c8883680f7af72792dc49cd3ff3de93c6c656e3",
|
| 121 |
+
"lfs_sha256": "1874727e4bb6ac23fd0cd134ac6562d2759fe44f37fa68c55197b36526da4e37"
|
| 122 |
+
},
|
| 123 |
+
{
|
| 124 |
+
"rfilename": "Qwen3.5-4B-UD-Q4_K_XL.gguf",
|
| 125 |
+
"size": 2912109728,
|
| 126 |
+
"blob_id": "5896df429fa8a782f02d97a61fc6368e00abac76",
|
| 127 |
+
"lfs_sha256": "b252c5610a42ca82d20fe2a12813e9d069eed89292907e26c783eeb0bc961bc7"
|
| 128 |
+
},
|
| 129 |
+
{
|
| 130 |
+
"rfilename": "Qwen3.5-4B-UD-Q5_K_XL.gguf",
|
| 131 |
+
"size": 3250869408,
|
| 132 |
+
"blob_id": "23867ba06ac09b1328da976f7d7b9a825a3e008b",
|
| 133 |
+
"lfs_sha256": "b4c36a8e14a80c21bcab5a067ce342b2e70e28f60b4aa95ad12203fa17b87426"
|
| 134 |
+
},
|
| 135 |
+
{
|
| 136 |
+
"rfilename": "Qwen3.5-4B-UD-Q6_K_XL.gguf",
|
| 137 |
+
"size": 4145548448,
|
| 138 |
+
"blob_id": "bb88c43e04870443a5a459e9d1df9e13f0f7a23a",
|
| 139 |
+
"lfs_sha256": "87f58d94410b81429268d8389a3d686e6c6bffecf7852772720fbea059cbbb9d"
|
| 140 |
+
},
|
| 141 |
+
{
|
| 142 |
+
"rfilename": "Qwen3.5-4B-UD-Q8_K_XL.gguf",
|
| 143 |
+
"size": 5952048288,
|
| 144 |
+
"blob_id": "44ede2300530708d78e52868e70c50981cf2270e",
|
| 145 |
+
"lfs_sha256": "e786a3c6570474c3885199bfb5adc54325aa7521a314e10b0aaefe16a54ba42f"
|
| 146 |
+
},
|
| 147 |
+
{
|
| 148 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 149 |
+
"size": 675569344,
|
| 150 |
+
"blob_id": "463d1078fc2d0285190d031551c25d08fc28d568",
|
| 151 |
+
"lfs_sha256": "302b92d565080b9cc0281186979ae75a7429ec23d14f6f7607a035539b21f3a6"
|
| 152 |
+
},
|
| 153 |
+
{
|
| 154 |
+
"rfilename": "mmproj-F16.gguf",
|
| 155 |
+
"size": 672423616,
|
| 156 |
+
"blob_id": "df5eff16338bf924865eb98723fc7ef20eb54e7f",
|
| 157 |
+
"lfs_sha256": "cd88edcf8d031894960bb0c9c5b9b7e1fea6ebee02b9f7ce925a00d12891f864"
|
| 158 |
+
},
|
| 159 |
+
{
|
| 160 |
+
"rfilename": "mmproj-F32.gguf",
|
| 161 |
+
"size": 1334075072,
|
| 162 |
+
"blob_id": "b31ec78c6d346b63be1343f159597e50bb3104bd",
|
| 163 |
+
"lfs_sha256": "758b74e604c5374577c21026c5bdc3aec75560eccb4c67844c8f585d6ec74804"
|
| 164 |
+
}
|
| 165 |
+
]
|
| 166 |
+
}
|
bpw/hf/repo-metadata/unsloth__Qwen3.5-4B-MTP-GGUF.json
ADDED
|
@@ -0,0 +1,160 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/Qwen3.5-4B-MTP-GGUF",
|
| 4 |
+
"commit_sha": "86835bf9949e4d14d6860f7910b1340ad4f271a9",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 4326350848,
|
| 7 |
+
"architecture": "qwen35",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set num_sys = 0 %}\n{%- set merged_system = '' %}\n{%- if messages[0].role == 'system' or messages[0].role == 'developer' %}\n {%- set first = render_content(messages[0].content, false, true)|trim %}\n {%- if messages|length > 1 and (messages[1].role == 'system' or messages[1].role == 'developer') %}\n {%- set second = render_content(messages[1].content, false, true)|trim %}\n {%- set merged_system = first + '\\n' + second %}\n {%- set num_sys = 2 %}\n {%- else %}\n {%- set merged_system = first %}\n {%- set num_sys = 1 %}\n {%- endif %}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if merged_system %}\n {{- '\\n\\n' + merged_system }}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if merged_system %}\n {{- '<|im_start|>system\\n' + merged_system + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if loop.index0 >= num_sys and message.role != \"system\" and message.role != \"developer\" %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if loop.index0 > ns.last_query_index %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is mapping %}\n {%- for args_name in tool_call.arguments %}\n {%- set args_value = tool_call.arguments[args_name] %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}\n{#- Unsloth fixes - developer role, tool calling #}\n",
|
| 10 |
+
"eos_token": "<|im_end|>",
|
| 11 |
+
"totalFileSize": 8665620544
|
| 12 |
+
},
|
| 13 |
+
"fetched_at_utc": "2026-09-06T11:32:08.464674+00:00",
|
| 14 |
+
"siblings": [
|
| 15 |
+
{
|
| 16 |
+
"rfilename": "Qwen3.5-4B-BF16.gguf",
|
| 17 |
+
"size": 8665620544,
|
| 18 |
+
"blob_id": "67f1d958f1858635bd2eb99eae824d6634233af9",
|
| 19 |
+
"lfs_sha256": "65c0fa68c10d6d8f2bb90e4e26d83c1421c7dde6ce98b9f93624a411f7eb0113"
|
| 20 |
+
},
|
| 21 |
+
{
|
| 22 |
+
"rfilename": "Qwen3.5-4B-IQ4_NL.gguf",
|
| 23 |
+
"size": 2729175360,
|
| 24 |
+
"blob_id": "acd6a4b4a7a63fed0f809fb9c89c70aa13f8c9e1",
|
| 25 |
+
"lfs_sha256": "f696836adb2f2287036620dfd154cf83e741bb87d3106ccd3596130f6f75b382"
|
| 26 |
+
},
|
| 27 |
+
{
|
| 28 |
+
"rfilename": "Qwen3.5-4B-IQ4_XS.gguf",
|
| 29 |
+
"size": 2642012480,
|
| 30 |
+
"blob_id": "d476bda2add18e915378d5eead4ac5753bb4dea4",
|
| 31 |
+
"lfs_sha256": "b44dc5ed8b8589b237eea6cc732c4e2779c7465f77ee9c05e221b638a41f9ad2"
|
| 32 |
+
},
|
| 33 |
+
{
|
| 34 |
+
"rfilename": "Qwen3.5-4B-Q3_K_M.gguf",
|
| 35 |
+
"size": 2374564160,
|
| 36 |
+
"blob_id": "9bd04e711d4383ddead214dac02d19eadb2fe70d",
|
| 37 |
+
"lfs_sha256": "18df851efa1870eb2df6de0114031bca5a302beeeb1cb98665a6f65903e98cc8"
|
| 38 |
+
},
|
| 39 |
+
{
|
| 40 |
+
"rfilename": "Qwen3.5-4B-Q3_K_S.gguf",
|
| 41 |
+
"size": 2177505600,
|
| 42 |
+
"blob_id": "0d085508a37486642a31d87755b1da17024e5b0f",
|
| 43 |
+
"lfs_sha256": "b7d4bfe9132decb46c9867540ae268c941f12b34368888fc93e3ae11965b12fa"
|
| 44 |
+
},
|
| 45 |
+
{
|
| 46 |
+
"rfilename": "Qwen3.5-4B-Q4_0.gguf",
|
| 47 |
+
"size": 2669209920,
|
| 48 |
+
"blob_id": "0c6d0fd25bd3a6aa604b5c191e45baa63d9683d9",
|
| 49 |
+
"lfs_sha256": "14e6ef39302330c63c2c1a1ab548c7f6f1b7e36b3150ca8b42cab7193b0c3669"
|
| 50 |
+
},
|
| 51 |
+
{
|
| 52 |
+
"rfilename": "Qwen3.5-4B-Q4_1.gguf",
|
| 53 |
+
"size": 2877122880,
|
| 54 |
+
"blob_id": "975e4fd0ff43a132876ad4ef4accd66aeae7869f",
|
| 55 |
+
"lfs_sha256": "ce904a58d18bcc3db92e8d43a35aee53ef5b1982a0a07d72ee82e7abfa149ed1"
|
| 56 |
+
},
|
| 57 |
+
{
|
| 58 |
+
"rfilename": "Qwen3.5-4B-Q4_K_M.gguf",
|
| 59 |
+
"size": 2834975040,
|
| 60 |
+
"blob_id": "e5172f580b9975ec93452e0034df35f5633be5dc",
|
| 61 |
+
"lfs_sha256": "3874209241c9a397e2f62cd3f70f80fd2dfbf0dfccb6838416bdb48a714e8630"
|
| 62 |
+
},
|
| 63 |
+
{
|
| 64 |
+
"rfilename": "Qwen3.5-4B-Q4_K_S.gguf",
|
| 65 |
+
"size": 2683300160,
|
| 66 |
+
"blob_id": "be6644b35150e1b2b95fb938788985a406e563ca",
|
| 67 |
+
"lfs_sha256": "ad89d1b4281574b0ebd110b579370ac23da4d5505f4ce3b5134e4e0d8b1df457"
|
| 68 |
+
},
|
| 69 |
+
{
|
| 70 |
+
"rfilename": "Qwen3.5-4B-Q5_K_M.gguf",
|
| 71 |
+
"size": 3212790080,
|
| 72 |
+
"blob_id": "e3b808c6e427b5898ea58e3a7083bdd3f52da662",
|
| 73 |
+
"lfs_sha256": "280071016b00a8d2be6ba08ef2b555ad513f0b806419784e657b6bf62d650a1e"
|
| 74 |
+
},
|
| 75 |
+
{
|
| 76 |
+
"rfilename": "Qwen3.5-4B-Q5_K_S.gguf",
|
| 77 |
+
"size": 3124357440,
|
| 78 |
+
"blob_id": "26c9ea4d213ce27e6b81eeecc25e6c75279eaf1e",
|
| 79 |
+
"lfs_sha256": "aaf7f4319392876cfc3a94c3fcfc04a1cec3d5cdf81f562bdc8b4f3fc827b44e"
|
| 80 |
+
},
|
| 81 |
+
{
|
| 82 |
+
"rfilename": "Qwen3.5-4B-Q6_K.gguf",
|
| 83 |
+
"size": 3639654720,
|
| 84 |
+
"blob_id": "8dff29f116f89aae4a019bcbef9ca31deaed6750",
|
| 85 |
+
"lfs_sha256": "d8fe325a6184ac489529bb2286e879865d02acdd710ac0a54a0afa3e66051b87"
|
| 86 |
+
},
|
| 87 |
+
{
|
| 88 |
+
"rfilename": "Qwen3.5-4B-Q8_0.gguf",
|
| 89 |
+
"size": 4610580800,
|
| 90 |
+
"blob_id": "385bf68d6e137771a579efccd914669d686a246d",
|
| 91 |
+
"lfs_sha256": "4f40ff26e3b6e23888e520e9c33d9a309d919b940cd1375b421710c6cb6cc8dd"
|
| 92 |
+
},
|
| 93 |
+
{
|
| 94 |
+
"rfilename": "Qwen3.5-4B-UD-IQ2_M.gguf",
|
| 95 |
+
"size": 1942548800,
|
| 96 |
+
"blob_id": "f64d06e57d896f2b68e99ef2fc31495d68433194",
|
| 97 |
+
"lfs_sha256": "848288eda62b3d9eb266080b2f7d4a7c34e0a59c91060ee72fde4f83045dedc2"
|
| 98 |
+
},
|
| 99 |
+
{
|
| 100 |
+
"rfilename": "Qwen3.5-4B-UD-IQ3_XXS.gguf",
|
| 101 |
+
"size": 2103521600,
|
| 102 |
+
"blob_id": "621118d7b520e58b46d790cfd42f63b50a831b8e",
|
| 103 |
+
"lfs_sha256": "2f3d2899688d98e8ce505cb99b13c342992471077ebd652944db1fd8360469f2"
|
| 104 |
+
},
|
| 105 |
+
{
|
| 106 |
+
"rfilename": "Qwen3.5-4B-UD-Q2_K_XL.gguf",
|
| 107 |
+
"size": 2121677120,
|
| 108 |
+
"blob_id": "0edfa00a98d891e0263a6a13a5c8968d4c961766",
|
| 109 |
+
"lfs_sha256": "8731639bc713ec3fb0d8b0e699185f8852f8bfa0d5b16ea972248d3f6097a454"
|
| 110 |
+
},
|
| 111 |
+
{
|
| 112 |
+
"rfilename": "Qwen3.5-4B-UD-Q3_K_XL.gguf",
|
| 113 |
+
"size": 2528860480,
|
| 114 |
+
"blob_id": "d78256b1cb6ac1897af676b758e2cda172174502",
|
| 115 |
+
"lfs_sha256": "fc4c1538f1ea3f3bcb789dd03a03ea2ffbafcbd5d7a84b0fa0abe8118a23347c"
|
| 116 |
+
},
|
| 117 |
+
{
|
| 118 |
+
"rfilename": "Qwen3.5-4B-UD-Q4_K_XL.gguf",
|
| 119 |
+
"size": 2990664000,
|
| 120 |
+
"blob_id": "e27934ee6091b1b3970e6ec332ad2714008cb46b",
|
| 121 |
+
"lfs_sha256": "d2bfbee4de17c74e6308a4dc750be4c2271f92ae2df1e28f5c5afa0dcdb6fccc"
|
| 122 |
+
},
|
| 123 |
+
{
|
| 124 |
+
"rfilename": "Qwen3.5-4B-UD-Q5_K_XL.gguf",
|
| 125 |
+
"size": 3304827200,
|
| 126 |
+
"blob_id": "fd8d2bf071c09fdad7393d0ecc7e80a839667add",
|
| 127 |
+
"lfs_sha256": "d76bf69a16f1d59f8d6c74a7373c41e43e14dc7ab47901cc2504c7ad647c6ba6"
|
| 128 |
+
},
|
| 129 |
+
{
|
| 130 |
+
"rfilename": "Qwen3.5-4B-UD-Q6_K_XL.gguf",
|
| 131 |
+
"size": 4261908800,
|
| 132 |
+
"blob_id": "c8d6d10805e09e960b5ffb6d6938f2b682432d48",
|
| 133 |
+
"lfs_sha256": "28bedf3269ebb40444dab71cf884d85ad639fd57cfc30757a62b7929d4e316de"
|
| 134 |
+
},
|
| 135 |
+
{
|
| 136 |
+
"rfilename": "Qwen3.5-4B-UD-Q8_K_XL.gguf",
|
| 137 |
+
"size": 6065971520,
|
| 138 |
+
"blob_id": "1dd8af4e7f3c8010a3374378c647eaeb95f1c121",
|
| 139 |
+
"lfs_sha256": "5ede74f75757ab29acfe76b99f57b0ba6d5bedf7ac921e516654bcb7055adafd"
|
| 140 |
+
},
|
| 141 |
+
{
|
| 142 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 143 |
+
"size": 675569216,
|
| 144 |
+
"blob_id": "b918aba78b2b95af5cafe61a9a0c56f949340db3",
|
| 145 |
+
"lfs_sha256": "169ee40fb1e234ff38b2d814eb8633611a54b6f941f11b700d96dec02cb44ddf"
|
| 146 |
+
},
|
| 147 |
+
{
|
| 148 |
+
"rfilename": "mmproj-F16.gguf",
|
| 149 |
+
"size": 672423488,
|
| 150 |
+
"blob_id": "23ac5b34590f83d1a664faf39beac1de744e525d",
|
| 151 |
+
"lfs_sha256": "d63b1a847fe9cd52e8e1525008cd33703821299f5a9eae40b2865426208767e7"
|
| 152 |
+
},
|
| 153 |
+
{
|
| 154 |
+
"rfilename": "mmproj-F32.gguf",
|
| 155 |
+
"size": 1334074944,
|
| 156 |
+
"blob_id": "48097ee7922860f1ceef1ecf96f6c72050b7b318",
|
| 157 |
+
"lfs_sha256": "d5d71bf021af20a75ad20eaa9b970747739b601a4459d445da5c1e9ff7d63b59"
|
| 158 |
+
}
|
| 159 |
+
]
|
| 160 |
+
}
|
bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-GGUF.json
ADDED
|
@@ -0,0 +1,186 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/Qwen3.6-35B-A3B-GGUF",
|
| 4 |
+
"commit_sha": "a483e9e6cbd595906af30beda3187c2663a1118c",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 34660610688,
|
| 7 |
+
"architecture": "qwen35moe",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"quantize_imatrix_file": "Qwen3.6-35B-A3B-GGUF/imatrix_unsloth.gguf",
|
| 10 |
+
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set num_sys = 0 %}\n{%- set merged_system = '' %}\n{%- if messages[0].role == 'system' or messages[0].role == 'developer' %}\n {%- set first = render_content(messages[0].content, false, true)|trim %}\n {%- if messages|length > 1 and (messages[1].role == 'system' or messages[1].role == 'developer') %}\n {%- set second = render_content(messages[1].content, false, true)|trim %}\n {%- set merged_system = first + '\\n' + second %}\n {%- set num_sys = 2 %}\n {%- else %}\n {%- set merged_system = first %}\n {%- set num_sys = 1 %}\n {%- endif %}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if merged_system %}\n {{- '\\n\\n' + merged_system }}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if merged_system %}\n {{- '<|im_start|>system\\n' + merged_system + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if loop.index0 >= num_sys and message.role != \"system\" and message.role != \"developer\" %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if (preserve_thinking is defined and preserve_thinking is true) or (loop.index0 > ns.last_query_index) %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is mapping %}\n {%- for args_name in tool_call.arguments %}\n {%- set args_value = tool_call.arguments[args_name] %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}\n{#- Unsloth fixes - developer role, tool calling #}",
|
| 11 |
+
"bos_token": "<|endoftext|>",
|
| 12 |
+
"eos_token": "<|im_end|>",
|
| 13 |
+
"totalFileSize": 21706144736
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.470776+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "BF16/Qwen3.6-35B-A3B-BF16-00001-of-00002.gguf",
|
| 19 |
+
"size": 49913715424,
|
| 20 |
+
"blob_id": "7577f84ffbd5d4757b8ba88bc963b33b3741ebcb",
|
| 21 |
+
"lfs_sha256": "783c22885003ac7607020cd9c318db7232a0cc206fa7b8dc064fa262e28d4db7"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "BF16/Qwen3.6-35B-A3B-BF16-00002-of-00002.gguf",
|
| 25 |
+
"size": 19462922752,
|
| 26 |
+
"blob_id": "2f8c14c6f6bec4081597182221a0004fccf19774",
|
| 27 |
+
"lfs_sha256": "a5e66b67d4f2cdfc0cb9e399fc7d569576521d76cb69f186bdaff2b577457d66"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "Qwen3.6-35B-A3B-MXFP4_MOE.gguf",
|
| 31 |
+
"size": 21706144736,
|
| 32 |
+
"blob_id": "d28b9d68492a569f17c6a80f6e7ace0b463b9d03",
|
| 33 |
+
"lfs_sha256": "2fdd20997c4d88ee25f70f500c61f8b999378d92ab055f9d450fc70d617158d3"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "Qwen3.6-35B-A3B-Q8_0.gguf",
|
| 37 |
+
"size": 36903140320,
|
| 38 |
+
"blob_id": "482eec4f0764b9374d4239af0e3cb61d85b25949",
|
| 39 |
+
"lfs_sha256": "d1a395809f65a43a13ad119eb4e7acdef1ac6d68120f39902c8ab96e72794a59"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ1_M.gguf",
|
| 43 |
+
"size": 10047749088,
|
| 44 |
+
"blob_id": "67374606b336bc587b41823d631504fb9f0ce23d",
|
| 45 |
+
"lfs_sha256": "0dc2488c89d916c5599f7c03a286cd8f37a6a75a02bc13caf41c6bac26d70c9e"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ2_M.gguf",
|
| 49 |
+
"size": 11522702304,
|
| 50 |
+
"blob_id": "aeb8f1780e20e1c955e77198d0fec4989014eade",
|
| 51 |
+
"lfs_sha256": "2be7ef1ed7e1af8b10d3829102cf9a6c2bd5ddb64d675b4ece23a60799403d43"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ2_XXS.gguf",
|
| 55 |
+
"size": 10756586464,
|
| 56 |
+
"blob_id": "0175fc7e6694e8ab454e06f5ec6753af6619e0d0",
|
| 57 |
+
"lfs_sha256": "2e8f5f705355c56311432d0a8a5d14a696dbb7e4b197d05c75ba805fc1857bef"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ3_S.gguf",
|
| 61 |
+
"size": 13676723168,
|
| 62 |
+
"blob_id": "eadd67585ee5e5d3225e40b151e9b042fbd6f728",
|
| 63 |
+
"lfs_sha256": "66a3ca888ce13482b40c333db2432c0ebde3a7b13754fc29f0c6f5e89703ec66"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ3_XXS.gguf",
|
| 67 |
+
"size": 13211155424,
|
| 68 |
+
"blob_id": "4c22300650190f5944a3549f688c4afed5b65b1e",
|
| 69 |
+
"lfs_sha256": "9c964e657212fea1f24905dd7b0a89b82fd807d19fab0b41da14251b07b88fbe"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ4_NL.gguf",
|
| 73 |
+
"size": 18040888288,
|
| 74 |
+
"blob_id": "3f7543d2dff7f6271ebe9cd9790620b067efcb2c",
|
| 75 |
+
"lfs_sha256": "0d17e255dc257a11f398ed4bc8d62412d8ce9ca24b3fce2947d962e4bfed5758"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ4_NL_XL.gguf",
|
| 79 |
+
"size": 19500506080,
|
| 80 |
+
"blob_id": "df496e8ee2d4d6e59dce16eaf83fc352f68f2d38",
|
| 81 |
+
"lfs_sha256": "071ee2a008ec51372f990d8efbea92ec9dd0137974110ef68fbfde429c8c6dd4"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ4_XS.gguf",
|
| 85 |
+
"size": 17730509792,
|
| 86 |
+
"blob_id": "af3d6c1271ef693c3c16fff4f3c94384796b184a",
|
| 87 |
+
"lfs_sha256": "649d7508507b84638732c4f52c24c8b15843c6dca2f3ff793ae07c14a67ebbb3"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q2_K_XL.gguf",
|
| 91 |
+
"size": 12290628576,
|
| 92 |
+
"blob_id": "38f33a02620571ec295ddddf7d2653e93a968956",
|
| 93 |
+
"lfs_sha256": "96b9c0af5c77a4ecaabe3983175112b5ece763261c1ece12b2494b692a70dad7"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q3_K_M.gguf",
|
| 97 |
+
"size": 16600710112,
|
| 98 |
+
"blob_id": "215519914d6c38892d92465ccc383d8d4e0b70bf",
|
| 99 |
+
"lfs_sha256": "1b715841683f960bd9a49f008181bd910ee169b78d4cf465b6fde7f4d929ff99"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q3_K_S.gguf",
|
| 103 |
+
"size": 15359196128,
|
| 104 |
+
"blob_id": "d24bc2761e957f9f1f2d34defad80b0ce231e730",
|
| 105 |
+
"lfs_sha256": "212ccdf37d416167ce8dcd7e3a59bcd45b30ac7531822a1e7bb79bfbacb2d1aa"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf",
|
| 109 |
+
"size": 16845511648,
|
| 110 |
+
"blob_id": "5f10301f3eacaf3352204c487ae141dbc77e9df5",
|
| 111 |
+
"lfs_sha256": "a832b9689925f1bd335bbe985cdfb06c36bf2cf268f4f8f6eceafa3ceb515617"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf",
|
| 115 |
+
"size": 22134528992,
|
| 116 |
+
"blob_id": "c5100a3445ae71291c3c29f1e2e645744bbd04ca",
|
| 117 |
+
"lfs_sha256": "ac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf",
|
| 121 |
+
"size": 20893015008,
|
| 122 |
+
"blob_id": "1760ce9bc9e87bd4ac5a4a2cfe215c5c497c3a5e",
|
| 123 |
+
"lfs_sha256": "a8138f183e3993f12cdc23afd2babb8cdb084e64088ce4a256d49101d47b949c"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf",
|
| 127 |
+
"size": 22360456160,
|
| 128 |
+
"blob_id": "58b4c597357d95c31538ed877e31c6ae8072064b",
|
| 129 |
+
"lfs_sha256": "707a55a8a4397ecde44de0c499d3e68c1ad1d240d1da65826b4949d1043f4450"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q5_K_M.gguf",
|
| 133 |
+
"size": 26456194016,
|
| 134 |
+
"blob_id": "e63e8e9771da65c0c4ccb44162ee2ecbf82da5fc",
|
| 135 |
+
"lfs_sha256": "c13ce26253ea334df472bd8fbd2d6da66d8a41195c17f6fcbf44c4d20ece0932"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q5_K_S.gguf",
|
| 139 |
+
"size": 24942050272,
|
| 140 |
+
"blob_id": "6cf0e981b2a0c8e6be80d97b395a3c3bfe45c357",
|
| 141 |
+
"lfs_sha256": "31d886cbd8c3db2e66f4366cbfed93389cb982bdced1caa37262befdb34f5715"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q5_K_XL.gguf",
|
| 145 |
+
"size": 26592508896,
|
| 146 |
+
"blob_id": "28ad7af506701c4099893701351abc99dbfc0157",
|
| 147 |
+
"lfs_sha256": "25233af7642e3a91bd52cc4aeefdbd4a117479088e06cf1aea5b6bedb443c506"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q6_K.gguf",
|
| 151 |
+
"size": 29308320736,
|
| 152 |
+
"blob_id": "6ed55f35d114a3240d4c94527824518216bd0507",
|
| 153 |
+
"lfs_sha256": "4fe53b148b46f9b88830e2a3055c5b15c3a4d1e3ddc9a1384a108d8b9d59f043"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf",
|
| 157 |
+
"size": 31843777504,
|
| 158 |
+
"blob_id": "680ff1cedd6653dee0e85f037670d6118b8f626b",
|
| 159 |
+
"lfs_sha256": "f6b6c6d5cfa6f00d964eeb7add28eb14ce7481734d506b90681007678cd2c484"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q8_K_XL.gguf",
|
| 163 |
+
"size": 38451182560,
|
| 164 |
+
"blob_id": "b744500afbb15836df4dacf520cedc3c03378d27",
|
| 165 |
+
"lfs_sha256": "b762215c5f507f4865df4ac3d1afa803828afa41e05ecac3fac431a67bbd88e8"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 169 |
+
"size": 902822624,
|
| 170 |
+
"blob_id": "0c12b8d744e5547ca57378973e31c9adcdcc5fea",
|
| 171 |
+
"lfs_sha256": "356dfaa3111376a4f7165e32e8749713378d1700b37cf52e0c50d9f23322334d"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "mmproj-F16.gguf",
|
| 175 |
+
"size": 899283680,
|
| 176 |
+
"blob_id": "feb88525672670439196d09a7cf5ea07f350d7de",
|
| 177 |
+
"lfs_sha256": "8971ee4f331ff0a4c609374f32984b3d4e6dc086c0aa35f1d637fad1829e887f"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "mmproj-F32.gguf",
|
| 181 |
+
"size": 1786305248,
|
| 182 |
+
"blob_id": "e44f845facdbe79b19c79ffd7c369934caf1e15c",
|
| 183 |
+
"lfs_sha256": "0a1c1cd2772ae6de5e87e023cea454720924675f11fe2b0e7bb7648e48debdc0"
|
| 184 |
+
}
|
| 185 |
+
]
|
| 186 |
+
}
|
bpw/hf/repo-metadata/unsloth__Qwen3.6-35B-A3B-MTP-GGUF.json
ADDED
|
@@ -0,0 +1,174 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/Qwen3.6-35B-A3B-MTP-GGUF",
|
| 4 |
+
"commit_sha": "5bc3e238d916f48a861bac2f8a1990a0e9b7e98d",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 35505251456,
|
| 7 |
+
"architecture": "qwen35moe",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"quantize_imatrix_file": "Qwen3.6-35B-A3B-GGUF/imatrix_unsloth.gguf",
|
| 10 |
+
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set num_sys = 0 %}\n{%- set merged_system = '' %}\n{%- if messages[0].role == 'system' or messages[0].role == 'developer' %}\n {%- set first = render_content(messages[0].content, false, true)|trim %}\n {%- if messages|length > 1 and (messages[1].role == 'system' or messages[1].role == 'developer') %}\n {%- set second = render_content(messages[1].content, false, true)|trim %}\n {%- set merged_system = first + '\\n' + second %}\n {%- set num_sys = 2 %}\n {%- else %}\n {%- set merged_system = first %}\n {%- set num_sys = 1 %}\n {%- endif %}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if merged_system %}\n {{- '\\n\\n' + merged_system }}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if merged_system %}\n {{- '<|im_start|>system\\n' + merged_system + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if loop.index0 >= num_sys and message.role != \"system\" and message.role != \"developer\" %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in content %}\n {%- set reasoning_content = content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- set content = content.split('</think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if (preserve_thinking is defined and preserve_thinking is true) or (loop.index0 > ns.last_query_index) %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is mapping %}\n {%- for args_name in tool_call.arguments %}\n {%- set args_value = tool_call.arguments[args_name] %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}\n{#- Unsloth fixes - developer role, tool calling #}",
|
| 11 |
+
"bos_token": "<|endoftext|>",
|
| 12 |
+
"eos_token": "<|im_end|>",
|
| 13 |
+
"totalFileSize": 22182574368
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.473247+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "BF16/Qwen3.6-35B-A3B-BF16-00001-of-00002.gguf",
|
| 19 |
+
"size": 49913715456,
|
| 20 |
+
"blob_id": "37e8dd57524d3b07afc2c1a47b0ff0367e5fdedd",
|
| 21 |
+
"lfs_sha256": "a172dfea1fe8bb29132ea2f250c74cdc7d619d518d3f072d3816e31a69ce44a2"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "BF16/Qwen3.6-35B-A3B-BF16-00002-of-00002.gguf",
|
| 25 |
+
"size": 21152227104,
|
| 26 |
+
"blob_id": "f127ee964ae7428396c58de8020cd6d182792e6b",
|
| 27 |
+
"lfs_sha256": "b90b4d07e1be4967aec932e2501e7476ec5f44de772c7eb082d6e9c3ac105161"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "Qwen3.6-35B-A3B-MXFP4_MOE.gguf",
|
| 31 |
+
"size": 22182574368,
|
| 32 |
+
"blob_id": "cbd1b379ac10af3c080672ff63458204406570eb",
|
| 33 |
+
"lfs_sha256": "e1a4925d2ea132576daa9cb980b1102b970d919d896936b7b6e681ef5bc3d3f6"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "Qwen3.6-35B-A3B-Q8_0.gguf",
|
| 37 |
+
"size": 37801097504,
|
| 38 |
+
"blob_id": "d9d37eb84879675db018329e5ea3aabbc2e7492c",
|
| 39 |
+
"lfs_sha256": "c1283d8b80c3e38b2735ddbc9766d3b3126f44d6c484be419d4e101d09a76131"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ1_M.gguf",
|
| 43 |
+
"size": 11366414624,
|
| 44 |
+
"blob_id": "52f4bac63dcfb614c150da403ade9c88fa0abf7f",
|
| 45 |
+
"lfs_sha256": "223db8b347ebe3d75f43a0fd998eb86148c9744635066c6782662208ddc14867"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ2_M.gguf",
|
| 49 |
+
"size": 11882969376,
|
| 50 |
+
"blob_id": "cd02f83303498ea8aa52ce9411a599cb0f57fdf8",
|
| 51 |
+
"lfs_sha256": "b989da14b63b29bd469cb1fab5bd16b422ab921787569b4b2bb4fd61e26129b8"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ2_XXS.gguf",
|
| 55 |
+
"size": 11819399456,
|
| 56 |
+
"blob_id": "9c4a4695be5eb9a3cf284c2bdf2092e90d5ad34a",
|
| 57 |
+
"lfs_sha256": "627e2b05f83088448e27861ec392d56efc2b178783cae5adfa4ad2d988441203"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ3_S.gguf",
|
| 61 |
+
"size": 15346432288,
|
| 62 |
+
"blob_id": "721c441d0145f549baab49a0072484eb110643cf",
|
| 63 |
+
"lfs_sha256": "ab639a7f330f96c47d3e6c2dd2d6445182e7b763e17e6048dc850a71bbc9f27f"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ3_XXS.gguf",
|
| 67 |
+
"size": 14069266720,
|
| 68 |
+
"blob_id": "55b14b2b1c714b875a3bfa419388dc7e747c04e5",
|
| 69 |
+
"lfs_sha256": "36f9ec0e4c775f6efd3a61c1ea76f0875128469c3d012e3d9e2495a90e7a7150"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ4_NL.gguf",
|
| 73 |
+
"size": 18536192288,
|
| 74 |
+
"blob_id": "84b76af7a5e6a56bdd1d273b3630000d9e1e1c02",
|
| 75 |
+
"lfs_sha256": "d0ad78047bd0a583bfcb484e9defc63112c5f1f856e310dcf88dc48f2ebeae5b"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-IQ4_XS.gguf",
|
| 79 |
+
"size": 18209036576,
|
| 80 |
+
"blob_id": "a9cf0714ab89fea414ec5a61a51ed1738501aa2c",
|
| 81 |
+
"lfs_sha256": "df27a780435b7b45c2597536112ea3cb091f8544c3d0c3318d9f4258b31f7adf"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q2_K_XL.gguf",
|
| 85 |
+
"size": 12574128416,
|
| 86 |
+
"blob_id": "3b0bf1b2cbdd1390c363cbb1b8588b0da729d7a0",
|
| 87 |
+
"lfs_sha256": "ed7cda7e38985b4fcff76475865135039641d2bfbac3c169df15ca770f37fb0c"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q3_K_M.gguf",
|
| 91 |
+
"size": 17104402720,
|
| 92 |
+
"blob_id": "a5ce5ffd2d036d97c06bcb0f9294c9e895ceafdb",
|
| 93 |
+
"lfs_sha256": "8966dd0cd8c543c4228490a2a8b0e0814fc4f1e6a8e199ceed4de6754ae7b8e1"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q3_K_XL.gguf",
|
| 97 |
+
"size": 17227569440,
|
| 98 |
+
"blob_id": "f3f02139142e633467c023d4124ec4100fda8454",
|
| 99 |
+
"lfs_sha256": "3fba9ab57290b34726837521335bf9268397174f3dd662880e2d0c5264d17b81"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q4_K_M.gguf",
|
| 103 |
+
"size": 22663387424,
|
| 104 |
+
"blob_id": "b15d02d422205af4a836134ee8ff16e7d8226113",
|
| 105 |
+
"lfs_sha256": "0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q4_K_S.gguf",
|
| 109 |
+
"size": 21388319008,
|
| 110 |
+
"blob_id": "4ec7b57515cb6b458c05b36d9072ae6a9bc32c5c",
|
| 111 |
+
"lfs_sha256": "2bee952b218e4a481430c59d8d3bdc7bae20bed0eb501326340c5fca7ae95d42"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf",
|
| 115 |
+
"size": 22853663008,
|
| 116 |
+
"blob_id": "74b7924fe57b5a5f87aaaa2c9d1fbd7cb88b154d",
|
| 117 |
+
"lfs_sha256": "55983c5a75a1ab969824077b3bb3de4146e82a9234072b48ad4e8f92ad3fe9f1"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q5_K_M.gguf",
|
| 121 |
+
"size": 27087812896,
|
| 122 |
+
"blob_id": "d08f5faac7538dc1b6b335be512ef3f435ad6c0e",
|
| 123 |
+
"lfs_sha256": "8ca8224c5519b50f286b9739f9ab1c2bc0759e02cfb6cbf48a09f0759eb2d319"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q5_K_S.gguf",
|
| 127 |
+
"size": 25538017568,
|
| 128 |
+
"blob_id": "2746d4af0abe1eefd2bfc69a901f1b2bd22408f9",
|
| 129 |
+
"lfs_sha256": "b773526fab7e47cd2da8f51c20f986f7912f0aee56811265839650c4bfd1a098"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q5_K_XL.gguf",
|
| 133 |
+
"size": 27159116064,
|
| 134 |
+
"blob_id": "08e8b5449684ff024ef12b5f91420687343ab10f",
|
| 135 |
+
"lfs_sha256": "9de9a9420f61a0bb59bb2ca1ea170a6a57f6821fa1deec915bcaef523730a919"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q6_K.gguf",
|
| 139 |
+
"size": 30011242784,
|
| 140 |
+
"blob_id": "56936d7a28a628458a03441c2f71bd1bb21e2fff",
|
| 141 |
+
"lfs_sha256": "49935b04ad883c2f3d4da61f65b609d447dad67d0b08453b90abb09a1bb35464"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q6_K_XL.gguf",
|
| 145 |
+
"size": 32611711264,
|
| 146 |
+
"blob_id": "79ad6fb288c20aebda94163cdc99bb591cb832a1",
|
| 147 |
+
"lfs_sha256": "35fce994cd36104a7dc1bd8a4bdf13778145664c00fdef6773aebc9246e5019c"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "Qwen3.6-35B-A3B-UD-Q8_K_XL.gguf",
|
| 151 |
+
"size": 39099447584,
|
| 152 |
+
"blob_id": "cc9f98ccbffdb90c4a047b702a651911335a34df",
|
| 153 |
+
"lfs_sha256": "6c6b816537abad90b250a0972b345466028d861ddfe316d5f0de31ca6440f781"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 157 |
+
"size": 902822528,
|
| 158 |
+
"blob_id": "235f91c0165a8d2649ffdd460f03117809d62b02",
|
| 159 |
+
"lfs_sha256": "da63cb47a76763c712393f8a017070188a304fa39f8aeea6edc629ed7b975cfa"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "mmproj-F16.gguf",
|
| 163 |
+
"size": 899283584,
|
| 164 |
+
"blob_id": "77928e26110b862538144f70fee3ee56c286d5b7",
|
| 165 |
+
"lfs_sha256": "71f3cbc1f7cc0f30d09d41cfa924c0060827ebc33bf15ace7e86661e856f0160"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "mmproj-F32.gguf",
|
| 169 |
+
"size": 1786305152,
|
| 170 |
+
"blob_id": "92b1c95fd79e09f1ccf5f0609ca9ebbd728b72a4",
|
| 171 |
+
"lfs_sha256": "2c52a4ccbc8f0fdb716fb526bfee9506ed0092b2e6dc5d593759f7d200146663"
|
| 172 |
+
}
|
| 173 |
+
]
|
| 174 |
+
}
|
bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-GGUF.json
ADDED
|
@@ -0,0 +1,161 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/gemma-3n-E4B-it-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/gemma-3n-E4B-it-GGUF",
|
| 4 |
+
"commit_sha": "90fa8b0e431faeae50c305828bc260d6f71720e1",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 6866172400,
|
| 7 |
+
"architecture": "gemma3n",
|
| 8 |
+
"context_length": 32768,
|
| 9 |
+
"chat_template": "{{ bos_token }}\n{%- if messages[0]['role'] == 'system' -%}\n {%- if messages[0]['content'] is string -%}\n {%- set first_user_prefix = messages[0]['content'] + '\n\n' -%}\n {%- else -%}\n {%- set first_user_prefix = messages[0]['content'][0]['text'] + '\n\n' -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n{%- else -%}\n {%- set first_user_prefix = \"\" -%}\n {%- set loop_messages = messages -%}\n{%- endif -%}\n{%- for message in loop_messages -%}\n {%- if (message['role'] == 'user') != (loop.index0 % 2 == 0) -%}\n {{ raise_exception(\"Conversation roles must alternate user/assistant/user/assistant/...\") }}\n {%- endif -%}\n {%- if (message['role'] == 'assistant') -%}\n {%- set role = \"model\" -%}\n {%- else -%}\n {%- set role = message['role'] -%}\n {%- endif -%}\n {{ '<start_of_turn>' + role + '\n' + (first_user_prefix if loop.first else \"\") }}\n {%- if message['content'] is string -%}\n {{ message['content'] | trim }}\n {%- elif message['content'] is iterable -%}\n {%- for item in message['content'] -%}\n {%- if item['type'] == 'audio' -%}\n {{ '<audio_soft_token>' }}\n {%- elif item['type'] == 'image' -%}\n {{ '<image_soft_token>' }}\n {%- elif item['type'] == 'text' -%}\n {{ item['text'] | trim }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{ raise_exception(\"Invalid content type\") }}\n {%- endif -%}\n {{ '<end_of_turn>\n' }}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n {{'<start_of_turn>model\n'}}\n{%- endif -%}\n",
|
| 10 |
+
"bos_token": "<bos>",
|
| 11 |
+
"eos_token": "<end_of_turn>",
|
| 12 |
+
"totalFileSize": 13740103552
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.577445+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "gemma-3n-E4B-it-F16.gguf",
|
| 18 |
+
"size": 13740103552,
|
| 19 |
+
"blob_id": "ec2d6a751e0f47d516fc506fac1d10015105678a",
|
| 20 |
+
"lfs_sha256": "04753b9e7c9395e1830d495758b61c7727683255e178b0ac770cf0bedb0c5506"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "gemma-3n-E4B-it-IQ4_NL.gguf",
|
| 24 |
+
"size": 4391983232,
|
| 25 |
+
"blob_id": "5fe49c5e3b6b8b1732cbfcd686c0f0afe78ace99",
|
| 26 |
+
"lfs_sha256": "15c17596d0a84667bb908d168999e8c8b614190da1a566c12340904f0b6b0ee5"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "gemma-3n-E4B-it-IQ4_XS.gguf",
|
| 30 |
+
"size": 4271954048,
|
| 31 |
+
"blob_id": "6df3fdd7b6376a3a2f2ae387a277a6aec4e486ae",
|
| 32 |
+
"lfs_sha256": "51626e8b3eff18855ba618a00df8a54104de2a316dc38677a8784652afcec7b0"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "gemma-3n-E4B-it-Q2_K.gguf",
|
| 36 |
+
"size": 3190380672,
|
| 37 |
+
"blob_id": "4831d7f37e34287911a9c9c596f95d8e8e1e20f5",
|
| 38 |
+
"lfs_sha256": "c9778114c6f488806ba371b195f13fb1cf4fa2a863cddffe0d3da10377ce2799"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "gemma-3n-E4B-it-Q2_K_L.gguf",
|
| 42 |
+
"size": 3190380672,
|
| 43 |
+
"blob_id": "4831d7f37e34287911a9c9c596f95d8e8e1e20f5",
|
| 44 |
+
"lfs_sha256": "c9778114c6f488806ba371b195f13fb1cf4fa2a863cddffe0d3da10377ce2799"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "gemma-3n-E4B-it-Q3_K_M.gguf",
|
| 48 |
+
"size": 3689945216,
|
| 49 |
+
"blob_id": "4eb83658e2c6f22383ff0c0f36d7ebca5e899b37",
|
| 50 |
+
"lfs_sha256": "078ade06a346a4f960db1ea06cf1279697d44cf0ffdf3d170e25278ea40bcc70"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "gemma-3n-E4B-it-Q3_K_S.gguf",
|
| 54 |
+
"size": 3500947584,
|
| 55 |
+
"blob_id": "35efab6cf6139bedaf1402e96982fef9805d375d",
|
| 56 |
+
"lfs_sha256": "5cb5d2238da9f4af8ac0f8e248a517e62f1d523dda8b65934b8b0b95bcec0c32"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "gemma-3n-E4B-it-Q4_0.gguf",
|
| 60 |
+
"size": 4395784320,
|
| 61 |
+
"blob_id": "66f2ddeaa1d684f88ba74501a4a2e37e57a9ef94",
|
| 62 |
+
"lfs_sha256": "2d6d4a1ebc75908d03d7bd81c970e72ebabdbe4321d71f8b1b8cef3461dd170f"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "gemma-3n-E4B-it-Q4_1.gguf",
|
| 66 |
+
"size": 4632828032,
|
| 67 |
+
"blob_id": "e8c45c0fdcae14161c1c2036e33b0b5f0897e902",
|
| 68 |
+
"lfs_sha256": "33d0a74eaebbffac24168a144034528fccc777619926582e9f0e725a861bde51"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "gemma-3n-E4B-it-Q4_K_M.gguf",
|
| 72 |
+
"size": 4539054208,
|
| 73 |
+
"blob_id": "08bfa6c0e7434d7349c48f7f27419e178be2dc6c",
|
| 74 |
+
"lfs_sha256": "43b489bb77a81bda85180e7c490d40ad7f1d5c2ce654c9b05e15e104bd3c777e"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "gemma-3n-E4B-it-Q4_K_S.gguf",
|
| 78 |
+
"size": 4404697216,
|
| 79 |
+
"blob_id": "c832745f00d2630efffd721e4b45acca229bec2b",
|
| 80 |
+
"lfs_sha256": "2b24f9371cc2db50efd1c5ed8f23709a4830df4af8b44b34a9cc832455c4be49"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "gemma-3n-E4B-it-Q5_K_M.gguf",
|
| 84 |
+
"size": 5023496320,
|
| 85 |
+
"blob_id": "58ba6dd038a0c6cf08e05b05584cc6901c852673",
|
| 86 |
+
"lfs_sha256": "88a7552ad06665791aed6c3f71ebc011f7669bc5dd062607d875bd0f6f22e437"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "gemma-3n-E4B-it-Q5_K_S.gguf",
|
| 90 |
+
"size": 4945369216,
|
| 91 |
+
"blob_id": "a86dcb16da88fe319af087dd9ab476e0fc855718",
|
| 92 |
+
"lfs_sha256": "8a6befab353da89602988c1655ccb356e43708f81d956a7ac1c9c545df0f0660"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "gemma-3n-E4B-it-Q6_K.gguf",
|
| 96 |
+
"size": 6272219264,
|
| 97 |
+
"blob_id": "d3589ddaaa93f31f671781b66e4a3d31bc3a5596",
|
| 98 |
+
"lfs_sha256": "1f84a8d37d33a4f457d5bf89fcebf3f47eb7a4b799945ff0472b77a25c5a3593"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "gemma-3n-E4B-it-Q8_0.gguf",
|
| 102 |
+
"size": 7353292928,
|
| 103 |
+
"blob_id": "c12e0e8beb4beee83067a7942b7d31db85e77c86",
|
| 104 |
+
"lfs_sha256": "80e3a8cff3f29b2d2a6f580d8aaaf9269fff767c48eacf4306294718a76eb262"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "gemma-3n-E4B-it-UD-IQ2_M.gguf",
|
| 108 |
+
"size": 3105929344,
|
| 109 |
+
"blob_id": "34c5ee3c74a7083026e1742e7c4378f4807cb976",
|
| 110 |
+
"lfs_sha256": "0e259c5dee31ceff487bb1974262173f5e28eff7d1cb041e00596980894f804d"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "gemma-3n-E4B-it-UD-IQ2_XXS.gguf",
|
| 114 |
+
"size": 2830964864,
|
| 115 |
+
"blob_id": "ba8ee579d9dcd4d368a979e39d6fbc917bcfc705",
|
| 116 |
+
"lfs_sha256": "8fe1ea0ddfdc4e32be0acfb52c3fd84fb4b52e7f2a7842a5736d60e5a78531c4"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "gemma-3n-E4B-it-UD-IQ3_XXS.gguf",
|
| 120 |
+
"size": 3349244032,
|
| 121 |
+
"blob_id": "2cb16ca1b33f7789b9a05c28930942a821746032",
|
| 122 |
+
"lfs_sha256": "2f25dac930b95175ccc86301d8ce604ea8995928e80813dce503922a8ea057b0"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "gemma-3n-E4B-it-UD-Q2_K_XL.gguf",
|
| 126 |
+
"size": 3661842560,
|
| 127 |
+
"blob_id": "141037257a0d1cd138fe255636b92900574350f1",
|
| 128 |
+
"lfs_sha256": "786c38a3343f5d603d8f4f24ce16146115766e8531fbc6cdbff3ad9aa19288c8"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "gemma-3n-E4B-it-UD-Q3_K_XL.gguf",
|
| 132 |
+
"size": 4127762560,
|
| 133 |
+
"blob_id": "d6a3ece2d56c90e4327e54cc6469d5bcb3e960b9",
|
| 134 |
+
"lfs_sha256": "d75515d5751aafcf5468925cd1b2ee1a1ab4f548ad5bd579bdf32a67847a5758"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "gemma-3n-E4B-it-UD-Q4_K_XL.gguf",
|
| 138 |
+
"size": 5385042048,
|
| 139 |
+
"blob_id": "14746c0b2b5c01d373caef61a2da4d605fba303e",
|
| 140 |
+
"lfs_sha256": "49f8ac599ea6b01e7421ffb584f92f89583224ad5b490d7870e3b4fd503e50eb"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "gemma-3n-E4B-it-UD-Q5_K_XL.gguf",
|
| 144 |
+
"size": 5857728640,
|
| 145 |
+
"blob_id": "946a615d70808c1500f4d238be2697c2fe503247",
|
| 146 |
+
"lfs_sha256": "3ead3fe0506efa4d22a4e26e037d97262b4df1861f74a554c13ba11e3b8ef04a"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "gemma-3n-E4B-it-UD-Q6_K_XL.gguf",
|
| 150 |
+
"size": 6618101888,
|
| 151 |
+
"blob_id": "165efae61eb09a0b22c6f1ba828cc55f7afe0962",
|
| 152 |
+
"lfs_sha256": "b4eeef524e0ac74597e37a275aa1eaff21f1ce08cee326fceda13b727b627384"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "gemma-3n-E4B-it-UD-Q8_K_XL.gguf",
|
| 156 |
+
"size": 10589460608,
|
| 157 |
+
"blob_id": "c5c29bf6c85261f2f0f949b55405e7f61adaccb1",
|
| 158 |
+
"lfs_sha256": "e983c4c873c5399f616facfcbc5269a582a766e7d5f944c1dea58c7c118188c8"
|
| 159 |
+
}
|
| 160 |
+
]
|
| 161 |
+
}
|
bpw/hf/repo-metadata/unsloth__gemma-3n-E4B-it-litert-preview-GGUF.json
ADDED
|
@@ -0,0 +1,161 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/gemma-3n-E4B-it-litert-preview-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/gemma-3n-E4B-it-litert-preview-GGUF",
|
| 4 |
+
"commit_sha": "60a01054165a834c9c47b79dd94de15a8f636ab6",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 6866172400,
|
| 7 |
+
"architecture": "gemma3n",
|
| 8 |
+
"context_length": 32768,
|
| 9 |
+
"chat_template": "{{ bos_token }}\n{%- if messages[0]['role'] == 'system' -%}\n {%- if messages[0]['content'] is string -%}\n {%- set first_user_prefix = messages[0]['content'] + '\n\n' -%}\n {%- else -%}\n {%- set first_user_prefix = messages[0]['content'][0]['text'] + '\n\n' -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n{%- else -%}\n {%- set first_user_prefix = \"\" -%}\n {%- set loop_messages = messages -%}\n{%- endif -%}\n{%- for message in loop_messages -%}\n {%- if (message['role'] == 'user') != (loop.index0 % 2 == 0) -%}\n {{ raise_exception(\"Conversation roles must alternate user/assistant/user/assistant/...\") }}\n {%- endif -%}\n {%- if (message['role'] == 'assistant') -%}\n {%- set role = \"model\" -%}\n {%- else -%}\n {%- set role = message['role'] -%}\n {%- endif -%}\n {{ '<start_of_turn>' + role + '\n' + (first_user_prefix if loop.first else \"\") }}\n {%- if message['content'] is string -%}\n {{ message['content'] | trim }}\n {%- elif message['content'] is iterable -%}\n {%- for item in message['content'] -%}\n {%- if item['type'] == 'audio' -%}\n {{ '<audio_soft_token>' }}\n {%- elif item['type'] == 'image' -%}\n {{ '<image_soft_token>' }}\n {%- elif item['type'] == 'text' -%}\n {{ item['text'] | trim }}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{ raise_exception(\"Invalid content type\") }}\n {%- endif -%}\n {{ '<end_of_turn>\n' }}\n{%- endfor -%}\n{%- if add_generation_prompt -%}\n {{'<start_of_turn>model\n'}}\n{%- endif -%}\n",
|
| 10 |
+
"bos_token": "<bos>",
|
| 11 |
+
"eos_token": "<end_of_turn>",
|
| 12 |
+
"totalFileSize": 13740103552
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.525406+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-F16.gguf",
|
| 18 |
+
"size": 13740103552,
|
| 19 |
+
"blob_id": "ec2d6a751e0f47d516fc506fac1d10015105678a",
|
| 20 |
+
"lfs_sha256": "04753b9e7c9395e1830d495758b61c7727683255e178b0ac770cf0bedb0c5506"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-IQ4_NL.gguf",
|
| 24 |
+
"size": 4391983232,
|
| 25 |
+
"blob_id": "5fe49c5e3b6b8b1732cbfcd686c0f0afe78ace99",
|
| 26 |
+
"lfs_sha256": "15c17596d0a84667bb908d168999e8c8b614190da1a566c12340904f0b6b0ee5"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-IQ4_XS.gguf",
|
| 30 |
+
"size": 4271954048,
|
| 31 |
+
"blob_id": "6df3fdd7b6376a3a2f2ae387a277a6aec4e486ae",
|
| 32 |
+
"lfs_sha256": "51626e8b3eff18855ba618a00df8a54104de2a316dc38677a8784652afcec7b0"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q2_K.gguf",
|
| 36 |
+
"size": 3190380672,
|
| 37 |
+
"blob_id": "4831d7f37e34287911a9c9c596f95d8e8e1e20f5",
|
| 38 |
+
"lfs_sha256": "c9778114c6f488806ba371b195f13fb1cf4fa2a863cddffe0d3da10377ce2799"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q2_K_L.gguf",
|
| 42 |
+
"size": 3190380672,
|
| 43 |
+
"blob_id": "4831d7f37e34287911a9c9c596f95d8e8e1e20f5",
|
| 44 |
+
"lfs_sha256": "c9778114c6f488806ba371b195f13fb1cf4fa2a863cddffe0d3da10377ce2799"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q3_K_M.gguf",
|
| 48 |
+
"size": 3689945216,
|
| 49 |
+
"blob_id": "4eb83658e2c6f22383ff0c0f36d7ebca5e899b37",
|
| 50 |
+
"lfs_sha256": "078ade06a346a4f960db1ea06cf1279697d44cf0ffdf3d170e25278ea40bcc70"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q3_K_S.gguf",
|
| 54 |
+
"size": 3500947584,
|
| 55 |
+
"blob_id": "35efab6cf6139bedaf1402e96982fef9805d375d",
|
| 56 |
+
"lfs_sha256": "5cb5d2238da9f4af8ac0f8e248a517e62f1d523dda8b65934b8b0b95bcec0c32"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q4_0.gguf",
|
| 60 |
+
"size": 4395784320,
|
| 61 |
+
"blob_id": "66f2ddeaa1d684f88ba74501a4a2e37e57a9ef94",
|
| 62 |
+
"lfs_sha256": "2d6d4a1ebc75908d03d7bd81c970e72ebabdbe4321d71f8b1b8cef3461dd170f"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q4_1.gguf",
|
| 66 |
+
"size": 4632828032,
|
| 67 |
+
"blob_id": "e8c45c0fdcae14161c1c2036e33b0b5f0897e902",
|
| 68 |
+
"lfs_sha256": "33d0a74eaebbffac24168a144034528fccc777619926582e9f0e725a861bde51"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q4_K_M.gguf",
|
| 72 |
+
"size": 4539054208,
|
| 73 |
+
"blob_id": "08bfa6c0e7434d7349c48f7f27419e178be2dc6c",
|
| 74 |
+
"lfs_sha256": "43b489bb77a81bda85180e7c490d40ad7f1d5c2ce654c9b05e15e104bd3c777e"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q4_K_S.gguf",
|
| 78 |
+
"size": 4404697216,
|
| 79 |
+
"blob_id": "c832745f00d2630efffd721e4b45acca229bec2b",
|
| 80 |
+
"lfs_sha256": "2b24f9371cc2db50efd1c5ed8f23709a4830df4af8b44b34a9cc832455c4be49"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q5_K_M.gguf",
|
| 84 |
+
"size": 5023496320,
|
| 85 |
+
"blob_id": "58ba6dd038a0c6cf08e05b05584cc6901c852673",
|
| 86 |
+
"lfs_sha256": "88a7552ad06665791aed6c3f71ebc011f7669bc5dd062607d875bd0f6f22e437"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q5_K_S.gguf",
|
| 90 |
+
"size": 4945369216,
|
| 91 |
+
"blob_id": "a86dcb16da88fe319af087dd9ab476e0fc855718",
|
| 92 |
+
"lfs_sha256": "8a6befab353da89602988c1655ccb356e43708f81d956a7ac1c9c545df0f0660"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q6_K.gguf",
|
| 96 |
+
"size": 6272219264,
|
| 97 |
+
"blob_id": "d3589ddaaa93f31f671781b66e4a3d31bc3a5596",
|
| 98 |
+
"lfs_sha256": "1f84a8d37d33a4f457d5bf89fcebf3f47eb7a4b799945ff0472b77a25c5a3593"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-Q8_0.gguf",
|
| 102 |
+
"size": 7353292928,
|
| 103 |
+
"blob_id": "c12e0e8beb4beee83067a7942b7d31db85e77c86",
|
| 104 |
+
"lfs_sha256": "80e3a8cff3f29b2d2a6f580d8aaaf9269fff767c48eacf4306294718a76eb262"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-IQ2_M.gguf",
|
| 108 |
+
"size": 3105929344,
|
| 109 |
+
"blob_id": "34c5ee3c74a7083026e1742e7c4378f4807cb976",
|
| 110 |
+
"lfs_sha256": "0e259c5dee31ceff487bb1974262173f5e28eff7d1cb041e00596980894f804d"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-IQ2_XXS.gguf",
|
| 114 |
+
"size": 2830964864,
|
| 115 |
+
"blob_id": "ba8ee579d9dcd4d368a979e39d6fbc917bcfc705",
|
| 116 |
+
"lfs_sha256": "8fe1ea0ddfdc4e32be0acfb52c3fd84fb4b52e7f2a7842a5736d60e5a78531c4"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-IQ3_XXS.gguf",
|
| 120 |
+
"size": 3349244032,
|
| 121 |
+
"blob_id": "2cb16ca1b33f7789b9a05c28930942a821746032",
|
| 122 |
+
"lfs_sha256": "2f25dac930b95175ccc86301d8ce604ea8995928e80813dce503922a8ea057b0"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-Q2_K_XL.gguf",
|
| 126 |
+
"size": 3661842560,
|
| 127 |
+
"blob_id": "141037257a0d1cd138fe255636b92900574350f1",
|
| 128 |
+
"lfs_sha256": "786c38a3343f5d603d8f4f24ce16146115766e8531fbc6cdbff3ad9aa19288c8"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-Q3_K_XL.gguf",
|
| 132 |
+
"size": 4127762560,
|
| 133 |
+
"blob_id": "d6a3ece2d56c90e4327e54cc6469d5bcb3e960b9",
|
| 134 |
+
"lfs_sha256": "d75515d5751aafcf5468925cd1b2ee1a1ab4f548ad5bd579bdf32a67847a5758"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-Q4_K_XL.gguf",
|
| 138 |
+
"size": 5385042048,
|
| 139 |
+
"blob_id": "14746c0b2b5c01d373caef61a2da4d605fba303e",
|
| 140 |
+
"lfs_sha256": "49f8ac599ea6b01e7421ffb584f92f89583224ad5b490d7870e3b4fd503e50eb"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-Q5_K_XL.gguf",
|
| 144 |
+
"size": 5857728640,
|
| 145 |
+
"blob_id": "946a615d70808c1500f4d238be2697c2fe503247",
|
| 146 |
+
"lfs_sha256": "3ead3fe0506efa4d22a4e26e037d97262b4df1861f74a554c13ba11e3b8ef04a"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-Q6_K_XL.gguf",
|
| 150 |
+
"size": 6618101888,
|
| 151 |
+
"blob_id": "165efae61eb09a0b22c6f1ba828cc55f7afe0962",
|
| 152 |
+
"lfs_sha256": "b4eeef524e0ac74597e37a275aa1eaff21f1ce08cee326fceda13b727b627384"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "gemma-3n-E4B-it-litert-preview-UD-Q8_K_XL.gguf",
|
| 156 |
+
"size": 10589460608,
|
| 157 |
+
"blob_id": "c5c29bf6c85261f2f0f949b55405e7f61adaccb1",
|
| 158 |
+
"lfs_sha256": "e983c4c873c5399f616facfcbc5269a582a766e7d5f944c1dea58c7c118188c8"
|
| 159 |
+
}
|
| 160 |
+
]
|
| 161 |
+
}
|
bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-GGUF.json
ADDED
|
@@ -0,0 +1,198 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/gemma-4-31B-it-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/gemma-4-31B-it-GGUF",
|
| 4 |
+
"commit_sha": "c1ac76e99d5513b141e8adde7288b85c3f9c32ec",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30697345596,
|
| 7 |
+
"architecture": "gemma4",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"quantize_imatrix_file": "gemma-4-31B-it-GGUF/imatrix_unsloth.gguf",
|
| 10 |
+
"chat_template": "{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('<channel|>') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '<tool_response|>' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '<tool|>' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n<channel|>' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- elif function['arguments'] is string -%}\n {#- Pre-serialized args (e.g. an OpenAI JSON string). We cannot JSON-parse\n portably in-template, so render non-fatally instead of erroring. Strip an\n outer {...} so it composes with the DSL braces rather than double-wrapping.\n Prefer passing arguments as a mapping for exact Gemma DSL. -#}\n {%- set argstr = function['arguments'] | trim -%}\n {%- if argstr[:1] == '{' and argstr[-1:] == '}' -%}\n {{- argstr[1:-1] -}}\n {%- else -%}\n {{- function['arguments'] -}}\n {%- endif -%}\n {%- endif -%}\n {{- '}<tool_call|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '<turn|>\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- if not enable_thinking -%}\n {{- '<|channel>thought\\n<channel|>' -}}\n {%- endif -%}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n",
|
| 11 |
+
"bos_token": "<bos>",
|
| 12 |
+
"eos_token": "<turn|>",
|
| 13 |
+
"totalFileSize": 17287670720
|
| 14 |
+
},
|
| 15 |
+
"fetched_at_utc": "2026-09-06T11:32:08.517107+00:00",
|
| 16 |
+
"siblings": [
|
| 17 |
+
{
|
| 18 |
+
"rfilename": "BF16/gemma-4-31B-it-BF16-00001-of-00002.gguf",
|
| 19 |
+
"size": 49950156960,
|
| 20 |
+
"blob_id": "40a0285dbd07e96695d231214a4795fb46992178",
|
| 21 |
+
"lfs_sha256": "9aa27a4f71ce16ed6edda262b517e34d4301fd6506be773c0004eb2e021d4e14"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"rfilename": "BF16/gemma-4-31B-it-BF16-00002-of-00002.gguf",
|
| 25 |
+
"size": 11463033568,
|
| 26 |
+
"blob_id": "7c5a0e522ada1879aa987c3ee7aec30e845ed93e",
|
| 27 |
+
"lfs_sha256": "eca9083855ec546e8cbad372e4348e7f9a118a4925fb108052621252dcb43504"
|
| 28 |
+
},
|
| 29 |
+
{
|
| 30 |
+
"rfilename": "MTP/mtp-gemma-4-31B-it-BF16.gguf",
|
| 31 |
+
"size": 954843264,
|
| 32 |
+
"blob_id": "b2d470b6b23b6dc1bc3f65c21ad083abecf098ed",
|
| 33 |
+
"lfs_sha256": "8e6211a54648eca5af909bddf9331b447203b1a7febae6831491367afb61da7f"
|
| 34 |
+
},
|
| 35 |
+
{
|
| 36 |
+
"rfilename": "MTP/mtp-gemma-4-31B-it-F16.gguf",
|
| 37 |
+
"size": 954843264,
|
| 38 |
+
"blob_id": "cac3c3ee1f756f23f55d6bb2469ee834a3d3ad19",
|
| 39 |
+
"lfs_sha256": "c19d08440ed71bc0fb57b8d09f5eef925c13ad19b2bdbb6e7784e75740e1b3ad"
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"rfilename": "MTP/mtp-gemma-4-31B-it-Q8_0.gguf",
|
| 43 |
+
"size": 514687104,
|
| 44 |
+
"blob_id": "c10e13b1e16c4e1c05856ec97532d595e84e77a6",
|
| 45 |
+
"lfs_sha256": "5ae8b0117bed601e8924c6305bd5b0585de361d51f0e77091bcb4252cf1f27de"
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"rfilename": "gemma-4-31B-it-IQ4_NL.gguf",
|
| 49 |
+
"size": 17287670720,
|
| 50 |
+
"blob_id": "b0c34b479128b380c25f5c15ed21742cc7783c97",
|
| 51 |
+
"lfs_sha256": "811dccf90edd3e0a5341c601473d42642f4acc238966326395d4f4c1289b2e92"
|
| 52 |
+
},
|
| 53 |
+
{
|
| 54 |
+
"rfilename": "gemma-4-31B-it-IQ4_XS.gguf",
|
| 55 |
+
"size": 16372460480,
|
| 56 |
+
"blob_id": "4625087f2978e28aba12f6ccaa0d013975cda272",
|
| 57 |
+
"lfs_sha256": "e3d40b6e363954c993a6e28b160d881dfe5a243b62746bd4092b393d4f1d54e5"
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"rfilename": "gemma-4-31B-it-Q3_K_M.gguf",
|
| 61 |
+
"size": 14736608192,
|
| 62 |
+
"blob_id": "6e7158f31eeaa503ab36cd2b76af1f87769b93db",
|
| 63 |
+
"lfs_sha256": "d2d7a0f9117eb1a9a4b8b68bbb53c1ce5d1f602c45b9028dc12add0d0056f4fd"
|
| 64 |
+
},
|
| 65 |
+
{
|
| 66 |
+
"rfilename": "gemma-4-31B-it-Q3_K_S.gguf",
|
| 67 |
+
"size": 13210856384,
|
| 68 |
+
"blob_id": "e4f0ba38726c9db8ac39b6c3c210d4a6eda47c66",
|
| 69 |
+
"lfs_sha256": "02cdd36af753d2a61832c3e71b621e6d6be65906bbee4adfcde9f62b42154d97"
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"rfilename": "gemma-4-31B-it-Q4_0.gguf",
|
| 73 |
+
"size": 17338248128,
|
| 74 |
+
"blob_id": "ec29a5e7406b313690bfc2b84bc27d8d9dde456a",
|
| 75 |
+
"lfs_sha256": "5c558b9b009e3ee69bde43e2b98a45d1f5afd316b9fbf447edd2ad4945a187bc"
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"rfilename": "gemma-4-31B-it-Q4_1.gguf",
|
| 79 |
+
"size": 19118091200,
|
| 80 |
+
"blob_id": "6cf47700bce1f1b6673f020a7e82b725009dd185",
|
| 81 |
+
"lfs_sha256": "4957468acdcf412b56d34b69acc9bb380a5872895846effbf37dacbd43c951c6"
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"rfilename": "gemma-4-31B-it-Q4_K_M.gguf",
|
| 85 |
+
"size": 18323733440,
|
| 86 |
+
"blob_id": "fecb016a5bc0ffac885a967f8e673f4973b31f3b",
|
| 87 |
+
"lfs_sha256": "38bd64c852c4b460434cc7162fa9bdcf242faf86502581a754cb72956bb17f84"
|
| 88 |
+
},
|
| 89 |
+
{
|
| 90 |
+
"rfilename": "gemma-4-31B-it-Q4_K_S.gguf",
|
| 91 |
+
"size": 17399835584,
|
| 92 |
+
"blob_id": "d4a40a431821584cba9e8aa1b7b5b9fadb6dafb6",
|
| 93 |
+
"lfs_sha256": "41557bd9b7fd0973f2648942fd3d073c5f7dd2aff30d4c91f934ad907dacbf7c"
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"rfilename": "gemma-4-31B-it-Q5_K_M.gguf",
|
| 97 |
+
"size": 21658401728,
|
| 98 |
+
"blob_id": "f54876d93cc867faa52153f73f72a12583fe6b12",
|
| 99 |
+
"lfs_sha256": "95192e41190ef5eb72db92b669cea0ed733049c2265a03a64ac5a080d8605958"
|
| 100 |
+
},
|
| 101 |
+
{
|
| 102 |
+
"rfilename": "gemma-4-31B-it-Q5_K_S.gguf",
|
| 103 |
+
"size": 21124672448,
|
| 104 |
+
"blob_id": "00c40ef28bb362a29fe69e35dfee3a7451e9c337",
|
| 105 |
+
"lfs_sha256": "81dbe67b7e2fc456eeb275f0ecdc493be82b7db4c8d6971061b7afc407f7a3dd"
|
| 106 |
+
},
|
| 107 |
+
{
|
| 108 |
+
"rfilename": "gemma-4-31B-it-Q6_K.gguf",
|
| 109 |
+
"size": 25201486784,
|
| 110 |
+
"blob_id": "209f467ba3a4236603d8ac9627baae5e64359797",
|
| 111 |
+
"lfs_sha256": "4660692bca96f1d9d19c550641088789c8c0c25bb07965a1e2798e3cb16885fb"
|
| 112 |
+
},
|
| 113 |
+
{
|
| 114 |
+
"rfilename": "gemma-4-31B-it-Q8_0.gguf",
|
| 115 |
+
"size": 32635677632,
|
| 116 |
+
"blob_id": "eb50693e866f82e3775620ba2556b8d3bc12ac9e",
|
| 117 |
+
"lfs_sha256": "d5808e5874e660a85ab45b2da00c9e3b4a003621249a333772232d1a703e4d67"
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"rfilename": "gemma-4-31B-it-UD-IQ2_M.gguf",
|
| 121 |
+
"size": 10752820160,
|
| 122 |
+
"blob_id": "ff5f5dd2e27a19f26aa4bbd08c36f35cc50285e0",
|
| 123 |
+
"lfs_sha256": "952cfe8d7872e9bc64edb8862e14c354c565ae9e86257f4e3f8fe720200af49c"
|
| 124 |
+
},
|
| 125 |
+
{
|
| 126 |
+
"rfilename": "gemma-4-31B-it-UD-IQ2_XXS.gguf",
|
| 127 |
+
"size": 8534295488,
|
| 128 |
+
"blob_id": "09c75fee96f80c95b4911182ee9dc19a30cdebfa",
|
| 129 |
+
"lfs_sha256": "e0366169198137bb91121777eb6235aaabe042b422812b12a2d3835d9564fe4b"
|
| 130 |
+
},
|
| 131 |
+
{
|
| 132 |
+
"rfilename": "gemma-4-31B-it-UD-IQ3_XXS.gguf",
|
| 133 |
+
"size": 11837782976,
|
| 134 |
+
"blob_id": "0873a95c1ed043982074e0b8b9ed56a14b9df14f",
|
| 135 |
+
"lfs_sha256": "beb8b6e69da5d3778d781664d376f94962528c84982e1bf5aa7453d9b2d739b8"
|
| 136 |
+
},
|
| 137 |
+
{
|
| 138 |
+
"rfilename": "gemma-4-31B-it-UD-Q2_K_XL.gguf",
|
| 139 |
+
"size": 11774991296,
|
| 140 |
+
"blob_id": "360e8232a47ceafda17be979b7309611a5a7a6c3",
|
| 141 |
+
"lfs_sha256": "3c0f374d3bc5d3d8c26adf27535354404f144922cecb8c57d7967647d56f17f3"
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"rfilename": "gemma-4-31B-it-UD-Q3_K_XL.gguf",
|
| 145 |
+
"size": 15380222912,
|
| 146 |
+
"blob_id": "9ff805e56f2de513f0df8cb1d487dcae12154f30",
|
| 147 |
+
"lfs_sha256": "73f1de2bde15da19362e5760febc01cd31e4e72f5c29561b7ead63ee2a28c716"
|
| 148 |
+
},
|
| 149 |
+
{
|
| 150 |
+
"rfilename": "gemma-4-31B-it-UD-Q4_K_XL.gguf",
|
| 151 |
+
"size": 18822970304,
|
| 152 |
+
"blob_id": "b1793671551a2e5e092e4b21d4131ddbc7c709be",
|
| 153 |
+
"lfs_sha256": "9e92cb6236044c6a9870af406029c74a76e0571c157a6f95df724dcc8c7a1575"
|
| 154 |
+
},
|
| 155 |
+
{
|
| 156 |
+
"rfilename": "gemma-4-31B-it-UD-Q5_K_XL.gguf",
|
| 157 |
+
"size": 21890429888,
|
| 158 |
+
"blob_id": "2a38d90d4c9b78eabaaab2d1f003b76237cc6123",
|
| 159 |
+
"lfs_sha256": "abd37a1692ed4a6e7387a886cce871a8d4205359ce098de43f144146cf6455a3"
|
| 160 |
+
},
|
| 161 |
+
{
|
| 162 |
+
"rfilename": "gemma-4-31B-it-UD-Q6_K_XL.gguf",
|
| 163 |
+
"size": 27521338304,
|
| 164 |
+
"blob_id": "8e90ef67bd4980202e54037213df3b2b82502371",
|
| 165 |
+
"lfs_sha256": "7f56eb37d53b0435ed154cbd647704b920488b38cd0684882766cf9a0cf0517f"
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"rfilename": "gemma-4-31B-it-UD-Q8_K_XL.gguf",
|
| 169 |
+
"size": 35020041152,
|
| 170 |
+
"blob_id": "7c207547036e0fbbbca470590d6523c32cd8754f",
|
| 171 |
+
"lfs_sha256": "d1808aea1320e2d1cd0296fbda97b2d2a889cf49a8b212f9eee8b21979e73190"
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 175 |
+
"size": 1200726496,
|
| 176 |
+
"blob_id": "9aeb0f231afb196f0cd4a32ec7303bfc88801f25",
|
| 177 |
+
"lfs_sha256": "7a4601b12ec680f706a7e0c7e1f78f579b1db64d485a9e352ee87d4b9daa45e4"
|
| 178 |
+
},
|
| 179 |
+
{
|
| 180 |
+
"rfilename": "mmproj-F16.gguf",
|
| 181 |
+
"size": 1198957024,
|
| 182 |
+
"blob_id": "7ae3a635c4917e44364bf572149f254c37f85d75",
|
| 183 |
+
"lfs_sha256": "6edcca228213c28d3567a35d22f849eea52d8360875093851959adf5d2f270eb"
|
| 184 |
+
},
|
| 185 |
+
{
|
| 186 |
+
"rfilename": "mmproj-F32.gguf",
|
| 187 |
+
"size": 2302996960,
|
| 188 |
+
"blob_id": "9edb0fd80705c9b142f953ca91f4053e682cc282",
|
| 189 |
+
"lfs_sha256": "6ba741a2445b1585a35556cf19b2a55eab86b4e2ed38e31767a6583a8a2fa4e4"
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"rfilename": "mtp-gemma-4-31B-it.gguf",
|
| 193 |
+
"size": 514687104,
|
| 194 |
+
"blob_id": "c10e13b1e16c4e1c05856ec97532d595e84e77a6",
|
| 195 |
+
"lfs_sha256": "5ae8b0117bed601e8924c6305bd5b0585de361d51f0e77091bcb4252cf1f27de"
|
| 196 |
+
}
|
| 197 |
+
]
|
| 198 |
+
}
|
bpw/hf/repo-metadata/unsloth__gemma-4-31B-it-qat-GGUF.json
ADDED
|
@@ -0,0 +1,71 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/gemma-4-31B-it-qat-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/gemma-4-31B-it-qat-GGUF",
|
| 4 |
+
"commit_sha": "43cc1aeb31adf47ec06a854507ce552cd9862e6f",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 30697345596,
|
| 7 |
+
"architecture": "gemma4",
|
| 8 |
+
"context_length": 262144,
|
| 9 |
+
"chat_template": "{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('<channel|>') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '<tool_response|>' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '<tool|>' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n<channel|>' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- elif function['arguments'] is string -%}\n {#- Pre-serialized args (e.g. an OpenAI JSON string). We cannot JSON-parse\n portably in-template, so render non-fatally instead of erroring. Strip an\n outer {...} so it composes with the DSL braces rather than double-wrapping.\n Prefer passing arguments as a mapping for exact Gemma DSL. -#}\n {%- set argstr = function['arguments'] | trim -%}\n {%- if argstr[:1] == '{' and argstr[-1:] == '}' -%}\n {{- argstr[1:-1] -}}\n {%- else -%}\n {{- function['arguments'] -}}\n {%- endif -%}\n {%- endif -%}\n {{- '}<tool_call|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '<turn|>\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- if not enable_thinking -%}\n {{- '<|channel>thought\\n<channel|>' -}}\n {%- endif -%}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n",
|
| 10 |
+
"bos_token": "<bos>",
|
| 11 |
+
"eos_token": "<eos>",
|
| 12 |
+
"totalFileSize": 17287670048
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.515723+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "MTP/mtp-gemma-4-31B-it-BF16.gguf",
|
| 18 |
+
"size": 954862080,
|
| 19 |
+
"blob_id": "2354f3341b1ed666376a0e5e73ac6a7ebdce618f",
|
| 20 |
+
"lfs_sha256": "1ea5895dc0e82207c58886e7bf8a80dc3e3445c8d7219407c506a5946048098e"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "MTP/mtp-gemma-4-31B-it-F16.gguf",
|
| 24 |
+
"size": 954862080,
|
| 25 |
+
"blob_id": "4506cb1cfcf3a5341dd6bfe3fb83c0744f7b3e08",
|
| 26 |
+
"lfs_sha256": "cbb3fde9fef201af9506c80eb9f5baa9840dfddf8dc94d83d1b9a24aa4b95b17"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "MTP/mtp-gemma-4-31B-it-Q4_0.gguf",
|
| 30 |
+
"size": 279955968,
|
| 31 |
+
"blob_id": "c26569a104c29056fac46d6f04d264e6c59601ef",
|
| 32 |
+
"lfs_sha256": "3a5e99fd8d0b23afb1fccd1ee0c9ebd1f571d00399c2dae2292d217feeec0f6b"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "MTP/mtp-gemma-4-31B-it-Q8_0.gguf",
|
| 36 |
+
"size": 514705920,
|
| 37 |
+
"blob_id": "18e1fda8a24b00adfa9f4aa1e84c4390a681dc81",
|
| 38 |
+
"lfs_sha256": "e6e88dea4fcf79a0a71cd7732e61632355126dbbda9b72a08d6301fa06fbaf22"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "gemma-4-31B-it-qat-UD-Q4_K_XL.gguf",
|
| 42 |
+
"size": 17287670048,
|
| 43 |
+
"blob_id": "7ba36a8d3a2ffc23114d0abb5afb9b8f3a6a9bbe",
|
| 44 |
+
"lfs_sha256": "00b5a7c497f0c8934033088c10a7fa9a4c015e46ee6d89e9c6890650ba5d0e71"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 48 |
+
"size": 1200726496,
|
| 49 |
+
"blob_id": "a848feb0104170423e55a9379778e036c408b6ba",
|
| 50 |
+
"lfs_sha256": "d904b3579a9fbfbd50bc9bf40cb7384909edbd69fa9276db5ddc853e80f0edca"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "mmproj-F16.gguf",
|
| 54 |
+
"size": 1198957024,
|
| 55 |
+
"blob_id": "85830f222fedbecb3203fc055450929cade6fde7",
|
| 56 |
+
"lfs_sha256": "4775e1bf6ef6f8df94caed2d672c74432f0722565e5225a170c72949ebe4cf23"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "mmproj-F32.gguf",
|
| 60 |
+
"size": 2302996960,
|
| 61 |
+
"blob_id": "198b566766be9358cdd8b3d12e69e8b8523375b1",
|
| 62 |
+
"lfs_sha256": "7a890d25bbc0a2ce70c3723ad57092d4a5ad98bb2115ed80561f990003c6e88a"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "mtp-gemma-4-31B-it.gguf",
|
| 66 |
+
"size": 279955968,
|
| 67 |
+
"blob_id": "c26569a104c29056fac46d6f04d264e6c59601ef",
|
| 68 |
+
"lfs_sha256": "3a5e99fd8d0b23afb1fccd1ee0c9ebd1f571d00399c2dae2292d217feeec0f6b"
|
| 69 |
+
}
|
| 70 |
+
]
|
| 71 |
+
}
|
bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-GGUF.json
ADDED
|
@@ -0,0 +1,185 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/gemma-4-E4B-it-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/gemma-4-E4B-it-GGUF",
|
| 4 |
+
"commit_sha": "bfc15c382204943c3a8fff0c750b94ae2364d7a3",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 7518069290,
|
| 7 |
+
"architecture": "gemma4",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"chat_template": "{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('<channel|>') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '<tool_response|>' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '<tool|>' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n<channel|>' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- elif function['arguments'] is string -%}\n {#- Pre-serialized args (e.g. an OpenAI JSON string). We cannot JSON-parse\n portably in-template, so render non-fatally instead of erroring. Strip an\n outer {...} so it composes with the DSL braces rather than double-wrapping.\n Prefer passing arguments as a mapping for exact Gemma DSL. -#}\n {%- set argstr = function['arguments'] | trim -%}\n {%- if argstr[:1] == '{' and argstr[-1:] == '}' -%}\n {{- argstr[1:-1] -}}\n {%- else -%}\n {{- function['arguments'] -}}\n {%- endif -%}\n {%- endif -%}\n {{- '}<tool_call|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '<turn|>\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n",
|
| 10 |
+
"bos_token": "<bos>",
|
| 11 |
+
"eos_token": "<turn|>",
|
| 12 |
+
"totalFileSize": 15053097856
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.566409+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "MTP/mtp-gemma-4-E4B-it-BF16.gguf",
|
| 18 |
+
"size": 171766848,
|
| 19 |
+
"blob_id": "b6351d2e5fff0c149cb9308e75241b7bf92b5c57",
|
| 20 |
+
"lfs_sha256": "909b31e9e0a4919c936f09b99b3562d663187d6c142abe3e6656610720f9b3e2"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "MTP/mtp-gemma-4-E4B-it-F16.gguf",
|
| 24 |
+
"size": 171766848,
|
| 25 |
+
"blob_id": "61f4c2447807df130236fe303bfbf535bcf9ce6b",
|
| 26 |
+
"lfs_sha256": "16f0fad416a6ce65b28688daa1d39f4b11af5427a4478beb1d4f3adf7b5ed2bf"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "MTP/mtp-gemma-4-E4B-it-Q8_0.gguf",
|
| 30 |
+
"size": 98653248,
|
| 31 |
+
"blob_id": "c8d1ffa34be5e8dde528a988c46bf3ee98d8f0f4",
|
| 32 |
+
"lfs_sha256": "b6a723115efa510d3b3215db1e26790dae84cd08c2134a764f3d194f1f0c3376"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "gemma-4-E4B-it-BF16.gguf",
|
| 36 |
+
"size": 15053097856,
|
| 37 |
+
"blob_id": "5e35525a19a063c1419d4c57ac9fdb9691cd8c06",
|
| 38 |
+
"lfs_sha256": "38e0dba6818d18e2b41062c7b3b9083dcfddc44767078c415ff7e13661911ba5"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "gemma-4-E4B-it-IQ4_NL.gguf",
|
| 42 |
+
"size": 4835839104,
|
| 43 |
+
"blob_id": "930b6075c6da4ae05450d5b23ccf359a9641957d",
|
| 44 |
+
"lfs_sha256": "fe389d0020e4ba26a502b73970fe00f6a8bd6012cec6987d36ff4ffd0b301750"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "gemma-4-E4B-it-IQ4_XS.gguf",
|
| 48 |
+
"size": 4715416704,
|
| 49 |
+
"blob_id": "8514ae63327ad9022b0765e4bb2889b4aa1bbf12",
|
| 50 |
+
"lfs_sha256": "0847f7300471e9a61abaeb46b45b3d61e393af8fa6d6aa70c563623773670dd9"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "gemma-4-E4B-it-Q3_K_M.gguf",
|
| 54 |
+
"size": 4058137728,
|
| 55 |
+
"blob_id": "7a8222e7b646ae64ffa3d8cca62b6c98094e4970",
|
| 56 |
+
"lfs_sha256": "0980898d0e7d9c75cea05141bf4010393312101ef6cf5b31f8197e0de18655f4"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "gemma-4-E4B-it-Q3_K_S.gguf",
|
| 60 |
+
"size": 3862379648,
|
| 61 |
+
"blob_id": "9e249be80533b3ddc583ba377ffb5a6071afefb0",
|
| 62 |
+
"lfs_sha256": "fe6e02cdcd5f3287b4ac146ea68ea2c73363bf935159aa254a9d280a4ffe31aa"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "gemma-4-E4B-it-Q4_0.gguf",
|
| 66 |
+
"size": 4836002944,
|
| 67 |
+
"blob_id": "4ce1367d0f279ffa5f92417f2300e5138d361548",
|
| 68 |
+
"lfs_sha256": "4a403d2e4d80281063e4f517b1c061ded8476b4011a4fc2ba7dbff707075547e"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "gemma-4-E4B-it-Q4_1.gguf",
|
| 72 |
+
"size": 5074390144,
|
| 73 |
+
"blob_id": "15d1e59d3e697a4ae2fd524b951454f825354522",
|
| 74 |
+
"lfs_sha256": "430685a687edf70c4fdb1158aa92c34dbb38e1230f674849f198a954cc748405"
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"rfilename": "gemma-4-E4B-it-Q4_K_M.gguf",
|
| 78 |
+
"size": 4977171584,
|
| 79 |
+
"blob_id": "14883a6b60cbc0037228a9769ce57d59ae892fa9",
|
| 80 |
+
"lfs_sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87"
|
| 81 |
+
},
|
| 82 |
+
{
|
| 83 |
+
"rfilename": "gemma-4-E4B-it-Q4_K_S.gguf",
|
| 84 |
+
"size": 4844850304,
|
| 85 |
+
"blob_id": "6a66265f4eb08f45c8120a6b6bc315eefff61eca",
|
| 86 |
+
"lfs_sha256": "0fdbd6df44e505481a0636fe3160d230d6de2ecf0f8a20f06a5c64adef0cae00"
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"rfilename": "gemma-4-E4B-it-Q5_K_M.gguf",
|
| 90 |
+
"size": 5481798784,
|
| 91 |
+
"blob_id": "f6095401b10297e9d37a5fb1bd0108bec08e8e98",
|
| 92 |
+
"lfs_sha256": "a5d6e634db151368d2caa4270fd32ab604d96c2d1291950586989f46d8e17d36"
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"rfilename": "gemma-4-E4B-it-Q5_K_S.gguf",
|
| 96 |
+
"size": 5404855424,
|
| 97 |
+
"blob_id": "cabdaac842ba9c9ddae1a43ab27b8a8493086e71",
|
| 98 |
+
"lfs_sha256": "f1991026c630086164a436c88f09b1a0cfe2eae6cd312ac4697be2b1567989dc"
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"rfilename": "gemma-4-E4B-it-Q6_K.gguf",
|
| 102 |
+
"size": 7074929792,
|
| 103 |
+
"blob_id": "abbc982c2cb8971b5a2ed4e8af845f970824c540",
|
| 104 |
+
"lfs_sha256": "fd83f3ef44d22e00ff0f638753dde9a66a83e8ccf79c11024f47d383c489531b"
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"rfilename": "gemma-4-E4B-it-Q8_0.gguf",
|
| 108 |
+
"size": 8192953472,
|
| 109 |
+
"blob_id": "16a3441effe391e19007f0b1fe53549f9489e250",
|
| 110 |
+
"lfs_sha256": "f8854aa4480df62585a279e7ca0a881554fc18a41c59c4f62642d16a2ae47012"
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"rfilename": "gemma-4-E4B-it-UD-IQ2_M.gguf",
|
| 114 |
+
"size": 3545083008,
|
| 115 |
+
"blob_id": "cbc345349fb09ef8b67e3aec42e6e3d01e5f3619",
|
| 116 |
+
"lfs_sha256": "ae7c1bd7867d2037c3d5b281c151319380a00f9f9f8de2cc8b507aef5d6a31b9"
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"rfilename": "gemma-4-E4B-it-UD-IQ3_XXS.gguf",
|
| 120 |
+
"size": 3717115008,
|
| 121 |
+
"blob_id": "3254b571aa8818ddef1a919304ac3b7837b49b48",
|
| 122 |
+
"lfs_sha256": "dd0b5b2f3ba8b4cbeb35154484fc67729183c8f24f53e43319d806ec9fffc6a7"
|
| 123 |
+
},
|
| 124 |
+
{
|
| 125 |
+
"rfilename": "gemma-4-E4B-it-UD-Q2_K_XL.gguf",
|
| 126 |
+
"size": 3757419648,
|
| 127 |
+
"blob_id": "e8bae75afe28af7da92b176703c913318e9ef7e6",
|
| 128 |
+
"lfs_sha256": "cc92186419be169e992a1df01978828a0d4cf3a5962379ff403c8d55f6faff78"
|
| 129 |
+
},
|
| 130 |
+
{
|
| 131 |
+
"rfilename": "gemma-4-E4B-it-UD-Q3_K_XL.gguf",
|
| 132 |
+
"size": 4588440704,
|
| 133 |
+
"blob_id": "6f3367ab20e4854cb9bc176eac53281e7f622c11",
|
| 134 |
+
"lfs_sha256": "7558880ee42b79ab732481bd7250e85c41d9ef044b22634b8a912eb184224009"
|
| 135 |
+
},
|
| 136 |
+
{
|
| 137 |
+
"rfilename": "gemma-4-E4B-it-UD-Q4_K_XL.gguf",
|
| 138 |
+
"size": 5126306944,
|
| 139 |
+
"blob_id": "b6e32a71b3df65d288f916981608c15c7c6c3fa7",
|
| 140 |
+
"lfs_sha256": "3cf61de12daa015ee0f7b68e7b7c541405bf220e1e942bad8b47cab827d7df80"
|
| 141 |
+
},
|
| 142 |
+
{
|
| 143 |
+
"rfilename": "gemma-4-E4B-it-UD-Q5_K_XL.gguf",
|
| 144 |
+
"size": 6656154752,
|
| 145 |
+
"blob_id": "d9cb26df5dec31caf4cad98d53cd20b5c290ef52",
|
| 146 |
+
"lfs_sha256": "9940a3eedd3dca186b09b1586006dafb1cc408c3fc53e73c313e48c0e3267825"
|
| 147 |
+
},
|
| 148 |
+
{
|
| 149 |
+
"rfilename": "gemma-4-E4B-it-UD-Q6_K_XL.gguf",
|
| 150 |
+
"size": 7457762432,
|
| 151 |
+
"blob_id": "6f9921abdf624cb68a712896ee407f4f1b8829bd",
|
| 152 |
+
"lfs_sha256": "17b9c459b28b420ce20d75bcfc329db4fac1343792a964c3ae2e2680ce768932"
|
| 153 |
+
},
|
| 154 |
+
{
|
| 155 |
+
"rfilename": "gemma-4-E4B-it-UD-Q8_K_XL.gguf",
|
| 156 |
+
"size": 8711507072,
|
| 157 |
+
"blob_id": "c561ac3700df3f0db288805da81cfa94ca794e07",
|
| 158 |
+
"lfs_sha256": "21a5e0f214eb1055bc34602e62fe46254756ee3f3698abab6fe0607203359dff"
|
| 159 |
+
},
|
| 160 |
+
{
|
| 161 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 162 |
+
"size": 991552320,
|
| 163 |
+
"blob_id": "33ac655d4215a7ac1861e55d66168fcdc9c1b810",
|
| 164 |
+
"lfs_sha256": "ee01cba03fd9c71ea2ea722225d24a84f72e7197714367e550ef705ef8851bc6"
|
| 165 |
+
},
|
| 166 |
+
{
|
| 167 |
+
"rfilename": "mmproj-F16.gguf",
|
| 168 |
+
"size": 990372672,
|
| 169 |
+
"blob_id": "a260ff2377ce139c1baaf114cbb6b72146489fee",
|
| 170 |
+
"lfs_sha256": "ddf46c21d7078e95338cfc22306b19b276a29a5ad089023449dd54d4b6170a51"
|
| 171 |
+
},
|
| 172 |
+
{
|
| 173 |
+
"rfilename": "mmproj-F32.gguf",
|
| 174 |
+
"size": 1912464192,
|
| 175 |
+
"blob_id": "2a20b8ae98dfc03c9b2bb5e440e93cca98f0f377",
|
| 176 |
+
"lfs_sha256": "343cdea7775835ebdd1caa6c42ec3ec3e711d082835c72253d4e87c4b7e303d0"
|
| 177 |
+
},
|
| 178 |
+
{
|
| 179 |
+
"rfilename": "mtp-gemma-4-E4B-it.gguf",
|
| 180 |
+
"size": 98653248,
|
| 181 |
+
"blob_id": "c8d1ffa34be5e8dde528a988c46bf3ee98d8f0f4",
|
| 182 |
+
"lfs_sha256": "b6a723115efa510d3b3215db1e26790dae84cd08c2134a764f3d194f1f0c3376"
|
| 183 |
+
}
|
| 184 |
+
]
|
| 185 |
+
}
|
bpw/hf/repo-metadata/unsloth__gemma-4-E4B-it-qat-GGUF.json
ADDED
|
@@ -0,0 +1,77 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"repo_id": "unsloth/gemma-4-E4B-it-qat-GGUF",
|
| 3 |
+
"requested_repo_id": "unsloth/gemma-4-E4B-it-qat-GGUF",
|
| 4 |
+
"commit_sha": "8c5a9e4fd5482e2be20fe0bf013b4c262a8f4265",
|
| 5 |
+
"gguf": {
|
| 6 |
+
"total": 7463013674,
|
| 7 |
+
"architecture": "gemma4",
|
| 8 |
+
"context_length": 131072,
|
| 9 |
+
"chat_template": "{%- macro format_parameters(properties, required, filter_keys=false) -%}\n {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in properties | dictsort -%}\n {%- set add_comma = false -%}\n {%- if not filter_keys or key not in standard_keys -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {{ key }}:{\n {%- if value['description'] -%}\n description:<|\"|>{{ value['description'] }}<|\"|>\n {%- set add_comma = true -%}\n {%- endif -%}\n {%- if value['type'] | upper == 'STRING' -%}\n {%- if value['enum'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n enum:{{ format_argument(value['enum']) }}\n {%- endif -%}\n {%- elif value['type'] | upper == 'ARRAY' -%}\n {%- if value['items'] is mapping and value['items'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n items:{\n {%- set ns_items = namespace(found_first=false) -%}\n {%- for item_key, item_value in value['items'] | dictsort -%}\n {%- if item_value is not none -%}\n {%- if ns_items.found_first %},{% endif -%}\n {%- set ns_items.found_first = true -%}\n {%- if item_key == 'properties' -%}\n properties:{\n {%- if item_value is mapping -%}\n {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n {%- endif -%}\n }\n {%- elif item_key == 'required' -%}\n required:[\n {%- for req_item in item_value -%}\n <|\"|>{{- req_item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- elif item_key == 'type' -%}\n {%- if item_value is string -%}\n type:{{ format_argument(item_value | upper) }}\n {%- else -%}\n type:{{ format_argument(item_value | map('upper') | list) }}\n {%- endif -%}\n {%- else -%}\n {{ item_key }}:{{ format_argument(item_value) }}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n }\n {%- endif -%}\n {%- endif -%}\n {%- if value['nullable'] %}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n nullable:true\n {%- endif -%}\n {%- if value['type'] | upper == 'OBJECT' -%}\n {%- if value['properties'] is defined and value['properties'] is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n }\n {%- elif value is mapping -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n properties:{\n {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n }\n {%- endif -%}\n {%- if value['required'] -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n required:[\n {%- for item in value['required'] | default([]) -%}\n <|\"|>{{- item -}}<|\"|>\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n ]\n {%- endif -%}\n {%- endif -%}\n {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n {%- endif -%}\n {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n {%- set params = tool_data['function']['parameters'] -%}\n {%- if params -%}\n ,parameters:{\n {%- if params['properties'] -%}\n properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n {%- endif -%}\n {%- if params['required'] -%}\n required:[\n {%- for item in params['required'] -%}\n <|\"|>{{- item -}}<|\"|>\n {{- ',' if not loop.last -}}\n {%- endfor -%}\n ],\n {%- endif -%}\n {%- if params['type'] -%}\n type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n {%- if 'response' in tool_data['function'] -%}\n {%- set response_declaration = tool_data['function']['response'] -%}\n ,response:{\n {%- if response_declaration['description'] -%}\n description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n {%- endif -%}\n {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n {%- endif -%}\n {%- endif -%}\n }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n {%- if argument is none -%}\n {{- 'null' -}}\n {%- elif argument is string -%}\n {{- '<|\"|>' + argument + '<|\"|>' -}}\n {%- elif argument is boolean -%}\n {{- 'true' if argument else 'false' -}}\n {%- elif argument is mapping -%}\n {{- '{' -}}\n {%- set ns = namespace(found_first=false) -%}\n {%- for key, value in argument | dictsort -%}\n {%- if ns.found_first %},{% endif -%}\n {%- set ns.found_first = true -%}\n {%- if escape_keys -%}\n {{- '<|\"|>' + key + '<|\"|>' -}}\n {%- else -%}\n {{- key -}}\n {%- endif -%}\n :{{- format_argument(value, escape_keys=escape_keys) -}}\n {%- endfor -%}\n {{- '}' -}}\n {%- elif argument is sequence -%}\n {{- '[' -}}\n {%- for item in argument -%}\n {{- format_argument(item, escape_keys=escape_keys) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- ']' -}}\n {%- else -%}\n {{- argument -}}\n {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n {%- set ns = namespace(result='') -%}\n {%- for part in text.split('<channel|>') -%}\n {%- if '<|channel>' in part -%}\n {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n {%- else -%}\n {%- set ns.result = ns.result + part -%}\n {%- endif -%}\n {%- endfor -%}\n {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n {{- '<|tool_response>' -}}\n {%- if response is mapping -%}\n {{- 'response:' + tool_name + '{' -}}\n {%- for key, value in response | dictsort -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- if not loop.last %},{% endif -%}\n {%- endfor -%}\n {{- '}' -}}\n {%- else -%}\n {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n {%- endif -%}\n {{- '<tool_response|>' -}}\n{%- endmacro -%}\n\n{#- ===== SETUP ===== -#}\n{%- set ns = namespace(prev_message_type=None, prev_non_tool_role=None) -%}\n{%- set loop_messages = messages -%}\n{%- set enable_thinking = enable_thinking | default(false) -%}\n{%- set preserve_thinking = preserve_thinking | default(false) -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if enable_thinking or tools or (messages and messages[0]['role'] in ['system', 'developer']) -%}\n {{- '<|turn>system\\n' -}}\n {#- Inject Thinking token at the very top of the FIRST system turn -#}\n {%- if enable_thinking -%}\n {{- '<|think|>\\n' -}}\n {%- set ns.prev_message_type = 'think' -%}\n {%- endif -%}\n {%- if messages and messages[0]['role'] in ['system', 'developer'] -%}\n {%- if messages[0]['content'] is string -%}\n {{- messages[0]['content'] | trim -}}\n {%- elif messages[0]['content'] is sequence -%}\n {%- for item in messages[0]['content'] -%}\n {{- item['text'] | trim + ' '-}}\n {%- endfor -%}\n {%- endif -%}\n {%- set loop_messages = messages[1:] -%}\n {%- endif -%}\n {%- if tools -%}\n {%- for tool in tools %}\n {{- '<|tool>' -}}\n {{- format_function_declaration(tool) | trim -}}\n {{- '<tool|>' -}}\n {%- endfor %}\n {%- set ns.prev_message_type = 'tool' -%}\n {%- endif -%}\n {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n {%- if loop_messages[i]['role'] == 'user' -%}\n {%- set ns_turn.last_user_idx = i -%}\n {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n {%- if message['role'] != 'tool' -%}\n {%- set ns.prev_message_type = None -%}\n {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n {#- Detect continuation using tracked state — O(1) instead of O(n) backward scan -#}\n {%- set continue_same_model_turn = (role == 'model' and ns.prev_non_tool_role == 'assistant') -%}\n {%- if not continue_same_model_turn -%}\n {{- '<|turn>' + role + '\\n' }}\n {%- endif -%}\n\n {#- Render reasoning/reasoning_content as thinking channel -#}\n {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n {%- set thinking_gate = (loop.index0 > ns_turn.last_user_idx) or (preserve_thinking and message.get('tool_calls')) -%}\n {%- if thinking_text and thinking_gate -%}\n {{- '<|channel>thought\\n' + thinking_text + '\\n<channel|>' -}}\n {%- endif -%}\n\n {%- if message.get('tool_calls') -%}\n {%- for tool_call in message.get('tool_calls') -%}\n {%- set function = tool_call['function'] -%}\n {{- '<|tool_call>call:' + function['name'] + '{' -}}\n {%- if function['arguments'] is mapping -%}\n {%- set ns_args = namespace(found_first=false) -%}\n {%- for key, value in function['arguments'] | dictsort -%}\n {%- if ns_args.found_first %},{% endif -%}\n {%- set ns_args.found_first = true -%}\n {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n {%- endfor -%}\n {%- elif function['arguments'] is none -%}\n {%- elif function['arguments'] is string -%}\n {#- Pre-serialized args (e.g. an OpenAI JSON string). We cannot JSON-parse\n portably in-template, so render non-fatally instead of erroring. Strip an\n outer {...} so it composes with the DSL braces rather than double-wrapping.\n Prefer passing arguments as a mapping for exact Gemma DSL. -#}\n {%- set argstr = function['arguments'] | trim -%}\n {%- if argstr[:1] == '{' and argstr[-1:] == '}' -%}\n {{- argstr[1:-1] -}}\n {%- else -%}\n {{- function['arguments'] -}}\n {%- endif -%}\n {%- endif -%}\n {{- '}<tool_call|>' -}}\n {%- endfor -%}\n {%- set ns.prev_message_type = 'tool_call' -%}\n {%- endif -%}\n\n {%- set ns_tr_out = namespace(flag=false) -%}\n {%- if message.get('tool_responses') -%}\n {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n {%- for tool_response in message.get('tool_responses') -%}\n {{- format_tool_response_block(tool_response['name'] | default('unknown', true), tool_response['response']) -}}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endfor -%}\n {%- elif message.get('tool_calls') -%}\n {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n {%- set ns_tool_scan = namespace(stopped=false) -%}\n {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if ns_tool_scan.stopped -%}\n {%- elif loop_messages[k]['role'] != 'tool' -%}\n {%- set ns_tool_scan.stopped = true -%}\n {%- else -%}\n {%- set follow = loop_messages[k] -%}\n {#- Resolve tool_call_id to function name -#}\n {%- set ns_tname = namespace(name=follow.get('name') or 'unknown') -%}\n {%- for tc in message.get('tool_calls') -%}\n {%- if tc.get('id') == follow.get('tool_call_id') -%}\n {%- set ns_tname.name = tc['function']['name'] -%}\n {%- endif -%}\n {%- endfor -%}\n {#- Handle content as string or content-parts array -#}\n {%- set tool_body = follow.get('content') -%}\n {%- if tool_body is string -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- elif tool_body is sequence and tool_body is not string -%}\n {%- set ns_txt = namespace(s='') -%}\n {%- for part in tool_body -%}\n {%- if part.get('type') == 'text' -%}\n {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n {%- endif -%}\n {%- endfor -%}\n {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n {%- for part in tool_body -%}\n {%- if part.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif part.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif part.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- else -%}\n {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n {%- endif -%}\n {%- set ns_tr_out.flag = true -%}\n {%- set ns.prev_message_type = 'tool_response' -%}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- set captured_content -%}\n {%- if message.get('content') is string -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(message['content']) -}}\n {%- else -%}\n {{- message['content'] | trim -}}\n {%- endif -%}\n {%- elif message.get('content') is sequence -%}\n {%- for item in message['content'] -%}\n {%- if item.get('type') == 'text' -%}\n {%- if role == 'model' -%}\n {{- strip_thinking(item['text']) -}}\n {%- else -%}\n {{- item['text'] | trim -}}\n {%- endif -%}\n {%- elif item.get('type') in ['image', 'image_url'] -%}\n {{- '<|image|>' -}}\n {%- elif item.get('type') in ['audio', 'input_audio'] -%}\n {{- '<|audio|>' -}}\n {%- elif item.get('type') == 'video' -%}\n {{- '<|video|>' -}}\n {%- endif -%}\n {%- endfor -%}\n {%- endif -%}\n {%- endset -%}\n\n {{- captured_content -}}\n {%- set has_content = captured_content | trim | length > 0 -%}\n\n {#- Forward-scan: find next non-tool message role for continuation detection -#}\n {%- set next_nt = namespace(role=None, found=false) -%}\n {%- for j in range(loop.index0 + 1, loop_messages | length) -%}\n {%- if not next_nt.found -%}\n {%- if loop_messages[j]['role'] != 'tool' -%}\n {%- set next_nt.role = loop_messages[j]['role'] -%}\n {%- set next_nt.found = true -%}\n {%- endif -%}\n {%- endif -%}\n {%- endfor -%}\n\n {%- set continues_into_next = (\n role == 'model'\n and next_nt.role == 'assistant'\n and (not message.get('tool_calls') or ns_tr_out.flag)\n ) -%}\n\n {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n {{- '<|tool_response>' -}}\n {%- elif continues_into_next -%}\n {%- elif not (ns_tr_out.flag and not has_content and not next_nt.found) -%}\n {{- '<turn|>\\n' -}}\n {%- endif -%}\n\n {#- Track previous non-tool role for next iteration (avoids O(n) backward scan) -#}\n {%- set ns.prev_non_tool_role = message['role'] -%}\n {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n {{- '<|turn>model\\n' -}}\n {%- elif ns.prev_message_type == 'tool_response' and enable_thinking -%}\n {{- '<|channel>thought\\n' -}}\n {%- endif -%}\n{%- endif -%}\n",
|
| 10 |
+
"bos_token": "<bos>",
|
| 11 |
+
"eos_token": "<eos>",
|
| 12 |
+
"totalFileSize": 3219532192
|
| 13 |
+
},
|
| 14 |
+
"fetched_at_utc": "2026-09-06T11:32:08.553715+00:00",
|
| 15 |
+
"siblings": [
|
| 16 |
+
{
|
| 17 |
+
"rfilename": "MTP/mtp-gemma-4-E4B-it-BF16.gguf",
|
| 18 |
+
"size": 171785536,
|
| 19 |
+
"blob_id": "2343e25e899dfd3195717b4869394b5f596ca930",
|
| 20 |
+
"lfs_sha256": "cb70f7a55c900e01911deb881c742d752cd63e047002da95750a99bf13c41516"
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"rfilename": "MTP/mtp-gemma-4-E4B-it-F16.gguf",
|
| 24 |
+
"size": 171785536,
|
| 25 |
+
"blob_id": "73e18112e845908b15c0f3e170e7559a687e94b2",
|
| 26 |
+
"lfs_sha256": "d47d1d3cce9e599b3df39f6ec65e1ae0db0f534006a6d56e398f19ca47f1c261"
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"rfilename": "MTP/mtp-gemma-4-E4B-it-Q4_0.gguf",
|
| 30 |
+
"size": 59678016,
|
| 31 |
+
"blob_id": "1f51a91317f5bfdad21bc772afd0ede56498fb2f",
|
| 32 |
+
"lfs_sha256": "423074e537504b4f9ec5eafed5c639fac82c96631626efccacdd3c4039b20605"
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"rfilename": "MTP/mtp-gemma-4-E4B-it-Q8_0.gguf",
|
| 36 |
+
"size": 98671936,
|
| 37 |
+
"blob_id": "7b5f0c4b8eec0f48057706ef58a0acd23d7ca965",
|
| 38 |
+
"lfs_sha256": "c566f6885963c83a0d868f9656287ed5d4f12a2b8f0c86a20524f89a96169ed2"
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"rfilename": "gemma-4-E4B-it-qat-UD-Q2_K_XL.gguf",
|
| 42 |
+
"size": 3219532192,
|
| 43 |
+
"blob_id": "5871f23d3d1df47d6f084ab5ada3543ec7c27b8b",
|
| 44 |
+
"lfs_sha256": "79dde517866cfbb5c00230b530de17910fc7fc78f8827554d0e14281ce5faf03"
|
| 45 |
+
},
|
| 46 |
+
{
|
| 47 |
+
"rfilename": "gemma-4-E4B-it-qat-UD-Q4_K_XL.gguf",
|
| 48 |
+
"size": 4215695776,
|
| 49 |
+
"blob_id": "91bc17545a01017a2593bbcba93fcc9885522ad5",
|
| 50 |
+
"lfs_sha256": "df0fd4ee07072c607c29a0a1cb4f98918426cca12f45a2776bdd6ee6d09a4de3"
|
| 51 |
+
},
|
| 52 |
+
{
|
| 53 |
+
"rfilename": "mmproj-BF16.gguf",
|
| 54 |
+
"size": 991552320,
|
| 55 |
+
"blob_id": "c49e5a9518428815c34b203fb8271f714287b9d9",
|
| 56 |
+
"lfs_sha256": "7c9bafa27f82d658eda805c1d82ef62bb0368e1ff75f64f77de58ad318beaaf9"
|
| 57 |
+
},
|
| 58 |
+
{
|
| 59 |
+
"rfilename": "mmproj-F16.gguf",
|
| 60 |
+
"size": 990372672,
|
| 61 |
+
"blob_id": "a9ef767d631f35583f8d8cef5080033554495a82",
|
| 62 |
+
"lfs_sha256": "6a255159ee4b01b304f633a57f017dd7d5a69d30fff52abb2614bf0813cef034"
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"rfilename": "mmproj-F32.gguf",
|
| 66 |
+
"size": 1912464192,
|
| 67 |
+
"blob_id": "25f909754fb2d6cdc8a1ebe1d68e62523d3bbf3c",
|
| 68 |
+
"lfs_sha256": "ca0d467d84abe0e8383982dc9bb4df6c49e49fe5c1baab9bbd8c346002793c9f"
|
| 69 |
+
},
|
| 70 |
+
{
|
| 71 |
+
"rfilename": "mtp-gemma-4-E4B-it.gguf",
|
| 72 |
+
"size": 59678016,
|
| 73 |
+
"blob_id": "1f51a91317f5bfdad21bc772afd0ede56498fb2f",
|
| 74 |
+
"lfs_sha256": "423074e537504b4f9ec5eafed5c639fac82c96631626efccacdd3c4039b20605"
|
| 75 |
+
}
|
| 76 |
+
]
|
| 77 |
+
}
|