Multilingual Embedding — Low-Bit Quantization - a ThakiCloud Collection

ThakiCloud 's Collections

Thaki Speech — Korean Dialect ASR

Thaki-Ops — Kubernetes SRE Agent Models

KoToolAct — Korean Enterprise Tool Calling 4B

Thaki-Decision — Generation-free LLM routing

Ko-Voice-Command — Korean Spoken Command Understanding

FactGuard — Evidence-Grounded Verification

Multilingual Embedding — Low-Bit Quantization

Commerce AI Models

Thaki-PolicyGate — Korean regulation-condition checking

ThakiCloud Security Models

Thaki-HW — Hardware Design LLM (Research Preview)

EmbeddingGemma 2 Edge — Quantization

RAG-Gate — Answer / Retrieve / Stop Gates for RAG

ChainCheck — Chain-Sensitive Evidence Judges

PACE — Enterprise Policy Decisions: Learned or Reasoned

Merchant Desk — Korean Small-Business Customer Desk

Qwen-Image-2.1 — Few-Step Distillation

K-Decision — Korean typed-decision adapters (weights only)

K-MT — Korean-Specialized Translation Without Forgetting

Satoori-KO — Korean Regional Dialect 27B

Evals & Reproducibility

Language Confusion Suppression — Vocabulary Pruning

Vision-Language — Serving Quantization

Qwen3-30B-A3B — Serving Quantization

Qwen3-Coder-30B-A3B — Serving Quantization

Qwen3.8-27B — Serving Quantization

SkillRet — Agent Skill Retrieval

Human-KO — Korean Style-Aligned 27B

Multilingual Embedding — Low-Bit Quantization

updated 7 days ago

Low-bit quantized multilingual retrieval embedders, shipped in a format a standard loader runs: mixed 3/4-bit packed artifacts plus a GGUF re-encode.

ThakiCloud/Qwen3-Embedding-0.6B-MultiCal-M1a-GPTQ

Feature Extraction • 0.6B • Updated 7 days ago • 89

Note Qwen3-Embedding-0.6B at mixed precision (4-bit g64 layers 0-6, 3-bit g32 layers 7-27, 3-bit g64 embedding table); packed file 295,391,600 B. Ships the runnable Q4_1 GGUF re-encode (378,522,208 B): 197/197 tensors bit-identical on read-back, token ids match HF 9/9, min cosine 0.999020 vs our fp32 reference, 3/3 top-1 on a smoke set. nDCG was measured on the packed artifact, not through llama.cpp. Research Preview.