Keural-Lab-1109

An experimental checkpoint from Keural, based on Qwen3.6-35B-A3B.

Parameters ~49B total, ~4.3B active per token
Base Qwen3.6-35B-A3B

Evaluation

Same harness for both models (lm-evaluation-harness with vLLM, full test sets; GSM8K, IFEval and GPQA with thinking enabled; GPQA Diamond is the mean of 3 runs).

Benchmark Keural-Lab-1109 Qwen3.6-35B-A3B
MMLU 0.819 0.839
KMMLU 0.609 0.645
GSM8K 0.953 0.963
IFEval 0.912 0.941
GPQA Diamond 0.749 0.823

Usage

vllm serve mkd-minkeun/Keural-Lab-1109 --tensor-parallel-size 4 --max-model-len 32768

For llama.cpp, see Keural-Lab-1109-GGUF.

License

Released under the Apache License 2.0, as a derivative of Qwen3.6-35B-A3B (Apache 2.0).

Downloads last month
-
Safetensors
Model size
49B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for mkd-minkeun/Keural-Lab-1109

Finetuned
(438)
this model
Quantizations
1 model