inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt1
0.6B • Updated • 29
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Gemma4-DFlash-SWA-Causal-Nemo-Cascade
4B • Updated • 26
inference-optimization/Qwen3-1.6B-A0.9B
Text Generation • 2B • Updated • 13.9k • 4
inference-optimization/ctest-Qwen3.5-9B-subset-397-speculator.dflash
2B • Updated • 34
inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16
Text Generation • 32B • Updated • 16
inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w8a8
Text Generation • 235B • Updated • 26
inference-optimization/Qwen3-235B-A22B-Instruct-2507-quantized.w4a16
Text Generation • 32B • Updated • 17
inference-optimization/Gemma4_SWA_DFLASH
4B • Updated • 26
inference-optimization/final-ctest-Qwen3-8B-speculator.dflash
2B • Updated • 35
inference-optimization/qwen3-8b-peagle-speculators
Updated
inference-optimization/peagle-gemma4
2B • Updated • 15
inference-optimization/ctest-Qwen3.5-9B-speculator.dflash
2B • Updated • 44
inference-optimization/ctest-Qwen3-8B-speculator.dflash
2B • Updated • 41
inference-optimization/laguna-xs-bf16-eagle3-ckpt0
0.4B • Updated • 2
inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK
Updated
inference-optimization/DeepSeek-V4-Flash-bf16
Updated
inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe
20B • Updated • 24
inference-optimization/Qwen3.6-35B-A3B-NVFP4
Updated • 23
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq
2B • Updated • 10
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod
2B • Updated • 9
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod
5B • Updated • 14
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq
5B • Updated • 12
inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-gptq
2B • Updated • 9
inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-qmod
2B • Updated • 12
inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-qmod
5B • Updated • 9
inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq
5B • Updated • 11
inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group
2B • Updated • 9
inference-optimization/Llama-3.2-3B-Instruct-FP8-Block
3B • Updated • 17
inference-optimization/Llama-3.2-1B-Instruct-FP8-Block
1B • Updated • 580
inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt5-speculator.eagle3
0.9B • Updated • 27