inference-optimization/TinyQwen3-KV-Cache-Only
Text Generation • 2.64M • Updated • 180 • 1
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
240
Active filters: kv-cache
turtler12/onetriangle-qwen3-1.7b-to-8b-prefill-mapper
Updated • 1
fromthesky/PLDR-LLM-v51-104M
Text Generation • 0.1B • Updated • 28
fromthesky/PLDR-LLM-v51-110M-1
Text Generation • 0.1B • Updated • 25
fromthesky/PLDR-LLM-v51-110M-2
Text Generation • 0.1B • Updated • 17
fromthesky/PLDR-LLM-v51-110M-3
Text Generation • 0.1B • Updated • 73
fromthesky/PLDR-LLM-v51-110M-4
Text Generation • 0.1B • Updated • 16
fromthesky/PLDR-LLM-v51-110M-5
Text Generation • 0.1B • Updated • 16
fromthesky/PLDR-LLM-v51-DAG-110M
Text Generation • 0.1B • Updated • 19
fromthesky/PLDR-LLM-v51G-106M-1
Text Generation • 0.1B • Updated • 18
fromthesky/PLDR-LLM-v51G-106M-2
Text Generation • 0.1B • Updated • 13
fromthesky/PLDR-LLM-v51G-106M-3
Text Generation • 0.1B • Updated • 233
fromthesky/PLDR-LLM-v51G-106M-test
Text Generation • 0.1B • Updated • 15
fromthesky/PLDR-LLM-v52-81M-FT-SC-1
Text Classification • 81M • Updated • 19
fromthesky/PLDR-LLM-v52-81M-FT-QA-1
Question Answering • 81M • Updated • 33
fromthesky/PLDR-LLM-v52-81M-FT-TC-1
Token Classification • 81M • Updated • 9
fromthesky/PLDR-LLM-v52-110M-1
Text Generation • 0.1B • Updated • 14
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
ddddamn/IronCell-Mark-1
Updated