Inference Providers
Active filters: kv-cache
tfwnotops/Ternary-Bonsai-2-27B-ConstantKV
Text Generation • 27B • Updated • 1.19k
• 11
inference-optimization/TinyQwen3-KV-Cache-Only
Text Generation • 2.64M • Updated • 171
• 1
Updated • 381
• 3
darioooooo0o/LFM3-1.7B-Base-KV800
Text Generation • Updated • 45
• 1
Tommysha/Octopus-Qwen3.5-4B
Text Generation • Updated • 70
• 1
turtler12/onetriangle-qwen3-1.7b-to-8b-prefill-mapper
fromthesky/PLDR-LLM-v51-104M
Text Generation • 0.1B • Updated • 27
fromthesky/PLDR-LLM-v51-110M-1
Text Generation • 0.1B • Updated • 23
fromthesky/PLDR-LLM-v51-110M-2
Text Generation • 0.1B • Updated • 17
fromthesky/PLDR-LLM-v51-110M-3
Text Generation • 0.1B • Updated • 81
fromthesky/PLDR-LLM-v51-110M-4
Text Generation • 0.1B • Updated • 15
fromthesky/PLDR-LLM-v51-110M-5
Text Generation • 0.1B • Updated • 17
fromthesky/PLDR-LLM-v51-DAG-110M
Text Generation • 0.1B • Updated • 20
fromthesky/PLDR-LLM-v51G-106M-1
Text Generation • 0.1B • Updated • 20
fromthesky/PLDR-LLM-v51G-106M-2
Text Generation • 0.1B • Updated • 15
fromthesky/PLDR-LLM-v51G-106M-3
Text Generation • 0.1B • Updated • 239
fromthesky/PLDR-LLM-v51G-106M-test
Text Generation • 0.1B • Updated • 13
fromthesky/PLDR-LLM-v52-81M-FT-SC-1
Text Classification • 81M • Updated • 18
fromthesky/PLDR-LLM-v52-81M-FT-QA-1
Question Answering • 81M • Updated • 25
fromthesky/PLDR-LLM-v52-81M-FT-TC-1
Token Classification • 81M • Updated • 10
fromthesky/PLDR-LLM-v52-110M-1
Text Generation • 0.1B • Updated • 13
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated