kurcontko
/

clef-flash-NVFP4

compressed-tensors

structured-output

8-bit precision

Model card Files Files and versions

clef-flash-NVFP4

9.15 GB

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

kurcontko's picture

Card: single-request latency and the two settings behind it

5ceb59c verified about 16 hours ago

clef_head
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
scripts
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
vllm_plugin
Server: CUDA graphs for prompt-sized steps (70 -> 37 ms), --gdn-backend, Server-Timing about 16 hours ago
.gitattributes

1.57 kB
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
LICENSE

11.5 kB
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
README.md

12.6 kB
Card: single-request latency and the two settings behind it about 16 hours ago
chat_template.jinja

7.76 kB
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
config.json

12 kB
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
generation_config.json

116 Bytes
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
joint_schema_model.py

23.3 kB
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
model.safetensors

8.88 GB
xet

Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
processor_config.json

1.19 kB
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
recipe.yaml

287 Bytes
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
tokenizer.json

20 MB
xet

Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago
tokenizer_config.json

1.08 kB
Upload clef-flash-NVFP4 (vLLM plugin + SystemOne server) 4 days ago