GetCortex27
/

Nanbeige4.3-33B-FP8

Text Generation

compressed-tensors

Model card Files Files and versions

Nanbeige4.3-33B-FP8

35.5 GB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

GetCortex27's picture

FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card

324f2c1 verified 16 days ago

.gitattributes

1.57 kB
FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
README.md

4.12 kB
FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
chat_template.jinja

8.42 kB
FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
config.json

1.88 kB
FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
generation_config.json

162 Bytes
FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
model-00001-of-00002.safetensors

20 GB
xet

FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
model-00002-of-00002.safetensors

15.6 GB
xet

FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
model.safetensors.index.json

70.6 kB
FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
recipe.yaml

215 Bytes
FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
tokenizer.json

18.5 MB
xet

FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago
tokenizer_config.json

509 Bytes
FP8_DYNAMIC quant of Nanbeige4.3-33B (llm-compressor), with fidelity + throughput card 16 days ago