TheStageAI
/

Elastic-Qwen2.5-14B-Instruct

psynote123 commited on Apr 29, 2025

Commit

72cd8ae

verified ·

1 Parent(s): 1078b21

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md CHANGED Viewed

@@ -167,7 +167,7 @@ __100 input/300 output; tok/s:__
 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
 | H100 | 118 | 103 | 94 | -1 | 39 | 121 | - |
-| L40S | -1 | -1 | -1 | -1 | 22 | -1 | - |

 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
 | H100 | 118 | 103 | 94 | -1 | 39 | 121 | - |
+| L40S | 40 | 34 | -1 | -1 | 22 | 41 | - |