sgyaqing commited on
Commit
41562c0
·
verified ·
1 Parent(s): d360232

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -32,7 +32,7 @@ One RTX 3080, one session, one fixed request (full methodology and CPU numbers i
32
  | concurrency 32 | Throughput | P50 |
33
  |---|---:|---:|
34
  | FastAPI + torch (cuda) | 37.8 rps | 844 ms |
35
- | Verdict (CUDA EP) | 408 rps | 78 ms |
36
 
37
  ## Files
38
 
@@ -50,7 +50,7 @@ Weights are unchanged from `convaiinnovations/laya`; this repo adds the ONNX exp
50
  - export parity: max logits difference 6.6e-6 against the official forward
51
  - token ids: id-for-id identical to the official pipeline
52
  - responses: round-4 probabilities identical (golden vectors, 40 cases per task)
53
- - serving on both execution providers, against a 2e-4 tolerance: CPU worst logits difference 1.1e-4, CUDA 5e-5; response layer bitwise on both
54
 
55
  ## License
56
 
 
32
  | concurrency 32 | Throughput | P50 |
33
  |---|---:|---:|
34
  | FastAPI + torch (cuda) | 37.8 rps | 844 ms |
35
+ | Verdict (CUDA) | 408 rps | 78 ms |
36
 
37
  ## Files
38
 
 
50
  - export parity: max logits difference 6.6e-6 against the official forward
51
  - token ids: id-for-id identical to the official pipeline
52
  - responses: round-4 probabilities identical (golden vectors, 40 cases per task)
53
+ - serving on CPU and CUDA, against a 2e-4 tolerance: CPU worst logits difference 1.1e-4, CUDA 5e-5; response layer bitwise on both
54
 
55
  ## License
56