Spaces:

BeardedAmbivert
/

inference-server

Sleeping

App Files Files Community

inference-server / benchmarks

165 kB

Ctrl+K

Ctrl+K

3 contributors

History: 3 commits

Aditya Kulkarni

feat: add nfcorpus quality eval for fp32 vs INT8

c745c50 about 2 months ago

ANALYSIS.md

11.3 kB
feat: add nfcorpus quality eval for fp32 vs INT8 about 2 months ago
README.md

10.9 kB
feat: add nfcorpus quality eval for fp32 vs INT8 about 2 months ago
batching-sweep.png

92.9 kB
test: add benchmarking suite and publish results 4 months ago
lat-onnx-fp32-tpr1-c1.json

1.11 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-onnx-fp32-tpr32-c1.json

1.11 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-onnx-fp32-tpr8-c1.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-onnx-int8-tpr1-c1.json

1.11 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-onnx-int8-tpr32-c1.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-onnx-int8-tpr8-c1.json

1.11 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-pytorch-cpu-tpr1-c1.json

1.11 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-pytorch-cpu-tpr32-c1.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-pytorch-cpu-tpr8-c1.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-pytorch-mps-tpr1-c1.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-pytorch-mps-tpr32-c1.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
lat-pytorch-mps-tpr8-c1.json

1.11 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
naive-cpu.json

671 Bytes
test: add benchmarking suite and publish results 4 months ago
naive-mps.json

671 Bytes
test: add benchmarking suite and publish results 4 months ago
onnx-cpu-batch1-c32.json

891 Bytes
test: add benchmarking suite and publish results 4 months ago
onnx-cpu-batch16-c32.json

895 Bytes
test: add benchmarking suite and publish results 4 months ago
onnx-cpu-batch32-c32.json

893 Bytes
test: add benchmarking suite and publish results 4 months ago
onnx-cpu-batch8-c32.json

892 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-cpu-batch1-c1.json

895 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-cpu-batch1-c32.json

900 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-cpu-batch16-c32.json

899 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-cpu-batch32-c32.json

900 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-cpu-batch8-c32.json

896 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-mps-batch1-c1.json

894 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-mps-batch1-c32.json

900 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-mps-batch16-c32.json

893 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-mps-batch32-c32.json

899 Bytes
test: add benchmarking suite and publish results 4 months ago
pytorch-mps-batch8-c32.json

898 Bytes
test: add benchmarking suite and publish results 4 months ago
quality-nfcorpus.json

5.35 kB
feat: add nfcorpus quality eval for fp32 vs INT8 about 2 months ago
tput-onnx-fp32-bs128.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-onnx-fp32-bs256.json

1.24 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-onnx-fp32-bs512.json

1.13 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-onnx-int8-bs128.json

2.14 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-onnx-int8-bs256.json

2.15 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-onnx-int8-bs512.json

2.15 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-pytorch-cpu-bs128.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-pytorch-cpu-bs256.json

1.23 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-pytorch-cpu-bs512.json

1.24 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-pytorch-mps-bs128.json

1.12 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-pytorch-mps-bs256.json

1.24 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago
tput-pytorch-mps-bs512.json

1.23 kB
feat: land nfcorpus benches, encode batch_size, and INT8-negative docs about 2 months ago