| Loading BGE-M3 model... |
| Model loaded. |
| Processing V1-B4... |
|
Batches: 0%| | 0/25 [00:00<?, ?it/s]
Batches: 4%|▍ | 1/25 [00:00<00:05, 4.70it/s]
Batches: 28%|██▊ | 7/25 [00:00<00:00, 25.48it/s]
Batches: 56%|█████▌ | 14/25 [00:00<00:00, 41.06it/s]
Batches: 92%|█████████▏| 23/25 [00:00<00:00, 56.28it/s]
Batches: 100%|██████████| 25/25 [00:00<00:00, 45.26it/s] |
|
Batches: 0%| | 0/25 [00:00<?, ?it/s]
Batches: 48%|████▊ | 12/25 [00:00<00:00, 116.39it/s]
Batches: 96%|█████████▌| 24/25 [00:00<00:00, 117.58it/s]
Batches: 100%|██████████| 25/25 [00:00<00:00, 117.35it/s] |
| V1-B4: exact=0.0000, semantic=0.0000 |
| Processing V1-O1... |
|
Batches: 0%| | 0/25 [00:00<?, ?it/s]
Batches: 20%|██ | 5/25 [00:00<00:00, 41.85it/s]
Batches: 48%|████▊ | 12/25 [00:00<00:00, 54.72it/s]
Batches: 80%|████████ | 20/25 [00:00<00:00, 65.41it/s]
Batches: 100%|██████████| 25/25 [00:00<00:00, 66.55it/s] |
|
Batches: 0%| | 0/25 [00:00<?, ?it/s]
Batches: 48%|████▊ | 12/25 [00:00<00:00, 119.45it/s]
Batches: 96%|█████████▌| 24/25 [00:00<00:00, 119.46it/s]
Batches: 100%|██████████| 25/25 [00:00<00:00, 119.55it/s] |
| V1-O1: exact=0.0000, semantic=0.0000 |
| Processing V2-B4... |
|
Batches: 0%| | 0/25 [00:00<?, ?it/s]
Batches: 20%|██ | 5/25 [00:00<00:00, 46.01it/s]
Batches: 48%|████▊ | 12/25 [00:00<00:00, 56.61it/s]
Batches: 76%|███████▌ | 19/25 [00:00<00:00, 61.24it/s]
Batches: 100%|██████████| 25/25 [00:00<00:00, 65.15it/s] |
|
Batches: 0%| | 0/25 [00:00<?, ?it/s]
Batches: 44%|████▍ | 11/25 [00:00<00:00, 103.61it/s]
Batches: 88%|████████▊ | 22/25 [00:00<00:00, 100.82it/s]
Batches: 100%|██████████| 25/25 [00:00<00:00, 100.58it/s] |
| V2-B4: exact=0.0000, semantic=0.0000 |
| Processing V2-O1... |
|
Batches: 0%| | 0/25 [00:00<?, ?it/s]
Batches: 16%|█▌ | 4/25 [00:00<00:00, 35.07it/s]
Batches: 40%|████ | 10/25 [00:00<00:00, 47.27it/s]
Batches: 72%|███████▏ | 18/25 [00:00<00:00, 58.70it/s]
Batches: 100%|██████████| 25/25 [00:00<00:00, 61.14it/s] |
|
Batches: 0%| | 0/25 [00:00<?, ?it/s]
Batches: 52%|█████▏ | 13/25 [00:00<00:00, 120.35it/s]
Batches: 100%|██████████| 25/25 [00:00<00:00, 120.25it/s] |
| V2-O1: exact=0.0000, semantic=0.0000 |
|
|
| Done! Results saved to benchmark/semantic_results.txt |
|
|
