Spaces:
Running
Running
| title: TamilBench - Beam's Tamil Token Tax | |
| emoji: 🪔 | |
| colorFrom: yellow | |
| colorTo: red | |
| sdk: static | |
| pinned: false | |
| license: cc-by-4.0 | |
| short_description: What does Beam charge to think in Tamil and Tanglish? | |
| models: | |
| - reflection/Beam-1.0-501B-A23B | |
| datasets: | |
| - esscor/TamilBench | |
| tags: | |
| - beam | |
| - build-with-beam | |
| - tamil | |
| - multilingual | |
| - tokenizer | |
| TamilBench: the same 50 questions in English, Tamil script and Tanglish, plus 22 native-Tamil questions, run on **Beam-1.0-501B-A23B** (via HF Inference Providers / Baseten). Measures accuracy, prompt tokens, reasoning tokens and cost, with an in-browser Beam tokenizer playground and every raw answer with its reasoning trace. | |
| Data: https://huggingface.co/datasets/esscor/TamilBench | |