--- title: TamilBench - Beam's Tamil Token Tax emoji: 🪔 colorFrom: yellow colorTo: red sdk: static pinned: false license: cc-by-4.0 short_description: What does Beam charge to think in Tamil and Tanglish? models: - reflection/Beam-1.0-501B-A23B datasets: - esscor/TamilBench tags: - beam - build-with-beam - tamil - multilingual - tokenizer --- TamilBench: the same 50 questions in English, Tamil script and Tanglish, plus 22 native-Tamil questions, run on **Beam-1.0-501B-A23B** (via HF Inference Providers / Baseten). Measures accuracy, prompt tokens, reasoning tokens and cost, with an in-browser Beam tokenizer playground and every raw answer with its reasoning trace. Data: https://huggingface.co/datasets/esscor/TamilBench