README.md

metadata

title: TamilBench - Beam's Tamil Token Tax
emoji: 🪔
colorFrom: yellow
colorTo: red
sdk: static
pinned: false
license: cc-by-4.0
short_description: What does Beam charge to think in Tamil and Tanglish?
models:
  - reflection/Beam-1.0-501B-A23B
datasets:
  - esscor/TamilBench
tags:
  - beam
  - build-with-beam
  - tamil
  - multilingual
  - tokenizer

TamilBench: the same 50 questions in English, Tamil script and Tanglish, plus 22 native-Tamil questions, run on Beam-1.0-501B-A23B (via HF Inference Providers / Baseten). Measures accuracy, prompt tokens, reasoning tokens and cost, with an in-browser Beam tokenizer playground and every raw answer with its reasoning trace.

Data: https://huggingface.co/datasets/esscor/TamilBench