Instructions to use Timegravity/tamil-lm-2b-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Timegravity/tamil-lm-2b-instruct with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="Timegravity/tamil-lm-2b-instruct")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("Timegravity/tamil-lm-2b-instruct")
model = AutoModelForMultimodalLM.from_pretrained("Timegravity/tamil-lm-2b-instruct", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Timegravity/tamil-lm-2b-instruct with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Timegravity/tamil-lm-2b-instruct"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Timegravity/tamil-lm-2b-instruct",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/Timegravity/tamil-lm-2b-instruct

SGLang

How to use Timegravity/tamil-lm-2b-instruct with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Timegravity/tamil-lm-2b-instruct" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Timegravity/tamil-lm-2b-instruct",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Timegravity/tamil-lm-2b-instruct" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Timegravity/tamil-lm-2b-instruct",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use Timegravity/tamil-lm-2b-instruct with Docker Model Runner:
```
docker model run hf.co/Timegravity/tamil-lm-2b-instruct
```

vignesh1234 commited on Sep 8

Commit

f64a421

verified ·

1 Parent(s): 0bfc802

Upload eval_results/guard_v3_eval.json with huggingface_hub

Browse files

Files changed (1) hide show

eval_results/guard_v3_eval.json +203 -0

eval_results/guard_v3_eval.json ADDED Viewed

	@@ -0,0 +1,203 @@

+{
+ "version": "v3-2026-09-08",
+ "general_threshold": 0.5,
+ "category_thresholds": {
+  "sexual": 0.3,
+  "slur": 0.3
+ },
+ "info": {
+  "pos": 9639,
+  "neg": 54771,
+  "pos_by_group": {
+   "rt": 184,
+   "child": 145,
+   "offenseval": 8245,
+   "lex": 1065
+  },
+  "neg_by_group": {
+   "rt": 126,
+   "offenseval": 11995,
+   "lookalike": 250,
+   "clean": 40000,
+   "sft": 2400
+  },
+  "pos_by_category": {
+   "sexual": 671,
+   "violence": 45,
+   "self_harm": 55,
+   "other": 8315,
+   "slur": 331,
+   "profanity": 222
+  },
+  "pos_by_lang": {
+   "tanglish": 1981,
+   "en": 6210,
+   "ta": 1448
+  },
+  "neg_by_lang": {
+   "tanglish": 21388,
+   "en": 9351,
+   "ta": 24032
+  },
+  "heldout": {
+   "template_disjoint": {
+    "pos": 426,
+    "neg": 250
+   },
+   "offenseval_validation": {
+    "pos": 1023,
+    "neg": 3193
+   },
+   "ui_benign": {
+    "neg": 114
+   }
+  },
+  "lexicon_entries_train": 355,
+  "lexicon_entries_held": 105
+ },
+ "held_out": {
+  "template_disjoint": {
+   "n_pos": 426,
+   "n_neg": 250,
+   "overall": {
+    "tp": 391,
+    "fp": 6,
+    "fn": 35,
+    "precision": 0.985,
+    "recall": 0.918,
+    "f1": 0.95
+   },
+   "per_lang": {
+    "ta": {
+     "tp": 21,
+     "fp": 0,
+     "fn": 20,
+     "precision": 1.0,
+     "recall": 0.512,
+     "f1": 0.677
+    },
+    "tanglish": {
+     "tp": 40,
+     "fp": 4,
+     "fn": 7,
+     "precision": 0.909,
+     "recall": 0.851,
+     "f1": 0.879
+    },
+    "en": {
+     "tp": 330,
+     "fp": 2,
+     "fn": 8,
+     "precision": 0.994,
+     "recall": 0.976,
+     "f1": 0.985
+    }
+   },
+   "per_category_recall": {
+    "other": 0.4,
+    "profanity": 0.977,
+    "sexual": 0.956,
+    "slur": 0.933,
+    "violence": 0.5
+   },
+   "benign_fpr": 0.024,
+   "benign_fpr_per_lang": {
+    "ta": 0.0,
+    "tanglish": 0.056,
+    "en": 0.022
+   }
+  },
+  "offenseval_validation": {
+   "n_pos": 1023,
+   "n_neg": 3193,
+   "overall": {
+    "tp": 891,
+    "fp": 976,
+    "fn": 132,
+    "precision": 0.477,
+    "recall": 0.871,
+    "f1": 0.617
+   },
+   "per_lang": {
+    "ta": {
+     "tp": 106,
+     "fp": 161,
+     "fn": 41,
+     "precision": 0.397,
+     "recall": 0.721,
+     "f1": 0.512
+    },
+    "tanglish": {
+     "tp": 213,
+     "fp": 175,
+     "fn": 15,
+     "precision": 0.549,
+     "recall": 0.934,
+     "f1": 0.692
+    },
+    "en": {
+     "tp": 572,
+     "fp": 640,
+     "fn": 76,
+     "precision": 0.472,
+     "recall": 0.883,
+     "f1": 0.615
+    }
+   },
+   "per_category_recall": {
+    "other": 0.871
+   },
+   "benign_fpr": 0.306,
+   "benign_fpr_per_lang": {
+    "ta": 0.241,
+    "tanglish": 0.585,
+    "en": 0.287
+   }
+  },
+  "ui_benign": {
+   "n_pos": 0,
+   "n_neg": 114,
+   "overall": {
+    "tp": 0,
+    "fp": 21,
+    "fn": 0,
+    "precision": 0.0,
+    "recall": 0.0,
+    "f1": 0.0
+   },
+   "per_lang": {
+    "ta": {
+     "tp": 0,
+     "fp": 5,
+     "fn": 0,
+     "precision": 0.0,
+     "recall": 0.0,
+     "f1": 0.0
+    },
+    "tanglish": {
+     "tp": 0,
+     "fp": 9,
+     "fn": 0,
+     "precision": 0.0,
+     "recall": 0.0,
+     "f1": 0.0
+    },
+    "en": {
+     "tp": 0,
+     "fp": 7,
+     "fn": 0,
+     "precision": 0.0,
+     "recall": 0.0,
+     "f1": 0.0
+    }
+   },
+   "per_category_recall": {},
+   "benign_fpr": 0.184,
+   "benign_fpr_per_lang": {
+    "ta": 0.135,
+    "tanglish": 0.562,
+    "en": 0.115
+   }
+  }
+ }
+}