Instructions to use ahkamboh/tiny-search-reader-60M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ahkamboh/tiny-search-reader-60M with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ahkamboh/tiny-search-reader-60M")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ahkamboh/tiny-search-reader-60M")
model = AutoModelForCausalLM.from_pretrained("ahkamboh/tiny-search-reader-60M", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use ahkamboh/tiny-search-reader-60M with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf ahkamboh/tiny-search-reader-60M:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf ahkamboh/tiny-search-reader-60M:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf ahkamboh/tiny-search-reader-60M:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf ahkamboh/tiny-search-reader-60M:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf ahkamboh/tiny-search-reader-60M:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf ahkamboh/tiny-search-reader-60M:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf ahkamboh/tiny-search-reader-60M:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf ahkamboh/tiny-search-reader-60M:Q4_K_M

Use Docker

docker model run hf.co/ahkamboh/tiny-search-reader-60M:Q4_K_M

LM Studio
Jan

vLLM

How to use ahkamboh/tiny-search-reader-60M with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ahkamboh/tiny-search-reader-60M"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ahkamboh/tiny-search-reader-60M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/ahkamboh/tiny-search-reader-60M:Q4_K_M

SGLang

How to use ahkamboh/tiny-search-reader-60M with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ahkamboh/tiny-search-reader-60M" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ahkamboh/tiny-search-reader-60M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ahkamboh/tiny-search-reader-60M" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ahkamboh/tiny-search-reader-60M",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Ollama
How to use ahkamboh/tiny-search-reader-60M with Ollama:
```
ollama run hf.co/ahkamboh/tiny-search-reader-60M:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use ahkamboh/tiny-search-reader-60M with Docker Model Runner:
```
docker model run hf.co/ahkamboh/tiny-search-reader-60M:Q4_K_M
```

Lemonade

How to use ahkamboh/tiny-search-reader-60M with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull ahkamboh/tiny-search-reader-60M:Q4_K_M

Run and chat with the model

lemonade run user.tiny-search-reader-60M-Q4_K_M

List all available models

lemonade list

Atomic Chat

tiny-search-reader-60M / eval /google_heldout.jsonl

ahkamboh

tiny-search-reader-60M v3.1a: model, GGUF phone files, prompt helper, eval results

e563482 verified 5 days ago

Raw History Blame Contribute Delete

11.1 kB

	{"id": "gh-0", "question": "What is the euro rate in Pakistan today?", "answers": ["311.76", "311.53", "311.15", "313.96635826", "311"], "kind": "live", "answer": "311.53 PKR", "verdict": "answered_correct", "correct": true}
	{"id": "gh-1", "question": "What is the price of silver in Pakistan today?", "answers": ["Rs 6,794", "6,794", "Rs. 6822", "6822", "6,822", "6,352.38", "6,450"], "kind": "live", "answer": "Rs. 6822", "verdict": "answered_correct", "correct": true}
	{"id": "gh-2", "question": "What is the weather in Karachi today?", "answers": ["94°", "94", "90", "91", "91F", "Sunshine", "Mainly sunny", "Hazy"], "kind": "live", "answer": "78°", "verdict": "wrong", "correct": false}
	{"id": "gh-3", "question": "What is the temperature in Islamabad today?", "answers": ["70°", "70", "86 °F", "86", "91°", "91", "31°", "89°"], "kind": "live", "answer": "91°", "verdict": "answered_correct", "correct": true}
	{"id": "gh-4", "question": "What is the Ethereum price today?", "answers": ["$2,717.98", "$2719.13", "$2718.51", "$2,718.36", "2,717.98", "2719.13", "2718.51", "2,718.36", "2,697.49"], "kind": "live", "answer": "$2719.13", "verdict": "answered_correct", "correct": true}
	{"id": "gh-5", "question": "What is the price of chicken in Lahore today?", "answers": ["490", "338", "Rs. 295", "295"], "kind": "live", "answer": "Rs. 295", "verdict": "answered_correct", "correct": true}
	{"id": "gh-6", "question": "Who won the last El Clasico?", "answers": ["Barcelona", "Barça", "FC Barcelona"], "kind": "live", "answer": "Barcelona", "verdict": "answered_correct", "correct": true}
	{"id": "gh-7", "question": "What is the Tesla stock price today?", "answers": ["354.11", "354.81", "356.81", "354.30", "356.44"], "kind": "live", "answer": "354.11", "verdict": "answered_correct", "correct": true}
	{"id": "gh-8", "question": "Who is the current president of the United States?", "answers": ["Donald Trump", "Donald J. Trump", "Trump"], "kind": "live", "answer": "Donald Trump", "verdict": "answered_correct", "correct": true}
	{"id": "gh-9", "question": "Who is the current prime minister of Pakistan?", "answers": ["Shehbaz Sharif", "Muhammad Shehbaz Sharif", "Mian Muhammad Shehbaz Sharif"], "kind": "live", "answer": "Mian Muhammad Shehbaz Sharif", "verdict": "answered_correct", "correct": true}
	{"id": "gh-10", "question": "Who is the current chief justice of Pakistan?", "answers": ["Yahya Afridi", "Justice Yahya Afridi"], "kind": "live", "answer": "Yahya Afridi", "verdict": "answered_correct", "correct": true}
	{"id": "gh-11", "question": "What is the latest Samsung Galaxy S phone?", "answers": ["Galaxy S26", "Samsung Galaxy S26", "Galaxy S26 Ultra", "S26 Ultra", "S26"], "kind": "live", "answer": "Samsung Galaxy S26", "verdict": "answered_correct", "correct": true}
	{"id": "gh-12", "question": "What is the latest version of Android?", "answers": ["Android 17"], "kind": "live", "answer": "Android 17", "verdict": "answered_correct", "correct": true}
	{"id": "gh-13", "question": "What is the latest version of iOS?", "answers": ["iOS 27", "27.0.1", "iOS 27.0.1"], "kind": "live", "answer": "iOS 11", "verdict": "wrong", "correct": false}
	{"id": "gh-14", "question": "Who is the CEO of Google?", "answers": ["Sundar Pichai"], "kind": "live", "answer": "Sundar Pichai", "verdict": "answered_correct", "correct": true}
	{"id": "gh-15", "question": "Who won the most recent Ballon d'Or?", "answers": ["Ousmane Dembélé", "Dembélé", "Ousmane Dembéle"], "kind": "live", "answer": "Ousmane Dembéle", "verdict": "answered_correct", "correct": true}
	{"id": "gh-16", "question": "Who won the most recent Nobel Peace Prize?", "answers": ["María Corina Machado", "Maria Corina Machado", "Machado"], "kind": "live", "answer": "María Corina Machado", "verdict": "answered_correct", "correct": true}
	{"id": "gh-17", "question": "What is the KSE-100 index today?", "answers": ["169,969.33", "168,636.90", "167,866.74"], "kind": "live", "answer": "169,969.33", "verdict": "answered_correct", "correct": true}
	{"id": "gh-18", "question": "What is the LPG price in Pakistan this month?", "answers": ["Rs279.34 per kg", "Rs279.34", "279.34"], "kind": "live", "answer": "Rs. 2,848.91", "verdict": "wrong", "correct": false}
	{"id": "gh-19", "question": "Who won the last IPL final?", "answers": ["Royal Challengers Bengaluru", "RCB"], "kind": "live", "answer": "Gujarat Titans", "verdict": "wrong", "correct": false}
	{"id": "gh-20", "question": "What is the State Bank of Pakistan policy rate?", "answers": ["11.50%", "11.5%", "11.50", "11.5"], "kind": "live", "answer": "11.5%", "verdict": "answered_correct", "correct": true}
	{"id": "gh-21", "question": "What is the population of Pakistan in 2026?", "answers": ["259,299,791", "254,714,473"], "kind": "live", "answer": "259,299,791", "verdict": "answered_correct", "correct": true}
	{"id": "gh-22", "question": "How tall is Mount Everest?", "answers": ["8,848.86 m", "8,848.86", "8,849 meters", "8,849", "29,032 feet", "29,032", "8,850 meters", "8,848.9 meters"], "kind": "fact", "answer": "29,032 feet", "verdict": "answered_correct", "correct": true}
	{"id": "gh-23", "question": "How long is the Indus River?", "answers": ["3,180 km", "3180 km", "3,180", "2,000 miles", "3,200 km", "1,980 mi"], "kind": "fact", "answer": "2,000 miles", "verdict": "answered_correct", "correct": true}
	{"id": "gh-24", "question": "What is the melting point of iron?", "answers": ["1538°C", "1538 °C", "1,538 degrees Celsius", "1,538°C", "2800°F", "1538", "1,538"], "kind": "fact", "answer": "1,538 degrees C", "verdict": "answered_correct", "correct": true}
	{"id": "gh-25", "question": "How far is the Moon from the Earth?", "answers": ["238,855 miles", "384,399 km", "384,400 km", "384000 km", "238,854 mi", "238,855", "384,399", "384,400"], "kind": "fact", "answer": "238,855 miles", "verdict": "answered_correct", "correct": true}
	{"id": "gh-26", "question": "What is the boiling point of water in Kelvin?", "answers": ["373.15 K", "373.15"], "kind": "fact", "answer": "100 °C", "verdict": "wrong", "correct": false}
	{"id": "gh-27", "question": "Who designed the Faisal Mosque?", "answers": ["Vedat Dalokay", "Vedat Delokay"], "kind": "fact", "answer": "Vedat Dalokay", "verdict": "answered_correct", "correct": true}
	{"id": "gh-28", "question": "What is the area of Pakistan in square kilometers?", "answers": ["881,913 km2", "881,913 square kilometers", "881,913", "796,100"], "kind": "fact", "answer": "881,913 km2", "verdict": "answered_correct", "correct": true}
	{"id": "gh-29", "question": "How many bones are in the adult human body?", "answers": ["206"], "kind": "fact", "answer": "206", "verdict": "answered_correct", "correct": true}
	{"id": "gh-30", "question": "What is the national language of Pakistan?", "answers": ["Urdu"], "kind": "fact", "answer": "Urdu", "verdict": "answered_correct", "correct": true}
	{"id": "gh-31", "question": "Who wrote the national anthem of Pakistan?", "answers": ["Hafeez Jalandhari", "Hafeez Jullundhri", "Abul Asar Hafeez Jullundhri"], "kind": "fact", "answer": "Hafeez Jalandhari", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-0", "question": "When did World War 2 end?", "answers": ["2 September 1945", "September 2, 1945", "1945", "May 8, 1945", "August 14, 1945"], "kind": "fact", "answer": "not found", "verdict": "missed", "correct": false}
	{"id": "ghb-1", "question": "What is the chemical symbol for gold?", "answers": ["Au"], "kind": "fact", "answer": "Au", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-2", "question": "How many players are on a cricket team?", "answers": ["11", "eleven"], "kind": "fact", "answer": "11 players", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-3", "question": "What is the currency of Japan?", "answers": ["Japanese yen", "yen", "JPY"], "kind": "fact", "answer": "Japanese yen", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-4", "question": "Who invented the telephone?", "answers": ["Alexander Graham Bell", "Graham Bell"], "kind": "fact", "answer": "Alexander Graham Bell", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-5", "question": "What is the largest ocean in the world?", "answers": ["Pacific Ocean", "Pacific"], "kind": "fact", "answer": "Pacific", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-6", "question": "What is the capital of Canada?", "answers": ["Ottawa"], "kind": "fact", "answer": "Ottawa", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-7", "question": "When was Google founded?", "answers": ["1998", "September 4, 1998", "September 1998"], "kind": "fact", "answer": "1998", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-8", "question": "What is the freezing point of water in Fahrenheit?", "answers": ["32 °F", "32°F", "32"], "kind": "fact", "answer": "0 °F", "verdict": "wrong", "correct": false}
	{"id": "ghb-9", "question": "How long is a marathon in kilometers?", "answers": ["42.195 kilometres", "42.195 km", "42.195", "42.2 kilometres", "42.2 km", "42.2"], "kind": "fact", "answer": "42.195km", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-10", "question": "Who was the first person to walk on the moon?", "answers": ["Neil Armstrong", "Armstrong"], "kind": "fact", "answer": "Neil Armstrong", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-11", "question": "In which year did Pakistan win the Cricket World Cup?", "answers": ["1992"], "kind": "fact", "answer": "1992", "verdict": "answered_correct", "correct": true}
	{"id": "ghb-12", "question": "Who won the men's 100m gold at the 2032 Olympics?", "answers": [], "kind": "none", "answer": "not found", "verdict": "trap_caught", "correct": true}
	{"id": "ghb-13", "question": "When did Pakistan land a person on the Moon?", "answers": [], "kind": "none", "answer": "not found", "verdict": "trap_caught", "correct": true}
	{"id": "ghb-15", "question": "In which year did the Eiffel Tower move to London?", "answers": [], "kind": "none", "answer": "1889", "verdict": "trap_fooled", "correct": false}
	{"id": "ghb-17", "question": "Who won the Nobel Prize in Cricket?", "answers": [], "kind": "none", "answer": "Samuel Beckett", "verdict": "trap_fooled", "correct": false}
	{"id": "ghb-19", "question": "What is the name of the first city built on Mars?", "answers": [], "kind": "none", "answer": "Cape Canaveral", "verdict": "trap_fooled", "correct": false}
	{"id": "ghb-20", "question": "When did Albert Einstein win an Oscar?", "answers": [], "kind": "none", "answer": "not found", "verdict": "trap_caught", "correct": true}
	{"id": "ghb-21", "question": "Who won the 2028 FIFA World Cup?", "answers": [], "kind": "none", "answer": "not found", "verdict": "trap_caught", "correct": true}
	{"id": "ghb-22", "question": "When did Lahore become the capital of India?", "answers": [], "kind": "none", "answer": "not found", "verdict": "trap_caught", "correct": true}
	{"id": "ghb-23", "question": "Who is the current emperor of Pakistan?", "answers": [], "kind": "none", "answer": "not found", "verdict": "trap_caught", "correct": true}