v8: Ollama / LM Studio read the request (language, type, topic) like the app; 4 Ollama recipes

Modelfile.poem-bn

@@ -0,0 +1,17 @@
+FROM ./tagoregpt-29m-f16.gguf
+TEMPLATE """<|bn|><|poem|><|tagore|>{{ .Prompt }}
+
+বিষয়: {{ .Prompt }}
+দৈর্ঘ্য: মাঝারি
+ছন্দ: মিল
+
+"""
+PARAMETER stop "</s>"
+PARAMETER stop "<|request|>"
+PARAMETER temperature 0.75
+PARAMETER top_k 40
+PARAMETER top_p 0.95
+PARAMETER min_p 0.02
+PARAMETER repeat_penalty 1.3
+PARAMETER repeat_last_n 256
+PARAMETER num_ctx 1024

Modelfile.poem-en

@@ -0,0 +1,17 @@
+FROM ./tagoregpt-29m-f16.gguf
+TEMPLATE """<|en|><|poem|><|tagore|>{{ .Prompt }}
+
+About: {{ .Prompt }}
+Length: medium
+Rhyme: yes
+
+"""
+PARAMETER stop "</s>"
+PARAMETER stop "<|request|>"
+PARAMETER temperature 0.75
+PARAMETER top_k 40
+PARAMETER top_p 0.95
+PARAMETER min_p 0.02
+PARAMETER repeat_penalty 1.3
+PARAMETER repeat_last_n 256
+PARAMETER num_ctx 1024

Modelfile.song-bn

@@ -0,0 +1,17 @@
+FROM ./tagoregpt-29m-f16.gguf
+TEMPLATE """<|bn|><|song|><|tagore|>{{ .Prompt }}
+
+বিষয়: {{ .Prompt }}
+দৈর্ঘ্য: ছোট
+ছন্দ: মিল
+
+"""
+PARAMETER stop "</s>"
+PARAMETER stop "<|request|>"
+PARAMETER temperature 0.7
+PARAMETER top_k 40
+PARAMETER top_p 0.95
+PARAMETER min_p 0.02
+PARAMETER repeat_penalty 1.3
+PARAMETER repeat_last_n 256
+PARAMETER num_ctx 1024

Modelfile → Modelfile.story-en

@@ -1,9 +1,16 @@
 FROM ./tagoregpt-29m-f16.gguf
-TEMPLATE """<|request|>{{ .Prompt }}<|response|>"""
-PARAMETER stop "<|request|>"
+TEMPLATE """<|en|><|story|><|tagore|>{{ .Prompt }}
+
+About: {{ .Prompt }}
+Length: medium
+
+"""
 PARAMETER stop "</s>"
+PARAMETER stop "<|request|>"
 PARAMETER temperature 0.8
 PARAMETER top_k 40
-PARAMETER repeat_penalty 1.15
+PARAMETER top_p 0.95
+PARAMETER min_p 0.02
+PARAMETER repeat_penalty 1.3
 PARAMETER repeat_last_n 256
 PARAMETER num_ctx 1024

README.md

@@ -16,21 +16,34 @@ Sir Rabindranath Tagore (Gurudev) was the first non-European to win the Nobel Pr
 
 ## How to ask
 
-Ask in plain words. The app/chat template wraps it as `<|request|>…<|response|>`:
+The model writes from **a topic + hidden labels** (language, type, length, rhyme); it does not read free-form requests.
+The chat template in the GGUF does that step for you, like the TagoreGPT app: it finds the language (Bengali letters or
+not), the type (poem / song / story / letter / essay / play / novel words) and the topic (the request minus
+"write a poem about ..."). Examples that work:
 
-- `write a poem about the river in Bengali`
-- `write a song about the rain`
-- `একটা কবিতা লেখো বৃষ্টি নিয়ে`
-- `write a letter to a friend in English`
+- `write a poem about the river` · `write a song about the rain` · `Write a story about a boatman`
+- `নদী নিয়ে একটা কবিতা লেখো` · `বৃষ্টি নিয়ে একটা গান লেখো`
 
-Settings that work well: temperature 0.8, top-k 40, **repeat penalty 1.15** (last 256 tokens), up to ~400 new tokens.
-Without a repeat penalty the model can loop (LM Studio: set "Repeat Penalty" to 1.15).
+Settings that work well (= the app): temperature 0.75 (poem) / 0.7 (song) / 0.8 (story), top-k 40, top-p 0.95,
+min-p 0.02, **repeat penalty 1.3** (last 256 tokens).
 
-### LM Studio / llama.cpp / Ollama
+### Ollama: type just the topic
 
-- File: `tagoregpt-29m-f16.gguf` (Llama layout, 58 MB).
-- llama.cpp: `llama-cli -m tagoregpt-29m-f16.gguf -cnv --temp 0.8 --top-k 40`
-- Ollama: `ollama create tagoregpt -f Modelfile` then `ollama run tagoregpt "write a poem about the river"`
+Four ready recipes, one per language + type:
+
+```
+ollama create tagoregpt-poem-en  -f Modelfile.poem-en    # then: ollama run tagoregpt-poem-en  "The River"
+ollama create tagoregpt-story-en -f Modelfile.story-en   #       ollama run tagoregpt-story-en "The old boatman"
+ollama create tagoregpt-poem-bn  -f Modelfile.poem-bn    #       ollama run tagoregpt-poem-bn  "নদী"
+ollama create tagoregpt-song-bn  -f Modelfile.song-bn    #       ollama run tagoregpt-song-bn  "বৃষ্টি"
+```
+
+### LM Studio / llama.cpp
+
+- File: `tagoregpt-29m-f16.gguf` (Llama layout, 85 MB). Its chat template reads the request as described above.
+- llama.cpp: `llama-cli -m tagoregpt-29m-f16.gguf -cnv --jinja --temp 0.75 --top-k 40 --repeat-penalty 1.3`
+- English is weaker than Bengali in this version; the TagoreGPT app adds topic guidance and line rules that plain
+  llama.cpp / Ollama / LM Studio do not have.
 
 ### Transformers
 

chat_template.jinja

@@ -1 +1 @@
-{% for message in messages %}{% if message['role'] == 'user' %}<|request|>{{ message['content'] }}<|response|>{% elif message['role'] == 'assistant' %}{{ message['content'] }}</s>{% endif %}{% endfor %}
+{%- set c = messages[-1]['content'] | trim -%}{%- set low = c | lower -%}{%- set t = c -%}{%- set t = t | replace('write a song about ', '') -%}{%- set t = t | replace('write a song on ', '') -%}{%- set t = t | replace('write a story about ', '') -%}{%- set t = t | replace('write a story on ', '') -%}{%- set t = t | replace('write a letter about ', '') -%}{%- set t = t | replace('write a letter on ', '') -%}{%- set t = t | replace('write a essay about ', '') -%}{%- set t = t | replace('write a essay on ', '') -%}{%- set t = t | replace('write a play about ', '') -%}{%- set t = t | replace('write a play on ', '') -%}{%- set t = t | replace('write a novel about ', '') -%}{%- set t = t | replace('write a novel on ', '') -%}{%- set t = t | replace('write a poem about ', '') -%}{%- set t = t | replace('write a poem on ', '') -%}{%- set t = t | replace('write an song about ', '') -%}{%- set t = t | replace('write an song on ', '') -%}{%- set t = t | replace('write an story about ', '') -%}{%- set t = t | replace('write an story on ', '') -%}{%- set t = t | replace('write an letter about ', '') -%}{%- set t = t | replace('write an letter on ', '') -%}{%- set t = t | replace('write an essay about ', '') -%}{%- set t = t | replace('write an essay on ', '') -%}{%- set t = t | replace('write an play about ', '') -%}{%- set t = t | replace('write an play on ', '') -%}{%- set t = t | replace('write an novel about ', '') -%}{%- set t = t | replace('write an novel on ', '') -%}{%- set t = t | replace('write an poem about ', '') -%}{%- set t = t | replace('write an poem on ', '') -%}{%- set t = t | replace('Write a song about ', '') -%}{%- set t = t | replace('Write a song on ', '') -%}{%- set t = t | replace('Write a story about ', '') -%}{%- set t = t | replace('Write a story on ', '') -%}{%- set t = t | replace('Write a letter about ', '') -%}{%- set t = t | replace('Write a letter on ', '') -%}{%- set t = t | replace('Write a essay about ', '') -%}{%- set t = t | replace('Write a essay on ', '') -%}{%- set t = t | replace('Write a play about ', '') -%}{%- set t = t | replace('Write a play on ', '') -%}{%- set t = t | replace('Write a novel about ', '') -%}{%- set t = t | replace('Write a novel on ', '') -%}{%- set t = t | replace('Write a poem about ', '') -%}{%- set t = t | replace('Write a poem on ', '') -%}{%- set t = t | replace('Write an song about ', '') -%}{%- set t = t | replace('Write an song on ', '') -%}{%- set t = t | replace('Write an story about ', '') -%}{%- set t = t | replace('Write an story on ', '') -%}{%- set t = t | replace('Write an letter about ', '') -%}{%- set t = t | replace('Write an letter on ', '') -%}{%- set t = t | replace('Write an essay about ', '') -%}{%- set t = t | replace('Write an essay on ', '') -%}{%- set t = t | replace('Write an play about ', '') -%}{%- set t = t | replace('Write an play on ', '') -%}{%- set t = t | replace('Write an novel about ', '') -%}{%- set t = t | replace('Write an novel on ', '') -%}{%- set t = t | replace('Write an poem about ', '') -%}{%- set t = t | replace('Write an poem on ', '') -%}{%- set t = t | replace(' নিয়ে একটা গান লেখো', '') -%}{%- set t = t | replace(' নিয়ে একটা গল্প লেখো', '') -%}{%- set t = t | replace(' নিয়ে একটা চিঠি লেখো', '') -%}{%- set t = t | replace(' নিয়ে একটা প্রবন্ধ লেখো', '') -%}{%- set t = t | replace(' নিয়ে একটা নাটক লেখো', '') -%}{%- set t = t | replace(' নিয়ে একটা উপন্যাস লেখো', '') -%}{%- set t = t | replace(' নিয়ে একটা কবিতা লেখো', '') -%}{%- set t = t | replace(' নিয়ে গান লেখো', '') -%}{%- set t = t | replace(' নিয়ে গল্প লেখো', '') -%}{%- set t = t | replace(' নিয়ে চিঠি লেখো', '') -%}{%- set t = t | replace(' নিয়ে প্রবন্ধ লেখো', '') -%}{%- set t = t | replace(' নিয়ে নাটক লেখো', '') -%}{%- set t = t | replace(' নিয়ে উপন্যাস লেখো', '') -%}{%- set t = t | replace(' নিয়ে কবিতা লেখো', '') -%}{%- if 'া' in c or 'ি' in c or 'ে' in c or 'ো' in c or 'র' in c or 'ক' in c or 'ন' in c or '্' in c -%}{%- if 'গান' in c -%}<|bn|><|song|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}বিষয়: {{ t }}{{ '\n' }}দৈর্ঘ্য: ছোট{{ '\n' }}ছন্দ: মিল{{ '\n' }}{{ '\n' }}{%- elif 'গল্প' in c -%}<|bn|><|story|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}বিষয়: {{ t }}{{ '\n' }}দৈর্ঘ্য: মাঝারি{{ '\n' }}{{ '\n' }}{%- elif 'চিঠি' in c -%}<|bn|><|letter|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}বিষয়: {{ t }}{{ '\n' }}দৈর্ঘ্য: মাঝারি{{ '\n' }}{{ '\n' }}{%- elif 'প্রবন্ধ' in c -%}<|bn|><|essay|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}বিষয়: {{ t }}{{ '\n' }}দৈর্ঘ্য: মাঝারি{{ '\n' }}{{ '\n' }}{%- elif 'নাটক' in c -%}<|bn|><|play|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}বিষয়: {{ t }}{{ '\n' }}দৈর্ঘ্য: মাঝারি{{ '\n' }}{{ '\n' }}{%- elif 'উপন্যাস' in c -%}<|bn|><|novel|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}বিষয়: {{ t }}{{ '\n' }}দৈর্ঘ্য: মাঝারি{{ '\n' }}{{ '\n' }}{%- elif true -%}<|bn|><|poem|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}বিষয়: {{ t }}{{ '\n' }}দৈর্ঘ্য: মাঝারি{{ '\n' }}ছন্দ: মিল{{ '\n' }}{{ '\n' }}{%- endif -%}{%- else -%}{%- if 'song' in low -%}<|en|><|song|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}About: {{ t }}{{ '\n' }}Length: short{{ '\n' }}Rhyme: yes{{ '\n' }}{{ '\n' }}{%- elif 'story' in low -%}<|en|><|story|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}About: {{ t }}{{ '\n' }}Length: medium{{ '\n' }}{{ '\n' }}{%- elif 'letter' in low -%}<|en|><|letter|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}About: {{ t }}{{ '\n' }}Length: medium{{ '\n' }}{{ '\n' }}{%- elif 'essay' in low -%}<|en|><|essay|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}About: {{ t }}{{ '\n' }}Length: medium{{ '\n' }}{{ '\n' }}{%- elif 'play' in low -%}<|en|><|play|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}About: {{ t }}{{ '\n' }}Length: medium{{ '\n' }}{{ '\n' }}{%- elif 'novel' in low -%}<|en|><|novel|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}About: {{ t }}{{ '\n' }}Length: medium{{ '\n' }}{{ '\n' }}{%- elif true -%}<|en|><|poem|><|tagore|>{{ t }}{{ '\n' }}{{ '\n' }}About: {{ t }}{{ '\n' }}Length: medium{{ '\n' }}Rhyme: yes{{ '\n' }}{{ '\n' }}{%- endif -%}{%- endif -%}

tagoregpt-29m-f16.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:33f3d410f102534624a316fc97fb5966941caba1295e6d7955c756e78c141c78
-size 85127584
+oid sha256:65f10abb4706655586d8d72ff5b1f4ca5b69b434fc86196e14a0cee72b8879f5
+size 85134144