Text Generation
Transformers
ONNX
English
text-generation-inference
ArushBuilds commited on
Commit
63313eb
·
verified ·
1 Parent(s): 00106e1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -22,13 +22,13 @@ pipeline_tag: text-generation
22
 
23
  **Pragya Preview** is an experimental, lightweight language model fine-tuned on the [TinyStories](https://huggingface.co/datasets/roneneldan/TinyStories) dataset. Built as a proof-of-concept under strict compute limits (1-hour single T4 GPU run), it demonstrates rapid baseline convergence and efficient short-form narrative generation.
24
 
25
- - **Developer:** [Arush Kumar and Pragya's team]
26
- - **Model Type:** Causal Language Model (Decoder-only Transformer)
27
  - **Language:** English (`en`)
28
  - **Base Dataset:** `roneneldan/TinyStories`
29
  - **License:** Apache 2.0
30
  - **Primary Task:** Text Generation / Short Story Completion
31
-
32
  ---
33
 
34
  ## Intended Uses & Scope
 
22
 
23
  **Pragya Preview** is an experimental, lightweight language model fine-tuned on the [TinyStories](https://huggingface.co/datasets/roneneldan/TinyStories) dataset. Built as a proof-of-concept under strict compute limits (1-hour single T4 GPU run), it demonstrates rapid baseline convergence and efficient short-form narrative generation.
24
 
25
+ - **Developer:** Arush Kumar and Pragya's team
26
+ - **Model Type:** Causal Language Model using Grouped Query Attention(Decoder-only Transformer)
27
  - **Language:** English (`en`)
28
  - **Base Dataset:** `roneneldan/TinyStories`
29
  - **License:** Apache 2.0
30
  - **Primary Task:** Text Generation / Short Story Completion
31
+ - **Note**: Model is not Instruct tuned and is not trained completely
32
  ---
33
 
34
  ## Intended Uses & Scope