Initialise Pran: frozen copy of Agron @ a311e94 (no training applied)

README.md

@@ -0,0 +1,64 @@
+---
+language:
+- en
+license: mit
+tags:
+- llama
+- pran
+- frozen-fork
+- base-model
+- text-generation
+pipeline_tag: text-generation
+---
+
+# Pran
+
+**Pran** is a frozen sibling copy of [`teddyoas/Agron`](https://huggingface.co/teddyoas/Agron),
+created from Agron commit [`a311e94`](https://huggingface.co/teddyoas/Agron/commit/a311e94867629620de8d0a45136acb5d0ba91755)
+(2026-10-22).
+
+Pran is intentionally **left alone**: it is not trained, fine-tuned, or modified in
+this iteration. Its weights are bit-for-bit the published Agron weights at that
+commit, and it exists so a second, independent pretraining run can start from the
+same base without touching Agron.
+
+## Model details
+
+| Property | Value |
+|---|---|
+| Architecture | `LlamaForCausalLM` |
+| Parameters | ~50.3M |
+| Hidden size | 512 |
+| Layers | 8 |
+| Attention heads | 4 (4 KV heads) |
+| Intermediate size | 2048 |
+| Context length | 512 |
+| Vocab size | 16384 |
+| Precision | fp32 |
+| Tokenizer | `PreTrainedTokenizerFast` (same as Agron) |
+
+The config, tokenizer and `model.safetensors` are exact copies of Agron at the
+commit above.
+
+## Status
+
+- **Training: none.** Pran has no additional training steps applied.
+- Agron, by contrast, is being continued-pretrained on programming languages and
+  cybersecurity in the same iteration.
+- Pran is reserved for a separate, later pretraining objective.
+
+## Usage
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+tok = AutoTokenizer.from_pretrained("teddyoas/Pran")
+model = AutoModelForCausalLM.from_pretrained("teddyoas/Pran")
+```
+
+Pran is a small experimental base model. It is not instruction tuned and will
+produce raw, often incoherent continuations.
+
+## License
+
+MIT, inherited from Agron.

config.json

@@ -0,0 +1,32 @@
+{
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 0,
+  "dtype": "float32",
+  "eos_token_id": 2,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 512,
+  "initializer_range": 0.02,
+  "intermediate_size": 2048,
+  "max_position_embeddings": 512,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 4,
+  "num_hidden_layers": 8,
+  "num_key_value_heads": 4,
+  "pad_token_id": 1,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-06,
+  "rope_parameters": {
+    "rope_theta": 10000.0,
+    "rope_type": "default"
+  },
+  "tie_word_embeddings": false,
+  "transformers_version": "5.18.0",
+  "use_cache": false,
+  "vocab_size": 16384
+}

generation_config.json

@@ -0,0 +1,10 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "eos_token_id": 2,
+  "output_attentions": false,
+  "output_hidden_states": false,
+  "pad_token_id": 1,
+  "transformers_version": "5.18.0",
+  "use_cache": true
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8869d225040c3c9233c181fd6c428ce855733696c0e74c1290415705a4d7fbfa
+size 201369648

tokenizer_config.json

@@ -0,0 +1,14 @@
+{
+  "backend": "tokenizers",
+  "bos_token": "<s>",
+  "eos_token": "</s>",
+  "mask_token": "<mask>",
+  "max_length": 512,
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "stride": 0,
+  "tokenizer_class": "TokenizersBackend",
+  "truncation_side": "right",
+  "truncation_strategy": "longest_first",
+  "unk_token": "<unk>"
+}