| license: apache-2.0 | |
| tags: | |
| - text-generation | |
| - pytorch | |
| - chronological | |
| - year-2015 | |
| # chronollm-2015 | |
| A 2B-parameter causal language model (PyTorch / safetensors), ChronoGPT-style GPT architecture. | |
| Source checkpoint: `jjjlimaus/chrono2014-finance2015-ft3`. | |
| ```json | |
| { | |
| "model_type": "gpt", | |
| "vocab_size": 50304, | |
| "num_layers": 52, | |
| "num_heads": 12, | |
| "model_dim": 1536, | |
| "torch_dtype": "bfloat16" | |
| } | |
| ``` | |