ordlibrary commited on
Commit
b57f85a
·
verified ·
1 Parent(s): 151b22d

Add model card

Browse files
Files changed (1) hide show
  1. README.md +72 -0
README.md ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: transformers
4
+ tags:
5
+ - gpt2
6
+ - solana
7
+ - clawd
8
+ - code
9
+ - text-generation
10
+ language:
11
+ - en
12
+ pipeline_tag: text-generation
13
+ ---
14
+
15
+ # deepsol-clawd-code
16
+
17
+ Merged GPT-2 checkpoint from the Solana Clawd AI training stack (`deepsol-clawd-code-merged`).
18
+
19
+ ## Model details
20
+
21
+ | | |
22
+ |---|---|
23
+ | Architecture | `GPT2LMHeadModel` |
24
+ | Layers | 12 |
25
+ | Hidden size | 768 |
26
+ | Heads | 12 |
27
+ | Context | 1024 |
28
+ | Vocab | 50257 (GPT-2 tokenizer) |
29
+ | Weights dtype | float16 (`model.safetensors`) |
30
+ | Size | ~237 MB |
31
+
32
+ ## Files
33
+
34
+ - `model.safetensors` — merged weights
35
+ - `config.json` / `generation_config.json`
36
+ - `tokenizer.json` / `tokenizer_config.json`
37
+
38
+ ## Quick start
39
+
40
+ ```python
41
+ from transformers import AutoModelForCausalLM, AutoTokenizer
42
+
43
+ repo = "ordlibrary/deepsol-clawd-code"
44
+ tok = AutoTokenizer.from_pretrained(repo)
45
+ model = AutoModelForCausalLM.from_pretrained(repo)
46
+
47
+ prompt = "def transfer_sol("
48
+ inputs = tok(prompt, return_tensors="pt")
49
+ out = model.generate(**inputs, max_new_tokens=64)
50
+ print(tok.decode(out[0], skip_special_tokens=True))
51
+ ```
52
+
53
+ ## Intended use
54
+
55
+ Research / experimentation around Solana-oriented code and tooling assistants in the Clawd training pipeline. This is a small GPT-2-scale model, not a production 7B+ coder.
56
+
57
+ ## Limitations
58
+
59
+ - Small capacity vs modern LLMs; expect weak long-context and complex reasoning.
60
+ - Training data and merge recipe are project-internal; evaluate before any production use.
61
+ - Do not rely on it for financial advice or unsigned transaction construction without human review.
62
+
63
+ ## Citation
64
+
65
+ ```bibtex
66
+ @misc{deepsol-clawd-code,
67
+ title = {deepsol-clawd-code},
68
+ author = {ordlibrary},
69
+ year = {2026},
70
+ howpublished = {\url{https://huggingface.co/ordlibrary/deepsol-clawd-code}}
71
+ }
72
+ ```