TightX commited on
Commit
5588b1f
·
verified ·
1 Parent(s): 32e9d3c

fix links: GitHub URL + base/sft cross-links

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -15,11 +15,11 @@ library_name: pytorch
15
  A 435M-parameter decoder-only Transformer for Python code completion. Data pipeline, tokenizer,
16
  architecture, training loop, checkpoint merging and evaluation were all written and run by one person
17
  on one consumer GPU — this repository holds the weights; the code, design record, ablation report and
18
- failure log live in the GitHub repository linked below.
19
 
20
  > **This folder is the pretrained base.** Its weights are the *merged* (weight-averaged) product of the
21
  > pretraining run: under this training scheme the merged checkpoint, not the last step, is the finished
22
- > pretrained model — hence the folder name. The instruction-tuned variant is in [`../sft`](../sft).
23
 
24
  ## Architecture
25
 
@@ -101,4 +101,4 @@ reproduce patterns (and licensing quirks) from the training corpus despite copyr
101
 
102
  Everything else — `DESIGN.md` (decisions and why), `CHALLENGES.md` (every bug and contaminant),
103
  the ablation report, the fine-tuning log with corrections, and every evaluated generation — is in the
104
- GitHub repository. MIT licensed.
 
15
  A 435M-parameter decoder-only Transformer for Python code completion. Data pipeline, tokenizer,
16
  architecture, training loop, checkpoint merging and evaluation were all written and run by one person
17
  on one consumer GPU — this repository holds the weights; the code, design record, ablation report and
18
+ failure log live in the GitHub repository at https://github.com/TightXu/Simple_Code_LLM.
19
 
20
  > **This folder is the pretrained base.** Its weights are the *merged* (weight-averaged) product of the
21
  > pretraining run: under this training scheme the merged checkpoint, not the last step, is the finished
22
+ > pretrained model — hence the folder name. The instruction-tuned variant is in [`TightX/code-llm-435m-sft`](https://huggingface.co/TightX/code-llm-435m-sft).
23
 
24
  ## Architecture
25
 
 
101
 
102
  Everything else — `DESIGN.md` (decisions and why), `CHALLENGES.md` (every bug and contaminant),
103
  the ablation report, the fine-tuning log with corrections, and every evaluated generation — is in the
104
+ GitHub repository at https://github.com/TightXu/Simple_Code_LLM. MIT licensed.