sarathi-balakrishnan commited on
Commit
d7fe6de
·
verified ·
1 Parent(s): 8fde2c1

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -15,6 +15,9 @@ library_name: pytorch
15
 
16
  # Tiny SQL GPT
17
 
 
 
 
18
  **A 841,216-parameter decoder-only transformer, trained from random weights on a laptop CPU in
19
  five minutes. 100% of the SQL it generates executes against a real database.**
20
 
 
15
 
16
  # Tiny SQL GPT
17
 
18
+ > **The goal:** build a language model from scratch, end to end, small enough to understand every
19
+ > part of it, and in doing so understand how the large ones actually work.
20
+
21
  **A 841,216-parameter decoder-only transformer, trained from random weights on a laptop CPU in
22
  five minutes. 100% of the SQL it generates executes against a real database.**
23