lc8k_135m_2026-10-24/armA_t1e5 step 300
Browse files- lc8k_135m_2026-10-24/armA_t1e5/step_300/blumodelcp_run1.meta +5 -0
- lc8k_135m_2026-10-24/armA_t1e5/step_300/rank_0__blumodelcp_run1_step_300.ckpt +3 -0
- lc8k_135m_2026-10-24/armA_t1e5/step_300/rank_0__blumodelcp_run1_step_300.zero_g1 +0 -0
- lc8k_135m_2026-10-24/armA_t1e5/step_300/rank_1__blumodelcp_run1_step_300.ckpt +3 -0
- lc8k_135m_2026-10-24/armA_t1e5/step_300/rank_1__blumodelcp_run1_step_300.zero_g1 +0 -0
lc8k_135m_2026-10-24/armA_t1e5/step_300/blumodelcp_run1.meta
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
rope_theta 100000
|
| 2 |
+
d_model 512
|
| 3 |
+
q_heads 4
|
| 4 |
+
kv_heads 2
|
| 5 |
+
head_dim 128
|
lc8k_135m_2026-10-24/armA_t1e5/step_300/rank_0__blumodelcp_run1_step_300.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5602294c79f39c29ddf68351869bec61db0940d4d74d421b299d1f797c0885a2
|
| 3 |
+
size 807359444
|
lc8k_135m_2026-10-24/armA_t1e5/step_300/rank_0__blumodelcp_run1_step_300.zero_g1
ADDED
|
Binary file (61.1 kB). View file
|
|
|
lc8k_135m_2026-10-24/armA_t1e5/step_300/rank_1__blumodelcp_run1_step_300.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d508d6de20a4be15aa3e5e9580e57a95b5aa2c9decb6b456d282fa975daff25d
|
| 3 |
+
size 805568094
|
lc8k_135m_2026-10-24/armA_t1e5/step_300/rank_1__blumodelcp_run1_step_300.zero_g1
ADDED
|
Binary file (57.9 kB). View file
|
|
|