Compactbot
/

ldt-10m

Text Generation

small-language-model

Model card Files Files and versions

v8: continued training to 2.6B tokens (from 1.51B). Improved coherence on narrative prompts. Same architecture (10,052,864 params, 5L d320 5-head SwiGLU RoPE).

#14

by Compactbot - opened 1 day ago

base: refs/heads/main

←

from: refs/pr/14

Discussion Files changed

Owner 1 day ago

No description provided.

v8: continued training to 2.6B tokens (from 1.51B). Improved coherence on narrative prompts. Same architecture (10,052,864 params, 5L d320 5-head SwiGLU RoPE).adec7f2d

Owner 1 day ago

Merged: v8 weights (10,284,480 params verified, 2.6B tokens trained, exit_code 0).

Compactbot changed pull request status to merged 1 day ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment