build-small-hackathon
/

deku

Text Generation

knowledge-distillation

geometry-distillation

Model card Files Files and versions

208 MB

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

Kaiky Maia

Deku v3 — 6 teachers (+ Nemotron-Mini-4B), 5k steps

ca010c4 verified 4 months ago

.gitattributes

1.57 kB
Deku — Qwen2.5-0.5B LoRA + gating 4 months ago
README.md

3.74 kB
Deku v3 — 6 teachers (+ Nemotron-Mini-4B), 5k steps 4 months ago
adapter_config.json

1.11 kB
Deku v3 — 6 teachers (+ Nemotron-Mini-4B), 5k steps 4 months ago
adapter_model.safetensors

141 MB
xet

Deku v3 — 6 teachers (+ Nemotron-Mini-4B), 5k steps 4 months ago
added_tokens.json

605 Bytes
Deku — Qwen2.5-0.5B LoRA + gating 4 months ago
chat_template.jinja

2.51 kB
Deku — Qwen2.5-0.5B LoRA + gating 4 months ago
gating.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
23.4 kB
xet

Deku v3 — 6 teachers (+ Nemotron-Mini-4B), 5k steps 4 months ago
merges.txt

1.67 MB
Deku — Qwen2.5-0.5B LoRA + gating 4 months ago
projections.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
51.4 MB
xet

Deku v3 — 6 teachers (+ Nemotron-Mini-4B), 5k steps 4 months ago
special_tokens_map.json

613 Bytes
Deku — Qwen2.5-0.5B LoRA + gating 4 months ago
tokenizer.json

11.4 MB
xet

Deku — Qwen2.5-0.5B LoRA + gating 4 months ago
tokenizer_config.json

4.69 kB
Deku — Qwen2.5-0.5B LoRA + gating 4 months ago
vocab.json

2.78 MB
Deku — Qwen2.5-0.5B LoRA + gating 4 months ago