Nicholas0228
/

tail-drop-5b-dense

trained-from-scratch

Model card Files Files and versions

tail-drop-5b-dense / research_code /pretraining_mamba2_outer

41.3 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

Nicholas0228's picture

Release verified completed 5B weights, tokenizer and inference loader

4b47956 verified 26 days ago

Dockerfile

2.39 kB
Release verified completed 5B weights, tokenizer and inference loader 26 days ago
__init__.py

71 Bytes
Release verified completed 5B weights, tokenizer and inference loader 26 days ago
deterministic_backward.py

5.97 kB
Release verified completed 5B weights, tokenizer and inference loader 26 days ago
layers.py

9.5 kB
Release verified completed 5B weights, tokenizer and inference loader 26 days ago
native_initialization.py

3.22 kB
Release verified completed 5B weights, tokenizer and inference loader 26 days ago
native_initialization_seed1.json

17.4 kB
Release verified completed 5B weights, tokenizer and inference loader 26 days ago
spec.py

2.76 kB
Release verified completed 5B weights, tokenizer and inference loader 26 days ago