Soilytix/LOAM-25M
Text Generation • 25.5M • Updated • 12
LOAM
LOAM: A family of genomic language models trained on long-read soil metagenomes
Note Smallest of 4. 5 layers, d_model 640, 25,483,520 params. Held-out 1.6288 bits/nt at 8,192-nt context.
Soilytix/LOAM-100M
Text Generation • 0.1B • Updated • 6Note Second smallest of 4. 8 layers, d_model 1024, 102,914,048 params. Held-out 1.5134 bits/nt at 8,192-nt context.
Soilytix/LOAM-340M
Text Generation • 0.3B • Updated • 6Note Second largest of 4. 12 layers, d_model 1536, 339,993,600 params. Held-out 1.4030 bits/nt at 8,192-nt context.
Soilytix/LOAM-624M
Text Generation • 0.6B • Updated • 5 • 2Note Largest of 4. 16 layers, d_model 1792, 624,229,120 params. Held-out 1.3463 bits/nt at 8,192-nt context.