Feyd89
/

BitBop-91M

BitBop-91M / config.json

Initial BiBoP release (private)

8149e21 verified 4 months ago

147 Bytes

{
 "variant": "bop",
 "d": 768,
 "layers": 12,
 "heads": 8,
 "window": 64,
 "n_full": 1,
 "vocab": 8192,
 "eot_id": 0,
 "tau": [
  2.0,
  2.75
 ]
}