# Notes

- check whether the config round-trips through from_pretrained
- compare parameter counts against a reference implementation
- move constants into the config file
- document the expected input shapes