metadata
license: bsd-3-clause
tags:
- bilinear
- generation
- instancenorm
- linear
- mish
- mobilevit
- nano
- rmsprop
- step
- xavier-uniform
model.py
Model Overview
A nano-scale implementation of the mobilevit architecture, built for generation tasks.
Architecture
- Architecture: mobilevit
- Scale: nano
- Attention: linear
- Fusion strategy: bilinear
- Task head: generation
- Activation: mish
- Normalization: instancenorm
- Initialization: xavier uniform
Training
- Optimizer: rmsprop
- LR scheduler: step
Files
model.py— main artifact of this repository
License
See the license field above.