--- license: bsd-3-clause tags: - bilinear - generation - instancenorm - linear - mish - mobilevit - nano - rmsprop - step - xavier-uniform --- # model.py ## Model Overview A **nano**-scale implementation of the **mobilevit** architecture, built for **generation** tasks. ## Architecture - **Architecture**: mobilevit - **Scale**: nano - **Attention**: linear - **Fusion strategy**: bilinear - **Task head**: generation - **Activation**: mish - **Normalization**: instancenorm - **Initialization**: xavier uniform ## Training - **Optimizer**: rmsprop - **LR scheduler**: step ## Files - `model.py` — main artifact of this repository ## License See the license field above.