timm documentation

FasterNet

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

FasterNet

Category: Efficient/Mobile · Code: timm/models/fasternet.py · Architectures: 6 · Pretrained weights: 6 (6 with ImageNet-1k results)

FasterNet is built around partial convolution (PConv), which convolves only a part of the input channels to reduce redundant computation and memory access.

Papers

Usage

See the Quickstart for loading pretrained weights, image preprocessing and fine-tuning, and Feature Extraction for using the models as backbones.

>>> import timm
>>> model = timm.create_model('fasternet_s.in1k', pretrained=True)
>>> data_config = timm.data.resolve_model_data_config(model)

Model API support

FeatureFasterNet
features_only=True feature maps✓ (strides 4, 8, 16, 32)
forward_intermediates()✓
prune_intermediate_layers()✓
Any input size, no changes needed✓
set_input_size()–
dynamic_img_size=True–
set_grad_checkpointing()✓
Layer-wise LR decay (group_matcher())✓
reset_classifier()✓

✓ supported, ✓ (square) works for square sizes only, ✗ not supported, – not needed (the model already accepts any input size). Checked by running each feature on a randomly initialized model (FasterNet with fasternet_t0 at 224), other architectures of the same class are expected to behave the same. See the Model API page for details.

Architectures

ArchitectureParams (M)GMACsInput sizePretrained weights
fasternet_l93.4715.522241
fasternet_m53.528.742241
fasternet_s31.184.562241
fasternet_t03.910.342241
fasternet_t17.600.852241
fasternet_t214.981.912241

GMACs and parameter counts are for the default input size and classifier of each architecture, from the benchmark results.

Pretrained weights

Top-1 is ImageNet-1k validation accuracy from results-imagenet.csv at the listed eval size, - if the weight has no ImageNet-1k result (e.g. pretraining or image-text weights). Classes is the size of the pretrained classifier, none for weights without one.

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
fasternet_l.in1k22483.5162241000apache-2.0timm
fasternet_m.in1k22482.8482241000apache-2.0timm
fasternet_s.in1k22481.3282241000apache-2.0timm
fasternet_t0.in1k22471.7322241000apache-2.0timm
fasternet_t1.in1k22475.9222241000apache-2.0timm
fasternet_t2.in1k22478.7382241000apache-2.0timm

Citation

@article{chen2023run,
  title={Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks},
  author={Chen, Jierun and Kao, Shiu-hong and He, Hao and Zhuo, Weipeng and Wen, Song and Lee, Chul-Ho and Chan, S-H Gary},
  journal={arXiv preprint arXiv:2303.03667},
  year={2023}
}
Update on GitHub