timm documentation

FasterNet

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v1.0.30).
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

FasterNet

Category: Efficient/Mobile · Code: timm/models/fasternet.py · Architectures: 6 · Pretrained weights: 6 (6 with ImageNet-1k results)

FasterNet is built around partial convolution (PConv), which convolves only a part of the input channels to reduce redundant computation and memory access.

Papers

Usage

See the Quickstart for loading pretrained weights, image preprocessing and fine-tuning, and Feature Extraction for using the models as backbones.

>>> import timm
>>> model = timm.create_model('fasternet_s.in1k', pretrained=True)
>>> data_config = timm.data.resolve_model_data_config(model)

Model API support

FeatureFasterNet
features_only=True feature maps✓ (strides 4, 8, 16, 32)
forward_intermediates()✓
prune_intermediate_layers()✓
Any input size, no changes needed✓
set_input_size()–
dynamic_img_size=True–
set_grad_checkpointing()✓
Layer-wise LR decay (group_matcher())✓
reset_classifier()✓

✓ supported, ✓ (square) works for square sizes only, ✗ not supported, – not needed (the model already accepts any input size). Checked by running each feature on a randomly initialized model (FasterNet with fasternet_t0 at 224), other architectures of the same class are expected to behave the same. See the Model API page for details.

Architectures

ArchitectureParams (M)GMACsInput sizePretrained weights
fasternet_l93.4715.522241
fasternet_m53.528.742241
fasternet_s31.184.562241
fasternet_t03.910.342241
fasternet_t17.600.852241
fasternet_t214.981.912241

GMACs and parameter counts are for the default input size and classifier of each architecture, from the benchmark results.

Pretrained weights

Top-1 is ImageNet-1k validation accuracy from results-imagenet.csv at the listed eval size, - if the weight has no ImageNet-1k result (e.g. pretraining or image-text weights). Classes is the size of the pretrained classifier, none for weights without one.

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
fasternet_l.in1k22483.5162241000apache-2.0timm
fasternet_m.in1k22482.8482241000apache-2.0timm
fasternet_s.in1k22481.3282241000apache-2.0timm
fasternet_t0.in1k22471.7322241000apache-2.0timm
fasternet_t1.in1k22475.9222241000apache-2.0timm
fasternet_t2.in1k22478.7382241000apache-2.0timm

Citation

@article{chen2023run,
  title={Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks},
  author={Chen, Jierun and Kao, Shiu-hong and He, Hao and Zhuo, Weipeng and Wen, Song and Lee, Chul-Ho and Chan, S-H Gary},
  journal={arXiv preprint arXiv:2303.03667},
  year={2023}
}
Update on GitHub