timm documentation

RegNet

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

RegNet

Category: CNN · Code: timm/models/regnet.py · Architectures: 36 · Pretrained weights: 65 (60 with ImageNet-1k results)

RegNetX and RegNetY networks from the regular network design spaces, RegNetZ from “Fast and Accurate Model Scaling”, and timm additions such as the pre-activation RegNetV. Includes weights from pycls, torchvision and VISSL (SEER).

Papers

Usage

See the Quickstart for loading pretrained weights, image preprocessing and fine-tuning, and Feature Extraction for using the models as backbones.

>>> import timm
>>> model = timm.create_model('regnetx_064.pycls_in1k', pretrained=True)
>>> data_config = timm.data.resolve_model_data_config(model)

Model API support

FeatureRegNet
features_only=True feature maps✓ (strides 2, 4, 8, 16, 32)
forward_intermediates()✓
prune_intermediate_layers()✓
Any input size, no changes needed✓
set_input_size()–
dynamic_img_size=True–
set_grad_checkpointing()✓
Layer-wise LR decay (group_matcher())✓
reset_classifier()✓

✓ supported, ✓ (square) works for square sizes only, ✗ not supported, – not needed (the model already accepts any input size). Checked by running each feature on a randomly initialized model (RegNet with regnetx_002 at 224), other architectures of the same class are expected to behave the same. See the Model API page for details.

Architectures

ArchitectureParams (M)GMACsInput sizePretrained weights
regnetv_04020.644.002241
regnetv_06430.586.392241
regnetx_0022.680.202241
regnetx_0045.160.402241
regnetx_004_tv5.500.422241
regnetx_0066.200.612241
regnetx_0087.260.812242
regnetx_0169.191.622242
regnetx_03215.303.202242
regnetx_04022.123.992241
regnetx_06426.216.492241
regnetx_08039.578.022242
regnetx_12046.1112.132241
regnetx_16054.2815.992242
regnetx_320107.8131.812242
regnety_0023.160.202241
regnety_0044.340.412242
regnety_0066.060.612241
regnety_0086.260.812241
regnety_008_tv6.430.842241
regnety_01611.201.632242
regnety_03219.443.202243
regnety_04020.654.002242
regnety_040_sgn20.654.032240
regnety_06430.586.392242
regnety_08039.188.002242
regnety_080_tv39.388.512241
regnety_12051.8212.142243
regnety_16083.5915.962248
regnety_320145.0532.342246
regnety_640281.38188.473842
regnety_1280644.81374.993844
regnety_25601282.60747.833841
regnetz_0057.120.522240
regnetz_04027.124.062561
regnetz_040_h28.944.122561

GMACs and parameter counts are for the default input size and classifier of each architecture, from the benchmark results.

Pretrained weights

Top-1 is ImageNet-1k validation accuracy from results-imagenet.csv at the listed eval size, - if the weight has no ImageNet-1k result (e.g. pretraining or image-text weights). Classes is the size of the pretrained classifier, none for weights without one.

Weights are grouped by source: the paper or origin given in the pretrained config, else a Hub organization other than timm, else the first part of the pretrained tag (architecture.tag). Sources with a single weight are listed under other.

facebookresearch/pycls

Origin: github.com/facebookresearch/pycls

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnetx_002.pycls_in1k22468.7582241000mittimm
regnetx_004.pycls_in1k22472.4822241000mittimm
regnetx_006.pycls_in1k22473.9042241000mittimm
regnetx_008.pycls_in1k22475.0542241000mittimm
regnetx_016.pycls_in1k22476.9362241000mittimm
regnetx_032.pycls_in1k22478.1602241000mittimm
regnetx_040.pycls_in1k22478.4862241000mittimm
regnetx_064.pycls_in1k22479.0622241000mittimm
regnetx_080.pycls_in1k22479.2142241000mittimm
regnetx_120.pycls_in1k22479.6082241000mittimm
regnetx_160.pycls_in1k22479.8442241000mittimm
regnetx_320.pycls_in1k22480.2582241000mittimm
regnety_002.pycls_in1k22470.2882241000mittimm
regnety_004.pycls_in1k22474.0042241000mittimm
regnety_006.pycls_in1k22475.2742241000mittimm
regnety_008.pycls_in1k22476.3342241000mittimm
regnety_016.pycls_in1k22477.8802241000mittimm
regnety_032.pycls_in1k22478.9022241000mittimm
regnety_040.pycls_in1k22479.2462241000mittimm
regnety_064.pycls_in1k22479.7342241000mittimm
regnety_080.pycls_in1k22479.8742241000mittimm
regnety_120.pycls_in1k22480.3822241000mittimm
regnety_160.pycls_in1k22480.2842241000mittimm
regnety_320.pycls_in1k22480.7962241000mittimm

pytorch/vision

Origin: github.com/pytorch/vision

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnetx_004_tv.tv2_in1k22474.5962241000bsd-3-clausetimm
regnetx_008.tv2_in1k22477.2942241000bsd-3-clausetimm
regnetx_016.tv2_in1k22479.4402241000bsd-3-clausetimm
regnetx_032.tv2_in1k22480.9162241000bsd-3-clausetimm
regnetx_080.tv2_in1k22481.5522241000bsd-3-clausetimm
regnetx_160.tv2_in1k22482.5742241000bsd-3-clausetimm
regnetx_320.tv2_in1k22482.8242241000bsd-3-clausetimm
regnety_004.tv2_in1k22475.5942241000bsd-3-clausetimm
regnety_008_tv.tv2_in1k22478.6722241000bsd-3-clausetimm
regnety_016.tv2_in1k22480.6682241000bsd-3-clausetimm
regnety_032.tv2_in1k22481.7882241000bsd-3-clausetimm
regnety_080_tv.tv2_in1k22482.5802241000bsd-3-clausetimm
regnety_160.swag_ft_in1k38486.0203841000cc-by-nc-4.0timm
regnety_160.swag_lc_in1k22483.8062241000cc-by-nc-4.0timm
regnety_160.tv2_in1k22482.6462241000bsd-3-clausetimm
regnety_320.swag_ft_in1k38486.8303841000cc-by-nc-4.0timm
regnety_320.swag_lc_in1k22484.6542241000cc-by-nc-4.0timm
regnety_320.tv2_in1k22483.1702241000bsd-3-clausetimm
regnety_1280.swag_ft_in1k38488.2283841000cc-by-nc-4.0timm
regnety_1280.swag_lc_in1k22485.9642241000cc-by-nc-4.0timm

ra3 tags

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnetv_040.ra3_in1k224 (test 288)83.2042881000apache-2.0timm
regnetv_064.ra3_in1k224 (test 288)83.7462881000apache-2.0timm
regnety_040.ra3_in1k224 (test 288)83.0482881000apache-2.0timm
regnety_064.ra3_in1k224 (test 288)83.7162881000apache-2.0timm
regnety_080.ra3_in1k224 (test 288)83.9402881000apache-2.0timm
regnetz_040.ra3_in1k256 (test 320)84.2423201000apache-2.0timm
regnetz_040_h.ra3_in1k256 (test 320)84.4983201000apache-2.0timm

facebookresearch/vissl

Origin: github.com/facebookresearch/vissl

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnety_320.seer224--noneseer-licensetimm
regnety_320.seer_ft_in1k38483.3243841000seer-licensetimm
regnety_640.seer224--noneseer-licensetimm
regnety_640.seer_ft_in1k38483.9243841000seer-licensetimm
regnety_1280.seer224--noneseer-licensetimm
regnety_1280.seer_ft_in1k38484.4263841000seer-licensetimm
regnety_2560.seer_ft_in1k38485.1443841000seer-licensetimm

sw tags

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnety_120.sw_in12k224 (test 288)--11821apache-2.0timm
regnety_120.sw_in12k_ft_in1k224 (test 288)85.4282881000apache-2.0timm
regnety_160.sw_in12k224 (test 288)--11821apache-2.0timm
regnety_160.sw_in12k_ft_in1k224 (test 288)86.0282881000apache-2.0timm

Other

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnety_032.ra_in1k224 (test 288)82.7242881000apache-2.0timm
regnety_160.deit_in1k224 (test 288)83.7042881000apache-2.0timm
regnety_160.lion_in12k_ft_in1k224 (test 288)86.0042881000apache-2.0timm
Update on GitHub