timm documentation

RegNet

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v1.0.30).
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

RegNet

Category: CNN · Code: timm/models/regnet.py · Architectures: 36 · Pretrained weights: 65 (60 with ImageNet-1k results)

RegNetX and RegNetY networks from the regular network design spaces, RegNetZ from “Fast and Accurate Model Scaling”, and timm additions such as the pre-activation RegNetV. Includes weights from pycls, torchvision and VISSL (SEER).

Papers

Usage

See the Quickstart for loading pretrained weights, image preprocessing and fine-tuning, and Feature Extraction for using the models as backbones.

>>> import timm
>>> model = timm.create_model('regnetx_064.pycls_in1k', pretrained=True)
>>> data_config = timm.data.resolve_model_data_config(model)

Model API support

FeatureRegNet
features_only=True feature maps✓ (strides 2, 4, 8, 16, 32)
forward_intermediates()✓
prune_intermediate_layers()✓
Any input size, no changes needed✓
set_input_size()–
dynamic_img_size=True–
set_grad_checkpointing()✓
Layer-wise LR decay (group_matcher())✓
reset_classifier()✓

✓ supported, ✓ (square) works for square sizes only, ✗ not supported, – not needed (the model already accepts any input size). Checked by running each feature on a randomly initialized model (RegNet with regnetx_002 at 224), other architectures of the same class are expected to behave the same. See the Model API page for details.

Architectures

ArchitectureParams (M)GMACsInput sizePretrained weights
regnetv_04020.644.002241
regnetv_06430.586.392241
regnetx_0022.680.202241
regnetx_0045.160.402241
regnetx_004_tv5.500.422241
regnetx_0066.200.612241
regnetx_0087.260.812242
regnetx_0169.191.622242
regnetx_03215.303.202242
regnetx_04022.123.992241
regnetx_06426.216.492241
regnetx_08039.578.022242
regnetx_12046.1112.132241
regnetx_16054.2815.992242
regnetx_320107.8131.812242
regnety_0023.160.202241
regnety_0044.340.412242
regnety_0066.060.612241
regnety_0086.260.812241
regnety_008_tv6.430.842241
regnety_01611.201.632242
regnety_03219.443.202243
regnety_04020.654.002242
regnety_040_sgn20.654.032240
regnety_06430.586.392242
regnety_08039.188.002242
regnety_080_tv39.388.512241
regnety_12051.8212.142243
regnety_16083.5915.962248
regnety_320145.0532.342246
regnety_640281.38188.473842
regnety_1280644.81374.993844
regnety_25601282.60747.833841
regnetz_0057.120.522240
regnetz_04027.124.062561
regnetz_040_h28.944.122561

GMACs and parameter counts are for the default input size and classifier of each architecture, from the benchmark results.

Pretrained weights

Top-1 is ImageNet-1k validation accuracy from results-imagenet.csv at the listed eval size, - if the weight has no ImageNet-1k result (e.g. pretraining or image-text weights). Classes is the size of the pretrained classifier, none for weights without one.

Weights are grouped by source: the paper or origin given in the pretrained config, else a Hub organization other than timm, else the first part of the pretrained tag (architecture.tag). Sources with a single weight are listed under other.

facebookresearch/pycls

Origin: github.com/facebookresearch/pycls

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnetx_002.pycls_in1k22468.7582241000mittimm
regnetx_004.pycls_in1k22472.4822241000mittimm
regnetx_006.pycls_in1k22473.9042241000mittimm
regnetx_008.pycls_in1k22475.0542241000mittimm
regnetx_016.pycls_in1k22476.9362241000mittimm
regnetx_032.pycls_in1k22478.1602241000mittimm
regnetx_040.pycls_in1k22478.4862241000mittimm
regnetx_064.pycls_in1k22479.0622241000mittimm
regnetx_080.pycls_in1k22479.2142241000mittimm
regnetx_120.pycls_in1k22479.6082241000mittimm
regnetx_160.pycls_in1k22479.8442241000mittimm
regnetx_320.pycls_in1k22480.2582241000mittimm
regnety_002.pycls_in1k22470.2882241000mittimm
regnety_004.pycls_in1k22474.0042241000mittimm
regnety_006.pycls_in1k22475.2742241000mittimm
regnety_008.pycls_in1k22476.3342241000mittimm
regnety_016.pycls_in1k22477.8802241000mittimm
regnety_032.pycls_in1k22478.9022241000mittimm
regnety_040.pycls_in1k22479.2462241000mittimm
regnety_064.pycls_in1k22479.7342241000mittimm
regnety_080.pycls_in1k22479.8742241000mittimm
regnety_120.pycls_in1k22480.3822241000mittimm
regnety_160.pycls_in1k22480.2842241000mittimm
regnety_320.pycls_in1k22480.7962241000mittimm

pytorch/vision

Origin: github.com/pytorch/vision

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnetx_004_tv.tv2_in1k22474.5962241000bsd-3-clausetimm
regnetx_008.tv2_in1k22477.2942241000bsd-3-clausetimm
regnetx_016.tv2_in1k22479.4402241000bsd-3-clausetimm
regnetx_032.tv2_in1k22480.9162241000bsd-3-clausetimm
regnetx_080.tv2_in1k22481.5522241000bsd-3-clausetimm
regnetx_160.tv2_in1k22482.5742241000bsd-3-clausetimm
regnetx_320.tv2_in1k22482.8242241000bsd-3-clausetimm
regnety_004.tv2_in1k22475.5942241000bsd-3-clausetimm
regnety_008_tv.tv2_in1k22478.6722241000bsd-3-clausetimm
regnety_016.tv2_in1k22480.6682241000bsd-3-clausetimm
regnety_032.tv2_in1k22481.7882241000bsd-3-clausetimm
regnety_080_tv.tv2_in1k22482.5802241000bsd-3-clausetimm
regnety_160.swag_ft_in1k38486.0203841000cc-by-nc-4.0timm
regnety_160.swag_lc_in1k22483.8062241000cc-by-nc-4.0timm
regnety_160.tv2_in1k22482.6462241000bsd-3-clausetimm
regnety_320.swag_ft_in1k38486.8303841000cc-by-nc-4.0timm
regnety_320.swag_lc_in1k22484.6542241000cc-by-nc-4.0timm
regnety_320.tv2_in1k22483.1702241000bsd-3-clausetimm
regnety_1280.swag_ft_in1k38488.2283841000cc-by-nc-4.0timm
regnety_1280.swag_lc_in1k22485.9642241000cc-by-nc-4.0timm

ra3 tags

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnetv_040.ra3_in1k224 (test 288)83.2042881000apache-2.0timm
regnetv_064.ra3_in1k224 (test 288)83.7462881000apache-2.0timm
regnety_040.ra3_in1k224 (test 288)83.0482881000apache-2.0timm
regnety_064.ra3_in1k224 (test 288)83.7162881000apache-2.0timm
regnety_080.ra3_in1k224 (test 288)83.9402881000apache-2.0timm
regnetz_040.ra3_in1k256 (test 320)84.2423201000apache-2.0timm
regnetz_040_h.ra3_in1k256 (test 320)84.4983201000apache-2.0timm

facebookresearch/vissl

Origin: github.com/facebookresearch/vissl

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnety_320.seer224--noneseer-licensetimm
regnety_320.seer_ft_in1k38483.3243841000seer-licensetimm
regnety_640.seer224--noneseer-licensetimm
regnety_640.seer_ft_in1k38483.9243841000seer-licensetimm
regnety_1280.seer224--noneseer-licensetimm
regnety_1280.seer_ft_in1k38484.4263841000seer-licensetimm
regnety_2560.seer_ft_in1k38485.1443841000seer-licensetimm

sw tags

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnety_120.sw_in12k224 (test 288)--11821apache-2.0timm
regnety_120.sw_in12k_ft_in1k224 (test 288)85.4282881000apache-2.0timm
regnety_160.sw_in12k224 (test 288)--11821apache-2.0timm
regnety_160.sw_in12k_ft_in1k224 (test 288)86.0282881000apache-2.0timm

Other

WeightInput sizeTop-1 (%)Eval sizeClassesLicenseHub
regnety_032.ra_in1k224 (test 288)82.7242881000apache-2.0timm
regnety_160.deit_in1k224 (test 288)83.7042881000apache-2.0timm
regnety_160.lion_in12k_ft_in1k224 (test 288)86.0042881000apache-2.0timm
Update on GitHub