Artem Plastinkin commited on
Commit
7b5d384
·
1 Parent(s): d824d9b

Update config

Browse files
compile_config/network_config_1core.yaml ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ network_configuration:
2
+ retinanet-9:
3
+ optimization_options:
4
+ - -enable_dma_fusion
5
+ - -enable_stu_multi_channel
6
+ - -stu_multi_channel_config 0x15212420
7
+ - -stu_weight
8
+ - -distributed_coef_stu
int8/benchmarks/x5h_mwmx_npu_apm80_1core.yaml CHANGED
@@ -44,6 +44,7 @@ power:
44
  # Exact commands verified against the NNAC "Getting Started" chapter. Rendered
45
  # by the AI-Dashboard in place of the generic placeholder flow — see
46
  # downloadRunHTML() / parse_reproduce() in AI-Dashboard/app.js.
 
47
  reproduce:
48
  steps:
49
  - title: Activate the Python environment
@@ -52,11 +53,11 @@ reproduce:
52
  (huggingface_hub) and the NNAC toolchain installed, e.g.
53
  `source nnac_venv/bin/activate` -- path depends on your toolchain install.
54
  kind: note
55
- - title: Download the ONNX model
56
- command: hf download Renesas/RetinaNet-R101-ONNX --repo-type=model --include "fp32/*" --local-dir ./RetinaNet-R101-ONNX-fp32
57
  - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
58
  command: |
59
- python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 1
60
  - title: Set up the R-Car X5H board
61
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
62
  kind: note
 
44
  # Exact commands verified against the NNAC "Getting Started" chapter. Rendered
45
  # by the AI-Dashboard in place of the generic placeholder flow — see
46
  # downloadRunHTML() / parse_reproduce() in AI-Dashboard/app.js.
47
+ # Network config verified against the internal model_zoo compile config for this model's 1-core slice.
48
  reproduce:
49
  steps:
50
  - title: Activate the Python environment
 
53
  (huggingface_hub) and the NNAC toolchain installed, e.g.
54
  `source nnac_venv/bin/activate` -- path depends on your toolchain install.
55
  kind: note
56
+ - title: Download the ONNX model and compile config
57
+ command: hf download Renesas/RetinaNet-R101-ONNX --repo-type model --include "fp32/*" "compile_config/*" --local-dir ./RetinaNet-R101-ONNX-fp32
58
  - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
59
  command: |
60
+ python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 1 --network-config ./RetinaNet-R101-ONNX-fp32/compile_config/network_config_1core.yaml
61
  - title: Set up the R-Car X5H board
62
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
63
  kind: note
int8/benchmarks/x5h_mwmx_npu_apm80_3core.yaml CHANGED
@@ -41,11 +41,10 @@ memory:
41
  power:
42
  avg_w: null
43
 
44
- # UNCONFIRMED (segmentation config): this repo's segmentation_json compile_config
45
- # (compile_config/RetinaNet_l2seg.json, see the 12-core reproduce block) is
46
- # specific to the 12-core build; no 3-core segmentation config is bundled, so
47
- # the steps below compile without one — a best-effort single-cluster flow that
48
- # may not reproduce the exact benchmarked 3-core latency.
49
  reproduce:
50
  steps:
51
  - title: Activate the Python environment
@@ -54,11 +53,11 @@ reproduce:
54
  (huggingface_hub) and the NNAC toolchain installed, e.g.
55
  `source nnac_venv/bin/activate` -- path depends on your toolchain install.
56
  kind: note
57
- - title: Download the ONNX model
58
- command: hf download Renesas/RetinaNet-R101-ONNX --repo-type=model --include "fp32/*" --local-dir ./RetinaNet-R101-ONNX-fp32
59
  - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
60
  command: |
61
- python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 3
62
  - title: Set up the R-Car X5H board
63
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
64
  kind: note
 
41
  power:
42
  avg_w: null
43
 
44
+ # Exact commands verified against the NNAC "Getting Started" chapter, plus the
45
+ # network config verified against the internal model_zoo compile config for
46
+ # this model's 3-core slice (identical segmentation config to the 3/4/6/12-core
47
+ # slices, see compile_config/RetinaNet_l2seg.json).
 
48
  reproduce:
49
  steps:
50
  - title: Activate the Python environment
 
53
  (huggingface_hub) and the NNAC toolchain installed, e.g.
54
  `source nnac_venv/bin/activate` -- path depends on your toolchain install.
55
  kind: note
56
+ - title: Download the ONNX model and compile config
57
+ command: hf download Renesas/RetinaNet-R101-ONNX --repo-type model --include "fp32/*" "compile_config/*" --local-dir ./RetinaNet-R101-ONNX-fp32
58
  - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
59
  command: |
60
+ python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 3 --network-config ./RetinaNet-R101-ONNX-fp32/compile_config/network_config.yaml
61
  - title: Set up the R-Car X5H board
62
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
63
  kind: note
int8/benchmarks/x5h_mwmx_npu_apm80_4core.yaml CHANGED
@@ -41,11 +41,10 @@ memory:
41
  power:
42
  avg_w: null
43
 
44
- # UNCONFIRMED (segmentation config): this repo's segmentation_json compile_config
45
- # (compile_config/RetinaNet_l2seg.json, see the 12-core reproduce block) is
46
- # specific to the 12-core build; no 4-core segmentation config is bundled, so
47
- # the steps below compile without one — a best-effort single-cluster flow that
48
- # may not reproduce the exact benchmarked 4-core latency.
49
  reproduce:
50
  steps:
51
  - title: Activate the Python environment
@@ -54,11 +53,11 @@ reproduce:
54
  (huggingface_hub) and the NNAC toolchain installed, e.g.
55
  `source nnac_venv/bin/activate` -- path depends on your toolchain install.
56
  kind: note
57
- - title: Download the ONNX model
58
- command: hf download Renesas/RetinaNet-R101-ONNX --repo-type=model --include "fp32/*" --local-dir ./RetinaNet-R101-ONNX-fp32
59
  - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
60
  command: |
61
- python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 4
62
  - title: Set up the R-Car X5H board
63
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
64
  kind: note
 
41
  power:
42
  avg_w: null
43
 
44
+ # Exact commands verified against the NNAC "Getting Started" chapter, plus the
45
+ # network config verified against the internal model_zoo compile config for
46
+ # this model's 4-core slice (identical segmentation config to the 3/4/6/12-core
47
+ # slices, see compile_config/RetinaNet_l2seg.json).
 
48
  reproduce:
49
  steps:
50
  - title: Activate the Python environment
 
53
  (huggingface_hub) and the NNAC toolchain installed, e.g.
54
  `source nnac_venv/bin/activate` -- path depends on your toolchain install.
55
  kind: note
56
+ - title: Download the ONNX model and compile config
57
+ command: hf download Renesas/RetinaNet-R101-ONNX --repo-type model --include "fp32/*" "compile_config/*" --local-dir ./RetinaNet-R101-ONNX-fp32
58
  - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
59
  command: |
60
+ python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 4 --network-config ./RetinaNet-R101-ONNX-fp32/compile_config/network_config.yaml
61
  - title: Set up the R-Car X5H board
62
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
63
  kind: note
int8/benchmarks/x5h_mwmx_npu_apm80_6core.yaml CHANGED
@@ -41,11 +41,10 @@ memory:
41
  power:
42
  avg_w: null
43
 
44
- # UNCONFIRMED (segmentation config): this repo's segmentation_json compile_config
45
- # (compile_config/RetinaNet_l2seg.json, see the 12-core reproduce block) is
46
- # specific to the 12-core build; no 6-core segmentation config is bundled, so
47
- # the steps below compile without one — a best-effort single-cluster flow that
48
- # may not reproduce the exact benchmarked 6-core latency.
49
  reproduce:
50
  steps:
51
  - title: Activate the Python environment
@@ -54,11 +53,11 @@ reproduce:
54
  (huggingface_hub) and the NNAC toolchain installed, e.g.
55
  `source nnac_venv/bin/activate` -- path depends on your toolchain install.
56
  kind: note
57
- - title: Download the ONNX model
58
- command: hf download Renesas/RetinaNet-R101-ONNX --repo-type=model --include "fp32/*" --local-dir ./RetinaNet-R101-ONNX-fp32
59
  - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
60
  command: |
61
- python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 6
62
  - title: Set up the R-Car X5H board
63
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
64
  kind: note
 
41
  power:
42
  avg_w: null
43
 
44
+ # Exact commands verified against the NNAC "Getting Started" chapter, plus the
45
+ # network config verified against the internal model_zoo compile config for
46
+ # this model's 6-core slice (identical segmentation config to the 3/4/6/12-core
47
+ # slices, see compile_config/RetinaNet_l2seg.json).
 
48
  reproduce:
49
  steps:
50
  - title: Activate the Python environment
 
53
  (huggingface_hub) and the NNAC toolchain installed, e.g.
54
  `source nnac_venv/bin/activate` -- path depends on your toolchain install.
55
  kind: note
56
+ - title: Download the ONNX model and compile config
57
+ command: hf download Renesas/RetinaNet-R101-ONNX --repo-type model --include "fp32/*" "compile_config/*" --local-dir ./RetinaNet-R101-ONNX-fp32
58
  - title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
59
  command: |
60
+ python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 6 --network-config ./RetinaNet-R101-ONNX-fp32/compile_config/network_config.yaml
61
  - title: Set up the R-Car X5H board
62
  command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
63
  kind: note