Artem Plastinkin commited on
Commit ·
7b5d384
1
Parent(s): d824d9b
Update config
Browse files
compile_config/network_config_1core.yaml
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
network_configuration:
|
| 2 |
+
retinanet-9:
|
| 3 |
+
optimization_options:
|
| 4 |
+
- -enable_dma_fusion
|
| 5 |
+
- -enable_stu_multi_channel
|
| 6 |
+
- -stu_multi_channel_config 0x15212420
|
| 7 |
+
- -stu_weight
|
| 8 |
+
- -distributed_coef_stu
|
int8/benchmarks/x5h_mwmx_npu_apm80_1core.yaml
CHANGED
|
@@ -44,6 +44,7 @@ power:
|
|
| 44 |
# Exact commands verified against the NNAC "Getting Started" chapter. Rendered
|
| 45 |
# by the AI-Dashboard in place of the generic placeholder flow — see
|
| 46 |
# downloadRunHTML() / parse_reproduce() in AI-Dashboard/app.js.
|
|
|
|
| 47 |
reproduce:
|
| 48 |
steps:
|
| 49 |
- title: Activate the Python environment
|
|
@@ -52,11 +53,11 @@ reproduce:
|
|
| 52 |
(huggingface_hub) and the NNAC toolchain installed, e.g.
|
| 53 |
`source nnac_venv/bin/activate` -- path depends on your toolchain install.
|
| 54 |
kind: note
|
| 55 |
-
- title: Download the ONNX model
|
| 56 |
-
command: hf download Renesas/RetinaNet-R101-ONNX --repo-type
|
| 57 |
- title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
|
| 58 |
command: |
|
| 59 |
-
python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 1
|
| 60 |
- title: Set up the R-Car X5H board
|
| 61 |
command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
|
| 62 |
kind: note
|
|
|
|
| 44 |
# Exact commands verified against the NNAC "Getting Started" chapter. Rendered
|
| 45 |
# by the AI-Dashboard in place of the generic placeholder flow — see
|
| 46 |
# downloadRunHTML() / parse_reproduce() in AI-Dashboard/app.js.
|
| 47 |
+
# Network config verified against the internal model_zoo compile config for this model's 1-core slice.
|
| 48 |
reproduce:
|
| 49 |
steps:
|
| 50 |
- title: Activate the Python environment
|
|
|
|
| 53 |
(huggingface_hub) and the NNAC toolchain installed, e.g.
|
| 54 |
`source nnac_venv/bin/activate` -- path depends on your toolchain install.
|
| 55 |
kind: note
|
| 56 |
+
- title: Download the ONNX model and compile config
|
| 57 |
+
command: hf download Renesas/RetinaNet-R101-ONNX --repo-type model --include "fp32/*" "compile_config/*" --local-dir ./RetinaNet-R101-ONNX-fp32
|
| 58 |
- title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
|
| 59 |
command: |
|
| 60 |
+
python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 1 --network-config ./RetinaNet-R101-ONNX-fp32/compile_config/network_config_1core.yaml
|
| 61 |
- title: Set up the R-Car X5H board
|
| 62 |
command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
|
| 63 |
kind: note
|
int8/benchmarks/x5h_mwmx_npu_apm80_3core.yaml
CHANGED
|
@@ -41,11 +41,10 @@ memory:
|
|
| 41 |
power:
|
| 42 |
avg_w: null
|
| 43 |
|
| 44 |
-
#
|
| 45 |
-
#
|
| 46 |
-
#
|
| 47 |
-
#
|
| 48 |
-
# may not reproduce the exact benchmarked 3-core latency.
|
| 49 |
reproduce:
|
| 50 |
steps:
|
| 51 |
- title: Activate the Python environment
|
|
@@ -54,11 +53,11 @@ reproduce:
|
|
| 54 |
(huggingface_hub) and the NNAC toolchain installed, e.g.
|
| 55 |
`source nnac_venv/bin/activate` -- path depends on your toolchain install.
|
| 56 |
kind: note
|
| 57 |
-
- title: Download the ONNX model
|
| 58 |
-
command: hf download Renesas/RetinaNet-R101-ONNX --repo-type
|
| 59 |
- title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
|
| 60 |
command: |
|
| 61 |
-
python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 3
|
| 62 |
- title: Set up the R-Car X5H board
|
| 63 |
command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
|
| 64 |
kind: note
|
|
|
|
| 41 |
power:
|
| 42 |
avg_w: null
|
| 43 |
|
| 44 |
+
# Exact commands verified against the NNAC "Getting Started" chapter, plus the
|
| 45 |
+
# network config verified against the internal model_zoo compile config for
|
| 46 |
+
# this model's 3-core slice (identical segmentation config to the 3/4/6/12-core
|
| 47 |
+
# slices, see compile_config/RetinaNet_l2seg.json).
|
|
|
|
| 48 |
reproduce:
|
| 49 |
steps:
|
| 50 |
- title: Activate the Python environment
|
|
|
|
| 53 |
(huggingface_hub) and the NNAC toolchain installed, e.g.
|
| 54 |
`source nnac_venv/bin/activate` -- path depends on your toolchain install.
|
| 55 |
kind: note
|
| 56 |
+
- title: Download the ONNX model and compile config
|
| 57 |
+
command: hf download Renesas/RetinaNet-R101-ONNX --repo-type model --include "fp32/*" "compile_config/*" --local-dir ./RetinaNet-R101-ONNX-fp32
|
| 58 |
- title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
|
| 59 |
command: |
|
| 60 |
+
python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 3 --network-config ./RetinaNet-R101-ONNX-fp32/compile_config/network_config.yaml
|
| 61 |
- title: Set up the R-Car X5H board
|
| 62 |
command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
|
| 63 |
kind: note
|
int8/benchmarks/x5h_mwmx_npu_apm80_4core.yaml
CHANGED
|
@@ -41,11 +41,10 @@ memory:
|
|
| 41 |
power:
|
| 42 |
avg_w: null
|
| 43 |
|
| 44 |
-
#
|
| 45 |
-
#
|
| 46 |
-
#
|
| 47 |
-
#
|
| 48 |
-
# may not reproduce the exact benchmarked 4-core latency.
|
| 49 |
reproduce:
|
| 50 |
steps:
|
| 51 |
- title: Activate the Python environment
|
|
@@ -54,11 +53,11 @@ reproduce:
|
|
| 54 |
(huggingface_hub) and the NNAC toolchain installed, e.g.
|
| 55 |
`source nnac_venv/bin/activate` -- path depends on your toolchain install.
|
| 56 |
kind: note
|
| 57 |
-
- title: Download the ONNX model
|
| 58 |
-
command: hf download Renesas/RetinaNet-R101-ONNX --repo-type
|
| 59 |
- title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
|
| 60 |
command: |
|
| 61 |
-
python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 4
|
| 62 |
- title: Set up the R-Car X5H board
|
| 63 |
command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
|
| 64 |
kind: note
|
|
|
|
| 41 |
power:
|
| 42 |
avg_w: null
|
| 43 |
|
| 44 |
+
# Exact commands verified against the NNAC "Getting Started" chapter, plus the
|
| 45 |
+
# network config verified against the internal model_zoo compile config for
|
| 46 |
+
# this model's 4-core slice (identical segmentation config to the 3/4/6/12-core
|
| 47 |
+
# slices, see compile_config/RetinaNet_l2seg.json).
|
|
|
|
| 48 |
reproduce:
|
| 49 |
steps:
|
| 50 |
- title: Activate the Python environment
|
|
|
|
| 53 |
(huggingface_hub) and the NNAC toolchain installed, e.g.
|
| 54 |
`source nnac_venv/bin/activate` -- path depends on your toolchain install.
|
| 55 |
kind: note
|
| 56 |
+
- title: Download the ONNX model and compile config
|
| 57 |
+
command: hf download Renesas/RetinaNet-R101-ONNX --repo-type model --include "fp32/*" "compile_config/*" --local-dir ./RetinaNet-R101-ONNX-fp32
|
| 58 |
- title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
|
| 59 |
command: |
|
| 60 |
+
python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 4 --network-config ./RetinaNet-R101-ONNX-fp32/compile_config/network_config.yaml
|
| 61 |
- title: Set up the R-Car X5H board
|
| 62 |
command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
|
| 63 |
kind: note
|
int8/benchmarks/x5h_mwmx_npu_apm80_6core.yaml
CHANGED
|
@@ -41,11 +41,10 @@ memory:
|
|
| 41 |
power:
|
| 42 |
avg_w: null
|
| 43 |
|
| 44 |
-
#
|
| 45 |
-
#
|
| 46 |
-
#
|
| 47 |
-
#
|
| 48 |
-
# may not reproduce the exact benchmarked 6-core latency.
|
| 49 |
reproduce:
|
| 50 |
steps:
|
| 51 |
- title: Activate the Python environment
|
|
@@ -54,11 +53,11 @@ reproduce:
|
|
| 54 |
(huggingface_hub) and the NNAC toolchain installed, e.g.
|
| 55 |
`source nnac_venv/bin/activate` -- path depends on your toolchain install.
|
| 56 |
kind: note
|
| 57 |
-
- title: Download the ONNX model
|
| 58 |
-
command: hf download Renesas/RetinaNet-R101-ONNX --repo-type
|
| 59 |
- title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
|
| 60 |
command: |
|
| 61 |
-
python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 6
|
| 62 |
- title: Set up the R-Car X5H board
|
| 63 |
command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
|
| 64 |
kind: note
|
|
|
|
| 41 |
power:
|
| 42 |
avg_w: null
|
| 43 |
|
| 44 |
+
# Exact commands verified against the NNAC "Getting Started" chapter, plus the
|
| 45 |
+
# network config verified against the internal model_zoo compile config for
|
| 46 |
+
# this model's 6-core slice (identical segmentation config to the 3/4/6/12-core
|
| 47 |
+
# slices, see compile_config/RetinaNet_l2seg.json).
|
|
|
|
| 48 |
reproduce:
|
| 49 |
steps:
|
| 50 |
- title: Activate the Python environment
|
|
|
|
| 53 |
(huggingface_hub) and the NNAC toolchain installed, e.g.
|
| 54 |
`source nnac_venv/bin/activate` -- path depends on your toolchain install.
|
| 55 |
kind: note
|
| 56 |
+
- title: Download the ONNX model and compile config
|
| 57 |
+
command: hf download Renesas/RetinaNet-R101-ONNX --repo-type model --include "fp32/*" "compile_config/*" --local-dir ./RetinaNet-R101-ONNX-fp32
|
| 58 |
- title: Compile with the NNAC toolchain (INT8 auto-cast from the FP32 graph)
|
| 59 |
command: |
|
| 60 |
+
python3 nnac_frontend/legalize.py -d binary/nnx ./RetinaNet-R101-ONNX-fp32/fp32/retinanet-9.onnx --num-core 6 --network-config ./RetinaNet-R101-ONNX-fp32/compile_config/network_config.yaml
|
| 61 |
- title: Set up the R-Car X5H board
|
| 62 |
command: Configure the board per the AI Compiler (NNAC) "Getting Started" guide, section 3.4 (host TFTP/NFS setup, bootloader flashing, U-Boot, Linux boot, login) -- exact steps depend on your board/network setup.
|
| 63 |
kind: note
|