heal
horizon
bev
zacxr commited on
Commit
723941c
·
verified ·
1 Parent(s): ebe01a0

docs: sync model card to heal 0.14.0 with J6M/J6P perf

Browse files
Files changed (1) hide show
  1. README.md +7 -4
README.md CHANGED
@@ -8,7 +8,9 @@ tags:
8
 
9
  # BEV Multitask + HENet-tiny
10
 
11
- `bev_multitask_henet_tinym` is a camera-only BEV multitask perception model: HENet-tiny backbone + single-frame BevFormer view transformer, jointly performing five tasks — dynamic object 3D detection (with tracking), static object 3D detection, occupancy prediction, discrete map (stop line) detection, and online vectorized map (MapTR). It covers the full pipeline from 3-stage float training → quantization calibration → HBIR export → HBM compilation → inference.
 
 
12
 
13
  ---
14
 
@@ -28,7 +30,7 @@ tags:
28
 
29
  > Accuracy numbers not yet measured; fill in after evaluation. Results use `march = March.NASH_M` (J6M) configuration; this task has no QAT stage (qat column is `—`).
30
  >
31
- > HEAL version: heal 0.6.0 / hbdk4-compiler 4.13.1 / horizon_plugin_pytorch 3.4.5 (board UCP 3.16.2).
32
 
33
  ### Performance Metrics
34
 
@@ -37,7 +39,8 @@ tags:
37
 
38
  | March | latency (ms) | fps | Memory Usage (MB) |
39
  |---|---|---|---|
40
- | J6M | — | — | — |
 
41
 
42
  ---
43
 
@@ -45,7 +48,7 @@ tags:
45
 
46
  ### Core Design
47
 
48
- HENet-tiny extracts multi-view camera features; a single-frame `SingleBevFormerViewTransformer` (with `LearnedPositionalEncoding`, `HorizonSpatialCrossAttention` and `HorizonMultiScaleDeformableAttention`) lifts them to a `128×128` BEV grid covering `[-51.2m, 51.2m]²`. The BEV feature drives five task heads: dynamic/static 3D detection (`DenseBEVSparseHead`, SparseBEV-style sparse queries with `MemoryBank` temporal tracking), occupancy (`BEVOCCHead2D`, 18 classes), discrete map (`BEVFormerDet2DDecoder`, stop line), and online vectorized map (`MaptrDetDecoder`, 3 classes).
49
 
50
  - **Task type**: BEV multitask perception (dynamic det + static det + occupancy + discrete map + online map).
51
  - **backbone**: HENet-tiny (`type=HENet`, `block_nums=[4,3,8,6]`, `embed_dims=[64,128,192,384]`, `GroupDWCB`/`AltDWCB`/`DWCB` blocks, `S2DDown` downsampling), initialized from the ImageNet-pretrained `henet_tinym` float checkpoint.
 
8
 
9
  # BEV Multitask + HENet-tiny
10
 
11
+ A camera-only BEV multitask model for 3D detection, occupancy, stop-line detection, and online lane-level mapping.
12
+
13
+ BEV Multitask + HENet-tiny lifts six surround cameras into a shared bird’s-eye feature and runs five heads together—dynamic/static objects, occupancy, stop lines, and vectorized map—so scene cues stay consistent. This release is calibrated for Horizon J6M / J6P deployment without lidar at inference.
14
 
15
  ---
16
 
 
30
 
31
  > Accuracy numbers not yet measured; fill in after evaluation. Results use `march = March.NASH_M` (J6M) configuration; this task has no QAT stage (qat column is `—`).
32
  >
33
+ > HEAL version: heal 0.14.0 / hbdk4-compiler 4.13.1 / horizon_plugin_pytorch 3.4.5 (board UCP 3.16.2).
34
 
35
  ### Performance Metrics
36
 
 
39
 
40
  | March | latency (ms) | fps | Memory Usage (MB) |
41
  |---|---|---|---|
42
+ | J6M | 77.82 | 13.21 | 386.90 |
43
+ | J6P | 47.65 | 76.17 | 373.50 |
44
 
45
  ---
46
 
 
48
 
49
  ### Core Design
50
 
51
+ Six surround cameras are encoded by HENet-tiny, then lifted into a compact BEV canvas (about 100 m around the ego) with a single-frame BevFormer view transformer. That shared BEV feature fans out to five lightweight heads: SparseBEV-style queries for dynamic and static 3D boxes, a voxel occupancy head, a stop-line detector, and a MapTR-style polyline head for dividers, crossings, and boundaries — so detection, free space, and map cues stay consistent without running five separate networks.
52
 
53
  - **Task type**: BEV multitask perception (dynamic det + static det + occupancy + discrete map + online map).
54
  - **backbone**: HENet-tiny (`type=HENet`, `block_nums=[4,3,8,6]`, `embed_dims=[64,128,192,384]`, `GroupDWCB`/`AltDWCB`/`DWCB` blocks, `S2DDown` downsampling), initialized from the ImageNet-pretrained `henet_tinym` float checkpoint.