heal
horizon
zacxr commited on
Commit
0153ce4
·
verified ·
1 Parent(s): cd2b21d

docs: sync PDMS accuracy and J6M/J6P performance metrics

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -7,7 +7,9 @@ tags:
7
 
8
  # E2E Diffusion Planner + HENet-tiny
9
 
10
- `e2e_planner` is an end-to-end autonomous-driving model on NAVSIM: an 8-camera BEV multitask perception front-end (HENet-tiny + single-frame BevFormer view transformer; dynamic/static 3D detection, occupancy, discrete map, online MapTR) feeding a BEV-feature-conditioned Diffusion Planner that outputs future ego trajectories. It covers the full pipeline from 5-stage float training → quantization calibration → HBIR export → HBM compilation → NAVSIM closed-loop metric evaluation.
 
 
11
 
12
  ---
13
 
@@ -36,8 +38,8 @@ tags:
36
 
37
  | March | latency (ms) | fps | Memory Usage (MB) |
38
  |---|---|---|---|
39
- | J6M | 99.14 (BPU 99.07) | 10.11 | 306.30 |
40
- | J6P | 37.84 (BPU 37.78) | 88.23 | 242.20 |
41
 
42
  ---
43
 
@@ -45,7 +47,7 @@ tags:
45
 
46
  ### Core Design
47
 
48
- The model has two halves joined at the BEV feature: an 8-camera multitask perception front-end producing a `128×192` BEV grid, and a BEV-conditioned Diffusion Planner. HENet-tiny extracts multi-view camera features; a single-frame `SingleBevFormerViewTransformer` lifts them to BEV; five task heads (`DenseBEVSparseHead` dynamic/static, `BEVOCCHead2D` occupancy, `BEVFormerDet2DDecoder` discrete map, `MaptrDetDecoder` online map) share the BEV feature. The planner encodes the pooled BEV feature into 384 tokens, conditions a 3-layer DiT via a route-lane `RouteEncoder`, and denoises future ego waypoints over 5 reverse diffusion steps.
49
 
50
  - **Task type**: End-to-end planning (perception + planning joint).
51
  - **Perception backbone**: HENet-tiny (`block_nums=[4,3,8,6]`, `embed_dims=[64,128,192,384]`), initialized from the ImageNet-pretrained `henet_tinym` float checkpoint.
 
7
 
8
  # E2E Diffusion Planner + HENet-tiny
9
 
10
+ An end-to-end driving model for camera-based perception and short-horizon ego trajectory planning on NAVSIM.
11
+
12
+ E2E Diffusion Planner + HENet-tiny combines an 8-camera BEV perception front-end with a diffusion planner conditioned on BEV features, ego state, and route. Perception and planning are trained and quantized as one graph for Horizon J6M / J6P deployment.
13
 
14
  ---
15
 
 
38
 
39
  | March | latency (ms) | fps | Memory Usage (MB) |
40
  |---|---|---|---|
41
+ | J6M | 104.66 (BPU 104.56) | 9.75 | 376.90 |
42
+ | J6P | 53.25 (BPU 53.19) | 66.26 | 353.70 |
43
 
44
  ---
45
 
 
47
 
48
  ### Core Design
49
 
50
+ Think of two stages glued on one BEV map. Cameras are encoded by HENet-tiny and lifted with a single-frame BevFormer into a forward-looking BEV grid; the same feature feeds detection, occupancy, and map heads for a consistent scene. A compact diffusion planner then reads that BEV, listens to the route, and denoises a few future ego waypoints—so planning stays conditioned on what perception actually sees, without a separate hand-off stack.
51
 
52
  - **Task type**: End-to-end planning (perception + planning joint).
53
  - **Perception backbone**: HENet-tiny (`block_nums=[4,3,8,6]`, `embed_dims=[64,128,192,384]`), initialized from the ImageNet-pretrained `henet_tinym` float checkpoint.