AVID-EPJ-Baseline-Models-and-Data / docs /identifiability_proof.md
Terrano09's picture
Upload 250k-round long-horizon datasets, Weighted-Bellman R2D2 .pt checkpoints, pair-aware Q7.8 banks & math docs
3499f95 verified
|
Raw History Blame Contribute Delete
3.29 kB

Structural Identifiability & Jacobian SVD Rank Report (A03 / Q04)

1. Executive Summary of Rank Deficiency in the Legacy Marginal Model

In the legacy estimator (noise_model.cpp prior to A02/A03 repair), the 12 nearest-neighbor $Z_i Z_j$ pair probabilities were folded into 9 effective qubit error probabilities $p_{\text{eff}}(v)$, and the likelihood summed 4 independent Bernoulli check marginals $q_0, q_1, q_2, q_3$. Because the observation map factored through 4 scalar check marginals, its $4 \times 21$ Jacobian $J_{\text{marginal}}$ had structural rank: rank⁡(Jmarginal)=4≤4\operatorname{rank}(J_{\text{marginal}}) = 4 \le 4 leaving a $21 - 4 = 17$-dimensional unobservable nullspace.

2. Exact Joint Syndrome Distribution & Signature Orbit Analysis

Under the exact $2^m = 16$-state joint syndrome distribution $P_\theta(s)$, the column of the $16 \times 21$ Jacobian $J_{s, e} = \partial P_\theta(s) / \partial p_e$ for mechanism $e$ is: J:,e=Pθ(s⊕ge)−Pθ(s)1−2peJ_{:, e} = \frac{P_\theta(s \oplus g_e) - P_\theta(s)}{1 - 2 p_e} Consequently, two physical fault mechanisms $e_a, e_b$ have linearly dependent (collinear) Jacobian columns if and only if they share the same syndrome signature $g_{e_a} = g_{e_b} \in {0, \dots, 15}$, and any mechanism with $g_e = 0$ (stabilizer-equivalent or boundary-commuting fault) has an identically zero Jacobian column.

Metric Legacy 4-Marginal Model Repaired 16-State Joint DP (21-param) Repaired 16-State Joint DP (25-param) Prior-Tethered MAP ($\lambda=0.5$)
Parameter Dimension ($E$) 21 21 25 21
Observation Dimension 4 16 16 16 + 21 prior
Distinct Non-Zero Signatures N/A 9 9 9
Numerical Jacobian / Fisher Rank 4 9 9 21
MAP Hessian Condition Number $\infty$ (singular) $\infty$ on gauge nullspace $\infty$ on gauge nullspace 234.05

3. Gauge Orbits (Syndrome Signature Equivalence Classes)

Across the 21 fault events (9 single-qubit $Z_i$ + 12 nearest-neighbor $Z_i Z_j$ pairs) on the canonical rotated $d=3$ X-check basis:

  • Zero-signature events ($g_e = 0$): ZZ_3_6, ZZ_2_5 (events that commute with all 4 X-checks on the boundary).
  • Distinct non-zero syndrome signatures: 9 distinct non-zero bitmasks in ${1, \dots, 15}$, yielding an exact unregularized Fisher rank of 9 (more than double the legacy rank of 4).
  • Quotient & MAP Resolution: Within each signature equivalence class $\mathcal{O}g = {e : g_e = g}$, the aggregate class probability $P_g = \bigoplus{e \in \mathcal{O}g} p_e$ is strictly identifiable from the joint syndrome histogram, while individual members within a multi-event orbit are uniquely resolved by the strictly convex Gaussian prior tether $\frac{\lambda}{2} |\theta - \theta{\text{prior}}|_2^2$ (Hessian rank = 21 / 21, condition number $\kappa = 234.05$).

References

  • [R4] E. van den Berg, Z. K. Minev, A. Kandala, and K. Temme, "Probabilistic error cancellation with sparse Pauli-Lindblad models on noisy quantum processors," Nature Physics, vol. 19, pp. 1116–1121, 2023.
  • [R5] S. T. Flammia and J. J. Wallman, "Efficient estimation of Pauli channels," ACM Transactions on Quantum Computing, vol. 1, no. 1, pp. 1–32, 2020.