| # AX DocLayout v1.2 CUDA inference source | |
| ONNX Runtime CUDA + TF32 inference for AXDocLayout-M v1.2, using unchanged FP32 | |
| weights and 1024 letterbox geometry. Requires supported Linux x86-64/NVIDIA | |
| CUDA 12.8 setup and Python 3.12 or 3.13. | |
| ```bash | |
| python -m pip install ".[onnx]" | |
| python examples/predict_page.py page.png --backend onnx | |
| ``` | |
| The ONNX extra installs the pinned GPU runtime and CUDA/cuDNN dependencies. | |
| The backend requires CUDA and verifies TF32/compute placement. A GPU failure | |
| raises an error. Use the immutable source and weight revisions in the model | |
| repository root README. For an explicit CPU comparison, install `.[torch]` | |
| and select `--backend pytorch`. See LICENSE and NOTICE (AGPL-3.0-only). | |