Agora board builds (Model Farm, verified on real boards)
Browse files- LICENSE_MODEL_FARM.pdf +0 -0
- NOTICE.md +5 -0
- README.md +37 -0
- SHA256SUMS +3 -0
- targets/QCS8550/FP16/composite.json +35 -0
- targets/QCS8550/FP16/decoder.onnx +3 -0
- targets/QCS8550/FP16/encoder.bin +3 -0
- targets/QCS8550/model.json +7 -0
LICENSE_MODEL_FARM.pdf
ADDED
|
Binary file (71.1 kB). View file
|
|
|
NOTICE.md
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Provenance
|
| 2 |
+
|
| 3 |
+
Resources are copied without binary changes from the APLUX Model Farm build `SAM2-tiny` that Agora verified on real boards (decoded sample check, then measured), pinned by sha256 in SHA256SUMS.
|
| 4 |
+
|
| 5 |
+
Agora arranges files under targets/<SoC>/<precision>/ and adds model.json. AidLite, AidGen, AidVoice and the Qualcomm QNN runtime are separate dependencies with their own terms.
|
README.md
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: aplux-model-farm
|
| 4 |
+
license_link: https://huggingface.co/APLUX-Agora/SAM2-tiny/blob/main/LICENSE_MODEL_FARM.pdf
|
| 5 |
+
pipeline_tag: image-segmentation
|
| 6 |
+
tags: [Agora, QNN, AIoT, Qualcomm]
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# SAM2-tiny model resources
|
| 10 |
+
|
| 11 |
+
SAM2-tiny 点提示图像分割,使用 NPU 图像编码器与原始 checkpoint 派生的 CPU 解码器。
|
| 12 |
+
|
| 13 |
+
Board builds that [Agora](https://mega.aidlux.com) runs and measures on real Qualcomm boards. Try it online, without a board: https://mega.aidlux.com/models/sam2-tiny
|
| 14 |
+
|
| 15 |
+
| SoC · board | Precisions | Measured on Agora (default precision) |
|
| 16 |
+
| --- | --- | --- |
|
| 17 |
+
| QCS8550 · 犀牛派 X1 (Rhino Pi X1) | FP16 | 300.2 ms |
|
| 18 |
+
|
| 19 |
+
Task: 分割. Inputs: image (image). Outputs: masks (masks), out (json).
|
| 20 |
+
|
| 21 |
+
## Download
|
| 22 |
+
|
| 23 |
+
```bash
|
| 24 |
+
export AGORA_WORKSPACE="$HOME/my-sam2-tiny"
|
| 25 |
+
export AGORA_SOC='QCS8550'
|
| 26 |
+
hf download APLUX-Agora/SAM2-tiny \
|
| 27 |
+
--include "targets/$AGORA_SOC/*" --local-dir "$AGORA_WORKSPACE/resources"
|
| 28 |
+
```
|
| 29 |
+
|
| 30 |
+
Each `targets/<SoC>/` holds `model.json` (default precision and variant paths) and one directory per precision. Context binaries are named `model.bin`; multi-file packages are kept as published by Model Farm.
|
| 31 |
+
|
| 32 |
+
Pre- and post-processing, the runner and an exported project: open the model on Agora and choose “部署指南”, or export any workflow that uses it.
|
| 33 |
+
|
| 34 |
+
## Licence and provenance
|
| 35 |
+
|
| 36 |
+
Source model licence: see the original model's terms.
|
| 37 |
+
Converted, deployable resources: APLUX Model Farm License (LICENSE_MODEL_FARM.pdf). See NOTICE.md and SHA256SUMS.
|
SHA256SUMS
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
f8c55cd22e21940417d2f06684b67368f32aaa20b6049744290a03012da3d140 targets/QCS8550/FP16/composite.json
|
| 2 |
+
64fec93130c31da0cd6f44beff7b060d82f698f13fdebf076a02ec1b916fdbe5 targets/QCS8550/FP16/decoder.onnx
|
| 3 |
+
c0104afea8a72b6cc63ae9569e796783ce33fb4f13e71663730cc0e67ccabe58 targets/QCS8550/FP16/encoder.bin
|
targets/QCS8550/FP16/composite.json
ADDED
|
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"components": {
|
| 3 |
+
"decoder": "decoder.onnx",
|
| 4 |
+
"encoder": "encoder.bin"
|
| 5 |
+
},
|
| 6 |
+
"decoderRuntime": "onnx",
|
| 7 |
+
"kind": "prompt_sam",
|
| 8 |
+
"source": {
|
| 9 |
+
"decoder": {
|
| 10 |
+
"checkpointPath": "algorithm/pretrainWeights/sam2_hiera_tiny.pt",
|
| 11 |
+
"checkpointSha256": "65b50056e05bcb13694174f51bb6da89c894b57b75ccdf0ba6352c597c5d1125",
|
| 12 |
+
"derivedOnnxSha256": "64fec93130c31da0cd6f44beff7b060d82f698f13fdebf076a02ec1b916fdbe5",
|
| 13 |
+
"onnx": "1.20.0",
|
| 14 |
+
"opset": 17,
|
| 15 |
+
"projectId": 728,
|
| 16 |
+
"ref": "f143195df33e8fa84055e763106bf1d2a3e5c065",
|
| 17 |
+
"sourceFiles": {
|
| 18 |
+
"modeling/position_encoding.py": "f19556279ef68170fc64004f5a43d9600a603954b26e50665ee17627d3f9dbe8",
|
| 19 |
+
"modeling/sam/mask_decoder.py": "573eaa438a6de85bb186628ceb2425b6bcde0c2bc599bb56bb24d76a08dabf16",
|
| 20 |
+
"modeling/sam/prompt_encoder.py": "486596f5ba976cb9ced3836d65f1793dae586be2180567a451098f96c45ae401",
|
| 21 |
+
"modeling/sam/transformer.py": "747d4023a8f5566083304f70864605dbfd39382b35bed99fcdb6c0a55a7de38b",
|
| 22 |
+
"modeling/sam2_utils.py": "85f5b9474b382b2ee7e87f6f25db0590ba2b2fb7534bc4ace33f6ea9bc65c143",
|
| 23 |
+
"utils/misc.py": "2ca91323a2964622f54e6e928df1dccb1addc5851a4b7cb1783e0627ca49cbd2"
|
| 24 |
+
},
|
| 25 |
+
"torch": "2.9.1+cu126"
|
| 26 |
+
},
|
| 27 |
+
"encoder": {
|
| 28 |
+
"path": "models/QCS8550/FP16/sam2_encoder_qcs8550_fp16.qnn236.ctx.bin",
|
| 29 |
+
"projectId": 1325,
|
| 30 |
+
"ref": "ad32ab614421eac543959c756be789a6e6f338a2",
|
| 31 |
+
"sha256": "c0104afea8a72b6cc63ae9569e796783ce33fb4f13e71663730cc0e67ccabe58"
|
| 32 |
+
}
|
| 33 |
+
},
|
| 34 |
+
"version": 1
|
| 35 |
+
}
|
targets/QCS8550/FP16/decoder.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64fec93130c31da0cd6f44beff7b060d82f698f13fdebf076a02ec1b916fdbe5
|
| 3 |
+
size 16376298
|
targets/QCS8550/FP16/encoder.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c0104afea8a72b6cc63ae9569e796783ce33fb4f13e71663730cc0e67ccabe58
|
| 3 |
+
size 84330504
|
targets/QCS8550/model.json
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"soc": "QCS8550",
|
| 3 |
+
"default_precision": "FP16",
|
| 4 |
+
"variants": {
|
| 5 |
+
"FP16": "FP16/"
|
| 6 |
+
}
|
| 7 |
+
}
|