Download README.md from maxffarrell/amos-1-medium-CoreAI: direct link, hf CLI and curl.
- Browser
- Download file 4.31 kB
-
https://huggingface.co/maxffarrell/amos-1-medium-CoreAI/resolve/main/README.md
- Command line
-
hf download hf://maxffarrell/amos-1-medium-CoreAI/README.md
-
curl -L -o README.md https://huggingface.co/maxffarrell/amos-1-medium-CoreAI/resolve/main/README.md
license: apache-2.0
base_model: mukaddamzaid/amos-1-medium
tags:
- coreai
- core-ai
- apple
- aimodel
- decisions
- vision
amos-1-medium — Apple Core AI
Independent AMOS-1 conversion with its checkpoint's causal full attention preserved. Text backbone, 255-code readout, vision tower, span head, region head and trained box head execute through Core AI. Original prompt formatting, temperatures and quote decoding are retained. This is a decision model, not a text generator.
Use
Requires macOS 27 and the Core AI Python runtime. Tested with coreai-torch==0.4.3, PyTorch 2.14.0, Transformers 5.19 development, NumPy and Pillow. Exact dependencies are in requirements.txt. The converter warns that this PyTorch version exceeds its validated range. Host preprocessing/decoding uses PyTorch tensors; it loads no PyTorch neural weights.
import asyncio
from coreai_decoder import AmosDecoder
async def main():
m = await AmosDecoder.load(".")
print(await m.request({
"state": "Please refund the duplicate charge.",
"questions": {"refund": {
"type": "noul", "instructions": "Is a refund requested?"
}}
}))
asyncio.run(main())
predict(state, questions, images=()) takes upstream internal questions (text, options) and PIL images, including image options. request() takes base64 images in the original AMOS format.
Verified scope and limits
Batch one, 512 combined tokens, 224×224 images (49 merged tokens), float32 backbone/vision weights with FP32 readout and heads. Requests over capacity raise an error. Original longer contexts, variable image resolution, wide-choice two-pass routing, rotations, thinking, hosted server and explanation endpoints are not implemented. Up to 255 option codes are available subject to token capacity. No iPhone, Neural Engine placement, throughput or upstream benchmark accuracy claim has been verified. Core AI uses default specialization.
The text graph is split into an embedding asset, 32 transformer-layer assets and a final normalization/readout asset. They execute sequentially through Core AI in FP32. Conversion and the independent reference expand only one layer at a time. Gated-delta attention uses functional forward substitution instead of the export-only inverse construction; this matches the original eager triangular solve. The replacement passed 21 independent randomized comparisons and was checked against intermediate outputs from the trained model. Tested on a 64 GiB Mac; no smaller-memory device has been verified.
Nine smoke/parity cases cover all six typed question kinds, quote extraction, Unicode, 24 options, synthetic state images and image options. Tested discrete decisions matched upstream. Maximum measured probability/box-coordinate error: 0.00001425. Full results are in validation.json; these smoke cases do not establish benchmark accuracy. runtime-smoke.json verifies inference with PyTorch neural execution disabled.
The primary parity reference executes the pinned checkpoint in FP32. Compared with the original BF16 serving path in 9 additional cases, maximum probability/box error was 0.109300, and 1 case changed a discrete output. Region confidence can change discontinuously when a box crosses a grid boundary. See bf16-comparison.json; this is not bit-identical BF16 serving.
Attribution and reproducibility
Original model and serving code: Zaid Mukaddam, mukaddamzaid/amos-1-medium. Weights derive from Qwen3.5. Apache-2.0 applies; see LICENSE and SOURCE.json for the pinned AMOS revision and source hashes. Conversion adds no restrictions. Upstream serving sources are included under serve/.
Download the pinned source and reproduce from a directory holding these scripts:
hf download mukaddamzaid/amos-1-medium --revision 6b48a91ed940e08c87dcdd29c71c3b256d757ec7 --local-dir upstream/amos-1-medium
python convert_medium_sharded.py
python validate_decoder.py amos-1-medium --mode reference
python validate_decoder.py amos-1-medium --mode coreai
python smoke_decoder.py amos-1-medium
The two validation processes keep the reference model and Core AI runtime out of memory at the same time. Release integrity is recorded in SHA256SUMS.