--- license: apache-2.0 base_model: allenai/OLMo-2-0425-1B-Instruct library_name: aether-kit pipeline_tag: text-generation tags: - core-ai - on-device - apple - macos - olmo2 --- # AetherKit OLMo 2 1B Instruct A Core AI language bundle for [AetherKit](https://github.com/bubstackdev/aether-kit), ported as a v0.0.6 spike. Source: [allenai/OLMo-2-0425-1B-Instruct](https://huggingface.co/allenai/OLMo-2-0425-1B-Instruct) at revision `48d788eca847d4d7548f375ad03d3c9312f6139e`, Apache-2.0. | Folder | Platform | Weights / cache | Attention arithmetic | Context | | --- | --- | --- | --- | --- | | `mac/` | macOS 27+ on Apple silicon | float16 | float32 | 4,096 tokens | `mac/` is a complete registered AetherKit bundle: `language-model.json`, `model.aimodel/`, `tokenizer/`, and `export-report.json`. The model is specialized by Core AI on first load. This repository contains the Kit registration format; use AetherKit's language products to open it. ## Download and use Download `mac/**` with Hugging Face tooling. Keep the complete directory structure, then pass the local `mac` directory to `AetherLanguageModel`: ```python from huggingface_hub import snapshot_download snapshot_download("aether-models/aether-kit-olmo-2-1b-instruct", allow_patterns=["mac/**", "LICENSE", "NOTICE"], local_dir="olmo2-kit") ``` ```swift import AetherLanguage import Foundation let model = AetherLanguageModel(bundle: URL(filePath: "/absolute/olmo2-kit/mac")) let session = AetherLanguageSession(model: model) let response = try await session.respond(to: "Explain why the sky is blue.") print(response.content) ``` For reproducible deployments, pin a repository commit as the download `revision`. AetherKit's catalog tooling can generate an entry with per-file sizes and SHA-256 values for `ModelPreparation`; this repo does not add automatic downloads to the runtime. ## Qualification and limits Exported with Torch 2.11.0, Core AI Torch 0.4.2, and Transformers 4.57.3. AetherKit source commit: `867b6fe0d56ed16079cfa987cef75297dcc0acde` (the locally integrated v0.0.6 spike; remote main may not include the export tooling yet). Evidence in `verification/` refers to exactly the model bytes recorded by the registration (model SHA-256 `6e3aca1b961acf4f206db3684bd13e77f6f7043de2ab02b805b821d13f8d70ab`). - 32/32 native GPU argmax rows match an independent upstream float32 reference; minimum cosine 0.999999843 and all 64 greedy continuation tokens match. - 1,024-token decoding completes with zero model reloads and bounded step shapes. - Full-model CPU self-check, tokenizer chat cases, registered chat, streaming, seeded sampling, stop sequences, cancellation recovery, and FoundationModels adapter checks pass. - Qualified on one M5 Max. iOS and other devices are unqualified. The extended native session gate exercised 2,048 tokens; the full registered 4,096-token context has not been qualified. This is an experimental spike bundle. - Float32 attention avoids a reproduced fp16 CPU attention near-tie reversal; weights and cache storage stay fp16. No paired precision-performance benchmark is claimed. ## License and conversion See `LICENSE` and `NOTICE`. The checkpoint declares Apache-2.0 and provides no license file; the included license is the canonical Apache-2.0 text. The tokenizer files are unchanged. Weights were converted to float16 Core AI format. The upstream model card describes the model's intended uses and limitations. The export report's local checkpoint path is redacted for publication; source repository, revision, hashes, versions, and conversion recipe are retained.