Match approved DINO minimal schema-v3 public package layout

README.md

@@ -1,6 +1,5 @@
 ---
 pipeline_tag: feature-extraction
-base_model: openai/clip-vit-base-patch32
 tags:
 - eidora
 - eidora-model-zoo
@@ -8,94 +7,101 @@ tags:
 - onnxruntime
 - embeddings
 - image
+- modality:image
 - clip
-- vit
+base_model: openai/clip-vit-base-patch32
 ---
 
 # CLIP ViT-B/32 Image Medium
 
-CLIP ViT-B/32 Image Medium is a medium image embedding model whose vectors are aligned with text, making it useful for semantic collection discovery and a natural starting point for future text-to-image search in EIDORA.
-
-## Source and provenance
-
-- Base model/checkpoint: `openai/clip-vit-base-patch32`
-- Source: https://huggingface.co/openai/clip-vit-base-patch32
-- Original model: CLIP ViT-B/32
-- Architecture paper: https://arxiv.org/abs/2103.00020
-- Training data: Publicly available image-caption data collected from the internet; the exact training dataset was not released.
-
-## EIDORA package
-
-- Package schema: `3` (Desktop preparation implementation `1`)
-- Declared providers: `CPUExecutionProvider`
-- Provider declarations require certification in validation-report.json before publication.
-- Preparation runs in EIDORA; exposed defaults are recommended, alternatives are not equivalent-quality claims.
-- Modality: `image`
-- Embedding dimensions: `512`
-- Normalized: `true`
-- Similarity: `cosine`
-
-## Preparation
-
-```yaml
-width: 224
-height: 224
-layout: NCHW
-resize: short_edge_crop
-resize_rounding: truncate
-interpolation: bicubic
-rescale: 0.00392156862745098
-mean:
-- 0.48145466
-- 0.4578275
-- 0.40821073
-std:
-- 0.26862954
-- 0.26130258
-- 0.27577711
-alpha_background:
-- 0
-- 0
-- 0
-short_edge: 224
-parameters:
-  resize:
-    default: short_edge_crop
-    choices:
-    - stretch
-    - fill_crop
-    - fit_pad
-    - short_edge_crop
-  interpolation:
-    default: bicubic
-    choices:
-    - nearest
-    - bilinear
-    - bicubic
-    - lanczos
-  crop_position:
-    default: center
-  short_edge:
-    default: 224
-    minimum: 224
-    maximum: 2048
-```
+CLIP ViT-B/32 learns visual features in a representation space shared with text. This package exposes its normalized 512-dimensional image encoder only.
+
+## Training Data and Checkpoint Provenance
+
+- **Architecture:** CLIP Vision Transformer Base with 32-pixel patches (ViT-B/32).
+- **Original checkpoint:** [openai/clip-vit-base-patch32](https://huggingface.co/openai/clip-vit-base-patch32).
+- **Pinned revision:** `b97b0100e55e367c057773c2a614676470b0d575`.
+- **Training data:** Publicly available image-caption data collected from the internet; the exact training dataset was not released.
+- **Training method:** Contrastive image–text pretraining; the exact upstream image–caption dataset was not released.
+- **Source:** CLIP ViT-B/32 (original author attribution retained).
+
+CLIP alignment relies on both encoders originating from the same upstream checkpoint and revision.
+
+## Model Overview
+
+- **Model:** CLIP ViT-B/32 Image Medium
+- **EIDORA identifier:** `eidora/image-clip-vit-b32-medium`
+- **Modality:** Image
+- **Embedding dimensions:** 512
+- **Embedding normalization:** L2-normalized
+- **Similarity measure:** Cosine similarity
+- **Package schema:** Version 3
+- **Model version:** `0.1.0`
+
+## EIDORA Use and Supported Modalities
+
+**Supported modality:** Images only.
+
+Researchers can use this package to:
+
+- Embed images for semantic collection discovery.
+- Compare image vectors with vectors from the corresponding CLIP Text model.
+- Contrast language-aligned features with visual-only CNN and DINO representations.
+
+Available EIDORA variants of the same checkpoint:
+
+- **Image:** [CLIP Image](https://huggingface.co/EIDORA/CLIP_ViTB32_Image) — image inputs only.
+- **Text:** [CLIP Text](https://huggingface.co/EIDORA/CLIP_ViTB32_Text) — text inputs only.
+- **Multimodal:** [CLIP Multimodal](https://huggingface.co/EIDORA/CLIP_ViTB32_Multimodal) — image and text inputs combined by EIDORA.
+
+The image-only repository does not accept a text input.
 
-## Intended use
+## Input and Preprocessing
 
-- Semantic image grouping and retrieval.
-- Cultural collections where future text-to-image or multimodal search is important.
-- Comparing language-aligned similarity with purely visual DINO and CNN embeddings.
+EIDORA prepares the image before inference:
+
+1. Convert to RGB.
+2. Resize the shorter side to 224 pixels, then take a center crop of **224 × 224**.
+3. Use **bicubic** interpolation. Use **truncate** dimension rounding.
+4. Rescale by `0.00392156862745098` and normalize each RGB channel.
+5. Arrange the tensor in `NCHW` layout and pass `float32` `pixel_values` with shape `[batch, 3, 224, 224]`.
+
+**Mean:** `[0.48145466, 0.4578275, 0.40821073]`  
+**Standard deviation:** `[0.26862954, 0.26130258, 0.27577711]`
+
+Normalization is performed by EIDORA and should not be applied a second time. The defaults in `config.yaml` determine the documented embedding behavior; alternate settings may change the vectors.
+
+## Output Embeddings
+
+The ONNX output is `float32` with shape `['batch', 512]`. Each vector has **512 dimensions**, is **L2-normalized**, and is intended for **cosine similarity** comparisons.
+
+EIDORA uses the CLIP visual pooled projection and applies L2 normalization. The packaged graph expects images that EIDORA has already normalized.
+
+## Runtime and Compatibility
+
+The package uses `model.onnx` and schema-v3 runtime declarations for image preparation and embedding output.
+
+It declares **`CPUExecutionProvider`**. Actual execution availability depends on the installed ONNX Runtime and EIDORA Desktop environment. `config.yaml` is authoritative for graph inputs, preprocessing, provider and embedding dimensions.
 
 ## Limitations
 
-CLIP's training data are internet-derived and its own model card warns that task-specific testing is necessary. Cultural collections can differ strongly from its training distribution, and its image embeddings are shaped by language supervision. Use it as one view of similarity and compare against visual-only models.
+- The checkpoint is trained on internet-derived image–text pairs and may encode biases.
+- Image–text correspondence scores are not statements of factual accuracy or identity.
+- This package does not accept text; use the sibling Text or Multimodal model as appropriate.
+
+Results should be evaluated against the intended research data and questions.
+
+## Research Context and References
+
+### Main paper
 
-## License and attribution
+**Learning Transferable Visual Models From Natural Language Supervision**
 
-Converted from OpenAI CLIP ViT-B/32. Review the upstream model card and weight-redistribution terms before public release.
+Paper: https://arxiv.org/abs/2103.00020
 
-## Citation
+The publication describes the upstream learning method and original model. The embeddings returned by EIDORA additionally depend on the specific preprocessing and output adaptation documented here.
+
+### Primary citation (BibTeX)
 
 ```bibtex
 @inproceedings{radford2021learning,
@@ -106,12 +112,21 @@ Converted from OpenAI CLIP ViT-B/32. Review the upstream model card and weight-r
 }
 ```
 
-## EIDORA CLIP Variant Selection
+## License and Attribution
+
+The OpenAI CLIP source repository publishes MIT-licensed software. The linked upstream checkpoint information does not establish an independent weight license, so the MIT code license is not presented as one. EIDORA attributes the original checkpoint and research to OpenAI.
+
+No separate upstream checkpoint `LICENSE` file was supplied in the captured EIDORA repository; that absence should not be interpreted as permission or prohibition.
 
-Accepts images only. Produces normalized 512-dimensional CLIP image embeddings.
+## Package Information
 
-Related variants:
+- **Model repository:** `EIDORA/CLIP_ViTB32_Image`
+- **Package version:** `0.1.0`
+- **Package schema:** `3`
+- **EIDORA configuration:** `config.yaml`
+- **ONNX graph(s):** `model.onnx`
+- **Supported modality:** Image
+- **License identifier:** `other`
+- **Declared provider:** CPUExecutionProvider
 
-- **Image:** https://huggingface.co/EIDORA/CLIP_ViTB32_Image
-- **Text:** https://huggingface.co/EIDORA/CLIP_ViTB32_Text
-- **Multimodal:** https://huggingface.co/EIDORA/CLIP_ViTB32_Multimodal
+The configuration defines the authoritative model-facing runtime contract. Other packaged assets, where present, do not introduce additional inference modalities.

config.yaml

@@ -12,33 +12,9 @@ bibtex: "@inproceedings{radford2021learning,\n  title={Learning Transferable Vis
 compatibility:
   min_eidora_version: 0.1.0
 artifacts:
-- path: README.md
-  sha256: c080786beb305c66b51eb8ebf2bff16488ce7a2b4d55e4af7370612a4ec86c8c
-  role: asset
-- path: conversion_report.json
-  sha256: 16bc64c1fe16ae1fa9a0ddec9eadab4a1968e91251cf740563d3bd7908c3eb73
-  role: asset
 - path: model.onnx
   sha256: e7b31f500e645350c2bb0ade2a506e3d9557b2b75338e7941cf4d4db51ee29de
   role: graph
-- path: validation/embedding.npy
-  sha256: 4557f61170cbeadf8b82a6aedc7df3e2f5b70c55c1b02c63f16e26ce1b3224a9
-  role: asset
-- path: validation/photo.png
-  sha256: 1d70a03fc99c16e3aa674dbb9c7a8d0c127b45e1cf416118131451932b2f2389
-  role: asset
-- path: validation/pixels.npy
-  sha256: 49e3049b432634bb2d8c33a78f7a63404e5e9961016b7dd71156cb4a840ce7f3
-  role: asset
-- path: validation/random_image.npy
-  sha256: 2e7b24b32c98c0ae8c05f508b9b037c6c3e51b0ba35405e5f2594604c3acbf48
-  role: asset
-- path: validation/source_parity.json
-  sha256: b0b11dcf05aa4f4cfcfdd0e65bc907c825d6266c2ccc3082f0c1b10041997b9c
-  role: asset
-- path: validation.yaml
-  sha256: 91e0f9f79768b3a6c18904ccc7484f9867cd3eb967b2fec19c397ce8cf220db3
-  role: asset
 runtime:
   graph: model.onnx
   inputs:

conversion_report.json

@@ -1,18 +0,0 @@
-{
-  "converter": "hf_clip_vit_b32_image",
-  "embedding_dimensions": 512,
-  "input_name": "pixel_values",
-  "opset": 17,
-  "output_name": "embedding",
-  "schema_version": 1,
-  "source_framework": "pytorch",
-  "source_vs_onnx": {
-    "atol": 0.0001,
-    "max_abs_error": 1.9371509552001953e-07,
-    "mean_abs_error": 3.901260825500685e-08,
-    "onnxruntime_version": "1.30.0",
-    "rtol": 0.001,
-    "status": "passed"
-  },
-  "torch_version": "2.14.0+cu130"
-}

validation-report.json

@@ -1,26 +0,0 @@
-{
-  "desktop_version": "0.2.0",
-  "schema_version": 3,
-  "preparation_version": 2,
-  "providers": {
-    "CPUExecutionProvider": {
-      "status": "passed",
-      "fixture_runs": 19,
-      "scope": "session provider chain; CPU graph-node support allowed",
-      "environment": {
-        "onnxruntime": "1.31.0",
-        "platform": "Linux-7.0.0-38-generic-x86_64-with-glibc2.43",
-        "python": "3.13.16 (main, Oct  9 2026, 15:23:36) [Clang 22.1.3 ]"
-      }
-    }
-  },
-  "environment": {
-    "onnxruntime": "1.31.0",
-    "platform": "Linux-7.0.0-38-generic-x86_64-with-glibc2.43",
-    "python": "3.13.16 (main, Oct  9 2026, 15:23:36) [Clang 22.1.3 ]"
-  },
-  "publication_ready": true,
-  "validation_sha256": "06483a29bad05a7cf68ebe2649019ff292fbf41a34480f1ce59a8479fd3d8542",
-  "contract_sha256": "65c20b19452a5cedc6874434d8379a280d6c9b4343a4deab6d9772d93ee8d6b0",
-  "package_sha256": "e7496600fb53ceb312ba38ffd0f34ebf4d4a4b09bf2ad46377d5914462b65adb"
-}

validation.yaml

@@ -1,21 +0,0 @@
-diagnostic_fixtures:
-- id: random_image
-  path: validation/random_image.npy
-  input_shape:
-  - 1
-  - 3
-  - 224
-  - 224
-  expected_shape:
-  - 1
-  - 512
-  seed: 17
-fixtures:
-- modality: image
-  path: validation/photo.png
-  expected_tensors:
-    pixel_values: validation/pixels.npy
-  expected_vectors: validation/embedding.npy
-note: Publication requires real-media fixtures with source-reference expected_tensors
-  and expected_vectors, copied using assets. Synthetic diagnostic fixtures do not
-  certify compatibility.

validation/embedding.npy

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:4557f61170cbeadf8b82a6aedc7df3e2f5b70c55c1b02c63f16e26ce1b3224a9
-size 2176

validation/pixels.npy

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:49e3049b432634bb2d8c33a78f7a63404e5e9961016b7dd71156cb4a840ce7f3
-size 602240

validation/random_image.npy

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:2e7b24b32c98c0ae8c05f508b9b037c6c3e51b0ba35405e5f2594604c3acbf48
-size 602240

validation/source_parity.json

@@ -1,14 +0,0 @@
-{
-  "model": "CLIP Image ViT-B/32",
-  "source_checkpoint": "openai/clip-vit-base-patch32",
-  "image_sha256": "1d70a03fc99c16e3aa674dbb9c7a8d0c127b45e1cf416118131451932b2f2389",
-  "onnx_sha256": "e7b31f500e645350c2bb0ade2a506e3d9557b2b75338e7941cf4d4db51ee29de",
-  "preprocessing_max_abs_error": 4.76837158203125e-07,
-  "embedding_max_abs_error": 3.119930624961853e-07,
-  "cosine_similarity": 0.9999999403953552,
-  "output_shape": [
-    1,
-    512
-  ],
-  "status": "passed"
-}