LCM_Dreamshaper_v7 for CV Studio: Core ML (macOS) and ONNX int8 (Windows), TAESD, manifest

README.md

@@ -0,0 +1,30 @@
+---
+license: mit
+tags: [text-to-image, latent-consistency-model, coreml, onnx]
+base_model: SimianLuo/LCM_Dreamshaper_v7
+---
+
+# CV Studio illustrator (on-device)
+
+Ready-to-run conversions used by the CV Studio desktop app to draw one illustration per sentence of a video, on the
+customer's own machine (no PyTorch at run time):
+
+| Folder | Runtime | Contents |
+|---|---|---|
+| `macos/` | Core ML (macOS 14+, Apple Silicon) | `text_encoder.mlpackage` (fp16), `unet_6bit.mlpackage` (6-bit palettised), `taesd_decoder.mlpackage`, `tokenizer.json` |
+| `windows/` | ONNX Runtime (CPU / DirectML) | `text_encoder_int8.onnx`, `unet_int8.onnx` (dynamic int8), `taesd_decoder.onnx`, `tokenizer.json` |
+
+Inputs: UNet `(sample 1×4×64×64, timestep 1, encoder_hidden_states 1×77×768) → noise_pred`, with the LCM guidance
+embedding (w = 8) built in; 4 LCM steps; the TAESD decoder returns RGB in [0, 1] at 512×512. `manifest.json` lists
+every file with its size and SHA-256.
+
+## Origin and licences
+
+- **LCM_Dreamshaper_v7** by Simian Luo et al. (https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7), published under
+  the **MIT** licence; it is a latent consistency model distilled from **DreamShaper v7** (Lykon), a Stable Diffusion
+  1.5 fine-tune released under the **CreativeML OpenRAIL-M** licence. To respect the upstream terms, the use
+  restrictions of OpenRAIL-M (Attachment A: no illegal, harmful, discriminatory, defamatory or deceptive use, no
+  medical advice, no exploitation of minors, etc.) are passed on to users of these files.
+- **TAESD** (Tiny AutoEncoder for Stable Diffusion) by Ollin Boer Bohan (https://github.com/madebyollin/taesd), MIT.
+- The conversions (Core ML palettisation, ONNX export and int8 quantisation) were made by the CV Studio team; no
+  weights were retrained.

macos/taesd_decoder.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7816cfc92ae44120b5bbbd78c799846db0706e595c2c62931383babdc2f37650
+size 57534

macos/taesd_decoder.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79efdfd4b22bf3bcab3bb62172f566e335ef339c3ff073ec7d4c35732c6dc740
+size 2449344

macos/taesd_decoder.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "A25D51AC-2B7F-4891-B107-AF0FF479C99F": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        },
+        "BE8038CE-7344-462D-8ACD-11E5E47D76E2": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        }
+    },
+    "rootModelIdentifier": "BE8038CE-7344-462D-8ACD-11E5E47D76E2"
+}

macos/text_encoder.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ab96d88ea7a1bdc21f253b1e0f2a61e9567bf81dab84dfddc1e4b73d3aa9a1d7
+size 129597

macos/text_encoder.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0f682780ccd108498488eab5738130d4825ebb4d3eeaa8a7ac7c578530eac093
+size 246145536

macos/text_encoder.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "0A9D97F7-AFBC-44DC-A682-D52EE4175307": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        },
+        "17F71030-F9F7-4EB2-8FA5-61C37E04C6C0": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        }
+    },
+    "rootModelIdentifier": "0A9D97F7-AFBC-44DC-A682-D52EE4175307"
+}

macos/unet_6bit.mlpackage/Data/com.apple.CoreML/model.mlmodel

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c740d8fe338e23a8b9dbd77a03c422ad0daf8368e2db9e83a1b25816245bd5d2
+size 773369

macos/unet_6bit.mlpackage/Data/com.apple.CoreML/weights/weight.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:363346f49f0f9b342da017fe51cacac9b7f4196989e565d0a4071081a516a960
+size 645326144

macos/unet_6bit.mlpackage/Manifest.json

@@ -0,0 +1,18 @@
+{
+    "fileFormatVersion": "1.0.0",
+    "itemInfoEntries": {
+        "2126D12B-1D3C-4BD7-88D8-857D429FFC7E": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Specification",
+            "name": "model.mlmodel",
+            "path": "com.apple.CoreML/model.mlmodel"
+        },
+        "3B00BEA7-B8DF-4A36-B605-5B1099A325C5": {
+            "author": "com.apple.CoreML",
+            "description": "CoreML Model Weights",
+            "name": "weights",
+            "path": "com.apple.CoreML/weights"
+        }
+    },
+    "rootModelIdentifier": "2126D12B-1D3C-4BD7-88D8-857D429FFC7E"
+}

manifest.json

@@ -0,0 +1,67 @@
+{
+ "model": "LCM_Dreamshaper_v7",
+ "steps": 4,
+ "size": 512,
+ "files": {
+  "README.md": {
+   "size": 1796,
+   "sha256": "4bef62f591413b2bab44bf9d54e3af2b5d7f3b872c8d91e4de9e33116ac2ad86"
+  },
+  "macos/taesd_decoder.mlpackage/Data/com.apple.CoreML/model.mlmodel": {
+   "size": 57534,
+   "sha256": "7816cfc92ae44120b5bbbd78c799846db0706e595c2c62931383babdc2f37650"
+  },
+  "macos/taesd_decoder.mlpackage/Data/com.apple.CoreML/weights/weight.bin": {
+   "size": 2449344,
+   "sha256": "79efdfd4b22bf3bcab3bb62172f566e335ef339c3ff073ec7d4c35732c6dc740"
+  },
+  "macos/taesd_decoder.mlpackage/Manifest.json": {
+   "size": 617,
+   "sha256": "411108ef105759c519624ff2b91014e3d09169a19931a3718e8d40330b44f6ea"
+  },
+  "macos/text_encoder.mlpackage/Data/com.apple.CoreML/model.mlmodel": {
+   "size": 129597,
+   "sha256": "ab96d88ea7a1bdc21f253b1e0f2a61e9567bf81dab84dfddc1e4b73d3aa9a1d7"
+  },
+  "macos/text_encoder.mlpackage/Data/com.apple.CoreML/weights/weight.bin": {
+   "size": 246145536,
+   "sha256": "0f682780ccd108498488eab5738130d4825ebb4d3eeaa8a7ac7c578530eac093"
+  },
+  "macos/text_encoder.mlpackage/Manifest.json": {
+   "size": 617,
+   "sha256": "d2f51e4aebadb534d5af6f70c66488c6a6bbdad190b5b5720228014d5c8e44ee"
+  },
+  "macos/tokenizer.json": {
+   "size": 3642072,
+   "sha256": "13104770298661de73a73c53d7d9ec718527bb9d0fc6e7080b8a9173b649d4bb"
+  },
+  "macos/unet_6bit.mlpackage/Data/com.apple.CoreML/model.mlmodel": {
+   "size": 773369,
+   "sha256": "c740d8fe338e23a8b9dbd77a03c422ad0daf8368e2db9e83a1b25816245bd5d2"
+  },
+  "macos/unet_6bit.mlpackage/Data/com.apple.CoreML/weights/weight.bin": {
+   "size": 645326144,
+   "sha256": "363346f49f0f9b342da017fe51cacac9b7f4196989e565d0a4071081a516a960"
+  },
+  "macos/unet_6bit.mlpackage/Manifest.json": {
+   "size": 617,
+   "sha256": "1b29d9f2b05a16c5b2e749c83bebfc6222b20ed08044a3c681831c038505d641"
+  },
+  "windows/taesd_decoder.onnx": {
+   "size": 4913012,
+   "sha256": "0badd58a353c29b2bf665b534b4518e2e59b0cf9e7127979a71f64c71af9a9fd"
+  },
+  "windows/text_encoder_int8.onnx": {
+   "size": 123691702,
+   "sha256": "6f9f0de97fcc19a8300120fb30ed3335f088e719c1b21e3214a364bfd92a8bba"
+  },
+  "windows/tokenizer.json": {
+   "size": 3642072,
+   "sha256": "13104770298661de73a73c53d7d9ec718527bb9d0fc6e7080b8a9173b649d4bb"
+  },
+  "windows/unet_int8.onnx": {
+   "size": 862388800,
+   "sha256": "d1e98b9ca0d750e58ae21570169dd7d88b79ae748fa994944ad3845e6cf62db0"
+  }
+ }
+}

windows/taesd_decoder.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0badd58a353c29b2bf665b534b4518e2e59b0cf9e7127979a71f64c71af9a9fd
+size 4913012

windows/text_encoder_int8.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f9f0de97fcc19a8300120fb30ed3335f088e719c1b21e3214a364bfd92a8bba
+size 123691702

windows/unet_int8.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d1e98b9ca0d750e58ae21570169dd7d88b79ae748fa994944ad3845e6cf62db0
+size 862388800