7err4 commited on
Commit
18c5014
·
verified ·
1 Parent(s): e895cd0

Model card and example images

Browse files
Files changed (10) hide show
  1. .gitattributes +8 -0
  2. README.md +71 -0
  3. fumika_0.jpg +3 -0
  4. fumika_1.jpg +3 -0
  5. fumika_2.jpg +3 -0
  6. fumika_examples.jpg +3 -0
  7. terra_0.jpg +3 -0
  8. terra_1.jpg +3 -0
  9. terra_2.jpg +3 -0
  10. terra_examples.jpg +3 -0
.gitattributes CHANGED
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ fumika_0.jpg filter=lfs diff=lfs merge=lfs -text
37
+ fumika_1.jpg filter=lfs diff=lfs merge=lfs -text
38
+ fumika_2.jpg filter=lfs diff=lfs merge=lfs -text
39
+ fumika_examples.jpg filter=lfs diff=lfs merge=lfs -text
40
+ terra_0.jpg filter=lfs diff=lfs merge=lfs -text
41
+ terra_1.jpg filter=lfs diff=lfs merge=lfs -text
42
+ terra_2.jpg filter=lfs diff=lfs merge=lfs -text
43
+ terra_examples.jpg filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,74 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ base_model: OpenMOSS-Team/MOSS-Image-Base
4
+ tags:
5
+ - lora
6
+ - moss-image
7
+ - character-reference
8
+ - image-editing
9
+ - anime
10
+ library_name: comfyui
11
  ---
12
+
13
+ # MOSS-Image CharRef v2
14
+
15
+ A character-reference LoRA for **MOSS-Image Base**: give it one picture of a character as *Picture 1* and a prompt, and it draws
16
+ that character – face, hair, outfit and art style – in a new scene. No per-character LoRA training needed.
17
+
18
+ It works on single images and on whole comic pages (MOSS JSON page layouts with panels and speech bubbles). It is the
19
+ "reference picture" option of the [Fumika](https://github.com/7err4/fumika) app.
20
+
21
+ ## Usage (ComfyUI ≥ 0.42)
22
+
23
+ Needs the [ComfyUI-MOSS-Image-Ostris-Edit](https://github.com/ostris/ComfyUI-MOSS-Image-Ostris-Edit) node (reference latents +
24
+ KV cache).
25
+
26
+ 1. `MOSSImageOstrisEditModelPatch` (kv_cache on) → `LoraLoaderModelOnly` with this LoRA at 1.0
27
+ 2. `TextEncodeMOSSImageOstrisEdit` with your reference as `image1` and a prompt that starts with
28
+ **`Same character and art style as Picture 1.`** followed by the scene (tags or sentences, or a MOSS JSON page layout)
29
+ 3. negative: the same encoder with an empty prompt
30
+ 4. 50 steps, cfg 3, euler / sgm_uniform, SkipLayerGuidance on single layer 22 (MOSS full mode)
31
+
32
+ Tips:
33
+ - A few appearance words in the prompt (hair style, eye colour, key outfit pieces) noticeably improve fidelity.
34
+ - Outfits follow the reference unless the prompt names other clothing – so you can change outfits by text.
35
+ - Clean, large references (full body or bust, plain background) work best.
36
+
37
+ ## Examples
38
+
39
+ Reference (left) → three new scenes, CharRef v2 at 1.0, MOSS-Image full mode (50 steps, cfg 3, sgm_uniform, SLG single layer 22),
40
+ 832×1216, prompt = prefix + scene tags + appearance words. No cherry-picking: one seed per scene.
41
+
42
+ ![Fumika: library, rooftop at sunset, kitchen](fumika_examples.jpg)
43
+ ![Terra: library, rooftop at sunset, kitchen](terra_examples.jpg)
44
+
45
+ ## Training
46
+
47
+ - ai-toolkit edit mode (`arch: moss_image`, `edit: true`, `kv_cache: true`), LoRA rank 32 / alpha 32, AdamW8bit 1e-4, batch 1,
48
+ 1000 steps, 1024 px, MOSS-Image Base bf16.
49
+ - ~1330 reference → target pairs: anime character art and synthetic renders of anime characters in many scenes, and renders of well-known adult anime
50
+ characters with mixed body types (2 references + 8 scenes each). Safe / suggestive only, no nudity; captions =
51
+ prefix + outfit / scene / pose tags, identity never named (it has to come from the picture).
52
+ - Recipe idea from [pleiades7/MOSS-Image-CharRef-PoC](https://huggingface.co/pleiades7/MOSS-Image-CharRef-PoC) (v1 of this LoRA
53
+ showed inflated proportions; v2 rebalanced the data).
54
+
55
+ ## Limitations
56
+
57
+ - Fine hair details (e.g. a single coloured streak, exact ponytail) can drift without appearance words in the prompt.
58
+ - One reference per image: scenes with several characters only take the identity of *Picture 1* reliably.
59
+ - Inherits MOSS-Image's limits (small text, hands).
60
+ - Trained on anime art: photo and 3D styles survive, but a photorealistic / 3D face is not kept reliably (outfit and hair are,
61
+ the face drifts between scenes). Use it for anime / illustrated characters.
62
+ - A reference cropped from a comic panel carries its props over (door, mug, even the speech bubble) – crop to the character.
63
+
64
+ ## Prohibited use
65
+
66
+ Do not use this LoRA, alone or with other models, to:
67
+
68
+ - create intimate or sexually explicit images of an identifiable real person without their explicit consent;
69
+ - create child sexual abuse material or any sexual depiction of minors;
70
+ - build or extend facial recognition databases by untargeted scraping of facial images;
71
+ - manipulate people subliminally or deceptively in ways that cause them or others harm.
72
+
73
+ These are prohibited practices under Art. 5 of the EU AI Act (as amended in 2026). If you publish a picture that resembles a
74
+ real person, place or event and could pass as authentic (a deep fake), you must disclose that it is AI-generated (Art. 50(4)).
fumika_0.jpg ADDED

Git LFS Details

  • SHA256: fe1d0d9cbaf55e7ca166ed563483654093153ee11d74ac53d08e27c7770336ab
  • Pointer size: 131 Bytes
  • Size of remote file: 291 kB
fumika_1.jpg ADDED

Git LFS Details

  • SHA256: d75c4c3c53ac991b1c738e5774be886fa3f2c537fc18370150c9ad499fcb6125
  • Pointer size: 131 Bytes
  • Size of remote file: 218 kB
fumika_2.jpg ADDED

Git LFS Details

  • SHA256: 566e03c2d0f8d771ed8722758130edcb3a4b7c7ff33888c7a86947b12fabebfd
  • Pointer size: 131 Bytes
  • Size of remote file: 255 kB
fumika_examples.jpg ADDED

Git LFS Details

  • SHA256: 4d6c5b150dd6efcfcdf26c49692a476479d24f0476633898d09507ac3110a282
  • Pointer size: 131 Bytes
  • Size of remote file: 300 kB
terra_0.jpg ADDED

Git LFS Details

  • SHA256: 9f3179aa99b3e60e5a5e493411167f8c978764a1220f892a19dde392228896de
  • Pointer size: 131 Bytes
  • Size of remote file: 264 kB
terra_1.jpg ADDED

Git LFS Details

  • SHA256: a869782ff6fdeb154adbc8dc3f3e2e308b491950ce90af4bde007dcaa1c939c0
  • Pointer size: 131 Bytes
  • Size of remote file: 165 kB
terra_2.jpg ADDED

Git LFS Details

  • SHA256: 28c9a823ac4e0df64d9caec26d7ac735ca2eaea44c4c11eae7210be5dd5cce9e
  • Pointer size: 131 Bytes
  • Size of remote file: 226 kB
terra_examples.jpg ADDED

Git LFS Details

  • SHA256: 18424e8c66460a67c8b6d422ee69a332460a579a8625ad5ccfe62f0d4942d48e
  • Pointer size: 131 Bytes
  • Size of remote file: 249 kB