Instructions to use raaedk/subliminal with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use raaedk/subliminal with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-3.5-medium", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("raaedk/subliminal") prompt = "unconditional (blank prompt)" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
| license: other | |
| base_model: "stabilityai/stable-diffusion-3.5-medium" | |
| tags: | |
| - sd3 | |
| - sd3-diffusers | |
| - text-to-image | |
| - diffusers | |
| - simpletuner | |
| - safe-for-work | |
| - lora | |
| - template:sd-lora | |
| - lycoris | |
| inference: true | |
| widget: | |
| - text: 'unconditional (blank prompt)' | |
| parameters: | |
| negative_prompt: 'blurry, cropped, ugly' | |
| output: | |
| url: ./assets/image_0_0.png | |
| - text: 'ps2 graphics, fog filled space, subliminal' | |
| parameters: | |
| negative_prompt: 'blurry, cropped, ugly' | |
| output: | |
| url: ./assets/image_1_0.png | |
| # subliminal | |
| This is a LyCORIS adapter derived from [stabilityai/stable-diffusion-3.5-medium](https://huggingface.co/stabilityai/stable-diffusion-3.5-medium). | |
| The main validation prompt used during training was: | |
| ``` | |
| ps2 graphics, fog filled space, subliminal | |
| ``` | |
| ## Validation settings | |
| - CFG: `5.0` | |
| - CFG Rescale: `0.0` | |
| - Steps: `20` | |
| - Sampler: `None` | |
| - Seed: `42` | |
| - Resolution: `1024x1024` | |
| Note: The validation settings are not necessarily the same as the [training settings](#training-settings). | |
| You can find some example images in the following gallery: | |
| <Gallery /> | |
| The text encoder **was not** trained. | |
| You may reuse the base model text encoder for inference. | |
| ## Training settings | |
| - Training epochs: 1 | |
| - Training steps: 4000 | |
| - Learning rate: 0.0001 | |
| - Max grad norm: 0.01 | |
| - Effective batch size: 1 | |
| - Micro-batch size: 1 | |
| - Gradient accumulation steps: 1 | |
| - Number of GPUs: 1 | |
| - Prediction type: flow-matching | |
| - Rescaled betas zero SNR: False | |
| - Optimizer: adamw_bf16 | |
| - Precision: Pure BF16 | |
| - Quantised: No | |
| - Xformers: Not used | |
| - LyCORIS Config: | |
| ```json | |
| { | |
| "algo": "lora", | |
| "multiplier": 1.0, | |
| "linear_dim": 64, | |
| "linear_alpha": 32, | |
| "apply_preset": { | |
| "target_module": [ | |
| "Attention", | |
| "FeedForward" | |
| ], | |
| "module_algo_map": { | |
| "Attention": { | |
| "factor": 16 | |
| }, | |
| "FeedForward": { | |
| "factor": 8 | |
| } | |
| } | |
| } | |
| } | |
| ``` | |
| ## Datasets | |
| ### subliminal-512 | |
| - Repeats: 10 | |
| - Total number of images: 55 | |
| - Total number of aspect buckets: 1 | |
| - Resolution: 0.262144 megapixels | |
| - Cropped: False | |
| - Crop style: None | |
| - Crop aspect: None | |
| - Used for regularisation data: No | |
| ### subliminal-1024 | |
| - Repeats: 10 | |
| - Total number of images: 55 | |
| - Total number of aspect buckets: 2 | |
| - Resolution: 1.048576 megapixels | |
| - Cropped: False | |
| - Crop style: None | |
| - Crop aspect: None | |
| - Used for regularisation data: No | |
| ### subliminal-512-crop | |
| - Repeats: 10 | |
| - Total number of images: 55 | |
| - Total number of aspect buckets: 1 | |
| - Resolution: 0.262144 megapixels | |
| - Cropped: True | |
| - Crop style: random | |
| - Crop aspect: square | |
| - Used for regularisation data: No | |
| ### subliminal-1024-crop | |
| - Repeats: 10 | |
| - Total number of images: 55 | |
| - Total number of aspect buckets: 1 | |
| - Resolution: 1.048576 megapixels | |
| - Cropped: True | |
| - Crop style: random | |
| - Crop aspect: square | |
| - Used for regularisation data: No | |
| ## Inference | |
| ```python | |
| import torch | |
| from diffusers import DiffusionPipeline | |
| from lycoris import create_lycoris_from_weights | |
| model_id = 'stabilityai/stable-diffusion-3.5-medium' | |
| adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually | |
| lora_scale = 1.0 | |
| wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer) | |
| wrapper.merge_to() | |
| prompt = "ps2 graphics, fog filled space, subliminal" | |
| negative_prompt = 'blurry, cropped, ugly' | |
| pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu') | |
| image = pipeline( | |
| prompt=prompt, | |
| negative_prompt=negative_prompt, | |
| num_inference_steps=20, | |
| generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826), | |
| width=1024, | |
| height=1024, | |
| guidance_scale=5.0, | |
| ).images[0] | |
| image.save("output.png", format="PNG") | |
| ``` | |