Text-to-Image
Diffusers
TensorBoard
stable-diffusion
stable-diffusion-diffusers
lora
diffusers-training
Instructions to use iamkaikai/FUI-LORA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use iamkaikai/FUI-LORA with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("runwayml/stable-diffusion-v1-5", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("iamkaikai/FUI-LORA") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
End of training
Browse files- README.md +6 -0
- image_0.png +0 -0
- image_1.png +0 -0
- image_2.png +0 -0
- image_3.png +0 -0
- logs/text2image-fine-tune/1711387848.4333377/events.out.tfevents.1711387848.DESKTOP-TNN0PMP.72720.1 +3 -0
- logs/text2image-fine-tune/1711387848.4363356/hparams.yml +50 -0
- logs/text2image-fine-tune/1711387945.5272832/events.out.tfevents.1711387945.DESKTOP-TNN0PMP.77632.1 +3 -0
- logs/text2image-fine-tune/1711387945.5292826/hparams.yml +50 -0
- logs/text2image-fine-tune/events.out.tfevents.1711387421.DESKTOP-TNN0PMP.69980.0 +2 -2
- logs/text2image-fine-tune/events.out.tfevents.1711387848.DESKTOP-TNN0PMP.72720.0 +3 -0
- logs/text2image-fine-tune/events.out.tfevents.1711387945.DESKTOP-TNN0PMP.77632.0 +3 -0
- pytorch_lora_weights.safetensors +1 -1
README.md
CHANGED
|
@@ -37,6 +37,12 @@ tags:
|
|
| 37 |
- diffusers
|
| 38 |
- diffusers-training
|
| 39 |
- lora
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
base_model: runwayml/stable-diffusion-v1-5
|
| 41 |
inference: true
|
| 42 |
---
|
|
|
|
| 37 |
- diffusers
|
| 38 |
- diffusers-training
|
| 39 |
- lora
|
| 40 |
+
- stable-diffusion
|
| 41 |
+
- stable-diffusion-diffusers
|
| 42 |
+
- text-to-image
|
| 43 |
+
- diffusers
|
| 44 |
+
- diffusers-training
|
| 45 |
+
- lora
|
| 46 |
base_model: runwayml/stable-diffusion-v1-5
|
| 47 |
inference: true
|
| 48 |
---
|
image_0.png
CHANGED
|
|
image_1.png
CHANGED
|
|
image_2.png
CHANGED
|
|
image_3.png
CHANGED
|
|
logs/text2image-fine-tune/1711387848.4333377/events.out.tfevents.1711387848.DESKTOP-TNN0PMP.72720.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:259cdd4bf4cad3c79a9ce457766f4c713c2e1595613be2c0775cab95059f69f7
|
| 3 |
+
size 2399
|
logs/text2image-fine-tune/1711387848.4363356/hparams.yml
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.01
|
| 5 |
+
allow_tf32: true
|
| 6 |
+
cache_dir: null
|
| 7 |
+
caption_column: text
|
| 8 |
+
center_crop: true
|
| 9 |
+
checkpointing_steps: 800
|
| 10 |
+
checkpoints_total_limit: 2
|
| 11 |
+
dataloader_num_workers: 0
|
| 12 |
+
dataset_config_name: null
|
| 13 |
+
dataset_name: iamkaikai/FUI-ART
|
| 14 |
+
enable_xformers_memory_efficient_attention: false
|
| 15 |
+
gradient_accumulation_steps: 1
|
| 16 |
+
gradient_checkpointing: false
|
| 17 |
+
hub_model_id: FUI-LORA
|
| 18 |
+
hub_token: null
|
| 19 |
+
image_column: image
|
| 20 |
+
learning_rate: 0.0001
|
| 21 |
+
local_rank: -1
|
| 22 |
+
logging_dir: logs
|
| 23 |
+
lr_scheduler: constant
|
| 24 |
+
lr_warmup_steps: 400
|
| 25 |
+
max_grad_norm: 1.0
|
| 26 |
+
max_train_samples: null
|
| 27 |
+
max_train_steps: 195
|
| 28 |
+
mixed_precision: fp16
|
| 29 |
+
noise_offset: 0
|
| 30 |
+
num_train_epochs: 15
|
| 31 |
+
num_validation_images: 4
|
| 32 |
+
output_dir: FUI-LORA
|
| 33 |
+
prediction_type: null
|
| 34 |
+
pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
|
| 35 |
+
push_to_hub: true
|
| 36 |
+
random_flip: true
|
| 37 |
+
rank: 4
|
| 38 |
+
report_to: tensorboard
|
| 39 |
+
resolution: 512
|
| 40 |
+
resume_from_checkpoint: null
|
| 41 |
+
revision: null
|
| 42 |
+
scale_lr: false
|
| 43 |
+
seed: 1337
|
| 44 |
+
snr_gamma: null
|
| 45 |
+
train_batch_size: 16
|
| 46 |
+
train_data_dir: null
|
| 47 |
+
use_8bit_adam: false
|
| 48 |
+
validation_epochs: 20
|
| 49 |
+
validation_prompt: FUI-ART, white, black, gray, silver, indigo
|
| 50 |
+
variant: null
|
logs/text2image-fine-tune/1711387945.5272832/events.out.tfevents.1711387945.DESKTOP-TNN0PMP.77632.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:358b50d3a5f3c832ecea95dc9e832323b65c6a48a816ee2c9f80b2656a32fb4c
|
| 3 |
+
size 2398
|
logs/text2image-fine-tune/1711387945.5292826/hparams.yml
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.01
|
| 5 |
+
allow_tf32: true
|
| 6 |
+
cache_dir: null
|
| 7 |
+
caption_column: text
|
| 8 |
+
center_crop: true
|
| 9 |
+
checkpointing_steps: 800
|
| 10 |
+
checkpoints_total_limit: 2
|
| 11 |
+
dataloader_num_workers: 0
|
| 12 |
+
dataset_config_name: null
|
| 13 |
+
dataset_name: iamkaikai/FUI-ART
|
| 14 |
+
enable_xformers_memory_efficient_attention: false
|
| 15 |
+
gradient_accumulation_steps: 1
|
| 16 |
+
gradient_checkpointing: false
|
| 17 |
+
hub_model_id: FUI-LORA
|
| 18 |
+
hub_token: null
|
| 19 |
+
image_column: image
|
| 20 |
+
learning_rate: 0.0001
|
| 21 |
+
local_rank: -1
|
| 22 |
+
logging_dir: logs
|
| 23 |
+
lr_scheduler: constant
|
| 24 |
+
lr_warmup_steps: 400
|
| 25 |
+
max_grad_norm: 1.0
|
| 26 |
+
max_train_samples: null
|
| 27 |
+
max_train_steps: 130
|
| 28 |
+
mixed_precision: fp16
|
| 29 |
+
noise_offset: 0
|
| 30 |
+
num_train_epochs: 10
|
| 31 |
+
num_validation_images: 4
|
| 32 |
+
output_dir: FUI-LORA
|
| 33 |
+
prediction_type: null
|
| 34 |
+
pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
|
| 35 |
+
push_to_hub: true
|
| 36 |
+
random_flip: true
|
| 37 |
+
rank: 4
|
| 38 |
+
report_to: tensorboard
|
| 39 |
+
resolution: 512
|
| 40 |
+
resume_from_checkpoint: null
|
| 41 |
+
revision: null
|
| 42 |
+
scale_lr: false
|
| 43 |
+
seed: 1337
|
| 44 |
+
snr_gamma: null
|
| 45 |
+
train_batch_size: 16
|
| 46 |
+
train_data_dir: null
|
| 47 |
+
use_8bit_adam: false
|
| 48 |
+
validation_epochs: 20
|
| 49 |
+
validation_prompt: FUI-ART, black, gray, black, silver, black
|
| 50 |
+
variant: null
|
logs/text2image-fine-tune/events.out.tfevents.1711387421.DESKTOP-TNN0PMP.69980.0
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7bcc98270f881f3a59253ed6fd68eeeac88d8ad69a5b84af8921e94811ee46d0
|
| 3 |
+
size 4829554
|
logs/text2image-fine-tune/events.out.tfevents.1711387848.DESKTOP-TNN0PMP.72720.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a6f6a94d0ed5cfcdbb0347c9ef51fb7f2c1a78fdec09eb2f7bf1d823c2b52b30
|
| 3 |
+
size 2219560
|
logs/text2image-fine-tune/events.out.tfevents.1711387945.DESKTOP-TNN0PMP.77632.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ca0c59631b0addcf05ddb809240885e03a4bed2135d953a292a356a7bb5d7832
|
| 3 |
+
size 2119330
|
pytorch_lora_weights.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3226184
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:625b531d96eb64f71f78aaa77757be9f5c6af554f32b4d1c20374373cb6c87a5
|
| 3 |
size 3226184
|