Instructions to use Andyrasika/lora_diffusion with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Andyrasika/lora_diffusion with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Andyrasika/lora_diffusion", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
File size: 1,414 Bytes
c25a4ab d3d1b30 50f0536 d59e138 50f0536 9fe794f 50f0536 d3d1b30 f3eb465 d3d1b30 50f0536 d3d1b30 650c6e9 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 | ---
license: creativeml-openrail-m
library_name: diffusers
pipeline_tag: text-to-image
---
The model is created using the following steps:
- Find the desired model (checkpoint or lora) on Civitai
- You can see some conversion scripts in diffusesrs. This time, only the scripts for converting checkpoit and lora are used.
It depends on the model type of Civitai. If it is a lora model, you need to specify a basic model
- Using __load_lora function from https://towardsdatascience.com/improving-diffusers-package-for-high-quality-image-generation-a50fff04bdd4
```
from diffusers import DiffusionPipeline
import torch
pipeline = DiffusionPipeline.from_pretrained(
"Andyrasika/lora_diffusion"
,custom_pipeline = "lpw_stable_diffusion"
,torch_dtype=torch.float16
)
lora = ("/content/lora_model.safetensors",0.8)
pipeline = __load_lora(pipeline=pipeline,lora_path=lora[0],lora_weight=lora[1])
pipeline.to("cuda")
# pipeline.enable_xformers_memory_efficient_attention()
#https://huggingface.co/docs/diffusers/optimization/fp16
pipeline.enable_vae_tiling()
prompt = """
shukezouma,negative space,shuimobysim
a branch of flower, traditional chinese ink painting
"""
image = pipeline(prompt).images[0]
image
```
<hr>
Since this is only the first official release, I believe there are still many, many imperfections.
Please provide feedback in time, and I will continuously make corrections, thank you!
|