Text-to-Image
Diffusers
Safetensors
StableDiffusionXLInpaintPipeline
stable-diffusion-xl
stable-diffusion-xl-diffusers
inpainting
Instructions to use diffusers/stable-diffusion-xl-1.0-inpainting-0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use diffusers/stable-diffusion-xl-1.0-inpainting-0.1 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import AutoPipelineForInpainting from diffusers.utils import load_image # switch to "mps" for apple devices pipe = AutoPipelineForInpainting.from_pretrained("diffusers/stable-diffusion-xl-1.0-inpainting-0.1", dtype=torch.float16, device_map="cuda") img_url = "https://raw.githubusercontent.com/CompVis/latent-diffusion/main/data/inpainting_examples/overture-creations-5sI6fQgYIuo.png" mask_url = "https://raw.githubusercontent.com/CompVis/latent-diffusion/main/data/inpainting_examples/overture-creations-5sI6fQgYIuo_mask.png" image = load_image(img_url).resize((1024, 1024)) mask_image = load_image(mask_url).resize((1024, 1024)) prompt = "a tiger sitting on a park bench" generator = torch.Generator(device="cuda").manual_seed(0) image = pipe( prompt=prompt, image=image, mask_image=mask_image, guidance_scale=8.0, num_inference_steps=20, # steps between 15 and 30 work well for us strength=0.99, # make sure to use `strength` below 1.0 generator=generator, ).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
output_type="latent" not working
#7
by Yakonrus - opened
base_inpaint_pipe = AutoPipelineForInpainting.from_pretrained(
"diffusers/stable-diffusion-xl-1.0-inpainting-0.1",
torch_dtype=torch.float16,
variant="fp16",
use_safetensors=True,
add_watermarker=False,
)
base_inpaint_pipe.enable_model_cpu_offload(gpu_id=gpu_id)
PIL images at the input
with and without load_image()
image = base_inpaint_pipe(
prompt=prompt,
negative_prompt=nprompt,
image=load_image(image_s),
mask_image=load_image(head),
strength=0.75,
num_inference_steps=20,
guidance_scale=12,
output_type="latent",
generator=generator,
).images
image = base_inpaint_pipe(
prompt=prompt,
negative_prompt=nprompt,
image=image,
mask_image=load_image(face),
strength=0.65,
num_inference_steps=30,
generator=generator,
).images[0]
diffusers\pipelines\stable_diffusion_xl\pipeline_stable_diffusion_xl_inpaint.py", line 1150, in call
num_channels_masked_image = masked_image_latents.shape[1]
AttributeError: 'NoneType' object has no attribute 'shape'
image = base_inpaint_pipe(
prompt=prompt,
negative_prompt=nprompt,
image=load_image(image_s),
mask_image=load_image(head),
strength=0.75,
num_inference_steps=20,
guidance_scale=12,
output_type="latent",
generator=generator,
).images
image = base_inpaint_pipe(
prompt=prompt,
negative_prompt=nprompt,
image=load_image(image),
mask_image=load_image(face),
strength=0.65,
num_inference_steps=30,
generator=generator,
).images[0]
diffusers\utils\testing_utils.py", line 288, in load_image
raise ValueError(
ValueError: Incorrect format used for image. Should be an url linking to an image, a local path, or a PIL image.