mirror of
https://github.com/invoke-ai/InvokeAI
synced 2024-08-30 20:32:17 +00:00
b101be041b
This is still a work in progress but seems functional. It supports inpainting, txt2img and img2img on the ddim and k* samplers (plms still needs work, but I know what to do). To test this, get the file `sd-v1-5-inpainting.ckpt' from https://huggingface.co/runwayml/stable-diffusion-inpainting and place it at `models/ldm/stable-diffusion-v1/sd-v1-5-inpainting.ckpt` Launch invoke.py with --model inpainting-1.5 and proceed as usual. Caveats: 1. The inpainting model takes about 800 Mb more memory than the standard 1.5 model. This model will not work on 4 GB cards. 2. The inpainting model is temperamental. It wants you to describe the entire scene and not just the masked area to replace. So if you want to replace the parrot on a man's shoulder with a crow, the prompt "crow" may fail. Try "man with a crow on shoulder" instead. The symptom of a failed inpainting is that the area will be erased and replaced with background. 3. This has not been tested well. Please report bugs.
30 lines
1.1 KiB
YAML
30 lines
1.1 KiB
YAML
# This file describes the alternative machine learning models
|
|
# available to the dream script.
|
|
#
|
|
# To add a new model, follow the examples below. Each
|
|
# model requires a model config file, a weights file,
|
|
# and the width and height of the images it
|
|
# was trained on.
|
|
stable-diffusion-1.4:
|
|
config: configs/stable-diffusion/v1-inference.yaml
|
|
weights: models/ldm/stable-diffusion-v1/model.ckpt
|
|
# vae: models/ldm/stable-diffusion-v1/vae-ft-mse-840000-ema-pruned.ckpt
|
|
description: Stable Diffusion inference model version 1.4
|
|
default: true
|
|
width: 512
|
|
height: 512
|
|
inpainting-1.5:
|
|
description: runwayML tuned inpainting model v1.5
|
|
weights: models/ldm/stable-diffusion-v1/sd-v1-5-inpainting.ckpt
|
|
config: configs/stable-diffusion/v1-inpainting-inference.yaml
|
|
# vae: models/ldm/stable-diffusion-v1/vae-ft-mse-840000-ema-pruned.ckpt
|
|
width: 512
|
|
height: 512
|
|
stable-diffusion-1.5:
|
|
config: configs/stable-diffusion/v1-inference.yaml
|
|
weights: models/ldm/stable-diffusion-v1/v1-5-pruned-emaonly.ckpt
|
|
# vae: models/ldm/stable-diffusion-v1/vae-ft-mse-840000-ema-pruned.ckpt
|
|
description: Stable Diffusion inference model version 1.5
|
|
width: 512
|
|
height: 512
|