InvokeAI/ldm
Lincoln Stein b101be041b add support for runwayML custom inpainting model
This is still a work in progress but seems functional. It supports
inpainting, txt2img and img2img on the ddim and k* samplers (plms
still needs work, but I know what to do).

To test this, get the file `sd-v1-5-inpainting.ckpt' from
https://huggingface.co/runwayml/stable-diffusion-inpainting and place it
at `models/ldm/stable-diffusion-v1/sd-v1-5-inpainting.ckpt`

Launch invoke.py with --model inpainting-1.5 and proceed as usual.

Caveats:

1. The inpainting model takes about 800 Mb more memory than the standard
   1.5 model. This model will not work on 4 GB cards.

2. The inpainting model is temperamental. It wants you to describe the
   entire scene and not just the masked area to replace. So if you want
   to replace the parrot on a man's shoulder with a crow, the prompt
   "crow" may fail. Try "man with a crow on shoulder" instead. The
   symptom of a failed inpainting is that the area will be erased and
   replaced with background.

3. This has not been tested well. Please report bugs.
2022-10-25 10:45:15 -04:00
..
data Textual Inversion for M1 2022-09-27 01:39:17 +02:00
invoke add support for runwayML custom inpainting model 2022-10-25 10:45:15 -04:00
models add support for runwayML custom inpainting model 2022-10-25 10:45:15 -04:00
modules Merge branch 'development' into fix-high-step-count 2022-10-21 06:55:17 -04:00
generate.py inpaint and txt2img working with ddim sampler 2022-10-25 10:00:28 -04:00
lr_scheduler.py prettified all the code using "blue" at the urging of @tildebyte 2022-08-26 03:15:42 -04:00
simplet2i.py Squashed commit of the following: 2022-09-12 14:31:48 -04:00
util.py add ability to import and edit alternative models online 2022-10-13 23:48:07 -04:00