InvokeAI/invokeai/app/invocations
Lincoln Stein 532f82cb97
Optimize RAM to VRAM transfer (#6312)
* avoid copying model back from cuda to cpu

* handle models that don't have state dicts

* add assertions that models need a `device()` method

* do not rely on torch.nn.Module having the device() method

* apply all patches after model is on the execution device

* fix model patching in latents too

* log patched tokenizer

* closes #6375

---------

Co-authored-by: Lincoln Stein <lstein@gmail.com>
2024-05-24 17:06:09 +00:00
..
custom_nodes fix(nodes): gracefully handle custom nodes init error 2024-04-02 13:25:14 +11:00
__init__.py fix(config): remove unnecessary resolve on config path 2024-03-19 09:24:28 +11:00
baseinvocation.py fix(config): use new get_config across the app, use correct settings 2024-03-19 09:24:28 +11:00
collections.py fix(nodes): restore type annotations for InvocationContext 2024-03-01 10:42:33 +11:00
compel.py Optimize RAM to VRAM transfer (#6312) 2024-05-24 17:06:09 +00:00
constants.py chore: ruff formatting 2024-03-01 10:42:33 +11:00
controlnet_image_processors.py feat(nodes): make all ModelIdentifierField inputs accept connections 2024-05-19 20:14:01 +10:00
cv.py chore: bump nodes versions 2024-03-20 10:28:07 +11:00
facetools.py chore: bump nodes versions 2024-03-20 10:28:07 +11:00
fields.py Rename MaskField to be a generice TensorField. 2024-04-09 08:12:12 -04:00
image.py feat(nodes): use new blur_if_nsfw method 2024-05-14 07:23:38 +10:00
infill.py feat(nodes): disable mosaic fill 2024-04-05 08:49:13 +11:00
ip_adapter.py feat(nodes): make all ModelIdentifierField inputs accept connections 2024-05-19 20:14:01 +10:00
latent.py Optimize RAM to VRAM transfer (#6312) 2024-05-24 17:06:09 +00:00
mask.py feat(nodes): image mask to tensor invocation 2024-04-20 11:32:08 -04:00
math.py chore: bump nodes versions 2024-03-20 10:28:07 +11:00
metadata.py tidy(nodes): move cnet mode literals to utils 2024-04-25 13:20:09 +10:00
model.py feat(nodes): make ModelIdentifierInvocation a prototype 2024-05-19 20:14:01 +10:00
noise.py [util] Add generic torch device class (#6174) 2024-04-15 13:12:49 +00:00
param_easing.py chore: bump nodes versions 2024-03-20 10:28:07 +11:00
primitives.py Rename MaskField to be a generice TensorField. 2024-04-09 08:12:12 -04:00
prompt.py chore: bump nodes versions 2024-03-20 10:28:07 +11:00
sdxl.py feat(nodes): make all ModelIdentifierField inputs accept connections 2024-05-19 20:14:01 +10:00
strings.py chore: bump nodes versions 2024-03-20 10:28:07 +11:00
t2i_adapter.py feat(nodes): make all ModelIdentifierField inputs accept connections 2024-05-19 20:14:01 +10:00
tiles.py chore: bump nodes versions 2024-03-20 10:28:07 +11:00
upscale.py [util] Add generic torch device class (#6174) 2024-04-15 13:12:49 +00:00
util.py fix(nodes): fix constraints/validation for controlnet 2024-01-02 07:28:53 -05:00