InvokeAI/invokeai
Lincoln Stein 532f82cb97
Optimize RAM to VRAM transfer (#6312)
* avoid copying model back from cuda to cpu

* handle models that don't have state dicts

* add assertions that models need a `device()` method

* do not rely on torch.nn.Module having the device() method

* apply all patches after model is on the execution device

* fix model patching in latents too

* log patched tokenizer

* closes #6375

---------

Co-authored-by: Lincoln Stein <lstein@gmail.com>
2024-05-24 17:06:09 +00:00
..
app Optimize RAM to VRAM transfer (#6312) 2024-05-24 17:06:09 +00:00
assets
backend Optimize RAM to VRAM transfer (#6312) 2024-05-24 17:06:09 +00:00
configs feat(mm): support sdxl ckpt inpainting models 2024-04-28 12:57:27 +10:00
frontend fix(ui): isLocal erroneously hardcoded 2024-05-25 00:05:44 +10:00
invocation_api
version Update invokeai_version.py 2024-05-24 08:00:03 +10:00
__init__.py