Lincoln Stein a3cb5da130 Improve RAM<->VRAM memory copy performance in LoRA patching and elsewhere (#6490) ... * allow model patcher to optimize away the unpatching step when feasible * remove lazy_offloading functionality * allow model patcher to optimize away the unpatching step when feasible * remove lazy_offloading functionality * do not save original weights if there is a CPU copy of state dict * Update invokeai/backend/model_manager/load/load_base.py Co-authored-by: Ryan Dick <ryanjdick3@gmail.com> * documentation fixes requested during penultimate review * add non-blocking=True parameters to several torch.nn.Module.to() calls, for slight performance increases * fix ruff errors * prevent crash on non-cuda-enabled systems --------- Co-authored-by: Lincoln Stein <lstein@gmail.com> Co-authored-by: Kent Keirsey <31807370+hipsterusername@users.noreply.github.com> Co-authored-by: Ryan Dick <ryanjdick3@gmail.com>		2024-06-13 17:10:03 +00:00
..
onnx_runtime.py	Improve RAM<->VRAM memory copy performance in LoRA patching and elsewhere (#6490)	2024-06-13 17:10:03 +00:00