Lincoln Stein
7fadd5e5c4
performance: low-memory option for calculating guidance sequentially ( #2732 )
...
In theory, this reduces peak memory consumption by doing the conditioned
and un-conditioned predictions one after the other instead of in a
single mini-batch.
In practice, it doesn't reduce the reported "Max VRAM used for this
generation" for me, even without xformers. (But it does slow things down
by a good 18%.)
That suggests to me that the peak memory usage is during VAE decoding,
not the diffusion unet, but ymmv. It does [improve things for gogurt's
16 GB
M1](https://github.com/invoke-ai/InvokeAI/pull/2732#issuecomment-1436187407 ),
so it seems worthwhile.
To try it out, use the `--sequential_guidance` option:
2dded68267/ldm/invoke/args.py (L487-L492)
2023-02-20 23:00:54 -05:00
Lincoln Stein
4c2a588e1f
Merge branch 'main' into perf/lowmem_sequential_guidance
2023-02-20 22:40:31 -05:00
Lincoln Stein
5f9de762ff
update installation docs for 2.3.1 installer screens ( #2749 )
...
This PR updates the manual page for automatic installation, and contains
screenshots of the new installer screens.
2023-02-20 22:40:02 -05:00
Lincoln Stein
91f7abb398
replace repeated triggers with <filename>
2023-02-20 22:33:13 -05:00
Damian Stewart
6420b81a5d
Merge remote-tracking branch 'upstream/main' into refactor_use_compel
2023-02-20 23:34:38 +01:00
Lincoln Stein
b6ed5eafd6
update installation docs for 2.3.1 installer screens
2023-02-20 17:24:52 -05:00
blessedcoolant
694d5aa2e8
Add 'update' action to launcher script ( #2636 )
...
- Adds an update action to launcher script
- This action calls new python script `invokeai-update`, which prompts
user to update to latest release version, main development version, or
an arbitrary git tag or branch name.
- It then uses `pip` to update to whatever tag was specified.
The user interface (such as it is) looks like this:
2023-02-21 11:17:22 +13:00
Lincoln Stein
833079140b
Merge branch 'main' into enhance/update-menu
2023-02-20 17:16:20 -05:00
Lincoln Stein
fd27948c36
Merge branch 'main' into perf/lowmem_sequential_guidance
2023-02-20 17:15:33 -05:00
Damian Stewart
1dfaaa2a57
fix web ui issues
2023-02-20 22:58:07 +01:00
Lincoln Stein
bac6b50dd1
During textual inversion training, skip over non-image files ( #2747 )
...
- The TI script was looping over all files in the training image
directory, regardless of whether they were image files or not. This PR
adds a check for image file extensions.
-
- Closes #2715
2023-02-20 16:17:32 -05:00
blessedcoolant
a30c91f398
Merge branch 'main' into bugfix/textual-inversion-training
2023-02-21 09:58:19 +13:00
Lincoln Stein
17294bfa55
restore ability of textual inversion manager to read .pt files ( #2746 )
...
- Fixes longstanding bug in the token vector size code which caused .pt
files to be assigned the wrong token vector length. These were then
tossed out during directory scanning.
2023-02-20 15:34:56 -05:00
Lincoln Stein
3fa1771cc9
Merge branch 'main' into perf/lowmem_sequential_guidance
2023-02-20 15:20:15 -05:00
Lincoln Stein
f3bd386ff0
Merge branch 'main' into bugfix/textual-inversion-training
2023-02-20 15:19:53 -05:00
Lincoln Stein
8486ce31de
Merge branch 'main' into bugfix/embedding-vector-length
2023-02-20 15:19:36 -05:00
Lincoln Stein
1d9845557f
reduced verbosity of embed loading messages
2023-02-20 15:18:55 -05:00
Lincoln Stein
55dce6cfdd
remove more dead code
2023-02-20 15:08:07 -05:00
Lincoln Stein
58be915446
Merge branch 'main' into install/refactor-configure-and-model-select
2023-02-20 14:48:41 -05:00
blessedcoolant
dc9268f772
[WebUI] Symmetry Fix ( #2745 )
...
Symmetry now has a toggle on and off. Won't be passed if not enabled.
Symmetry settings now moved to their accordion.
2023-02-21 08:47:23 +13:00
Lincoln Stein
47ddc00c6a
in textual inversion training, skip over non-image files
...
- Closes #2715
2023-02-20 14:44:10 -05:00
Lincoln Stein
0d22fd59ed
restore ability of textual inversion manager to read .pt files
...
- Fixes longstanding bug in the token vector size code which caused
.pt files to be assigned the wrong token vector length. These
were then tossed out during directory scanning.
2023-02-20 14:34:14 -05:00
blessedcoolant
d5efd57c28
Merge branch 'symmetry-fix' of https://github.com/blessedcoolant/InvokeAI into symmetry-fix
2023-02-21 07:44:34 +13:00
blessedcoolant
b52a92da7e
build: symmetry-fix-2
2023-02-21 07:43:56 +13:00
blessedcoolant
b949162e7e
Revert Symmetry Big Size Input
2023-02-21 07:42:20 +13:00
blessedcoolant
5409991256
Merge branch 'main' into symmetry-fix
2023-02-21 07:29:53 +13:00
blessedcoolant
be1bcbc173
build: symmetry-fix
2023-02-21 07:28:25 +13:00
blessedcoolant
d6196e863d
Move symmetry settings to their own accordion
2023-02-21 07:25:24 +13:00
blessedcoolant
63e790b79b
fix crash in CLI when --save_intermediates called ( #2744 )
...
Fixes #2733
2023-02-21 07:16:45 +13:00
Lincoln Stein
cf53bba99e
Merge branch 'main' into bugfix/save-intermediates
2023-02-20 12:51:53 -05:00
Lincoln Stein
ed4c8f6a8a
fix crash in CLI when --save_intermediates called
...
Fixes #2733
2023-02-20 12:50:32 -05:00
Lincoln Stein
aab8263c31
Fix crash on calling diffusers' prepare_attention_mask ( #2743 )
...
Diffusers' `prepare_attention_mask` was crashing when we didn't pass in
a batch size.
2023-02-20 12:35:33 -05:00
Jonathan
b21bd6f428
Fix crash on calling diffusers' prepare_attention_mask
...
Diffusers' `prepare_attention_mask` was crashing when we didn't pass in a batch size.
2023-02-20 11:12:47 -06:00
Kevin Turner
cb6903dfd0
Merge branch 'main' into perf/lowmem_sequential_guidance
2023-02-20 08:03:11 -08:00
blessedcoolant
cd87ca8214
Correctly detect when an embedding is incompatible with the current model ( #2736 )
...
- Fixed the test for token length; tested on several .pt and .bin files
- Also added a __main__ entrypoint for CLI.py, to make pdb debugging a
bit more convenient.
2023-02-21 04:32:32 +13:00
blessedcoolant
58e5bf5a58
Merge branch 'main' into bugfix/embedding-compatibility-test
2023-02-21 04:09:18 +13:00
blessedcoolant
f17c7ca6f7
[WebUI] Symmetry Settings ( #2741 )
...
Add the newly added Symmetry settings to the WebUI.
2023-02-21 04:07:30 +13:00
blessedcoolant
c3dd28cff9
Merge branch 'main' into symmetry-webui
2023-02-21 04:06:54 +13:00
blessedcoolant
db4e1e8b53
add @lstein and @blessedcoolant to all codeowner paths ( #2742 )
...
- In an emergency, one or the other of these individuals will be
available to review any part of the code.
2023-02-21 04:06:23 +13:00
Lincoln Stein
3e43c3e698
add @lstein and @blessedcoolant to all paths
...
- In an emergency, one or the other of these individuals will
be available to review any part of the code.
2023-02-20 10:02:32 -05:00
blessedcoolant
cc7733af1c
Merge branch 'main' into enhance/update-menu
2023-02-21 03:54:40 +13:00
blessedcoolant
2a29734a56
Merge branch 'main' into symmetry-webui
2023-02-21 03:18:47 +13:00
blessedcoolant
f2e533f7c8
build: threshold slider fix
2023-02-21 03:17:41 +13:00
blessedcoolant
078f897b67
Revert Threshold Slider to older values
2023-02-21 02:57:00 +13:00
Matthias Wild
8352ab2076
remove old swagger related files since security issues ( #2730 )
2023-02-20 14:55:21 +01:00
Matthias Wild
1a3d47814b
Merge branch 'main' into update/docs/remove-swagger-related-files
2023-02-20 14:54:22 +01:00
Lincoln Stein
e852ad0a51
fix bug that prevented converted files from being written into models.yaml`
2023-02-20 08:48:54 -05:00
blessedcoolant
136cd0e868
Merge branch 'main' into symmetry-webui
2023-02-21 02:43:40 +13:00
blessedcoolant
7afe26320a
build: symmetry-settings
2023-02-21 02:41:26 +13:00
Lincoln Stein
702da71515
swap y/n values for broken model reconfiguration prompt
2023-02-20 08:34:46 -05:00
