Lincoln Stein
7ea2a135f1
remove dangling import
2023-11-11 12:24:58 -05:00
Lincoln Stein
af2264b6eb
implement workaround for FastAPI and discriminated unions in Body parameter
2023-11-11 12:22:38 -05:00
Lincoln Stein
2b36565e9e
awkward workaround for double-Annotated in model_record route
2023-11-10 21:32:44 -05:00
Lincoln Stein
cb8cdefd59
Merge branch 'main' into refactor/model-manager-2
2023-11-10 19:24:19 -05:00
Lincoln Stein
f1c846ba5c
blackify
2023-11-10 19:14:29 -05:00
Lincoln Stein
3a6ba236f5
replace _class_map in ModelConfigFactory with a nested discriminated union
2023-11-10 19:14:15 -05:00
Lincoln Stein
0544917161
multiple small fixes suggested in reviews from psychedelicious and ryan
2023-11-10 18:25:37 -05:00
Lincoln Stein
f1c195afb7
Merge branch 'main' into refactor/model-manager-2
2023-11-10 17:54:28 -05:00
Wubbbi
6001d3d71d
Change pad_to_multiple_of to be 8 for all cases. Add comment about it's temporary status
2023-11-10 17:51:59 -05:00
Wubbbi
8831d1ee41
Update Documentation
2023-11-10 17:51:59 -05:00
Wubbbi
a0be83e370
Update Transformers to 4.34 and fix pad_to_multiple_of
2023-11-10 17:51:59 -05:00
Lincoln Stein
8702a63197
add support for downloading and installing LCM lora diffusers models
2023-11-10 17:51:30 -05:00
blessedcoolant
356b5a41a9
wip: Add LCMScheduler
2023-11-10 06:54:36 -08:00
psychedelicious
2570497d83
fix(installer): fix import of ValidationError
...
It was being imported from a deprecated module
2023-11-10 06:11:15 +11:00
psychedelicious
6aa87f973e
fix(nodes): create app/shared/ module to prevent circular imports
...
We have a number of shared classes, objects, and functions that are used in multiple places. This causes circular import issues.
This commit creates a new `app/shared/` module to hold these shared classes, objects, and functions.
Initially, only `FreeUConfig` and `FieldDescriptions` are moved here. This resolves a circular import issue with custom nodes.
Other shared classes, objects, and functions will be moved here in future commits.
2023-11-09 16:41:55 +11:00
Lincoln Stein
927f8a66e6
Merge branch 'main' into refactor/model-manager-2
2023-11-08 16:46:08 -05:00
Lincoln Stein
6b173cc66f
multiple small stylistic changes requested by reviewers
2023-11-08 16:45:26 -05:00
Lincoln Stein
ce22c0fbaa
sync pydantic and sql field names; merge routes
2023-11-06 18:08:57 -05:00
Kent Keirsey
ff8a8a1963
Merge branch 'main' into feat/nodes/freeu
2023-11-06 09:04:54 -08:00
Kent Keirsey
67f2616d5a
Merge branch 'main' into revert-4923-revert-4914-feat/mix-cnet-t2iadapter
2023-11-06 07:34:51 -08:00
Kent Keirsey
e66d0f7372
Merge branch 'main' into feat/nodes/freeu
2023-11-06 05:39:58 -08:00
Lincoln Stein
edeea5237b
add sql-based model config store and api
2023-11-04 23:03:26 -04:00
Ryan Dick
aa02ebf8f5
Fix model cache gc.collect() condition.
2023-11-04 08:52:10 -04:00
Ryan Dick
fb3d0c4b12
Fix bug in model cache reference count checking.
2023-11-03 13:50:40 -07:00
Ryan Dick
8488ab0134
Reduce frequency that we call gc.collect() in the model cache.
2023-11-03 13:50:40 -07:00
Ryan Dick
875231ed3d
Add reminder to clean up our model cache clearing logic.
2023-11-03 13:50:40 -07:00
Ryan Dick
43b300498f
Remove explicit gc.collect() after transferring models from device to CPU. I'm not sure why this was there in the first place, but it was taking a significant amount of time (up to ~1sec in my tests).
2023-11-03 13:50:40 -07:00
Ryan Dick
e391f3c9a8
Skip torch.nn.Embedding.reset_parameters(...) when loading a text encoder model.
2023-11-02 19:41:33 -07:00
Ryan Dick
6e7a3f0546
(minor) Fix static checks and typo.
2023-11-02 19:20:37 -07:00
Ryan Dick
4a683cc669
Add a app config parameter to control the ModelCache logging behavior.
2023-11-02 19:20:37 -07:00
Ryan Dick
3781e56e57
Add log_memory_usage param to ModelCache.
2023-11-02 19:20:37 -07:00
Ryan Dick
8ff49109a8
Update get_pretty_snapshot_diff(...) to handle None-snapshots.
2023-11-02 19:20:37 -07:00
Ryan Dick
bac2a757e8
Replace deepcopy with a pickle roundtrip in apply_ti(...) to improve speed.
2023-11-02 19:05:24 -07:00
Ryan Dick
fa7f6a6a10
Further tidying of LoRA patching. Revert some changes that didn't end up being important under the constraint that calculations are done on the same device as the model.
2023-11-02 10:03:17 -07:00
Ryan Dick
61b17c475a
Add TODO note about improving _resolve_lora_key(...).
2023-11-02 10:03:17 -07:00
Ryan Dick
379d68f595
Patch LoRA on device when model is already on device.
2023-11-02 10:03:17 -07:00
Ryan Dick
545c811bf1
Remove device and dtype members from LoRAModelRaw, they can too easily get out-of-sync with the underlying layer states.
2023-11-02 10:03:17 -07:00
Ryan Dick
2ba5b44ec4
Remove unused _lora_forward_hook(...).
2023-11-02 10:03:17 -07:00
Ryan Dick
7f4ce518b7
auto-format lora.py
2023-11-02 10:03:17 -07:00
Lincoln Stein
5c9046580f
Merge branch 'main' into bugfix/textual-inversion
2023-10-24 14:17:43 -04:00
Lincoln Stein
6cbc69f3b7
support conversion of controlnets from safetensors to diffusers
2023-10-23 22:06:10 -04:00
Lincoln Stein
3546c41f4a
close #4975
2023-10-23 18:48:14 -04:00
d8ahazard
fdf02c33d0
Catch generic model errors
...
Prevent the app from dying on invalid models.
2023-10-19 07:28:33 +11:00
Ryan Dick
a078efc0f2
Merge branch 'main' into ryan/multi-image-ip
2023-10-18 08:59:12 -04:00
psychedelicious
252c9a5f5a
fix(backend): fix nsfw/watermarker util types
2023-10-18 09:08:13 +11:00
Kent Keirsey
b7555ddae8
Revert "Revert "chore: lint""
...
This reverts commit 38e7eb8878
2023-10-17 11:59:19 -04:00
Kent Keirsey
8afc47018b
Revert "Revert "Cleaning up (removing diagnostic prints)""
...
This reverts commit 6e697b7b6f
2023-10-17 11:59:19 -04:00
Kent Keirsey
a97ec88e06
Revert "Revert "Changes to _apply_standard_conditioning_sequentially() and _apply_cross_attention_controlled_conditioning() to reflect changes to T2I-Adapter implementation to allow usage of T2I-Adapter and ControlNet at the same time.""
...
This reverts commit c04fb451ee
2023-10-17 11:59:19 -04:00
Kent Keirsey
282d36b640
Revert "Revert "Fixing some var and arg names.""
...
This reverts commit 58a0709c1e
2023-10-17 11:59:19 -04:00
psychedelicious
58a0709c1e
Revert "Fixing some var and arg names."
...
This reverts commit f11ba81a8d
2023-10-17 11:59:11 -04:00
