Steven Frank
e509d719ee
Fix attempt to deserialize on CUDA on Mac
...
Without specifying "cpu", attempts to use non-existent CUDA to deserialize embeddings on macOS, resulting in a warning / failure to load.
2023-11-28 09:24:57 +11:00
psychedelicious
7653d21cf5
feat(backend): rename realesrgan class & upscale method
2023-11-28 07:58:22 +11:00
psychedelicious
46a2d83b84
feat(backend): organise realesrgan code, add license
...
- Moved util to own folder
- BSD3 License for RealESRGAN repo added
2023-11-28 07:58:22 +11:00
psychedelicious
2192210910
feat(nodes): remove dependency on realesrgan
...
We used the `RealESRGANer` utility class from the repo. It handled model loading and tiled upscaling logic.
Unfortunately, it hasn't been updated in over a year, had no types, and annoyingly printed to console.
I've adapted the class, cleaning it up a bit and removing the bits that are not relevant for us.
Upscaling functionality is identical.
2023-11-28 07:58:22 +11:00
Lincoln Stein
98a4930a52
add probe support for LCM main models
2023-11-22 14:58:27 -05:00
psychedelicious
1a596a5684
fix(backend): fix unintentional change to import orders
...
- Ignore I001 (isort rules) for this file
- Ignore F401 (unused imports) for this file
2023-11-21 20:22:27 +11:00
psychedelicious
da443973cb
chore: ruff
2023-11-21 20:22:27 +11:00
Lincoln Stein
acc0a29dca
fixed ruff formatting issues
2023-11-13 18:15:17 -05:00
Lincoln Stein
38c1436f02
resolve conflicts; blackify
2023-11-13 18:12:45 -05:00
Lincoln Stein
efbdb75568
implement psychedelicious recommendations as of 13 November
2023-11-13 17:05:01 -05:00
psychedelicious
bc64cde6f9
chore: ruff lint
2023-11-14 07:57:07 +11:00
psychedelicious
4465f97cdf
Merge branch 'main' into refactor/model-manager-2
2023-11-14 07:51:57 +11:00
psychedelicious
04d8f2dfea
fix(backend): fix controlnet zip len
...
Do not use `strict=True` when scaling controlnet conditioning.
When using `guess_mode` (e.g. `more_control` or `more_prompt`), `down_block_res_samples` and `scales` are zipped.
These two objects are of different lengths, so using zip's strict mode raises an error.
In testing, `len(scales) === len(down_block_res_samples) + 1`.
It appears this behaviour is intentional, as the final "extra" item in `scales` is used immediately afterwards.
2023-11-13 15:45:03 +11:00
Lincoln Stein
8c71ff37ae
Update config.py
...
Co-authored-by: psychedelicious <4822129+psychedelicious@users.noreply.github.com>
2023-11-12 19:03:39 -05:00
Lincoln Stein
8afe517204
add note about discriminated union and Body() issue; blackified
2023-11-12 16:50:05 -05:00
Lincoln Stein
7ea2a135f1
remove dangling import
2023-11-11 12:24:58 -05:00
Lincoln Stein
af2264b6eb
implement workaround for FastAPI and discriminated unions in Body parameter
2023-11-11 12:22:38 -05:00
Lincoln Stein
2b36565e9e
awkward workaround for double-Annotated in model_record route
2023-11-10 21:32:44 -05:00
Lincoln Stein
cb8cdefd59
Merge branch 'main' into refactor/model-manager-2
2023-11-10 19:24:19 -05:00
Lincoln Stein
f1c846ba5c
blackify
2023-11-10 19:14:29 -05:00
Lincoln Stein
3a6ba236f5
replace _class_map in ModelConfigFactory with a nested discriminated union
2023-11-10 19:14:15 -05:00
psychedelicious
6494e8e551
chore: ruff format
2023-11-11 10:55:40 +11:00
psychedelicious
513fceac82
chore: ruff check - fix pycodestyle
2023-11-11 10:55:33 +11:00
psychedelicious
99a8ebe3a0
chore: ruff check - fix flake8-bugbear
2023-11-11 10:55:28 +11:00
psychedelicious
3a136420d5
chore: ruff check - fix flake8-comprensions
2023-11-11 10:55:23 +11:00
Lincoln Stein
0544917161
multiple small fixes suggested in reviews from psychedelicious and ryan
2023-11-10 18:25:37 -05:00
Lincoln Stein
f1c195afb7
Merge branch 'main' into refactor/model-manager-2
2023-11-10 17:54:28 -05:00
Wubbbi
6001d3d71d
Change pad_to_multiple_of to be 8 for all cases. Add comment about it's temporary status
2023-11-10 17:51:59 -05:00
Wubbbi
8831d1ee41
Update Documentation
2023-11-10 17:51:59 -05:00
Wubbbi
a0be83e370
Update Transformers to 4.34 and fix pad_to_multiple_of
2023-11-10 17:51:59 -05:00
Lincoln Stein
8702a63197
add support for downloading and installing LCM lora diffusers models
2023-11-10 17:51:30 -05:00
blessedcoolant
356b5a41a9
wip: Add LCMScheduler
2023-11-10 06:54:36 -08:00
psychedelicious
2570497d83
fix(installer): fix import of ValidationError
...
It was being imported from a deprecated module
2023-11-10 06:11:15 +11:00
psychedelicious
6aa87f973e
fix(nodes): create app/shared/ module to prevent circular imports
...
We have a number of shared classes, objects, and functions that are used in multiple places. This causes circular import issues.
This commit creates a new `app/shared/` module to hold these shared classes, objects, and functions.
Initially, only `FreeUConfig` and `FieldDescriptions` are moved here. This resolves a circular import issue with custom nodes.
Other shared classes, objects, and functions will be moved here in future commits.
2023-11-09 16:41:55 +11:00
Lincoln Stein
927f8a66e6
Merge branch 'main' into refactor/model-manager-2
2023-11-08 16:46:08 -05:00
Lincoln Stein
6b173cc66f
multiple small stylistic changes requested by reviewers
2023-11-08 16:45:26 -05:00
Lincoln Stein
ce22c0fbaa
sync pydantic and sql field names; merge routes
2023-11-06 18:08:57 -05:00
Kent Keirsey
ff8a8a1963
Merge branch 'main' into feat/nodes/freeu
2023-11-06 09:04:54 -08:00
Kent Keirsey
67f2616d5a
Merge branch 'main' into revert-4923-revert-4914-feat/mix-cnet-t2iadapter
2023-11-06 07:34:51 -08:00
Kent Keirsey
e66d0f7372
Merge branch 'main' into feat/nodes/freeu
2023-11-06 05:39:58 -08:00
Lincoln Stein
edeea5237b
add sql-based model config store and api
2023-11-04 23:03:26 -04:00
Ryan Dick
aa02ebf8f5
Fix model cache gc.collect() condition.
2023-11-04 08:52:10 -04:00
Ryan Dick
fb3d0c4b12
Fix bug in model cache reference count checking.
2023-11-03 13:50:40 -07:00
Ryan Dick
8488ab0134
Reduce frequency that we call gc.collect() in the model cache.
2023-11-03 13:50:40 -07:00
Ryan Dick
875231ed3d
Add reminder to clean up our model cache clearing logic.
2023-11-03 13:50:40 -07:00
Ryan Dick
43b300498f
Remove explicit gc.collect() after transferring models from device to CPU. I'm not sure why this was there in the first place, but it was taking a significant amount of time (up to ~1sec in my tests).
2023-11-03 13:50:40 -07:00
Ryan Dick
e391f3c9a8
Skip torch.nn.Embedding.reset_parameters(...) when loading a text encoder model.
2023-11-02 19:41:33 -07:00
Ryan Dick
6e7a3f0546
(minor) Fix static checks and typo.
2023-11-02 19:20:37 -07:00
Ryan Dick
4a683cc669
Add a app config parameter to control the ModelCache logging behavior.
2023-11-02 19:20:37 -07:00
Ryan Dick
3781e56e57
Add log_memory_usage param to ModelCache.
2023-11-02 19:20:37 -07:00
