Ryan Dick
|
75d0558241
|
Code cleanup and documentation around FLUX inpainting.
|
2024-08-30 14:46:04 +00:00 |
|
Ryan Dick
|
262b67b9cb
|
Split FLUX VAE decoding out into its own node from LatentsToImageInvocation.
|
2024-08-29 21:19:50 +00:00 |
|
Ryan Dick
|
6a89176c6a
|
Split FLUX VAE encoding out into its own node from ImageToLatentsInvocation.
|
2024-08-29 21:12:51 +00:00 |
|
Ryan Dick
|
7d854f32b0
|
Get a rough version of FLUX inpainting working.
|
2024-08-29 19:21:12 +00:00 |
|
Ryan Dick
|
e0f12c762e
|
Update MaskTensorToImageInvocation to support input mask tensors with or without a channel dimension.
|
2024-08-29 19:21:12 +00:00 |
|
Ryan Dick
|
bfa9de6826
|
Remove unused vae field from FLUXTextToImageInvocation.
|
2024-08-29 19:21:12 +00:00 |
|
Ryan Dick
|
a67340e628
|
Bump FLUX node versions after splitting out VAE encode/decode.
|
2024-08-29 19:21:12 +00:00 |
|
Ryan Dick
|
4384858be2
|
Split VAE decoding out from the FLUXTextToImageInvocation.
|
2024-08-29 19:21:12 +00:00 |
|
Ryan Dick
|
b33cba500c
|
Get FLUX non-masked image-to-image working - still rough.
|
2024-08-29 19:21:12 +00:00 |
|
Ryan Dick
|
e3a7bf12c1
|
Add FLUX VAE decoding support to LatentsToImageInvocation.
|
2024-08-29 19:21:12 +00:00 |
|
Ryan Dick
|
21701173d8
|
Add FLUX VAE support to ImageToLatentsInvocation.
|
2024-08-29 19:21:12 +00:00 |
|
Ryan Dick
|
4e4b6c6dbc
|
Tidy variable management and dtype handling in FluxTextToImageInvocation.
|
2024-08-29 19:08:18 +00:00 |
|
Ryan Dick
|
5e8cf9fb6a
|
Remove hack to clear cache from the FluxTextToImageInvocation. We now clear the cache based on the on-disk model size.
|
2024-08-29 19:08:18 +00:00 |
|
Ryan Dick
|
c738fe051f
|
Split T5 encoding and CLIP encoding into separate functions to ensure that all model references are locally-scoped so that the two models don't have to be help in memory at the same time.
|
2024-08-29 19:08:18 +00:00 |
|
maryhipp
|
16825ee6e9
|
feat(nodes): bump version of flux model node, update default workflow
|
2024-08-29 11:52:51 -04:00 |
|
Mary Hipp
|
3f5340fa53
|
feat(nodes): add submodels as inputs to FLUX main model node instead of hardcoded names
|
2024-08-29 11:52:51 -04:00 |
|
Brandon Rising
|
2d185fb766
|
Run ruff
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
849da67cc7
|
Remove no longer used code in the flux denoise function
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
3ea6c9666e
|
Remove in progress images until we're able to make the valuable
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
635d2f480d
|
ruff
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
70c278c810
|
Remove dependency on flux config files
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
56b9906e2e
|
Setup scaffolding for in progress images and add ability to cancel the flux node
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
5063be92bf
|
Switch flux to using its own conditioning field
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
6764dcfdaa
|
Load and unload clip/t5 encoders and run inference separately in text encoding
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
a0bf20bcee
|
Run FLUX VAE decoding in the user's preferred dtype rather than float32. Tested, and seems to work well at float16.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
14ab339b33
|
Move prepare_latent_image_patches(...) to sampling.py with all of the related FLUX inference code.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
25c91efbb6
|
Rename field positive_prompt -> prompt.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
d7c22b3bf7
|
Tidy is_schnell detection logic.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
185f2a395f
|
Make FLUX get_noise(...) consistent across devices/dtypes.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
0c5649491e
|
Mark FLUX nodes as prototypes.
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
c27d59baf7
|
Run ruff
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
f130ddec7c
|
Remove automatic install of models during flux model loader, remove no longer used import function on context
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
a0a259eef1
|
Fix max_seq_len field description.
|
2024-08-26 20:17:50 -04:00 |
|
maryhipp
|
5d0b248fdb
|
fix(worker) fix T5 type
|
2024-08-26 20:17:50 -04:00 |
|
maryhipp
|
5fed573a29
|
update flux_model_loader node to take a T5 encoder from node field instead of hardcoded list, assume all models have been downloaded
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
df9445c351
|
Various styling and exception type updates
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
71f18353a9
|
Address minor review comments.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
4228de707b
|
Rename t5Encoder -> t5_encoder.
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
db2a2d5e38
|
Some cleanup of the tags and description of flux nodes
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
57168d719b
|
Fix styling/lint
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
dee6d2c98e
|
Fix support for 8b quantized t5 encoders, update exception messages in flux loaders
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
0c5e11f521
|
Fix FLUX output image clamping. And a few other minor fixes to make inference work with the full bfloat16 FLUX transformer model.
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
a63f842a13
|
Select dev/schnell based on state dict, use correct max seq len based on dev/schnell, and shift in inference, separate vae flux params into separate config
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
4bd7fda694
|
Install sub directories with folders correctly, ensure consistent dtype of tensors in flux pipeline and vae
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
81f0886d6f
|
Working inference node with quantized bnb nf4 checkpoint
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
2eb87f3306
|
Remove unused param on _run_vae_decoding in flux text to image
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
723f3ab0a9
|
Add nf4 bnb quantized format
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
1bd90e0fd4
|
Run ruff, setup initial text to image node
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
436f18ff55
|
Add backend functions and classes for Flux implementation, Update the way flux encoders/tokenizers are loaded for prompt encoding, Update way flux vae is loaded
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
cde9696214
|
Some UI cleanup, regenerate schema
|
2024-08-26 20:17:50 -04:00 |
|