0bb485031f
feat(invocation): reduce canvas v2 mask & crop mask dilation
2024-08-27 11:01:38 +10:00
f8f21c0edd
feat(app): update CanvasV2MaskAndCropInvocation
2024-08-27 11:01:38 +10:00
038b29e15b
feat(app): add CanvasV2MaskAndCropInvocation & CanvasV2MaskAndCropOutput
...
This handles some masking and cropping that the canvas needs.
2024-08-27 11:01:21 +10:00
831fb814cc
feat(app): add origin to session queue
...
The origin is an optional field indicating the queue item's origin. For example, "canvas" when the queue item originated from the canvas or "workflows" when the queue item originated from the workflows tab. If omitted, we assume the queue item originated from the API directly.
- Add migration to add the nullable column to the `session_queue` table.
- Update relevant event payloads with the new field.
- Add `cancel_by_origin` method to `session_queue` service and corresponding route. This is required for the canvas to bail out early when staging images.
- Add `origin` to both `SessionQueueItem` and `Batch` - it needs to be provided initially via the batch and then passed onto the queue item.
-
2024-08-27 11:01:21 +10:00
cff382715a
default workflow: add steps to exposed fields, add more notes
2024-08-26 20:17:50 -04:00
e84ea68282
remove prompt
2024-08-26 20:17:50 -04:00
160dd36782
update default workflow for flux
2024-08-26 20:17:50 -04:00
2d185fb766
Run ruff
2024-08-26 20:17:50 -04:00
849da67cc7
Remove no longer used code in the flux denoise function
2024-08-26 20:17:50 -04:00
3ea6c9666e
Remove in progress images until we're able to make the valuable
2024-08-26 20:17:50 -04:00
635d2f480d
ruff
2024-08-26 20:17:50 -04:00
70c278c810
Remove dependency on flux config files
2024-08-26 20:17:50 -04:00
56b9906e2e
Setup scaffolding for in progress images and add ability to cancel the flux node
2024-08-26 20:17:50 -04:00
5063be92bf
Switch flux to using its own conditioning field
2024-08-26 20:17:50 -04:00
6764dcfdaa
Load and unload clip/t5 encoders and run inference separately in text encoding
2024-08-26 20:17:50 -04:00
a0bf20bcee
Run FLUX VAE decoding in the user's preferred dtype rather than float32. Tested, and seems to work well at float16.
2024-08-26 20:17:50 -04:00
14ab339b33
Move prepare_latent_image_patches(...) to sampling.py with all of the related FLUX inference code.
2024-08-26 20:17:50 -04:00
25c91efbb6
Rename field positive_prompt -> prompt.
2024-08-26 20:17:50 -04:00
d7c22b3bf7
Tidy is_schnell detection logic.
2024-08-26 20:17:50 -04:00
185f2a395f
Make FLUX get_noise(...) consistent across devices/dtypes.
2024-08-26 20:17:50 -04:00
0c5649491e
Mark FLUX nodes as prototypes.
2024-08-26 20:17:50 -04:00
c27d59baf7
Run ruff
2024-08-26 20:17:50 -04:00
f130ddec7c
Remove automatic install of models during flux model loader, remove no longer used import function on context
2024-08-26 20:17:50 -04:00
a0a259eef1
Fix max_seq_len field description.
2024-08-26 20:17:50 -04:00
fd68a2475b
add better workflow name
2024-08-26 20:17:50 -04:00
28ff7ba830
add better workflow description
2024-08-26 20:17:50 -04:00
5d0b248fdb
fix(worker) fix T5 type
2024-08-26 20:17:50 -04:00
01a4e0f6ef
update default workflow
2024-08-26 20:17:50 -04:00
5fed573a29
update flux_model_loader node to take a T5 encoder from node field instead of hardcoded list, assume all models have been downloaded
2024-08-26 20:17:50 -04:00
df9445c351
Various styling and exception type updates
2024-08-26 20:17:50 -04:00
f7e46622a1
Update doc string for import_local_model and remove access_token since it's only usable for local file paths
2024-08-26 20:17:50 -04:00
71f18353a9
Address minor review comments.
2024-08-26 20:17:50 -04:00
4228de707b
Rename t5Encoder -> t5_encoder.
2024-08-26 20:17:50 -04:00
b6a05629ef
add default workflow for flux t2i
2024-08-26 20:17:50 -04:00
db2a2d5e38
Some cleanup of the tags and description of flux nodes
2024-08-26 20:17:50 -04:00
57168d719b
Fix styling/lint
2024-08-26 20:17:50 -04:00
dee6d2c98e
Fix support for 8b quantized t5 encoders, update exception messages in flux loaders
2024-08-26 20:17:50 -04:00
0c5e11f521
Fix FLUX output image clamping. And a few other minor fixes to make inference work with the full bfloat16 FLUX transformer model.
2024-08-26 20:17:50 -04:00
a63f842a13
Select dev/schnell based on state dict, use correct max seq len based on dev/schnell, and shift in inference, separate vae flux params into separate config
2024-08-26 20:17:50 -04:00
4bd7fda694
Install sub directories with folders correctly, ensure consistent dtype of tensors in flux pipeline and vae
2024-08-26 20:17:50 -04:00
81f0886d6f
Working inference node with quantized bnb nf4 checkpoint
2024-08-26 20:17:50 -04:00
2eb87f3306
Remove unused param on _run_vae_decoding in flux text to image
2024-08-26 20:17:50 -04:00
723f3ab0a9
Add nf4 bnb quantized format
2024-08-26 20:17:50 -04:00
1bd90e0fd4
Run ruff, setup initial text to image node
2024-08-26 20:17:50 -04:00
436f18ff55
Add backend functions and classes for Flux implementation, Update the way flux encoders/tokenizers are loaded for prompt encoding, Update way flux vae is loaded
2024-08-26 20:17:50 -04:00
cde9696214
Some UI cleanup, regenerate schema
2024-08-26 20:17:50 -04:00
2d9042fb93
Run Ruff
2024-08-26 20:17:50 -04:00
9ed53af520
Run Ruff
2024-08-26 20:17:50 -04:00
56fda669fd
Manage quantization of models within the loader
2024-08-26 20:17:50 -04:00
5f59a828f9
Setup flux model loading in the UI
2024-08-26 20:17:50 -04:00
