Brandon Rising
|
df9445c351
|
Various styling and exception type updates
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
71f18353a9
|
Address minor review comments.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
4228de707b
|
Rename t5Encoder -> t5_encoder.
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
db2a2d5e38
|
Some cleanup of the tags and description of flux nodes
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
57168d719b
|
Fix styling/lint
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
dee6d2c98e
|
Fix support for 8b quantized t5 encoders, update exception messages in flux loaders
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
0c5e11f521
|
Fix FLUX output image clamping. And a few other minor fixes to make inference work with the full bfloat16 FLUX transformer model.
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
a63f842a13
|
Select dev/schnell based on state dict, use correct max seq len based on dev/schnell, and shift in inference, separate vae flux params into separate config
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
4bd7fda694
|
Install sub directories with folders correctly, ensure consistent dtype of tensors in flux pipeline and vae
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
81f0886d6f
|
Working inference node with quantized bnb nf4 checkpoint
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
2eb87f3306
|
Remove unused param on _run_vae_decoding in flux text to image
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
723f3ab0a9
|
Add nf4 bnb quantized format
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
1bd90e0fd4
|
Run ruff, setup initial text to image node
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
436f18ff55
|
Add backend functions and classes for Flux implementation, Update the way flux encoders/tokenizers are loaded for prompt encoding, Update way flux vae is loaded
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
cde9696214
|
Some UI cleanup, regenerate schema
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
2d9042fb93
|
Run Ruff
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
9ed53af520
|
Run Ruff
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
56fda669fd
|
Manage quantization of models within the loader
|
2024-08-26 20:17:50 -04:00 |
|
Brandon Rising
|
5f59a828f9
|
Setup flux model loading in the UI
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
1fa6bddc89
|
WIP on moving from diffusers to FLUX
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
f01f56a98e
|
LLM.int8() quantization is working, but still some rough edges to solve.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
99b0f79784
|
Clean up NF4 implementation.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
e1eb104345
|
NF4 inference working
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
a52c899c6d
|
Split a FluxTextEncoderInvocation out from the FluxTextToImageInvocation. This has the advantage that we benfit from automatic caching when the prompt isn't changed.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
eeabb7ebe5
|
Make quantized loading fast for both T5XXL and FLUX transformer.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
3cf0365a35
|
Make float16 inference work with FLUX on 24GB GPU.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
5870742bb9
|
Add support for 8-bit quantizatino of the FLUX T5XXL text encoder.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
01d8c62c57
|
Make 8-bit quantization save/reload work for the FLUX transformer. Reload is still very slow with the current optimum.quanto implementation.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
55a242b2d6
|
Minor improvements to FLUX workflow.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
45263b339f
|
Got FLUX schnell working with 8-bit quantization. Still lots of rough edges to clean up.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
3319491861
|
Use the FluxPipeline.encode_prompt() api rather than trying to run the two text encoders separately.
|
2024-08-26 20:17:50 -04:00 |
|
Ryan Dick
|
b39031ea53
|
First draft of FluxTextToImageInvocation.
|
2024-08-26 20:17:50 -04:00 |
|
blessedcoolant
|
4f8a4b0f22
|
Merge branch 'main' into depth_anything_v2
|
2024-08-03 00:38:57 +05:30 |
|
Ryan Dick
|
981475a624
|
Merge branch 'main' into ryan/grounded-sam
|
2024-08-01 20:30:35 +02:00 |
|
Ryan Dick
|
27ac61a4fb
|
Expose all model options in the GroundingDinoInvocation and the SegmentAnythingInvocation.
|
2024-08-01 14:23:32 -04:00 |
|
Ryan Dick
|
675ffc2757
|
Remove BoundingBoxInvocation field name overrides.
|
2024-08-01 14:05:44 -04:00 |
|
Ryan Dick
|
44b21f10f1
|
Add a pydantic model_validator to BoundingBoxField to check the validity of the coords.
|
2024-08-01 14:00:57 -04:00 |
|
Ryan Dick
|
c6d49e8b1f
|
Shorten SegmentAnythingInvocation and GroundingDinoInvocatino docstrings, since they are used as the invocation descriptions in the UI.
|
2024-08-01 10:17:42 -04:00 |
|
Ryan Dick
|
e6a512aa86
|
(minor) Tweak order of mask operations.
|
2024-08-01 10:12:24 -04:00 |
|
Ryan Dick
|
c3a6a6fb22
|
Rename SegmentAnythingModelInvocation -> SegmentAnythingInvocation.
|
2024-08-01 10:00:36 -04:00 |
|
Ryan Dick
|
b9dc3460ba
|
Rename SegmentAnythingModel -> SegmentAnythingPipeline.
|
2024-08-01 09:57:47 -04:00 |
|
blessedcoolant
|
f5cfdcf32d
|
feat: Add BoundingBox Primitive Node
|
2024-08-01 04:09:08 +05:30 |
|
Ryan Dick
|
b5832768dc
|
Return a MaskOutput from SegmentAnythingModelInvocation. And add a MaskTensorToImageInvocation.
|
2024-07-31 17:16:14 -04:00 |
|
Ryan Dick
|
5a9173f766
|
Merge branch 'main' into stalker-modular_lora
|
2024-07-31 15:13:22 -04:00 |
|
blessedcoolant
|
332bc9da5b
|
fix: Update depth anything node default to v2
|
2024-07-31 23:52:29 +05:30 |
|
blessedcoolant
|
daf899f9c4
|
fix: Move the manual image resizing out of the depth anything pipeline
|
2024-07-31 23:38:12 +05:30 |
|
blessedcoolant
|
13fb2d1f49
|
fix: Add Depth Anything V2 as a new option
It is also now the default in the UI replacing Depth Anything V1 small
|
2024-07-31 23:29:43 +05:30 |
|
Ryan Dick
|
fca119773b
|
Split invokeai/backend/image_util/segment_anything/ dir into grounding_dino/ and segment_anything/
|
2024-07-31 12:28:47 -04:00 |
|
Ryan Dick
|
0193267a53
|
Split GroundedSamInvocation into GroundingDinoInvocation and SegmentAnythingModelInvocation.
|
2024-07-31 12:20:23 -04:00 |
|
Ryan Dick
|
9f448fecb7
|
Move invokeai/backend/grounded_sam -> invokeai/backend/image_util/grounded_sam
|
2024-07-31 10:00:30 -04:00 |
|