|
|
75d8ac378c
|
Update the T5 8-bit quantized starter model to use the BnB LLM.int8() variant.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
b9dd354e2b
|
Fixes to the T5XXL quantization script.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
33c2fbd201
|
Add script for quantizing a T5 model.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
5063be92bf
|
Switch flux to using its own conditioning field
|
2024-08-26 20:17:50 -04:00 |
|
|
|
1047584b3e
|
Only import bnb quantize file if bitsandbytes is installed
|
2024-08-26 20:17:50 -04:00 |
|
|
|
6764dcfdaa
|
Load and unload clip/t5 encoders and run inference separately in text encoding
|
2024-08-26 20:17:50 -04:00 |
|
|
|
012864ceb1
|
Update macos test vm to macOS-14
|
2024-08-26 20:17:50 -04:00 |
|
|
|
a0bf20bcee
|
Run FLUX VAE decoding in the user's preferred dtype rather than float32. Tested, and seems to work well at float16.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
14ab339b33
|
Move prepare_latent_image_patches(...) to sampling.py with all of the related FLUX inference code.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
25c91efbb6
|
Rename field positive_prompt -> prompt.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
1c1f2c6664
|
Add comment about incorrect T5 Tokenizer size calculation.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
d7c22b3bf7
|
Tidy is_schnell detection logic.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
185f2a395f
|
Make FLUX get_noise(...) consistent across devices/dtypes.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
0c5649491e
|
Mark FLUX nodes as prototypes.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
94aba5892a
|
Attribute black-forest-labs/flux for much of the flux code
|
2024-08-26 20:17:50 -04:00 |
|
|
|
ef093dde29
|
Don't install bitsandbytes on macOS
|
2024-08-26 20:17:50 -04:00 |
|
|
|
34451e5f27
|
added FLUX dev to starter models
|
2024-08-26 20:17:50 -04:00 |
|
|
|
1f9bdd1a9a
|
Undo changes to the v2 dir of frontend types
|
2024-08-26 20:17:50 -04:00 |
|
|
|
c27d59baf7
|
Run ruff
|
2024-08-26 20:17:50 -04:00 |
|
|
|
f130ddec7c
|
Remove automatic install of models during flux model loader, remove no longer used import function on context
|
2024-08-26 20:17:50 -04:00 |
|
|
|
a0a259eef1
|
Fix max_seq_len field description.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
b66f19d4d1
|
Add docs to the quantization scripts.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
4105a78b83
|
Update load_flux_model_bnb_llm_int8.py to work with a single-file FLUX transformer checkpoint.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
19a68afb3a
|
Fix bug in InvokeInt8Params that was causing it to use double the necessary VRAM.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
fd68a2475b
|
add better workflow name
|
2024-08-26 20:17:50 -04:00 |
|
|
|
28ff7ba830
|
add better workflow description
|
2024-08-26 20:17:50 -04:00 |
|
|
|
5d0b248fdb
|
fix(worker) fix T5 type
|
2024-08-26 20:17:50 -04:00 |
|
|
|
01a4e0f6ef
|
update default workflow
|
2024-08-26 20:17:50 -04:00 |
|
|
|
91e0731506
|
fix schema
|
2024-08-26 20:17:50 -04:00 |
|
|
|
d1f904d41f
|
tsc and lint fix
|
2024-08-26 20:17:50 -04:00 |
|
|
|
269388c9f4
|
feat(ui): create new field for t5 encoder models in nodes
|
2024-08-26 20:17:50 -04:00 |
|
|
|
b8486379ce
|
fix(ui): pass base/type when installing models, add flux formats to MM badges
|
2024-08-26 20:17:50 -04:00 |
|
|
|
400eb94d3b
|
fix(ui): only exclude flux main models from linear UI dropdown, not model manager list
|
2024-08-26 20:17:50 -04:00 |
|
|
|
e210c96485
|
add FLUX schnell starter models and submodels as dependenices or adhoc download options
|
2024-08-26 20:17:50 -04:00 |
|
|
|
5f567f41f4
|
add case for clip embed models in probe
|
2024-08-26 20:17:50 -04:00 |
|
|
|
5fed573a29
|
update flux_model_loader node to take a T5 encoder from node field instead of hardcoded list, assume all models have been downloaded
|
2024-08-26 20:17:50 -04:00 |
|
|
|
cfac7c8189
|
Move requantize.py to the quatnization/ dir.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
1787de6836
|
Add docs to the requantize(...) function explaining why it was copied from optimum-quanto.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
ac96f187bd
|
Remove duplicate log_time(...) function.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
72398350b4
|
More flux loader cleanup
|
2024-08-26 20:17:50 -04:00 |
|
|
|
df9445c351
|
Various styling and exception type updates
|
2024-08-26 20:17:50 -04:00 |
|
|
|
87b7a2e39b
|
Switch inheritance class of flux model loaders
|
2024-08-26 20:17:50 -04:00 |
|
|
|
f7e46622a1
|
Update doc string for import_local_model and remove access_token since it's only usable for local file paths
|
2024-08-26 20:17:50 -04:00 |
|
|
|
71f18353a9
|
Address minor review comments.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
4228de707b
|
Rename t5Encoder -> t5_encoder.
|
2024-08-26 20:17:50 -04:00 |
|
|
|
b6a05629ef
|
add default workflow for flux t2i
|
2024-08-26 20:17:50 -04:00 |
|
|
|
fbaa820643
|
exclude flux models from main model dropdown
|
2024-08-26 20:17:50 -04:00 |
|
|
|
db2a2d5e38
|
Some cleanup of the tags and description of flux nodes
|
2024-08-26 20:17:50 -04:00 |
|
|
|
8ba6e6b1f8
|
Add t5 encoders and clip embeds to the model manager
|
2024-08-26 20:17:50 -04:00 |
|
|
|
57168d719b
|
Fix styling/lint
|
2024-08-26 20:17:50 -04:00 |
|
