12609 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ryan Dick	dff4a88baa	Move quantization scripts to a scripts/ subdir.	2024-08-26 20:17:50 -04:00
Ryan Dick	a21f6c4964	Update docs for T5 quantization script.	2024-08-26 20:17:50 -04:00
Ryan Dick	97562504b7	Remove all references to optimum-quanto and downgrade diffusers.	2024-08-26 20:17:50 -04:00
Ryan Dick	75d8ac378c	Update the T5 8-bit quantized starter model to use the BnB LLM.int8() variant.	2024-08-26 20:17:50 -04:00
Ryan Dick	b9dd354e2b	Fixes to the T5XXL quantization script.	2024-08-26 20:17:50 -04:00
Ryan Dick	33c2fbd201	Add script for quantizing a T5 model.	2024-08-26 20:17:50 -04:00
Brandon Rising	5063be92bf	Switch flux to using its own conditioning field	2024-08-26 20:17:50 -04:00
Brandon Rising	1047584b3e	Only import bnb quantize file if bitsandbytes is installed	2024-08-26 20:17:50 -04:00
Brandon Rising	6764dcfdaa	Load and unload clip/t5 encoders and run inference separately in text encoding	2024-08-26 20:17:50 -04:00
Brandon Rising	012864ceb1	Update macos test vm to macOS-14	2024-08-26 20:17:50 -04:00
Ryan Dick	a0bf20bcee	Run FLUX VAE decoding in the user's preferred dtype rather than float32. Tested, and seems to work well at float16.	2024-08-26 20:17:50 -04:00
Ryan Dick	14ab339b33	Move prepare_latent_image_patches(...) to sampling.py with all of the related FLUX inference code.	2024-08-26 20:17:50 -04:00
Ryan Dick	25c91efbb6	Rename field positive_prompt -> prompt.	2024-08-26 20:17:50 -04:00
Ryan Dick	1c1f2c6664	Add comment about incorrect T5 Tokenizer size calculation.	2024-08-26 20:17:50 -04:00
Ryan Dick	d7c22b3bf7	Tidy is_schnell detection logic.	2024-08-26 20:17:50 -04:00
Ryan Dick	185f2a395f	Make FLUX get_noise(...) consistent across devices/dtypes.	2024-08-26 20:17:50 -04:00
Ryan Dick	0c5649491e	Mark FLUX nodes as prototypes.	2024-08-26 20:17:50 -04:00
Brandon Rising	94aba5892a	Attribute black-forest-labs/flux for much of the flux code	2024-08-26 20:17:50 -04:00
Brandon Rising	ef093dde29	Don't install bitsandbytes on macOS	2024-08-26 20:17:50 -04:00
maryhipp	34451e5f27	added FLUX dev to starter models	2024-08-26 20:17:50 -04:00
Brandon Rising	1f9bdd1a9a	Undo changes to the v2 dir of frontend types	2024-08-26 20:17:50 -04:00
Brandon Rising	c27d59baf7	Run ruff	2024-08-26 20:17:50 -04:00
Brandon Rising	f130ddec7c	Remove automatic install of models during flux model loader, remove no longer used import function on context	2024-08-26 20:17:50 -04:00
Ryan Dick	a0a259eef1	Fix max_seq_len field description.	2024-08-26 20:17:50 -04:00
Ryan Dick	b66f19d4d1	Add docs to the quantization scripts.	2024-08-26 20:17:50 -04:00
Ryan Dick	4105a78b83	Update load_flux_model_bnb_llm_int8.py to work with a single-file FLUX transformer checkpoint.	2024-08-26 20:17:50 -04:00
Ryan Dick	19a68afb3a	Fix bug in InvokeInt8Params that was causing it to use double the necessary VRAM.	2024-08-26 20:17:50 -04:00
maryhipp	fd68a2475b	add better workflow name	2024-08-26 20:17:50 -04:00
maryhipp	28ff7ba830	add better workflow description	2024-08-26 20:17:50 -04:00
maryhipp	5d0b248fdb	fix(worker) fix T5 type	2024-08-26 20:17:50 -04:00
maryhipp	01a4e0f6ef	update default workflow	2024-08-26 20:17:50 -04:00
Mary Hipp	91e0731506	fix schema	2024-08-26 20:17:50 -04:00
Mary Hipp	d1f904d41f	tsc and lint fix	2024-08-26 20:17:50 -04:00
Mary Hipp	269388c9f4	feat(ui): create new field for t5 encoder models in nodes	2024-08-26 20:17:50 -04:00
Mary Hipp	b8486379ce	fix(ui): pass base/type when installing models, add flux formats to MM badges	2024-08-26 20:17:50 -04:00
Mary Hipp	400eb94d3b	fix(ui): only exclude flux main models from linear UI dropdown, not model manager list	2024-08-26 20:17:50 -04:00
maryhipp	e210c96485	add FLUX schnell starter models and submodels as dependenices or adhoc download options	2024-08-26 20:17:50 -04:00
maryhipp	5f567f41f4	add case for clip embed models in probe	2024-08-26 20:17:50 -04:00
maryhipp	5fed573a29	update flux_model_loader node to take a T5 encoder from node field instead of hardcoded list, assume all models have been downloaded	2024-08-26 20:17:50 -04:00
Ryan Dick	cfac7c8189	Move requantize.py to the quatnization/ dir.	2024-08-26 20:17:50 -04:00
Ryan Dick	1787de6836	Add docs to the requantize(...) function explaining why it was copied from optimum-quanto.	2024-08-26 20:17:50 -04:00
Ryan Dick	ac96f187bd	Remove duplicate log_time(...) function.	2024-08-26 20:17:50 -04:00
Brandon Rising	72398350b4	More flux loader cleanup	2024-08-26 20:17:50 -04:00
Brandon Rising	df9445c351	Various styling and exception type updates	2024-08-26 20:17:50 -04:00
Brandon Rising	87b7a2e39b	Switch inheritance class of flux model loaders	2024-08-26 20:17:50 -04:00
Brandon Rising	f7e46622a1	Update doc string for import_local_model and remove access_token since it's only usable for local file paths	2024-08-26 20:17:50 -04:00
Ryan Dick	71f18353a9	Address minor review comments.	2024-08-26 20:17:50 -04:00
Ryan Dick	4228de707b	Rename t5Encoder -> t5_encoder.	2024-08-26 20:17:50 -04:00
Mary Hipp	b6a05629ef	add default workflow for flux t2i	2024-08-26 20:17:50 -04:00
Mary Hipp	fbaa820643	exclude flux models from main model dropdown	2024-08-26 20:17:50 -04:00