2369 Commits

Author	SHA1	Message	Date
Mary Hipp	cff382715a	default workflow: add steps to exposed fields, add more notes	2024-08-26 20:17:50 -04:00
Mary Hipp	e84ea68282	remove prompt	2024-08-26 20:17:50 -04:00
Mary Hipp	160dd36782	update default workflow for flux	2024-08-26 20:17:50 -04:00
Brandon Rising	2d185fb766	Run ruff	2024-08-26 20:17:50 -04:00
Brandon Rising	849da67cc7	Remove no longer used code in the flux denoise function	2024-08-26 20:17:50 -04:00
Brandon Rising	3ea6c9666e	Remove in progress images until we're able to make the valuable	2024-08-26 20:17:50 -04:00
Ryan Dick	635d2f480d	ruff	2024-08-26 20:17:50 -04:00
Brandon Rising	70c278c810	Remove dependency on flux config files	2024-08-26 20:17:50 -04:00
Brandon Rising	56b9906e2e	Setup scaffolding for in progress images and add ability to cancel the flux node	2024-08-26 20:17:50 -04:00
Brandon Rising	5063be92bf	Switch flux to using its own conditioning field	2024-08-26 20:17:50 -04:00
Brandon Rising	6764dcfdaa	Load and unload clip/t5 encoders and run inference separately in text encoding	2024-08-26 20:17:50 -04:00
Ryan Dick	a0bf20bcee	Run FLUX VAE decoding in the user's preferred dtype rather than float32. Tested, and seems to work well at float16.	2024-08-26 20:17:50 -04:00
Ryan Dick	14ab339b33	Move prepare_latent_image_patches(...) to sampling.py with all of the related FLUX inference code.	2024-08-26 20:17:50 -04:00
Ryan Dick	25c91efbb6	Rename field positive_prompt -> prompt.	2024-08-26 20:17:50 -04:00
Ryan Dick	d7c22b3bf7	Tidy is_schnell detection logic.	2024-08-26 20:17:50 -04:00
Ryan Dick	185f2a395f	Make FLUX get_noise(...) consistent across devices/dtypes.	2024-08-26 20:17:50 -04:00
Ryan Dick	0c5649491e	Mark FLUX nodes as prototypes.	2024-08-26 20:17:50 -04:00
Brandon Rising	c27d59baf7	Run ruff	2024-08-26 20:17:50 -04:00
Brandon Rising	f130ddec7c	Remove automatic install of models during flux model loader, remove no longer used import function on context	2024-08-26 20:17:50 -04:00
Ryan Dick	a0a259eef1	Fix max_seq_len field description.	2024-08-26 20:17:50 -04:00
maryhipp	fd68a2475b	add better workflow name	2024-08-26 20:17:50 -04:00
maryhipp	28ff7ba830	add better workflow description	2024-08-26 20:17:50 -04:00
maryhipp	5d0b248fdb	fix(worker) fix T5 type	2024-08-26 20:17:50 -04:00
maryhipp	01a4e0f6ef	update default workflow	2024-08-26 20:17:50 -04:00
maryhipp	5fed573a29	update flux_model_loader node to take a T5 encoder from node field instead of hardcoded list, assume all models have been downloaded	2024-08-26 20:17:50 -04:00
Brandon Rising	df9445c351	Various styling and exception type updates	2024-08-26 20:17:50 -04:00
Brandon Rising	f7e46622a1	Update doc string for import_local_model and remove access_token since it's only usable for local file paths	2024-08-26 20:17:50 -04:00
Ryan Dick	71f18353a9	Address minor review comments.	2024-08-26 20:17:50 -04:00
Ryan Dick	4228de707b	Rename t5Encoder -> t5_encoder.	2024-08-26 20:17:50 -04:00
Mary Hipp	b6a05629ef	add default workflow for flux t2i	2024-08-26 20:17:50 -04:00
Brandon Rising	db2a2d5e38	Some cleanup of the tags and description of flux nodes	2024-08-26 20:17:50 -04:00
Brandon Rising	57168d719b	Fix styling/lint	2024-08-26 20:17:50 -04:00
Brandon Rising	dee6d2c98e	Fix support for 8b quantized t5 encoders, update exception messages in flux loaders	2024-08-26 20:17:50 -04:00
Ryan Dick	0c5e11f521	Fix FLUX output image clamping. And a few other minor fixes to make inference work with the full bfloat16 FLUX transformer model.	2024-08-26 20:17:50 -04:00
Brandon Rising	a63f842a13	Select dev/schnell based on state dict, use correct max seq len based on dev/schnell, and shift in inference, separate vae flux params into separate config	2024-08-26 20:17:50 -04:00
Brandon Rising	4bd7fda694	Install sub directories with folders correctly, ensure consistent dtype of tensors in flux pipeline and vae	2024-08-26 20:17:50 -04:00
Brandon Rising	81f0886d6f	Working inference node with quantized bnb nf4 checkpoint	2024-08-26 20:17:50 -04:00
Brandon Rising	2eb87f3306	Remove unused param on _run_vae_decoding in flux text to image	2024-08-26 20:17:50 -04:00
Brandon Rising	723f3ab0a9	Add nf4 bnb quantized format	2024-08-26 20:17:50 -04:00
Brandon Rising	1bd90e0fd4	Run ruff, setup initial text to image node	2024-08-26 20:17:50 -04:00
Brandon Rising	436f18ff55	Add backend functions and classes for Flux implementation, Update the way flux encoders/tokenizers are loaded for prompt encoding, Update way flux vae is loaded	2024-08-26 20:17:50 -04:00
Brandon Rising	cde9696214	Some UI cleanup, regenerate schema	2024-08-26 20:17:50 -04:00
Brandon Rising	2d9042fb93	Run Ruff	2024-08-26 20:17:50 -04:00
Brandon Rising	9ed53af520	Run Ruff	2024-08-26 20:17:50 -04:00
Brandon Rising	56fda669fd	Manage quantization of models within the loader	2024-08-26 20:17:50 -04:00
Brandon Rising	5f59a828f9	Setup flux model loading in the UI	2024-08-26 20:17:50 -04:00
Ryan Dick	1fa6bddc89	WIP on moving from diffusers to FLUX	2024-08-26 20:17:50 -04:00
Ryan Dick	f01f56a98e	LLM.int8() quantization is working, but still some rough edges to solve.	2024-08-26 20:17:50 -04:00
Ryan Dick	99b0f79784	Clean up NF4 implementation.	2024-08-26 20:17:50 -04:00
Ryan Dick	e1eb104345	NF4 inference working	2024-08-26 20:17:50 -04:00