Brandon Rising 6ea1278d22 Manage quantization of models within the loader

2024-08-21 09:06:34 -04:00

..

bnb_llm_int8.py

More improvements for LLM.int8() - not fully tested.

2024-08-21 08:59:19 -04:00

bnb_nf4.py

LLM.int8() quantization is working, but still some rough edges to solve.

2024-08-21 08:59:19 -04:00

fast_quantized_diffusion_model.py

Manage quantization of models within the loader

2024-08-21 09:06:34 -04:00

fast_quantized_transformers_model.py

Manage quantization of models within the loader

2024-08-21 09:06:34 -04:00

load_flux_model_bnb_llm_int8.py

LLM.int8() quantization is working, but still some rough edges to solve.

2024-08-21 08:59:19 -04:00

load_flux_model_bnb_nf4.py

WIP on moving from diffusers to FLUX

2024-08-21 08:59:19 -04:00