Ryan Dick 6d838fa997 Add script for quantizing a T5 model.

2024-08-23 18:03:23 +00:00

..

__init__.py

Move requantize.py to the quatnization/ dir.

2024-08-21 18:21:44 +00:00

bnb_llm_int8.py

Fix bug in InvokeInt8Params that was causing it to use double the necessary VRAM.

2024-08-21 19:08:00 +00:00

bnb_nf4.py

Install sub directories with folders correctly, ensure consistent dtype of tensors in flux pipeline and vae

2024-08-21 09:09:39 -04:00

fast_quantized_diffusion_model.py

Move requantize.py to the quatnization/ dir.

2024-08-21 18:21:44 +00:00

fast_quantized_transformers_model.py

Move requantize.py to the quatnization/ dir.

2024-08-21 18:21:44 +00:00

load_flux_model_bnb_llm_int8.py

Add docs to the quantization scripts.

2024-08-21 19:08:28 +00:00

load_flux_model_bnb_nf4.py

Add docs to the quantization scripts.

2024-08-21 19:08:28 +00:00

quantize_t5_xxl_bnb_llm_int8.py

Add script for quantizing a T5 model.

2024-08-23 18:03:23 +00:00

requantize.py

Move requantize.py to the quatnization/ dir.

2024-08-21 18:21:44 +00:00