Lincoln Stein 812f10730f

adjust free vram calculation for models that will be removed by lazy offloading (#6150) ...

Co-authored-by: Lincoln Stein <lstein@gmail.com>

2024-04-04 22:51:12 -04:00

..

__init__.py

final tidying before marking PR as ready for review

2024-03-01 10:42:33 +11:00

model_manager_base.py

tidy(mm): remove convenience methods from high level model manager service

2024-03-07 10:56:59 +11:00

model_manager_common.py

feat(nodes): update all invocations to use new invocation context

2024-03-01 10:42:33 +11:00

model_manager_default.py

adjust free vram calculation for models that will be removed by lazy offloading (#6150)

2024-04-04 22:51:12 -04:00