InvokeAI/invokeai/app/services/invocation_cache
Martin Kristiansen a2613948d8
Feature/lru caching 2 (#4657)
* fix(nodes): do not disable invocation cache delete methods

When the runtime disabled flag is on, do not skip the delete methods. This could lead to a hit on a missing resource.

Do skip them when the cache size is 0, because the user cannot change this (must restart app to change it).

* fix(nodes): do not use double-underscores in cache service

* Thread lock for cache

* Making cache LRU

* Bug fixes

* bugfix

* Switching to one Lock and OrderedDict cache

* Removing unused imports

* Move lock cache instance

* Addressing PR comments

---------

Co-authored-by: psychedelicious <4822129+psychedelicious@users.noreply.github.com>
Co-authored-by: Martin Kristiansen <martin@modyfi.io>
2023-09-26 03:42:09 +00:00
..
__init__.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
invocation_cache_base.py feat(nodes): add enable, disable, status to invocation cache 2023-09-21 09:45:52 -04:00
invocation_cache_common.py feat(nodes): add enable, disable, status to invocation cache 2023-09-21 09:45:52 -04:00
invocation_cache_memory.py Feature/lru caching 2 (#4657) 2023-09-26 03:42:09 +00:00