InvokeAI/invokeai/app/services
Martin Kristiansen a2613948d8
Feature/lru caching 2 (#4657)
* fix(nodes): do not disable invocation cache delete methods

When the runtime disabled flag is on, do not skip the delete methods. This could lead to a hit on a missing resource.

Do skip them when the cache size is 0, because the user cannot change this (must restart app to change it).

* fix(nodes): do not use double-underscores in cache service

* Thread lock for cache

* Making cache LRU

* Bug fixes

* bugfix

* Switching to one Lock and OrderedDict cache

* Removing unused imports

* Move lock cache instance

* Addressing PR comments

---------

Co-authored-by: psychedelicious <4822129+psychedelicious@users.noreply.github.com>
Co-authored-by: Martin Kristiansen <martin@modyfi.io>
2023-09-26 03:42:09 +00:00
..
config Respect INVOKEAI_ prefix on environment variables 2023-09-21 12:37:27 -04:00
invocation_cache Feature/lru caching 2 (#4657) 2023-09-26 03:42:09 +00:00
models isort wip 2023-09-12 13:01:58 -04:00
session_processor replace case statements with if/else to support python 3.9 2023-09-25 18:33:39 +10:00
session_queue replace case statements with if/else to support python 3.9 2023-09-25 18:33:39 +10:00
shared feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
__init__.py all files migrated; tweaks needed 2023-03-03 00:02:15 -05:00
board_image_record_storage.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
board_images.py isort wip 2023-09-12 13:01:58 -04:00
board_record_storage.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
boards.py isort wip 2023-09-12 13:01:58 -04:00
default_graphs.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
events.py fix: canvas not working on queue 2023-09-20 09:57:10 -04:00
graph.py feat(ui): allow numbers to connect to strings 2023-09-22 21:51:08 +10:00
image_file_storage.py fix(nodes): fix uploading image metadata retention 2023-08-30 14:52:50 +10:00
image_record_storage.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
images.py feat(backend): selective invalidation for invocation cache 2023-09-20 18:26:47 +10:00
invocation_queue.py fix: canvas not working on queue 2023-09-20 09:57:10 -04:00
invocation_services.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
invocation_stats.py isort wip 2023-09-12 13:01:58 -04:00
invoker.py fix: canvas not working on queue 2023-09-20 09:57:10 -04:00
item_storage.py Apply black 2023-07-27 10:54:01 -04:00
latent_storage.py feat(backend): selective invalidation for invocation cache 2023-09-20 18:26:47 +10:00
model_manager_service.py fix: canvas not working on queue 2023-09-20 09:57:10 -04:00
processor.py fix: canvas not working on queue 2023-09-20 09:57:10 -04:00
resource_name.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
sqlite.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
thread.py feat: queued generation (#4502) 2023-09-20 15:09:24 +10:00
urls.py feat: add multi-select to gallery 2023-08-03 11:46:59 +10:00