Mirrored_Repos/InvokeAI
1
0
Fork 0
mirror of https://github.com/invoke-ai/InvokeAI synced 2024-08-30 20:32:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

Event service will now sleep for 100ms between polls instead of 1ms, reducing CPU usage significantly (#3256)

Browse Source 
I noticed that the current invokeai-new.py was using almost all of a CPU
core. After a bit of profileing I noticed that there were many thousands
of calls to epoll() which suggested to me that something wasn't sleeping
properly in asyncio's loop.

A bit of further investigation with Python profiling revealed that the
__dispatch_from_queue() method in FastAPIEventService
(app/api/events.py:33) was also being called thousands of times.

I believe the asyncio.sleep(0.001) in that method is too aggressive (it
means that the queue will be polled every 1ms) and that 0.1 (100ms) is
still entirely reasonable.
This commit is contained in:
blessedcoolant 2023-04-24 19:35:27 +12:00 committed by GitHub
commit 7555b1f876
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
invokeai/app/api/events.py
View File

@ -45,7 +45,7 @@ class FastAPIEventService(EventServiceBase):
) )
except Empty: except Empty:
await asyncio.sleep(0.001) await asyncio.sleep(0.1)
pass pass
except asyncio.CancelledError as e: except asyncio.CancelledError as e: