Lincoln Stein
5bb3aeaccd
remove startup dependency on legacy models.yaml file
2024-03-01 10:42:33 +11:00
dunkeroni
30a374a70f
chore: typing
2024-03-01 10:42:33 +11:00
dunkeroni
07dde92664
chore: typing fix
2024-03-01 10:42:33 +11:00
dunkeroni
06cc57d82a
feat(nodes): added gradient mask node
2024-03-01 10:42:33 +11:00
Brandon Rising
f7fc20459a
Run ruff
2024-03-01 10:42:33 +11:00
Mary Hipp
9269bdd233
rename endpoint for scanning
2024-03-01 10:42:33 +11:00
Brandon Rising
97cfcd2eef
Create /search endpoint, update model object structure in scan model page
2024-03-01 10:42:33 +11:00
psychedelicious
34f3a39cc9
fix(nodes): fix TI loading
2024-03-01 10:42:33 +11:00
psychedelicious
a37b60db13
feat(bulk_download): update response model, messages
2024-03-01 10:42:33 +11:00
psychedelicious
cbb997e7d0
tidy(bulk_download): don't store events service separately
...
Using the invoker object directly leaves no ambiguity as to what `_events_bus` actually is.
2024-03-01 10:42:33 +11:00
psychedelicious
98441ad08d
tidy(bulk_download): do not rely on pagination API to get all images for board
...
We can get all images for the board as a list of image names, then pass that to `_image_handler` to get the DTOs, decoupling from the pagination API.
2024-03-01 10:42:33 +11:00
psychedelicious
80c67dd6e0
tidy(bulk_download): nit - use or
as a coalescing operator
...
Just a bit cleaner.
2024-03-01 10:42:33 +11:00
psychedelicious
38af234108
tidy(bulk_download): use single underscore for private attrs
...
Double underscores are used in the app but it doesn't actually do or convey anything that single underscores don't already do. Considered unpythonic except for actual dunder/magic methods.
2024-03-01 10:42:33 +11:00
psychedelicious
2291122c2b
tidy(bulk_download): remove class-level attr annotations
...
These can be misleading as they shadow actual assigned class attributes. This pattern is in the rest of the app but it shouldn't be.
2024-03-01 10:42:33 +11:00
psychedelicious
bf3b10cb1c
tidy(bulk_download): remove extraneous abstract methods
...
`start`, `stop` and `__init__` are not required in implementations of an ABC or service.
2024-03-01 10:42:33 +11:00
psychedelicious
7f8f182a00
tidy(bulk_download): clean up comments
2024-03-01 10:42:33 +11:00
Stefan Tobler
e51867756a
adding bulk_download_item_name to socket events
2024-03-01 10:42:33 +11:00
Stefan Tobler
a8d7cf4e97
refactoring handlers to do null check
2024-03-01 10:42:33 +11:00
Stefan Tobler
037cac8154
removing dependency on an output folder, embrace python temp folder for bulk download
2024-03-01 10:42:33 +11:00
Stefan Tobler
b5a9ed351d
moving the responsibility of cleaning up board names to the service not the route
2024-03-01 10:42:33 +11:00
Stefan Tobler
f15aa562c2
using temp directory for downloads
2024-03-01 10:42:33 +11:00
Stefan Tobler
d0f3571e59
returning the bulk_download_item_name on response for possible polling
2024-03-01 10:42:33 +11:00
Stefan Tobler
b5ca1643a6
narrowing bulk_download stop service scope
2024-03-01 10:42:33 +11:00
Stefan Tobler
79eb871683
cleaning up bulk download zip after the response is complete
2024-03-01 10:42:33 +11:00
Stefan Tobler
7d91426d8f
refactoring bulk_download to be better managed
2024-03-01 10:42:33 +11:00
Stefan Tobler
795fbf0e81
refactoring bulkdownload to consider image category
2024-03-01 10:42:33 +11:00
Stefan Tobler
7114d64b86
fixing issue where default board did not return images
2024-03-01 10:42:33 +11:00
Stefan Tobler
c43ea9f25c
using the board name to download boards
2024-03-01 10:42:33 +11:00
Stefan Tobler
52b0deb179
reworking some of the logic to use a default room, adding endpoint to download file on complete
2024-03-01 10:42:33 +11:00
Stefan Tobler
7ecc18938b
linted and styling
2024-03-01 10:42:33 +11:00
Stefan Tobler
56d2d220a8
implementation of bulkdownload background task
2024-03-01 10:42:33 +11:00
Stefan Tobler
f1967c3393
adding socket events for bulk download
2024-03-01 10:42:33 +11:00
Stefan Tobler
812e24cbd2
groundwork for the bulk_download_service
2024-03-01 10:42:33 +11:00
psychedelicious
89fa36a818
chore(nodes): update TODO comment
2024-03-01 10:42:33 +11:00
psychedelicious
e3f9da29ba
tidy(nodes): clean up profiler/stats in processor, better comments
2024-03-01 10:42:33 +11:00
psychedelicious
763debdeeb
fix(nodes): fix typing on stats service context manager
2024-03-01 10:42:33 +11:00
psychedelicious
8bf9fd34ad
fix(nodes): fix model load events
...
was accessing incorrect properties in event data
2024-03-01 10:42:33 +11:00
psychedelicious
0b0cb0ccc6
feat(nodes): making invocation class var in processor
2024-03-01 10:42:33 +11:00
psychedelicious
fa39523b11
feat(nodes): improved error messages in processor
2024-03-01 10:42:33 +11:00
psychedelicious
16676feea8
feat(nodes): make processor thread limit and polling interval configurable
2024-03-01 10:42:33 +11:00
psychedelicious
d53a2a2d4e
chore(nodes): better comments for invocation context
2024-03-01 10:42:33 +11:00
psychedelicious
ccfe6b6bef
chore(nodes): "context_data" -> "data"
...
Changed within InvocationContext, for brevity.
2024-03-01 10:42:33 +11:00
psychedelicious
fdac0c3c9b
refactor(nodes): move is_canceled to context.util
2024-03-01 10:42:33 +11:00
psychedelicious
18adcc1dd2
feat(nodes): add whole queue_item to InvocationContextData
...
No reason to not have the whole thing in there.
2024-03-01 10:42:33 +11:00
psychedelicious
86c50f2d5b
tidy(nodes): remove extraneous comments
2024-03-01 10:42:33 +11:00
psychedelicious
3cfac8b843
feat(nodes): better invocation error messages
2024-03-01 10:42:33 +11:00
psychedelicious
0788b6ecee
chore(nodes): add comments for cancel state
2024-03-01 10:42:33 +11:00
psychedelicious
317d076a1a
feat(nodes): promote is_canceled
to public node API
2024-03-01 10:42:33 +11:00
psychedelicious
725c03cf87
refactor(nodes): merge processors
...
Consolidate graph processing logic into session processor.
With graphs as the unit of work, and the session queue distributing graphs, we no longer need the invocation queue or processor.
Instead, the session processor dequeues the next session and processes it in a simple loop, greatly simplifying the app.
- Remove `graph_execution_manager` service.
- Remove `queue` (invocation queue) service.
- Remove `processor` (invocation processor) service.
- Remove queue-related logic from `Invoker`. It now only starts and stops the services, providing them with access to other services.
- Remove unused `invocation_retrieval_error` and `session_retrieval_error` events, these are no longer needed.
- Clean up stats service now that it is less coupled to the rest of the app.
- Refactor cancellation logic - cancellations now originate from session queue (i.e. HTTP cancel endpoint) and are emitted as events. Processor gets the events and sets the canceled event. Access to this event is provided to the invocation context for e.g. the step callback.
- Remove `sessions` router; it provided access to `graph_executions` but that no longer exists.
2024-03-01 10:42:33 +11:00
psychedelicious
7e71effa17
tidy(nodes): remove no-op model_config
...
Because we now customize the JSON Schema creation for GraphExecutionState, the model_config did nothing.
2024-03-01 10:42:33 +11:00