Brandon Rising
09295ae43b
Allow passing in key on register
2024-02-23 14:47:14 -05:00
Brandon Rising
80ad14d89f
Remove passing keys in on register
2024-02-23 14:33:49 -05:00
Brandon Rising
c674eb3168
Run ruff
2024-02-23 14:33:49 -05:00
Brandon Rising
63138640a7
Allow users to run model manager without cuda
2024-02-23 14:33:49 -05:00
Lincoln Stein
cc12f57a5a
several small model install enhancements
...
- Support extended HF repoid syntax in TUI. This allows
installation of subfolders and safetensors files, as in
`XpucT/Deliberate::Deliberate_v5.safetensors`
- Add `error` and `error_traceback` properties to the install
job objects.
- Rename the `heuristic_import` route to `heuristic_install`.
- Fix the example `config` input in the `heuristic_install` route.
2024-02-23 07:48:23 +11:00
Lincoln Stein
a6e2d2c5e0
fix repo-id for the Deliberate v5 model
...
prevent lora and embedding file suffixes from being stripped during installation
apply psychedelicious patch to get compel to load proper TI embedding
2024-02-23 07:48:04 +11:00
Lincoln Stein
ae14df97d6
remove startup dependency on legacy models.yaml file
2024-02-23 07:47:39 +11:00
psychedelicious
dd9b1c8eec
feat(bulk_download): update response model, messages
2024-02-21 00:00:25 +11:00
psychedelicious
7f75f6226b
tidy(bulk_download): don't store events service separately
...
Using the invoker object directly leaves no ambiguity as to what `_events_bus` actually is.
2024-02-20 23:39:30 +11:00
psychedelicious
6dc819fd47
tidy(bulk_download): do not rely on pagination API to get all images for board
...
We can get all images for the board as a list of image names, then pass that to `_image_handler` to get the DTOs, decoupling from the pagination API.
2024-02-20 23:39:30 +11:00
psychedelicious
0cc81e5d63
tidy(bulk_download): nit - use or as a coalescing operator
...
Just a bit cleaner.
2024-02-20 23:39:30 +11:00
psychedelicious
daecc54153
tidy(bulk_download): use single underscore for private attrs
...
Double underscores are used in the app but it doesn't actually do or convey anything that single underscores don't already do. Considered unpythonic except for actual dunder/magic methods.
2024-02-20 23:39:30 +11:00
psychedelicious
4c31c7f9f1
tidy(bulk_download): remove class-level attr annotations
...
These can be misleading as they shadow actual assigned class attributes. This pattern is in the rest of the app but it shouldn't be.
2024-02-20 23:39:30 +11:00
psychedelicious
d709c5519f
tidy(bulk_download): remove extraneous abstract methods
...
`start`, `stop` and `__init__` are not required in implementations of an ABC or service.
2024-02-20 23:39:30 +11:00
psychedelicious
5d84ecef49
tidy(bulk_download): clean up comments
2024-02-20 23:39:30 +11:00
Stefan Tobler
641d246213
adding bulk_download_item_name to socket events
2024-02-20 23:39:30 +11:00
Stefan Tobler
2e53aa48c9
refactoring handlers to do null check
2024-02-20 23:39:30 +11:00
Stefan Tobler
ef12631450
removing dependency on an output folder, embrace python temp folder for bulk download
2024-02-20 23:39:30 +11:00
Stefan Tobler
8033589629
moving the responsibility of cleaning up board names to the service not the route
2024-02-20 23:39:30 +11:00
Stefan Tobler
0bde933c89
using temp directory for downloads
2024-02-20 23:39:30 +11:00
Stefan Tobler
fc5c5b6bdd
returning the bulk_download_item_name on response for possible polling
2024-02-20 23:39:30 +11:00
Stefan Tobler
ff53563152
narrowing bulk_download stop service scope
2024-02-20 23:39:30 +11:00
Stefan Tobler
d06ee94fd3
cleaning up bulk download zip after the response is complete
2024-02-20 23:39:30 +11:00
Stefan Tobler
e99f3482cc
refactoring bulk_download to be better managed
2024-02-20 23:39:30 +11:00
Stefan Tobler
888db8ac46
refactoring bulkdownload to consider image category
2024-02-20 23:39:30 +11:00
Stefan Tobler
7deef2cb27
fixing issue where default board did not return images
2024-02-20 23:39:30 +11:00
Stefan Tobler
ada807af0c
using the board name to download boards
2024-02-20 23:39:30 +11:00
Stefan Tobler
aa132fb9e3
reworking some of the logic to use a default room, adding endpoint to download file on complete
2024-02-20 23:39:30 +11:00
Stefan Tobler
98a01368b8
linted and styling
2024-02-20 23:39:30 +11:00
Stefan Tobler
fc9a62dbf5
implementation of bulkdownload background task
2024-02-20 23:39:30 +11:00
Stefan Tobler
4d8bec1605
adding socket events for bulk download
2024-02-20 23:39:30 +11:00
Stefan Tobler
cf9dad83bc
groundwork for the bulk_download_service
2024-02-20 23:39:30 +11:00
psychedelicious
9d79ee8dc4
chore(nodes): update TODO comment
2024-02-20 09:54:01 +11:00
psychedelicious
78dd460348
tidy(nodes): clean up profiler/stats in processor, better comments
2024-02-20 09:54:01 +11:00
psychedelicious
9d27d354cf
fix(nodes): fix typing on stats service context manager
2024-02-20 09:54:01 +11:00
psychedelicious
e8725a1099
fix(nodes): fix model load events
...
was accessing incorrect properties in event data
2024-02-20 09:54:01 +11:00
psychedelicious
479d65b6e1
feat(nodes): making invocation class var in processor
2024-02-20 09:54:01 +11:00
psychedelicious
5d4b388dfd
feat(nodes): improved error messages in processor
2024-02-20 09:54:01 +11:00
psychedelicious
4956fa282b
feat(nodes): make processor thread limit and polling interval configurable
2024-02-20 09:54:01 +11:00
psychedelicious
6d5cc8b1ff
chore(nodes): better comments for invocation context
2024-02-20 09:54:01 +11:00
psychedelicious
08a5bb90e2
chore(nodes): "context_data" -> "data"
...
Changed within InvocationContext, for brevity.
2024-02-20 09:54:01 +11:00
psychedelicious
39bdf5c4e9
refactor(nodes): move is_canceled to context.util
2024-02-20 09:54:01 +11:00
psychedelicious
f31e4205aa
feat(nodes): add whole queue_item to InvocationContextData
...
No reason to not have the whole thing in there.
2024-02-20 09:54:01 +11:00
psychedelicious
4d05c4ff66
tidy(nodes): remove extraneous comments
2024-02-20 09:54:01 +11:00
psychedelicious
7e88d2a7f1
feat(nodes): better invocation error messages
2024-02-20 09:54:01 +11:00
psychedelicious
556f6aa174
chore(nodes): add comments for cancel state
2024-02-20 09:54:01 +11:00
psychedelicious
6a74048af8
feat(nodes): promote is_canceled to public node API
2024-02-20 09:54:01 +11:00
psychedelicious
2cb51bff11
refactor(nodes): merge processors
...
Consolidate graph processing logic into session processor.
With graphs as the unit of work, and the session queue distributing graphs, we no longer need the invocation queue or processor.
Instead, the session processor dequeues the next session and processes it in a simple loop, greatly simplifying the app.
- Remove `graph_execution_manager` service.
- Remove `queue` (invocation queue) service.
- Remove `processor` (invocation processor) service.
- Remove queue-related logic from `Invoker`. It now only starts and stops the services, providing them with access to other services.
- Remove unused `invocation_retrieval_error` and `session_retrieval_error` events, these are no longer needed.
- Clean up stats service now that it is less coupled to the rest of the app.
- Refactor cancellation logic - cancellations now originate from session queue (i.e. HTTP cancel endpoint) and are emitted as events. Processor gets the events and sets the canceled event. Access to this event is provided to the invocation context for e.g. the step callback.
- Remove `sessions` router; it provided access to `graph_executions` but that no longer exists.
2024-02-20 09:54:01 +11:00
psychedelicious
258fc006ec
tidy(nodes): remove no-op model_config
...
Because we now customize the JSON Schema creation for GraphExecutionState, the model_config did nothing.
2024-02-20 09:48:14 +11:00
psychedelicious
dcb4ee47d5
tidy(nodes): remove LibraryGraphs
...
The workflow library supersedes this unused feature.
2024-02-20 09:48:14 +11:00
