Lincoln Stein e93f4d632d [util] Add generic torch device class (#6174) ... * introduce new abstraction layer for GPU devices * add unit test for device abstraction * fix ruff * convert TorchDeviceSelect into a stateless class * move logic to select context-specific execution device into context API * add mock hardware environments to pytest * remove dangling mocker fixture * fix unit test for running on non-CUDA systems * remove unimplemented get_execution_device() call * remove autocast precision * Multiple changes: 1. Remove TorchDeviceSelect.get_execution_device(), as well as calls to context.models.get_execution_device(). 2. Rename TorchDeviceSelect to TorchDevice 3. Added back the legacy public API defined in `invocation_api`, including choose_precision(). 4. Added a config file migration script to accommodate removal of precision=autocast. * add deprecation warnings to choose_torch_device() and choose_precision() * fix test crash * remove app_config argument from choose_torch_device() and choose_torch_dtype() --------- Co-authored-by: Lincoln Stein <lstein@gmail.com>		2024-04-15 13:12:49 +00:00
..
__init__.py	final tidying before marking PR as ready for review	2024-03-01 10:42:33 +11:00
model_manager_base.py	tidy(mm): remove convenience methods from high level model manager service	2024-03-07 10:56:59 +11:00
model_manager_common.py	feat(nodes): update all invocations to use new invocation context	2024-03-01 10:42:33 +11:00
model_manager_default.py	[util] Add generic torch device class (#6174)	2024-04-15 13:12:49 +00:00