feat(//py): add user level device class in py for embed engine

[narendasan]

Description

Adds a python level Device class so users can set device for apis like embed engine.

Type of change

Please delete options that are not relevant and/or add your own.

• New feature (non-breaking change which adds functionality)

Checklist:

• My code follows the style guidelines of this project (You can use the linters)
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas and hacks
• I have made corresponding changes to the documentation
• I have added tests to verify my fix or my feature
• New and existing unit tests pass locally with my changes

[github-actions]

There are some changes that do not conform to Python style guidelines:

Reformatting /workspace/cpp/ptq/training/vgg16/export_ckpt.py
Reformatting /workspace/cpp/ptq/training/vgg16/vgg16.py
Reformatting /workspace/cpp/ptq/training/vgg16/main.py
Reformatting /workspace/tests/modules/hub.py
Reformatting /workspace/tests/py/test_to_backend_api.py
Reformatting /workspace/tests/py/test_ptq_trt_calibrator.py
Reformatting /workspace/tests/py/test_ptq_dataloader_calibrator.py
--- /workspace/tests/py/test_api.py	(original)
+++ /workspace/tests/py/test_api.py	(reformatted)
@@ -73,6 +73,7 @@
        same = (trt_mod(self.input) - self.scripted_model(self.input)).abs().max()
        self.assertTrue(same < 2e-2)

+
class TestCompileHalf(ModelTestCase):

    def setUp(self):
@@ -94,6 +95,7 @@
        same = (trt_mod(self.input.half()) - self.scripted_model(self.input.half())).abs().max()
        self.assertTrue(same < 2e-2)

+
class TestCompileHalfDefault(ModelTestCase):

    def setUp(self):
@@ -114,6 +116,7 @@
        trt_mod = trtorch.compile(self.scripted_model, compile_spec)
        same = (trt_mod(self.input.half()) - self.scripted_model(self.input.half())).abs().max()
        self.assertTrue(same < 2e-2)
+

class TestFallbackToTorch(ModelTestCase):

Reformatting /workspace/tests/py/test_api_dla.py
Reformatting /workspace/tests/py/test_trt_intercompatability.py
Reformatting /workspace/tests/py/model_test_case.py
Reformatting /workspace/tests/py/test_multi_gpu.py
Reformatting /workspace/tests/py/test_ptq_to_backend.py
Reformatting /workspace/tests/py/test_api.py
ERROR: Some files do not conform to style guidelines

[github-actions]

Code conforms to C++ style guidelines

[github-actions]

There are some changes that do not conform to Python style guidelines:

Reformatting /workspace/cpp/ptq/training/vgg16/export_ckpt.py
Reformatting /workspace/cpp/ptq/training/vgg16/vgg16.py
Reformatting /workspace/cpp/ptq/training/vgg16/main.py
--- /workspace/tests/py/test_api.py	(original)
+++ /workspace/tests/py/test_api.py	(reformatted)
@@ -73,6 +73,7 @@
        same = (trt_mod(self.input) - self.scripted_model(self.input)).abs().max()
        self.assertTrue(same < 2e-2)

+
class TestCompileHalf(ModelTestCase):

    def setUp(self):
@@ -94,6 +95,7 @@
        same = (trt_mod(self.input.half()) - self.scripted_model(self.input.half())).abs().max()
        self.assertTrue(same < 2e-2)

+
class TestCompileHalfDefault(ModelTestCase):

    def setUp(self):
@@ -114,6 +116,7 @@
        trt_mod = trtorch.compile(self.scripted_model, compile_spec)
        same = (trt_mod(self.input.half()) - self.scripted_model(self.input.half())).abs().max()
        self.assertTrue(same < 2e-2)
+

class TestFallbackToTorch(ModelTestCase):

Reformatting /workspace/tests/modules/hub.py
Reformatting /workspace/tests/py/test_to_backend_api.py
Reformatting /workspace/tests/py/test_api.py
Reformatting /workspace/tests/py/test_api_dla.py
Reformatting /workspace/tests/py/test_trt_intercompatability.py
Reformatting /workspace/tests/py/model_test_case.py
Reformatting /workspace/tests/py/test_multi_gpu.py
Reformatting /workspace/tests/py/test_ptq_to_backend.py
Reformatting /workspace/tests/py/test_ptq_trt_calibrator.py
Reformatting /workspace/tests/py/test_ptq_dataloader_calibrator.py
ERROR: Some files do not conform to style guidelines

[github-actions]

Code conforms to C++ style guidelines

[github-actions]

There are some changes that do not conform to Python style guidelines:

Reformatting /workspace/cpp/ptq/training/vgg16/export_ckpt.py
Reformatting /workspace/cpp/ptq/training/vgg16/vgg16.py
Reformatting /workspace/cpp/ptq/training/vgg16/main.py
Reformatting /workspace/tests/py/test_api_dla.py
Reformatting /workspace/tests/py/test_trt_intercompatability.py
Reformatting /workspace/tests/py/model_test_case.py
Reformatting /workspace/tests/py/test_multi_gpu.py
Reformatting /workspace/tests/py/test_ptq_to_backend.py
Reformatting /workspace/tests/py/test_ptq_trt_calibrator.py
Reformatting /workspace/tests/py/test_ptq_dataloader_calibrator.py
--- /workspace/tests/py/test_api.py	(original)
+++ /workspace/tests/py/test_api.py	(reformatted)
@@ -73,6 +73,7 @@
        same = (trt_mod(self.input) - self.scripted_model(self.input)).abs().max()
        self.assertTrue(same < 2e-2)

+
class TestCompileHalf(ModelTestCase):

    def setUp(self):
@@ -94,6 +95,7 @@
        same = (trt_mod(self.input.half()) - self.scripted_model(self.input.half())).abs().max()
        self.assertTrue(same < 2e-2)

+
class TestCompileHalfDefault(ModelTestCase):

    def setUp(self):
@@ -114,6 +116,7 @@
        trt_mod = trtorch.compile(self.scripted_model, compile_spec)
        same = (trt_mod(self.input.half()) - self.scripted_model(self.input.half())).abs().max()
        self.assertTrue(same < 2e-2)
+

class TestFallbackToTorch(ModelTestCase):

Reformatting /workspace/tests/modules/hub.py
Reformatting /workspace/tests/py/test_to_backend_api.py
Reformatting /workspace/tests/py/test_api.py
ERROR: Some files do not conform to style guidelines

[github-actions]

Code conforms to C++ style guidelines