You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Signed-off-by: Dheeraj Peri <[email protected]>
chore: updates
Signed-off-by: Dheeraj Peri <[email protected]>
chore: remove dynamo_export file since it has been moved
Signed-off-by: Dheeraj Peri <[email protected]>
`torch_tensorrt.dynamo.export` inlines the submodules within a GraphModule to their corresponding nodes, stiches all the nodes together and creates an ExportedProgram.
64
65
This is needed as `torch.export` serialization cannot handle serializing and deserializing of submodules (`call_module` nodes).
@@ -78,11 +79,11 @@ Torchscript IR
78
79
import torch_tensorrt
79
80
80
81
model = MyModel().eval().cuda()
81
-
inputs = torch.randn((1, 3, 224, 224)).cuda()
82
+
inputs =[torch.randn((1, 3, 224, 224)).cuda()]
82
83
trt_ts = torch_tensorrt.compile(model, ir="ts", inputs) # Output is a ScriptModule object
0 commit comments