Skip to content

Commit 07364ad

Browse files
committed
chore: fix docs
Signed-off-by: Dheeraj Peri <[email protected]> chore: updates Signed-off-by: Dheeraj Peri <[email protected]> chore: remove dynamo_export file since it has been moved Signed-off-by: Dheeraj Peri <[email protected]>
1 parent 42f87f2 commit 07364ad

File tree

4 files changed

+12
-95
lines changed

4 files changed

+12
-95
lines changed

docsrc/dynamo/dynamo_export.rst

+1-3
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
.. _dynamo_export:
22

3-
Compiling ``ExportedPrograms`` with Torch-TensorRT
3+
Compiling Exported Programs with Torch-TensorRT
44
=============================================
55
.. currentmodule:: torch_tensorrt.dynamo
66

@@ -9,8 +9,6 @@ Compiling ``ExportedPrograms`` with Torch-TensorRT
99
:undoc-members:
1010
:show-inheritance:
1111

12-
Using the Torch-TensorRT Frontend for ``torch.export.ExportedPrograms``
13-
--------------------------------------------------------
1412
Pytorch 2.1 introduced ``torch.export`` APIs which
1513
can export graphs from Pytorch programs into ``ExportedProgram`` objects. Torch-TensorRT dynamo
1614
frontend compiles these ``ExportedProgram`` objects and optimizes them using TensorRT. Here's a simple

docsrc/user_guide/dynamo_export.rst

-82
This file was deleted.

docsrc/user_guide/saving_models.rst

+10-9
Original file line numberDiff line numberDiff line change
@@ -29,14 +29,14 @@ The following code illustrates this approach.
2929
import torch_tensorrt
3030
3131
model = MyModel().eval().cuda()
32-
inputs = torch.randn((1, 3, 224, 224)).cuda()
32+
inputs = [torch.randn((1, 3, 224, 224)).cuda()]
3333
trt_gm = torch_tensorrt.compile(model, ir="dynamo", inputs) # Output is a torch.fx.GraphModule
34-
trt_traced_model = torchtrt.dynamo.serialize(trt_gm, inputs)
34+
trt_traced_model = torch.jit.trace(trt_gm, inputs)
3535
torch.jit.save(trt_traced_model, "trt_model.ts")
3636
3737
# Later, you can load it and run inference
3838
model = torch.jit.load("trt_model.ts").cuda()
39-
model(inputs)
39+
model(*inputs)
4040
4141
b) ExportedProgram
4242
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
@@ -50,15 +50,16 @@ b) ExportedProgram
5050
import torch_tensorrt
5151
5252
model = MyModel().eval().cuda()
53-
inputs = torch.randn((1, 3, 224, 224)).cuda()
54-
trt_gm = torch_tensorrt.compile(model, ir="dynamo", inputs) # Output is a torch.fx.GraphModule
53+
inputs = [torch.randn((1, 3, 224, 224)).cuda()]
54+
exp_program = torch_tensorrt.dynamo.trace(model, inputs)
55+
trt_gm = torch_tensorrt.dynamo.compile(exp_program, inputs) # Output is a torch.fx.GraphModule
5556
# Transform and create an exported program
56-
trt_exp_program = torch_tensorrt.dynamo.export(trt_gm, inputs, call_spec, ir="exported_program")
57+
trt_exp_program = torch_tensorrt.dynamo.export(trt_gm, inputs, exp_program.call_spec, ir="exported_program")
5758
torch.export.save(trt_exp_program, "trt_model.ep")
5859
5960
# Later, you can load it and run inference
6061
model = torch.export.load("trt_model.ep")
61-
model(inputs)
62+
model(*inputs)
6263
6364
`torch_tensorrt.dynamo.export` inlines the submodules within a GraphModule to their corresponding nodes, stiches all the nodes together and creates an ExportedProgram.
6465
This is needed as `torch.export` serialization cannot handle serializing and deserializing of submodules (`call_module` nodes).
@@ -78,11 +79,11 @@ Torchscript IR
7879
import torch_tensorrt
7980
8081
model = MyModel().eval().cuda()
81-
inputs = torch.randn((1, 3, 224, 224)).cuda()
82+
inputs = [torch.randn((1, 3, 224, 224)).cuda()]
8283
trt_ts = torch_tensorrt.compile(model, ir="ts", inputs) # Output is a ScriptModule object
8384
torch.jit.save(trt_ts, "trt_model.ts")
8485
8586
# Later, you can load it and run inference
8687
model = torch.jit.load("trt_model.ts").cuda()
87-
model(inputs)
88+
model(*inputs)
8889

py/torch_tensorrt/dynamo/_exporter.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,7 @@ def export(
5353
return exp_program
5454
else:
5555
raise ValueError(
56-
"Invalid ir : {ir} provided for serialization. Options include torchscript | exported_program"
56+
f"Invalid ir : {ir} provided for serialization. Options include torchscript | exported_program"
5757
)
5858

5959

0 commit comments

Comments
 (0)