✨[Feature] Support cases where LowerGraph() introduces input whose values are stored in Param #1190
Labels
bug
Something isn't working
component: lowering
Issues re: The lowering / preprocessing passes
feature request
New feature or request
Is your feature request related to a problem? Please describe.
#1024
There are some models that LowerGraph() might introduce new input to the entire graph after lowering, which may cause the missing value error. As what is happening here #922 (comment) and here: #922 (comment).
Describe the solution you'd like
For now, in most cases it fails at the shape analysis phase since Torch-TensorRT cannot find the value for the missing input. We could introduce a pass to modify the graph and substitute the input by some constant or we can just add some mechanism to use the values from Params directly.
In the future Torch-TensorRT could handle these cases.
The text was updated successfully, but these errors were encountered: