You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Currently Torch-TensorRT is relying on Partitioning to support Tuple/List grouped inputs, which means for some models with Tuple/List input/output, they are not supported end to end. This could also affect performance. So, we should try to implement a change where when we go to construct the inputs to the engine we on the fly group them to be in the form of the graph input so that conversion can work end to end.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Currently Torch-TensorRT is relying on Partitioning to support Tuple/List grouped inputs, which means for some models with Tuple/List input/output, they are not supported end to end. This could also affect performance. So, we should try to implement a change where when we go to construct the inputs to the engine we on the fly group them to be in the form of the graph input so that conversion can work end to end.
The text was updated successfully, but these errors were encountered: