🐛 [Bug] Encountered bug when converting deepset/roberta-base-squad2
Hugging Face Network
#1410
Labels
bug
Something isn't working
Bug Description
When converting the deepset/roberta-base-squad2 Hugging Face network (https://huggingface.co/deepset/roberta-base-squad2) from TorchScript to Torch-TRT, the following error is encountered:
To Reproduce
Steps to reproduce the behavior:
torch_tensorrt.compile
withdeepset/roberta-base-squad2
model as input, usingfp32
precision.[1, 128]
and enabletruncate_long_and_double
with 8 GB workspace.Expected behavior
Model should successfully compile to Torch-TRT. Specifically, the size of evaluated results and node outputs should be matching
Environment
Additional context
Bug was reproduced on PyTorch 22.08 and 22.09 containers
The text was updated successfully, but these errors were encountered: