We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
RuntimeError: linear convolution has bias of type <class 'tensorrt_bindings.tensorrt.ITensor'>, Expect Optional[Tensor]
import torch import torch_tensorrt import torchvision.models as models import timm class MyModule(torch.nn.Module): def __init__(self): super().__init__() self.conv = torch.nn.Conv2d(3, 16, 3, stride=1, bias=True) self.bn = torch.nn.BatchNorm2d(16) self.relu = torch.nn.ReLU() def forward(self, x): out = self.conv(x) out = self.bn(out) out = self.relu(out) return out model = MyModule().eval().cuda() input = torch.randn((1, 3, 224, 224)).to("cuda") compile_spec = { "inputs": [ torch_tensorrt.Input( input.shape, dtype=torch.float, format=torch.contiguous_format ) ], "enabled_precisions": {torch.float}, "debug": True, "is_aten": True, "min_block_size": 5, } trt_mod = torch_tensorrt.dynamo.backend.compile(model, **compile_spec)
Build information about Torch-TensorRT can be found by turning on debug messages
conda
pip
libtorch
The text was updated successfully, but these errors were encountered:
This one was fixed in #1972 - could you try the model again with that PR
Sorry, something went wrong.
This issue has not seen activity for 90 days, Remove stale label or comment or this will be closed in 10 days
Fixed on main in recent linear converter implementation
main
No branches or pull requests
Bug Description
RuntimeError: linear convolution has bias of type <class 'tensorrt_bindings.tensorrt.ITensor'>, Expect Optional[Tensor]
To Reproduce
Expected behavior
Environment
conda
,pip
,libtorch
, source):Additional context
The text was updated successfully, but these errors were encountered: