feat: torchtrtc using atol and rtol for tolerance test

[andi4191]

Signed-off-by: Anurag Dixit [email protected]

Description

Added rtol + atol tolerance check for torchtrtc. Similar to what we have for test benchmarks.

Fixes # (issue)
#1030

Type of change

Please delete options that are not relevant and/or add your own.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

Checklist:

• My code follows the style guidelines of this project (You can use the linters)
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas and hacks
• I have made corresponding changes to the documentation
• I have added tests to verify my fix or my feature
• New and existing unit tests pass locally with my changes

[narendasan]

I think theres a threshold CLI argument we need to change as well

[andi4191]

I think theres a threshold CLI argument we need to change as well

We still need this threshold value for comparison. Is this what you are referring to?
https://github.com/NVIDIA/Torch-TensorRT/blob/master/cpp/bin/torchtrtc/main.cpp#L124

OR

do you want the atol and rtol to be configurable using CLI as well?

[narendasan]

I think both should be configurable

[andi4191]

Closing this PR as it was created from my fork instead.
PR for this feature can be tracked here: #1052