feat: Add hardware compatibility option in Dynamo

[gs-olive]

Description

• Add support for hardware compatibility for Ampere and later architectures
• Add necessary functions to support the modification throughout the stack, including C++ and Python components
• Update ABI version to address new metadata format for TRT Engines
• Update engine serialization schema accordingly
• Add test cases to validate feature

Fixes #1929
Addresses #1888

Type of change

• New feature (ABI-Breaking)

Checklist:

• [ x ] My code follows the style guidelines of this project (You can use the linters)
• [ x ] I have performed a self-review of my own code
• [ x ] I have commented my code, particularly in hard-to-understand areas and hacks
• [ x ] I have made corresponding changes to the documentation
• [ x ] I have added tests to verify my fix or my feature
• [ x ] New and existing unit tests pass locally with my changes
• [ x ] I have added the relevant labels to my PR in so that relevant reviewers are notified

[narendasan]

Changes look fine, but have we tested this with torchscript to make sure nothing breaks there?

[gs-olive]

Currently, there is a Torchscript test which loads a hardware-compatible .ts file which has been pre-compiled and attempts to run inference with it.

[narendasan]

Will torchscript be able to create new engines using this API since the signature changed right? Is is just default not compatible?

[gs-olive]

Yes, the signature changed and the ABI version was bumped. For compatibility with older compiled engines (like ABI 4), would there be a way to just assume hardware_compatible=False, if the field is missing, or does the ABI mismatch forbid any parsing of the serialized object?

[narendasan]

Im not talking about old engines since they will not work with the bumped ABI. But like if I do torch_tensorrt.ts.compile() will this work properly?

[gs-olive]

I see - currently, hardware_compatible is not enabled for Torchscript - all TS compilations will work, but will be with hardware_compatible=False. Should I add this feature to TS as part of this PR?