Skip to content

Commit b0937fb

Browse files
committed
tool: Opset coverage notebook
Signed-off-by: Naren Dasan <[email protected]> Signed-off-by: Naren Dasan <[email protected]>
1 parent 4dc9acf commit b0937fb

File tree

167 files changed

+7212
-5416
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

167 files changed

+7212
-5416
lines changed

.gitignore

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -69,3 +69,8 @@ bazel-tensorrt
6969
bazel-project
7070
build/
7171
wheelhouse/
72+
*_status.json
73+
tests/py/dynamo/models/*.ts
74+
tests/py/dynamo/models/*.ep
75+
*.deb
76+
*.tar.xz

docs/_cpp_api/classtorch__tensorrt_1_1DataType.html

Lines changed: 30 additions & 22 deletions
Large diffs are not rendered by default.

docs/_cpp_api/classtorch__tensorrt_1_1Device_1_1DeviceType.html

Lines changed: 21 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010

1111
<meta name="viewport" content="width=device-width, initial-scale=1.0">
1212

13-
<title>Class Device::DeviceType &mdash; Torch-TensorRT v2.3.0.dev0+85971ff documentation</title>
13+
<title>Class Device::DeviceType &mdash; Torch-TensorRT v2.4.0.dev0+4dc9acfc9 documentation</title>
1414

1515

1616

@@ -237,7 +237,7 @@
237237

238238

239239
<div class="version">
240-
v2.3.0.dev0+85971ff
240+
v2.4.0.dev0+4dc9acfc9
241241
</div>
242242

243243

@@ -304,6 +304,9 @@
304304
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/torch_compile_transformers_example.html">Compiling a Transformer using torch.compile and TensorRT</a></li>
305305
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/torch_compile_advanced_usage.html">Torch Compile Advanced Usage</a></li>
306306
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/torch_compile_stable_diffusion.html">Torch Compile Stable Diffusion</a></li>
307+
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html">Using Custom Kernels within TensorRT Engines with Torch-TensorRT</a></li>
308+
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html#wrapping-custom-kernels-to-use-in-tensorrt">Wrapping Custom Kernels to use in TensorRT</a></li>
309+
<li class="toctree-l1"><a class="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html#using-torch-tensorrt-to-insert-the-kernel">Using Torch-TensorRT to Insert the Kernel</a></li>
307310
</ul>
308311
<p class="caption" role="heading"><span class="caption-text">Python API Documenation</span></p>
309312
<ul>
@@ -416,19 +419,19 @@
416419
<article itemprop="articleBody" id="pytorch-article" class="pytorch-article">
417420

418421
<section id="class-device-devicetype">
419-
<span id="exhale-class-classtorch-tensorrt-1-1device-1-1devicetype"></span><h1>Class Device::DeviceType<a class="headerlink" href="#class-device-devicetype" title="Permalink to this headline"></a></h1>
422+
<span id="exhale-class-classtorch-tensorrt-1-1device-1-1devicetype"></span><h1>Class Device::DeviceType<a class="headerlink" href="#class-device-devicetype" title="Permalink to this heading"></a></h1>
420423
<ul class="simple">
421424
<li><p>Defined in <a class="reference internal" href="file_cpp_include_torch_tensorrt_torch_tensorrt.h.html#file-cpp-include-torch-tensorrt-torch-tensorrt-h"><span class="std std-ref">File torch_tensorrt.h</span></a></p></li>
422425
</ul>
423426
<section id="nested-relationships">
424-
<h2>Nested Relationships<a class="headerlink" href="#nested-relationships" title="Permalink to this headline"></a></h2>
427+
<h2>Nested Relationships<a class="headerlink" href="#nested-relationships" title="Permalink to this heading"></a></h2>
425428
<p>This class is a nested type of <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#exhale-struct-structtorch-tensorrt-1-1device"><span class="std std-ref">Struct Device</span></a>.</p>
426429
</section>
427430
<section id="class-documentation">
428-
<h2>Class Documentation<a class="headerlink" href="#class-documentation" title="Permalink to this headline"></a></h2>
431+
<h2>Class Documentation<a class="headerlink" href="#class-documentation" title="Permalink to this heading"></a></h2>
429432
<dl class="cpp class">
430433
<dt class="sig sig-object cpp" id="_CPPv4N14torch_tensorrt6Device10DeviceTypeE">
431-
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType"></span><span class="k"><span class="pre">class</span></span><span class="w"> </span><span class="sig-prename descclassname"><span class="n"><span class="pre">torch_tensorrt</span></span><span class="p"><span class="pre">::</span></span><a class="reference internal" href="structtorch__tensorrt_1_1Device.html#_CPPv4N14torch_tensorrt6DeviceE" title="torch_tensorrt::Device"><span class="n"><span class="pre">Device</span></span></a><span class="p"><span class="pre">::</span></span></span><span class="sig-name descname"><span class="n"><span class="pre">DeviceType</span></span></span><a class="headerlink" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="Permalink to this definition"></a><br /></dt>
434+
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType"></span><span class="k"><span class="pre">class</span></span><span class="w"> </span><span class="sig-name descname"><span class="n"><span class="pre">DeviceType</span></span></span><a class="headerlink" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="Permalink to this definition"></a><br /></dt>
432435
<dd><p>Supported <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#structtorch__tensorrt_1_1Device"><span class="std std-ref">Device</span></a> Types that can be used with TensorRT engines</p>
433436
<p>This class is compatable with c10::DeviceTypes (but will check for TRT support) but the only applicable value is at::kCUDA, which maps to <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#classtorch__tensorrt_1_1Device_1_1DeviceType_1a23c188ccbece0f27609e8b1c7bf7e350a7096aeeb6744e578d5afd98e334f866c"><span class="std std-ref">DeviceType::kGPU</span></a></p>
434437
<p>To use the <a class="reference internal" href="classtorch__tensorrt_1_1DataType.html#classtorch__tensorrt_1_1DataType"><span class="std std-ref">DataType</span></a> class itself, interface using the enum vs. normal instatination</p>
@@ -484,7 +487,7 @@ <h2>Class Documentation<a class="headerlink" href="#class-documentation" title="
484487

485488
<dl class="cpp function">
486489
<dt class="sig sig-object cpp" id="_CPPv4NK14torch_tensorrt6Device10DeviceTypecv5ValueEv">
487-
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a46962474415caca02f9de9a7cde182ce"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="w"> </span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceType5ValueE" title="torch_tensorrt::Device::DeviceType::Value"><span class="n"><span class="pre">Value</span></span></a></span><span class="sig-paren">(</span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypecv5ValueEv" title="Permalink to this definition"></a><br /></dt>
490+
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a4afa0b396b7a076e37054754a367f2f4"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="w"> </span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceType5ValueE" title="torch_tensorrt::Device::DeviceType::Value"><span class="n"><span class="pre">Value</span></span></a></span><span class="sig-paren">(</span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypecv5ValueEv" title="Permalink to this definition"></a><br /></dt>
488491
<dd><p>Get the internal value from the <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#structtorch__tensorrt_1_1Device"><span class="std std-ref">Device</span></a> object. </p>
489492
<dl class="field-list simple">
490493
<dt class="field-odd">Returns</dt>
@@ -500,32 +503,34 @@ <h2>Class Documentation<a class="headerlink" href="#class-documentation" title="
500503

501504
<dl class="cpp function">
502505
<dt class="sig sig-object cpp" id="_CPPv4NK14torch_tensorrt6Device10DeviceTypeeqE10DeviceType">
503-
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1ac96651e5f12e09b45a31f6f6251634ad"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="k"><span class="pre">constexpr</span></span><span class="w"> </span><span class="kt"><span class="pre">bool</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="o"><span class="pre">==</span></span></span><span class="sig-paren">(</span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="torch_tensorrt::Device::DeviceType"><span class="n"><span class="pre">DeviceType</span></span></a><span class="w"> </span><span class="n sig-param"><span class="pre">other</span></span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypeeqE10DeviceType" title="Permalink to this definition"></a><br /></dt>
506+
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a0177ee9788edabb89a8cb64234d2a60c"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="k"><span class="pre">constexpr</span></span><span class="w"> </span><span class="kt"><span class="pre">bool</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="o"><span class="pre">==</span></span></span><span class="sig-paren">(</span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="torch_tensorrt::Device::DeviceType"><span class="n"><span class="pre">DeviceType</span></span></a><span class="w"> </span><span class="n sig-param"><span class="pre">other</span></span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypeeqE10DeviceType" title="Permalink to this definition"></a><br /></dt>
504507
<dd><p>Comparison operator for <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#classtorch__tensorrt_1_1Device_1_1DeviceType"><span class="std std-ref">DeviceType</span></a>. </p>
505508
<dl class="field-list simple">
506509
<dt class="field-odd">Parameters</dt>
507510
<dd class="field-odd"><p><strong>other</strong></p>
508511
</dd>
509512
<dt class="field-even">Returns</dt>
510-
<dd class="field-even"><p><p>true </p>
511-
<p>false </p>
512-
</p>
513+
<dd class="field-even"><p>true </p>
514+
</dd>
515+
<dt class="field-odd">Returns</dt>
516+
<dd class="field-odd"><p>false </p>
513517
</dd>
514518
</dl>
515519
</dd></dl>
516520

517521
<dl class="cpp function">
518522
<dt class="sig sig-object cpp" id="_CPPv4NK14torch_tensorrt6Device10DeviceTypeneE10DeviceType">
519-
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1af537ba74a76ce0b17aec3e4af9c0b5ad"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="k"><span class="pre">constexpr</span></span><span class="w"> </span><span class="kt"><span class="pre">bool</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="o"><span class="pre">!=</span></span></span><span class="sig-paren">(</span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="torch_tensorrt::Device::DeviceType"><span class="n"><span class="pre">DeviceType</span></span></a><span class="w"> </span><span class="n sig-param"><span class="pre">other</span></span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypeneE10DeviceType" title="Permalink to this definition"></a><br /></dt>
523+
<span class="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a0d8973b436226f17597d94f4e8f63336"></span><span class="k"><span class="pre">inline</span></span><span class="w"> </span><span class="k"><span class="pre">constexpr</span></span><span class="w"> </span><span class="kt"><span class="pre">bool</span></span><span class="w"> </span><span class="sig-name descname"><span class="k"><span class="pre">operator</span></span><span class="o"><span class="pre">!=</span></span></span><span class="sig-paren">(</span><a class="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="torch_tensorrt::Device::DeviceType"><span class="n"><span class="pre">DeviceType</span></span></a><span class="w"> </span><span class="n sig-param"><span class="pre">other</span></span><span class="sig-paren">)</span><span class="w"> </span><span class="k"><span class="pre">const</span></span><a class="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypeneE10DeviceType" title="Permalink to this definition"></a><br /></dt>
520524
<dd><p>Comparison operator for <a class="reference internal" href="structtorch__tensorrt_1_1Device.html#classtorch__tensorrt_1_1Device_1_1DeviceType"><span class="std std-ref">DeviceType</span></a>. </p>
521525
<dl class="field-list simple">
522526
<dt class="field-odd">Parameters</dt>
523527
<dd class="field-odd"><p><strong>other</strong></p>
524528
</dd>
525529
<dt class="field-even">Returns</dt>
526-
<dd class="field-even"><p><p>true </p>
527-
<p>false </p>
528-
</p>
530+
<dd class="field-even"><p>true </p>
531+
</dd>
532+
<dt class="field-odd">Returns</dt>
533+
<dd class="field-odd"><p>false </p>
529534
</dd>
530535
</dl>
531536
</dd></dl>
@@ -602,6 +607,7 @@ <h2>Class Documentation<a class="headerlink" href="#class-documentation" title="
602607
<script data-url_root="../" id="documentation_options" src="../_static/documentation_options.js"></script>
603608
<script src="../_static/jquery.js"></script>
604609
<script src="../_static/underscore.js"></script>
610+
<script src="../_static/_sphinx_javascript_frameworks_compat.js"></script>
605611
<script src="../_static/doctools.js"></script>
606612
<script src="../_static/collapsible-lists/js/CollapsibleLists.compressed.js"></script>
607613
<script src="../_static/collapsible-lists/js/apply-collapsible-lists.js"></script>

0 commit comments

Comments
 (0)