You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
<liclass="toctree-l1"><aclass="reference internal" href="../tutorials/_rendered_examples/dynamo/torch_compile_transformers_example.html">Compiling a Transformer using torch.compile and TensorRT</a></li>
<liclass="toctree-l1"><aclass="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html">Using Custom Kernels within TensorRT Engines with Torch-TensorRT</a></li>
308
+
<liclass="toctree-l1"><aclass="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html#wrapping-custom-kernels-to-use-in-tensorrt">Wrapping Custom Kernels to use in TensorRT</a></li>
309
+
<liclass="toctree-l1"><aclass="reference internal" href="../tutorials/_rendered_examples/dynamo/custom_kernel_plugins.html#using-torch-tensorrt-to-insert-the-kernel">Using Torch-TensorRT to Insert the Kernel</a></li>
307
310
</ul>
308
311
<pclass="caption" role="heading"><spanclass="caption-text">Python API Documenation</span></p>
<spanid="exhale-class-classtorch-tensorrt-1-1device-1-1devicetype"></span><h1>Class Device::DeviceType<aclass="headerlink" href="#class-device-devicetype" title="Permalink to this headline">¶</a></h1>
422
+
<spanid="exhale-class-classtorch-tensorrt-1-1device-1-1devicetype"></span><h1>Class Device::DeviceType<aclass="headerlink" href="#class-device-devicetype" title="Permalink to this heading">¶</a></h1>
420
423
<ulclass="simple">
421
424
<li><p>Defined in <aclass="reference internal" href="file_cpp_include_torch_tensorrt_torch_tensorrt.h.html#file-cpp-include-torch-tensorrt-torch-tensorrt-h"><spanclass="std std-ref">File torch_tensorrt.h</span></a></p></li>
422
425
</ul>
423
426
<sectionid="nested-relationships">
424
-
<h2>Nested Relationships<aclass="headerlink" href="#nested-relationships" title="Permalink to this headline">¶</a></h2>
427
+
<h2>Nested Relationships<aclass="headerlink" href="#nested-relationships" title="Permalink to this heading">¶</a></h2>
425
428
<p>This class is a nested type of <aclass="reference internal" href="structtorch__tensorrt_1_1Device.html#exhale-struct-structtorch-tensorrt-1-1device"><spanclass="std std-ref">Struct Device</span></a>.</p>
426
429
</section>
427
430
<sectionid="class-documentation">
428
-
<h2>Class Documentation<aclass="headerlink" href="#class-documentation" title="Permalink to this headline">¶</a></h2>
431
+
<h2>Class Documentation<aclass="headerlink" href="#class-documentation" title="Permalink to this heading">¶</a></h2>
<spanclass="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType"></span><spanclass="k"><spanclass="pre">class</span></span><spanclass="w"></span><spanclass="sig-prename descclassname"><spanclass="n"><spanclass="pre">torch_tensorrt</span></span><spanclass="p"><spanclass="pre">::</span></span><aclass="reference internal" href="structtorch__tensorrt_1_1Device.html#_CPPv4N14torch_tensorrt6DeviceE" title="torch_tensorrt::Device"><spanclass="n"><spanclass="pre">Device</span></span></a><spanclass="p"><spanclass="pre">::</span></span></span><spanclass="sig-name descname"><spanclass="n"><spanclass="pre">DeviceType</span></span></span><aclass="headerlink" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="Permalink to this definition">¶</a><br/></dt>
434
+
<spanclass="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType"></span><spanclass="k"><spanclass="pre">class</span></span><spanclass="w"></span><spanclass="sig-name descname"><spanclass="n"><spanclass="pre">DeviceType</span></span></span><aclass="headerlink" href="#_CPPv4N14torch_tensorrt6Device10DeviceTypeE" title="Permalink to this definition">¶</a><br/></dt>
432
435
<dd><p>Supported <aclass="reference internal" href="structtorch__tensorrt_1_1Device.html#structtorch__tensorrt_1_1Device"><spanclass="std std-ref">Device</span></a> Types that can be used with TensorRT engines</p>
433
436
<p>This class is compatable with c10::DeviceTypes (but will check for TRT support) but the only applicable value is at::kCUDA, which maps to <aclass="reference internal" href="structtorch__tensorrt_1_1Device.html#classtorch__tensorrt_1_1Device_1_1DeviceType_1a23c188ccbece0f27609e8b1c7bf7e350a7096aeeb6744e578d5afd98e334f866c"><spanclass="std std-ref">DeviceType::kGPU</span></a></p>
434
437
<p>To use the <aclass="reference internal" href="classtorch__tensorrt_1_1DataType.html#classtorch__tensorrt_1_1DataType"><spanclass="std std-ref">DataType</span></a> class itself, interface using the enum vs. normal instatination</p>
<spanclass="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a46962474415caca02f9de9a7cde182ce"></span><spanclass="k"><spanclass="pre">inline</span></span><spanclass="w"></span><spanclass="sig-name descname"><spanclass="k"><spanclass="pre">operator</span></span><spanclass="w"></span><aclass="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceType5ValueE" title="torch_tensorrt::Device::DeviceType::Value"><spanclass="n"><spanclass="pre">Value</span></span></a></span><spanclass="sig-paren">(</span><spanclass="sig-paren">)</span><spanclass="w"></span><spanclass="k"><spanclass="pre">const</span></span><aclass="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypecv5ValueEv" title="Permalink to this definition">¶</a><br/></dt>
490
+
<spanclass="target" id="classtorch__tensorrt_1_1Device_1_1DeviceType_1a4afa0b396b7a076e37054754a367f2f4"></span><spanclass="k"><spanclass="pre">inline</span></span><spanclass="w"></span><spanclass="sig-name descname"><spanclass="k"><spanclass="pre">operator</span></span><spanclass="w"></span><aclass="reference internal" href="#_CPPv4N14torch_tensorrt6Device10DeviceType5ValueE" title="torch_tensorrt::Device::DeviceType::Value"><spanclass="n"><spanclass="pre">Value</span></span></a></span><spanclass="sig-paren">(</span><spanclass="sig-paren">)</span><spanclass="w"></span><spanclass="k"><spanclass="pre">const</span></span><aclass="headerlink" href="#_CPPv4NK14torch_tensorrt6Device10DeviceTypecv5ValueEv" title="Permalink to this definition">¶</a><br/></dt>
488
491
<dd><p>Get the internal value from the <aclass="reference internal" href="structtorch__tensorrt_1_1Device.html#structtorch__tensorrt_1_1Device"><spanclass="std std-ref">Device</span></a> object. </p>
0 commit comments