Skip to main content
Ctrl+K

Torch-TensorRT

  • Installation
  • User Guide
  • Advanced Usage
  • Model Zoo
  • API Reference
    • Debugging
    • Contributing
    • Legacy Frontends
  • GitHub
  • Installation
  • User Guide
  • Advanced Usage
  • Model Zoo
  • API Reference
  • Debugging
  • Contributing
  • Legacy Frontends
  • GitHub

Section Navigation

  • Python API
    • torch_tensorrt
    • torch_tensorrt.dynamo
    • torch_tensorrt.logging
    • torch_tensorrt.runtime
    • torchtrtc
    • Operators Supported
    • torch_tensorrt.ts
    • torch_tensorrt.ts.ptq
    • torch_tensorrt.fx
  • C++ API
    • Torch-TensorRT C++ API
      • Namespace torch_tensorrt
      • Namespace torch_tensorrt::logging
      • Namespace torch_tensorrt::torchscript
      • Struct Device
      • Struct GraphInputs
      • Struct Input
      • Struct CompileSpec
      • Class DataType
      • Class Device::DeviceType
      • Class TensorFormat
      • Enum EngineCapability
      • Enum Level
      • Function torch_tensorrt::dump_build_info
      • Function torch_tensorrt::get_build_info
      • Function torch_tensorrt::logging::get_is_colored_output_on
      • Function torch_tensorrt::logging::get_logging_prefix
      • Function torch_tensorrt::logging::get_reportable_log_level
      • Function torch_tensorrt::logging::log
      • Function torch_tensorrt::logging::set_is_colored_output_on
      • Function torch_tensorrt::logging::set_logging_prefix
      • Function torch_tensorrt::logging::set_reportable_log_level
      • Function torch_tensorrt::set_device
      • Function torch_tensorrt::torchscript::check_method_operator_support
      • Function torch_tensorrt::torchscript::compile
      • Function torch_tensorrt::torchscript::convert_method_to_trt_engine
      • Function torch_tensorrt::torchscript::embed_engine_in_new_module
      • Define STR
      • Define TORCH_TENSORRT_MAJOR_VERSION
      • Define TORCH_TENSORRT_MINOR_VERSION
      • Define TORCH_TENSORRT_PATCH_VERSION
      • Define TORCH_TENSORRT_VERSION
      • Define TORCHTRT_API
      • Define TORCHTRT_HIDDEN
      • Define XSTR
  • API Reference
  • Python API

Python API#

Reference documentation for all public Python modules in Torch-TensorRT.

Core#

  • torch_tensorrt
  • torch_tensorrt.dynamo
  • torch_tensorrt.logging
  • torch_tensorrt.runtime
  • torchtrtc
  • Operators Supported

Legacy#

Note

The ts, ptq, and fx modules are in maintenance mode — for new projects use the Dynamo frontend (torch.compile or torch.export).

  • torch_tensorrt.ts
  • torch_tensorrt.ts.ptq
  • torch_tensorrt.fx

previous

API Reference

next

torch_tensorrt

On this page
  • Core
  • Legacy
Edit on GitHub
Show Source

© Copyright 2024, NVIDIA Corporation.