Function torch_tensorrt::torchscript::compile#

Defined in File torch_tensorrt.h

Function Documentation#

TORCHTRT_API torch::jit::Module torch_tensorrt::torchscript::compile(const torch::jit::Module &module, CompileSpec info)#

Compile a TorchScript module for NVIDIA GPUs using TensorRT.

Takes a existing TorchScript module and a set of settings to configure the compiler and will convert methods to JIT Graphs which call equivalent TensorRT engines

Converts specifically the forward method of a TorchScript Module

Parameters:

module – torch::jit::Module - Existing TorchScript module
info – torch_tensorrt::CompileSpec - Compilation settings

Returns:

: A new module trageting a TensorRT engine