Skip to main content
Ctrl+K

Torch-TensorRT

  • Installation
  • User Guide
  • Advanced Usage
  • Model Zoo
  • API Reference
    • Debugging
    • Contributing
    • Legacy Frontends
  • GitHub
  • Installation
  • User Guide
  • Advanced Usage
  • Model Zoo
  • API Reference
  • Debugging
  • Contributing
  • Legacy Frontends
  • GitHub

Section Navigation

  • Creating a TorchScript Module
  • Using Torch-TensorRT in Python
  • Using Torch-TensorRT in C++
  • Using Torch-TensorRT TorchScript Frontend Directly From PyTorch
  • Post Training Quantization (PTQ)
  • Torch-TensorRT (FX Frontend) User Guide
  • Legacy Frontends

Legacy Frontends#

Documentation for the TorchScript and FX compilation frontends. These frontends are in maintenance mode — for new projects use the Dynamo frontend (torch.compile or torch.export).

TorchScript Frontend#

  • Creating a TorchScript Module
  • Working with TorchScript in Python
  • Saving TorchScript Module to Disk
  • Using Torch-TensorRT in Python
  • Using Torch-TensorRT in C++
  • Using Torch-TensorRT TorchScript Frontend Directly From PyTorch
  • Post Training Quantization (PTQ)

FX Frontend#

  • Torch-TensorRT (FX Frontend) User Guide

previous

Export and Serialization

next

Creating a TorchScript Module

On this page
  • TorchScript Frontend
  • FX Frontend
Edit on GitHub
Show Source

© Copyright 2024, NVIDIA Corporation.