Welcome to the TorchTune Documentation¶

TorchTune is a Native-PyTorch library for LLM fine-tuning.

Getting Started¶

Topics in this section will help you get started with TorchTune.

What is TorchTune?

A gentle introduction to TorchTune and how you can use the library in your projects.

Installation instructions

A step-by-step tutorial on how to install TorchTune.

Finetune your first model

Follow a simple tutorial to finetune Llama2 with TorchTune.

Ready to experiment? Check out some of the interactive TorchTune tutorials.

Topics: finetuning,llama2

Full Finetuning for Llama2

Topics: finetuning,llama2,lora

Parameter-efficient finetuning of Llama2 using LoRA

Topics: finetuning

Dive into TorchTune's Training Recipes

Topics: checkpointing

Dive into TorchTune's Checkpointers