Shortcuts

LLMOnDevice

class torchrl.modules.llm.LLMOnDevice(*args, bundle_indices: list | None = None, **kwargs)[source]

A thin wrapper around vllm.LLM to control its placement devices.

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources