vLLMWorker

class torchrl.modules.llm.vLLMWorker(*args, **kwargs)

vLLM worker for Ray.

vLLMParameterServer will always take rank 0 in the stateless process group initialized by this worker. And the tp ranks associated with the LLM class will be in the range [1, tp_size].

check_weights_changed()

Check if the weights are updated to 0.