Skip to content

Commit fa644b1

Browse files
authored
[vllm] update comment about communication group host ip (#4337)
1 parent fda88c6 commit fa644b1

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

trl/extras/vllm_client.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -297,7 +297,8 @@ def init_communicator(self, device: Union[torch.device, str, int] = 0):
297297
else:
298298
client_device_uuid = str(torch.cuda.get_device_properties(device).uuid)
299299

300-
# In the server side, the host is set to 0.0.0.0
300+
# Set the weight update group's host to "0.0.0.0" so that
301+
# clients from different IPs can send updated weights
301302
response = self.session.post(
302303
url,
303304
json={

0 commit comments

Comments
 (0)