Skip to content

Commit 429284d

Browse files
authored
Fix dist.broadcast stall without group argument (#3408)
1 parent 253a980 commit 429284d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/parallel_utils/communication_op.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -177,7 +177,7 @@ def broadcast_tensor_dict(
177177
for key, value in metadata_list:
178178
if isinstance(value, TensorMetadata):
179179
tensor = tensor_dict[key]
180-
torch.distributed.broadcast(tensor, src=src)
180+
torch.distributed.broadcast(tensor, src=src, group=group)
181181
else:
182182
recv_metadata_list = [None]
183183
torch.distributed.broadcast_object_list(recv_metadata_list,

0 commit comments

Comments
 (0)