Skip to content

Commit b4ac449

Browse files
authored
[Misc] Merge the logs of pp layers partitions (#16225)
Signed-off-by: Kebe <[email protected]>
1 parent 8e5314a commit b4ac449

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

vllm/distributed/utils.py

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -102,10 +102,11 @@ def get_pp_indices(num_hidden_layers: int, pp_rank: int,
102102
if remaining_layers := num_hidden_layers % pp_size:
103103
for i in range(2, remaining_layers + 2):
104104
partitions[-i] += 1
105-
logger.info("Hidden layers were unevenly partitioned: %s",
106-
",".join(str(p) for p in partitions))
107-
logger.info("This can be manually overridden using the "
108-
"VLLM_PP_LAYER_PARTITION environment variable")
105+
logger.info(
106+
"Hidden layers were unevenly partitioned: [%s]. "
107+
"This can be manually overridden using the "
108+
"VLLM_PP_LAYER_PARTITION environment variable",
109+
",".join(str(p) for p in partitions))
109110

110111
start_layer = sum(partitions[:pp_rank])
111112
end_layer = start_layer + partitions[pp_rank]

0 commit comments

Comments
 (0)