Skip to content

Commit b943890

Browse files
authored
Fix OPT param names (#1819)
1 parent a1125ad commit b943890

File tree

1 file changed

+3
-0
lines changed
  • vllm/model_executor/models

1 file changed

+3
-0
lines changed

vllm/model_executor/models/opt.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -331,6 +331,9 @@ def load_weights(self,
331331
model_name_or_path, cache_dir, load_format, revision):
332332
if "lm_head.weight" in name:
333333
continue
334+
if name.startswith("decoder."):
335+
name = "model." + name
336+
334337
for (param_name, weight_name, shard_id) in stacked_params_mapping:
335338
if weight_name not in name:
336339
continue

0 commit comments

Comments
 (0)