Skip to content

Commit d38e41e

Browse files
committed
convert : fix n_ff typo
1 parent dff8cbe commit d38e41e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

Diff for: convert.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -275,7 +275,7 @@ def loadOriginalParamsJson(model: LazyModel, config_path: Path) -> Params:
275275
n_ff = model["layers.0.feed_forward.experts.0.w1.weight"].shape[0]
276276
n_ctx = 32768
277277
else:
278-
n_ff = model["layers.0.feed_forward.w1.weight"].shape[0],
278+
n_ff = model["layers.0.feed_forward.w1.weight"].shape[0]
279279

280280
return Params(
281281
n_vocab = model["tok_embeddings.weight"].shape[0],

0 commit comments

Comments
 (0)