Skip to content

Commit 23b5e12

Browse files
authored
simple : update error message for KV cache check (ggml-org#4324)
This commit updates the error message that is printed when the KV cache is not big enough to hold all the prompt and generated tokens. Specifically it removes the reference to n_parallel and replaces it with n_len. Signed-off-by: Daniel Bevenius <[email protected]>
1 parent d208995 commit 23b5e12

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/simple/simple.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,7 @@ int main(int argc, char ** argv) {
7575
// make sure the KV cache is big enough to hold all the prompt and generated tokens
7676
if (n_kv_req > n_ctx) {
7777
LOG_TEE("%s: error: n_kv_req > n_ctx, the required KV cache size is not big enough\n", __func__);
78-
LOG_TEE("%s: either reduce n_parallel or increase n_ctx\n", __func__);
78+
LOG_TEE("%s: either reduce n_len or increase n_ctx\n", __func__);
7979
return 1;
8080
}
8181

0 commit comments

Comments
 (0)