Skip to content

Commit 4fc48b7

Browse files
committed
readme : restore hint about --ignore-eos flag [no ci]
1 parent aa9158b commit 4fc48b7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/main/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -163,7 +163,7 @@ If the pause is undesirable, a value of -2 will stop generation immediately when
163163

164164
The `--no-context-shift` option allows you to stop the infinite text generation once the finite context window is full.
165165

166-
It is important to note that the generated text may be shorter than the specified number of tokens if an End-of-Sequence (EOS) token or a reverse prompt is encountered. In interactive mode, text generation will pause and control will be returned to the user. In non-interactive mode, the program will end. In both cases, the text generation may stop before reaching the specified `--predict` value.
166+
It is important to note that the generated text may be shorter than the specified number of tokens if an End-of-Sequence (EOS) token or a reverse prompt is encountered. In interactive mode, text generation will pause and control will be returned to the user. In non-interactive mode, the program will end. In both cases, the text generation may stop before reaching the specified `--predict` value. If you want the model to keep going without ever producing End-of-Sequence on its own, you can use the `--ignore-eos` parameter.
167167

168168
### Temperature
169169

0 commit comments

Comments
 (0)