We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 0293f0d commit 953f0a0Copy full SHA for 953f0a0
vllm/entrypoints/llm.py
@@ -519,11 +519,9 @@ def beam_search(
519
prompts: A list of prompts. Each prompt can be a string or a list
520
of token IDs.
521
params: The beam search parameters.
522
-
523
- TODO: how does beam search work together with length penalty, frequency
524
- penalty, and stopping criteria, etc.?
525
"""
526
+ # TODO: how does beam search work together with length penalty,
+ # frequency, penalty, and stopping criteria, etc.?
527
beam_width = params.beam_width
528
max_tokens = params.max_tokens
529
temperature = params.temperature
0 commit comments