Skip to content

llama.cpp: Do server launch parameters or WebUI settings control sampling during inference? #12996

Answered by ggerganov
sidran asked this question in Q&A
Discussion options

You must be logged in to vote

The WebUI overrides the default values that you provide to llama-server.

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@sidran
Comment options

Answer selected by sidran
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants