Skip to content

Support system prompt in /infill endpoint? #12430

Answered by ggerganov
Palm1r asked this question in Q&A
Discussion options

You must be logged in to vote

The infill endpoint should be used with models that support repo-level FIM template such as the Qwen2.5 Coder models. This template does not support system prompt, so it's not possible to use one.

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@Palm1r
Comment options

Answer selected by CISC
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants