-
Hello, I am developing a plugin for the QtCreator https://github.com/Palm1r/QodeAssist, I want to supplement my support for llama.cpp, as far as I understand, the format for /infill does not imply support for the field of "system" or "system_prompt" that I could, like in the others endpoints like /chat/completions, add additional contextual information? or I can just add "system" and all will work correct? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
The |
Beta Was this translation helpful? Give feedback.
The
infill
endpoint should be used with models that support repo-level FIM template such as the Qwen2.5 Coder models. This template does not support system prompt, so it's not possible to use one.