We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 5a699f1 commit bf28ea5Copy full SHA for bf28ea5
examples/server/README.md
@@ -524,6 +524,12 @@ Takes a prefix and a suffix and returns the predicted completion as stream.
524
525
- `input_prefix`: Set the prefix of the code to infill.
526
- `input_suffix`: Set the suffix of the code to infill.
527
+- `prompt`: Added after the `FIM_MID` token
528
+- `extra_context`: Additional context inserted before the FIM prefix. See https://github.com/ggerganov/llama.cpp/pull/9874
529
+
530
+```txt
531
+[extra context]<FIM_PRE>[input_prefix]<FIM_SUF>[input_suffix]<FIM_MID>[prompt]
532
+```
533
534
It also accepts all the options of `/completion`.
535
0 commit comments