Skip to content

Commit bf28ea5

Browse files
committed
server : update readme [no ci]
1 parent 5a699f1 commit bf28ea5

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

examples/server/README.md

+6
Original file line numberDiff line numberDiff line change
@@ -524,6 +524,12 @@ Takes a prefix and a suffix and returns the predicted completion as stream.
524524

525525
- `input_prefix`: Set the prefix of the code to infill.
526526
- `input_suffix`: Set the suffix of the code to infill.
527+
- `prompt`: Added after the `FIM_MID` token
528+
- `extra_context`: Additional context inserted before the FIM prefix. See https://github.com/ggerganov/llama.cpp/pull/9874
529+
530+
```txt
531+
[extra context]<FIM_PRE>[input_prefix]<FIM_SUF>[input_suffix]<FIM_MID>[prompt]
532+
```
527533

528534
It also accepts all the options of `/completion`.
529535

0 commit comments

Comments
 (0)