We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent d82dc43 commit b75f460Copy full SHA for b75f460
examples/online_serving/prometheus_grafana/README.md
@@ -24,7 +24,7 @@ Submit some sample requests to the server:
24
```bash
25
wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json
26
27
-python3 ../../benchmarks/benchmark_serving.py \
+python3 ../../../benchmarks/benchmark_serving.py \
28
--model mistralai/Mistral-7B-v0.1 \
29
--tokenizer mistralai/Mistral-7B-v0.1 \
30
--endpoint /v1/completions \
0 commit comments