You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: site-src/performance/benchmark/index.md
+1-1
Original file line number
Diff line number
Diff line change
@@ -93,6 +93,6 @@ This guide shows how to run the jupyter notebook using vscode.
93
93
```
94
94
95
95
1. Open the notebook `./tools/benchmark/benchmark.ipynb`, and run each cell. At the end you should
96
-
see a bar chart like below:
96
+
see a bar chart like below where **"ie"** represents inference extension. This chart is generated using this benchmarking tool with 10 vLLM (v1) model servers (H100 80 GB) and the ShareGPT dataset.
0 commit comments