Skip to content

Commit a29028a

Browse files
committed
update benchmarking guide with latest results with vllm v1
1 parent afab4b7 commit a29028a

File tree

2 files changed

+1
-1
lines changed

2 files changed

+1
-1
lines changed
Loading

site-src/performance/benchmark/index.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -93,6 +93,6 @@ This guide shows how to run the jupyter notebook using vscode.
9393
```
9494

9595
1. Open the notebook `./tools/benchmark/benchmark.ipynb`, and run each cell. At the end you should
96-
see a bar chart like below:
96+
see a bar chart like below where **"ie"** represents inference extension. This chart is generated using this benchmarking tool with 10 vLLM (v1) model servers (H100 80 GB) and the ShareGPT dataset.
9797

9898
![alt text](example-bar-chart.png)

0 commit comments

Comments
 (0)