Skip to content

Commit 13434bd

Browse files
authored
Update README.md 20250205_aiter (vllm-project#407)
* Update README.md 20250205_aiter * whitespace * adding VLLM_USE_AITER=0 advice
1 parent f65ecc9 commit 13434bd

File tree

1 file changed

+7
-2
lines changed

1 file changed

+7
-2
lines changed

docs/dev-docker/README.md

+7-2
Original file line numberDiff line numberDiff line change
@@ -12,14 +12,18 @@ The pre-built image includes:
1212

1313
- ROCm™ 6.3.1
1414
- vLLM 0.6.6
15-
- PyTorch 2.6dev (nightly)
15+
- PyTorch 2.7dev (nightly)
1616

1717
## Pull latest Docker Image
1818

1919
Pull the most recent validated docker image with `docker pull rocm/vllm-dev:main`
2020

2121
## What is New
2222

23+
20250205_aiter:
24+
- [AITER](https://github.com/ROCm/aiter) support
25+
- Performance improvement for custom paged attention
26+
- Reduced memory overhead bug fix
2327
20250124:
2428
- Fix accuracy issue with 405B FP8 Triton FA
2529
- Fixed accuracy issue with TP8
@@ -475,8 +479,9 @@ To reproduce the release docker:
475479
```bash
476480
git clone https://github.com/ROCm/vllm.git
477481
cd vllm
478-
git checkout 8e87b08c2a284c1a20eb3d8e0fbdc84918bf27dc
482+
git checkout 9dc3394c9ee4da250be28d7bd08babf098d51081
479483
docker build -f Dockerfile.rocm -t <your_tag> --build-arg BUILD_HIPBLASLT=1 --build-arg USE_CYTHON=1 .
484+
export VLLM_USE_AITER=0
480485
```
481486

482487
### AITER

0 commit comments

Comments
 (0)