Skip to content

Commit abbf0d6

Browse files
committed
Add tensor parallel size = 2 test to HPU CI
Signed-off-by: Lukasz Durejko <[email protected]>
1 parent 0877750 commit abbf0d6

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

.buildkite/scripts/hardware_ci/run-hpu-test.sh

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,4 +21,6 @@ remove_docker_container
2121

2222
# Run the image and launch offline inference
2323
docker run --runtime=habana --name=hpu-test --network=host -e HABANA_VISIBLE_DEVICES=all -e VLLM_SKIP_WARMUP=true --entrypoint="" hpu-test-env python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m
24+
docker run --runtime=habana --name=hpu-test --network=host -e HABANA_VISIBLE_DEVICES=all -e VLLM_SKIP_WARMUP=true --entrypoint="" hpu-test-env python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --tensor-parallel-size 2
25+
2426
EXITCODE=$?

0 commit comments

Comments
 (0)