Skip to content

Commit 76b290f

Browse files
committed
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to requirements/cpu.txt
Signed-off-by: Kay Yan <[email protected]>
1 parent db5a29b commit 76b290f

File tree

3 files changed

+5
-4
lines changed

3 files changed

+5
-4
lines changed

docker/Dockerfile.cpu

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -51,9 +51,6 @@ RUN --mount=type=cache,target=/root/.cache/uv \
5151
uv pip install --upgrade pip && \
5252
uv pip install -r requirements/cpu.txt
5353

54-
RUN --mount=type=cache,target=/root/.cache/uv \
55-
uv pip install intel-openmp==2024.2.1 intel_extension_for_pytorch==2.6.0
56-
5754
ENV LD_PRELOAD="/usr/lib/x86_64-linux-gnu/libtcmalloc_minimal.so.4:/opt/venv/lib/libiomp5.so:$LD_PRELOAD"
5855

5956
RUN echo 'ulimit -c 0' >> ~/.bashrc

requirements/cpu.txt

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,3 +20,7 @@ datasets # for benchmark scripts
2020

2121
# cpu cannot use triton 3.3.0
2222
triton==3.2.0; platform_machine == "x86_64"
23+
24+
# Intel Extension for PyTorch, only for x86_64 CPUs
25+
intel-openmp; platform_machine == "x86_64"
26+
intel_extension_for_pytorch==2.7.0; platform_machine == "x86_64"

vllm/model_executor/layers/quantization/ipex_quant.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@
1414
from vllm.model_executor.layers.quantization.gptq import GPTQLinearMethod
1515
from vllm.platforms import current_platform
1616

17-
MIN_IPEX_VERSION = "2.5.0"
17+
MIN_IPEX_VERSION = "2.7.0"
1818

1919

2020
class IPEXConfig(QuantizationConfig):

0 commit comments

Comments
 (0)