Skip to content

Commit 91409ff

Browse files
authored
Add mtl AOT packages in faq.md (#11577)
* Update faq.md * Update faq.md * Update faq.md * Update faq.md * Update faq.md
1 parent 50cf563 commit 91409ff

File tree

1 file changed

+10
-1
lines changed
  • docs/mddocs/Overview/FAQ

1 file changed

+10
-1
lines changed

docs/mddocs/Overview/FAQ/faq.md

+10-1
Original file line numberDiff line numberDiff line change
@@ -88,4 +88,13 @@ You may encounter this error during finetuning, expecially when run 70B model. P
8888

8989
### `RuntimeError: could not create a primitive` on Windows
9090

91-
This error may happen when multiple GPUs exists for Windows Users. To solve this error, you can open Device Manager (search "Device Manager" in your start menu). Then click the "Display adapter" option, and disable all the GPU device you do not want to use. Restart your computer and try again. IPEX-LLM should work fine this time.
91+
This error may happen when multiple GPUs exists for Windows Users. To solve this error, you can open Device Manager (search "Device Manager" in your start menu). Then click the "Display adapter" option, and disable all the GPU device you do not want to use. Restart your computer and try again. IPEX-LLM should work fine this time.
92+
93+
### The first time to run model on Meteor Lake's iGPU(Intel Core™ Ultra integrated GPU) will takes 5-10 minutes.
94+
This is caused by intel-extension-for-pytorch's compilation. For windows user, you can install this [intel-extension-for-pytorch](https://github.com/Nuullll/intel-extension-for-pytorch/releases) with Meteor Lake's [ahead-of-time-compilation](https://www.intel.com/content/www/us/en/docs/dpcpp-cpp-compiler/developer-guide-reference/2023-0/ahead-of-time-compilation.html).
95+
Please notice the packages only support python 3.10, you can use below commands after you have installed ipex-llm[xpu]:
96+
```bash
97+
pip install https://github.com/Nuullll/intel-extension-for-pytorch/releases/download/v2.1.20%2Bmtl%2Boneapi/intel_extension_for_pytorch-2.1.20+git4849f3b-cp310-cp310-win_amd64.whl
98+
pip install https://github.com/Nuullll/intel-extension-for-pytorch/releases/download/v2.1.20%2Bmtl%2Boneapi/torch-2.1.0a0+git7bcf7da-cp310-cp310-win_amd64.whl
99+
pip install https://github.com/Nuullll/intel-extension-for-pytorch/releases/download/v2.1.20%2Bmtl%2Boneapi/torchvision-0.16.0+fbb4cc5-cp310-cp310-win_amd64.whl
100+
```

0 commit comments

Comments
 (0)