[CI] Run SYCL-CTS with the latest nightly #12811

KornevNikita · 2024-02-23T12:20:49Z

Add a new workflow to run SYCL-CTS when new nightly build is available. This should help us to handle new failures in advance, monitor new suites and so on.

To start with running only reduced scope of tests (cts_exclude_filter is big enough) on unused "debug" runner (linux+cpu).

Add a new workflow to run SYCL-CTS when new nightly build is available. This should help us to handle new failures in advance, monitor new suites and so on. To start with running only reduced scope of tests (cts_exclude_filter is big enough) on unused "debug" runner (linux+cpu).

.github/workflows/sycl-linux-run-tests.yml

aelovikov-intel · 2024-02-23T16:09:25Z

.github/workflows/sycl-linux-run-tests.yml

@@ -290,6 +291,12 @@ jobs:
      if: inputs.tests_selector == 'cts'
      env:
        ONEAPI_DEVICE_SELECTOR: ${{ inputs.target_devices }}
+      # FIXME: For some reason the "sub_group api" test-case is failing with
+      # SIGSEGV while running test_all, so running each binary separately.
+      # BTW test_all requires a lot of resources to build it, so probably it'll


Should we try per-source kernel splitting maybe?

Will this improve compilation time for test_all?

I can't imagine other reasons for the slowdown...

per-source splitting is a default mode of splitting

aelovikov-intel · 2024-02-23T17:09:30Z

.github/workflows/sycl-cts-linux-cpu-latest-nightly.yml

+      target_devices: opencl:cpu
+      tests_selector: cts
+      install_drivers: false
+      ref: ${{ github.sha }}


nit: isn't it the default?

Looks like no, see https://github.com/intel/llvm/actions/runs/8007137309

.github/workflows/sycl-cts-linux-cpu-latest-nightly.yml

.github/workflows/sycl-linux-run-tests.yml

aelovikov-intel · 2024-02-23T17:12:15Z

.github/workflows/sycl-cts-linux-cpu-latest-nightly.yml

+on:
+  push:
+    tags:
+      - nightly-*


Can we add manual workflow_dispatch as well? Possibly with a selectable runner/target devices.

As discussed offline we can just run sycl-linux-run-tests.yml as it has workflow_dispatch.

…ug-runner

.github/workflows/sycl-linux-run-tests.yml

aelovikov-intel · 2024-02-23T20:14:10Z

.github/workflows/sycl-nightly.yml

@@ -107,6 +107,22 @@ jobs:
      runner: '["Windows","gen12"]'
      sycl_toolchain_archive: ${{ needs.build-win.outputs.artifact_archive_name }}

+  sycl-cts:


I think we can actually merge that into the e2e matrix.

441647a
Not sure what will be matrix.tests_selector for the rest

.github/workflows/sycl-linux-run-tests.yml

Testing failed.

aelovikov-intel · 2024-02-23T20:42:41Z

Being tested in https://github.com/intel/llvm/actions/runs/8024711118.

Recent intel#12811 uses generic `.github/workflows/sycl-linux-run-tests.yml` and the old implementation isn't necessary.

Recent #12811 uses generic `.github/workflows/sycl-linux-run-tests.yml` and the old implementation isn't necessary.

KornevNikita requested a review from a team as a code owner February 23, 2024 12:20

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 12:20 — with GitHub Actions Inactive

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 12:31 — with GitHub Actions Inactive

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 12:43 — with GitHub Actions Failure

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 12:58 — with GitHub Actions Failure

aelovikov-intel reviewed Feb 23, 2024

View reviewed changes

Rename runner, improve output

918399f

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 16:25 — with GitHub Actions Inactive

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 16:35 — with GitHub Actions Inactive

Fix syntax error

d83b5cb

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 16:48 — with GitHub Actions Error

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 16:48 — with GitHub Actions Inactive

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 16:53 — with GitHub Actions Inactive

aelovikov-intel reviewed Feb 23, 2024

View reviewed changes

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 17:15 — with GitHub Actions Error

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 17:27 — with GitHub Actions Failure

Apply suggestions

cd94539

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 17:56 — with GitHub Actions Inactive

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 18:01 — with GitHub Actions Inactive

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 18:12 — with GitHub Actions Failure

KornevNikita added 2 commits February 23, 2024 10:24

add if-condition

7f1cc2f

Merge remote-tracking branch 'intel_llvm/sycl' into enable-cts-on-deb…

f66807d

…ug-runner

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 18:24 — with GitHub Actions Inactive

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 18:34 — with GitHub Actions Inactive

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 18:47 — with GitHub Actions Failure

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 19:08 — with GitHub Actions Failure

aelovikov-intel reviewed Feb 23, 2024

View reviewed changes

.github/workflows/sycl-linux-run-tests.yml Outdated Show resolved Hide resolved

Move workflow to sycl-nihtly.yml

a2a2652

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 19:54 — with GitHub Actions Inactive

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 19:54 — with GitHub Actions Error

Apply suggestion

c97e9dc

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 19:59 — with GitHub Actions Inactive

aelovikov-intel previously approved these changes Feb 23, 2024

View reviewed changes

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 20:12 — with GitHub Actions Error

aelovikov-intel reviewed Feb 23, 2024

View reviewed changes

.github/workflows/sycl-linux-run-tests.yml Outdated Show resolved Hide resolved

move run to matrix

441647a

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 20:27 — with GitHub Actions Inactive

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 20:28 — with GitHub Actions Inactive

KornevNikita temporarily deployed to WindowsCILock February 23, 2024 20:33 — with GitHub Actions Inactive

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 20:57 — with GitHub Actions Failure

KornevNikita had a problem deploying to WindowsCILock February 23, 2024 21:04 — with GitHub Actions Failure

aelovikov-intel approved these changes Feb 23, 2024

View reviewed changes

aelovikov-intel merged commit c90de3c into sycl Feb 23, 2024

aelovikov-intel deleted the enable-cts-on-debug-runner branch February 23, 2024 22:02

aelovikov-intel mentioned this pull request Feb 28, 2024

[CI] Remove outdated devops/actions/khronos_cts_test/action.yml #12857

Merged

aelovikov-intel added a commit that referenced this pull request Mar 14, 2024

[CI] Remove outdated devops/actions/khronos_cts_test/action.yml (#12857)

b664df6

Recent #12811 uses generic `.github/workflows/sycl-linux-run-tests.yml` and the old implementation isn't necessary.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[CI] Run SYCL-CTS with the latest nightly #12811

[CI] Run SYCL-CTS with the latest nightly #12811

Uh oh!

KornevNikita commented Feb 23, 2024

Uh oh!

Uh oh!

Uh oh!

aelovikov-intel Feb 23, 2024

Uh oh!

KornevNikita Feb 23, 2024

Uh oh!

aelovikov-intel Feb 23, 2024

Uh oh!

AlexeySachkov Feb 26, 2024

Uh oh!

aelovikov-intel Feb 23, 2024

Uh oh!

KornevNikita Feb 23, 2024

Uh oh!

Uh oh!

Uh oh!

Uh oh!

aelovikov-intel Feb 23, 2024

Uh oh!

KornevNikita Feb 23, 2024

Uh oh!

Uh oh!

aelovikov-intel Feb 23, 2024

Uh oh!

KornevNikita Feb 23, 2024

Uh oh!

Uh oh!

aelovikov-intel commented Feb 23, 2024

Uh oh!

Uh oh!

[CI] Run SYCL-CTS with the latest nightly #12811

[CI] Run SYCL-CTS with the latest nightly #12811

Uh oh!

Conversation

KornevNikita commented Feb 23, 2024

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

aelovikov-intel commented Feb 23, 2024

Uh oh!

Uh oh!