Skip to content

Build error: '__nvvm_bar_warp_sync' needs target feature ptx60|ptx61|ptx63|ptx64|ptx65|ptx70|ptx71|ptx72|ptx73|ptx74|ptx75 #55446

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ms178 opened this issue May 13, 2022 · 16 comments
Labels

Comments

@ms178
Copy link

ms178 commented May 13, 2022

As of today I see the following build regression:

Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o
FAILED: projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o 
/usr/bin/clang++ -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -I/home/marcus/Downloads/llvm-git/src/_build/projects/openmp/libomptarget/DeviceRTL -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL -I/home/marcus/Downloads/llvm-git/src/_build/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/llvm/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/../include -O3 -march=native -mllvm -polly -mllvm -polly-parallel -fopenmp -mllvm -polly-vectorizer=stripmine -mllvm -polly-omp-backend=LLVM -mllvm -polly-num-threads=36 -mllvm -polly-scheduling=dynamic -mllvm -polly-scheduling-chunksize=1 -mllvm -polly-ast-use-context -mllvm -polly-invariant-load-hoisting -mllvm -polly-loopfusion-greedy -mllvm -polly-run-inliner -mllvm -polly-run-dce -fno-math-errno -fno-trapping-math -falign-functions=32 -fno-semantic-interposition -fcf-protection=none -flto=thin -g0 -Wp,-D_FORTIFY_SOURCE=0 -fPIC -fno-semantic-interposition -fvisibility-inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -pedantic -Wno-long-long -Wc++98-compat-extra-semi -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wsuggest-override -Wno-comment -Wstring-conversion -Wmisleading-indentation -fdiagnostics-color -ffunction-sections -fdata-sections -Wall -Wcast-qual -Wformat-pedantic -Wimplicit-fallthrough -Wsign-compare -Wno-extra -Wno-pedantic -std=c++14 -O3 -DNDEBUG -fopenmp -fopenmp-cuda-mode -foffload-lto -fvisibility=hidden -mllvm -openmp-opt-disable -nogpulib -nostdinc -DSHARED_SCRATCHPAD_SIZE=512 --offload-arch=sm_35 --offload-arch=sm_37 --offload-arch=sm_50 --offload-arch=sm_52 --offload-arch=sm_53 --offload-arch=sm_60 --offload-arch=sm_61 --offload-arch=sm_62 --offload-arch=sm_70 --offload-arch=sm_72 --offload-arch=sm_75 --offload-arch=sm_80 --offload-arch=sm_86 --offload-arch=gfx700 --offload-arch=gfx701 --offload-arch=gfx801 --offload-arch=gfx803 --offload-arch=gfx900 --offload-arch=gfx902 --offload-arch=gfx906 --offload-arch=gfx908 --offload-arch=gfx90a --offload-arch=gfx90c --offload-arch=gfx940 --offload-arch=gfx1010 --offload-arch=gfx1030 --offload-arch=gfx1031 --offload-arch=gfx1032 --offload-arch=gfx1033 --offload-arch=gfx1034 --offload-arch=gfx1035 --offload-arch=gfx1036 -std=c++17 -MD -MT projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o -MF projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o.d -o projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o -c /home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Synchronization.cpp

This is followed by a lot of errors like:

llvm-project/openmp/libomptarget/DeviceRTL/src/Synchronization.cpp:254:46: error: '__nvvm_bar_warp_sync' needs target feature ptx60|ptx61|ptx63|ptx64|ptx65|ptx70|ptx71|ptx72|ptx73|ptx74|ptx75

My LLVM-config is attached and I had no problems with that config until today:

PKGBUILD.txt

@ms178
Copy link
Author

ms178 commented May 13, 2022

@jhuber6 I think one of your changes of today might be the culprit. I also saw newer committs right now on the main branch and while I don't see the reported build issue any longer, I see these warnings:

[1246/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Configuration.cpp.o
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
[1252/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Debug.cpp.o
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
[1267/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Kernel.cpp.o
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
[1320/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Mapping.cpp.o
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]

@ms178
Copy link
Author

ms178 commented May 13, 2022

Plus the following warning which might be related to your changes:

1 warning generated.
/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Mapping.cpp:279:59: warning: extra ';' outside of a function is incompatible with C++98 [-Wc++98-compat-extra-semi]
int __attribute__((used, retain, weak)) SHARED(IsSPMDMode);

@jhuber6
Copy link
Contributor

jhuber6 commented May 13, 2022

@jhuber6 I think one of your changes of today might be the culprit. I also saw newer committs right now on the main branch and while I don't see the reported build issue any longer, I see these warnings:

[1246/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Configuration.cpp.o
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
[1252/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Debug.cpp.o
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
[1267/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Kernel.cpp.o
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
[1320/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Mapping.cpp.o
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]

Yes that was me, I forgot that we default to an extremely old PTX version if it wasn't detected on the user's system, so I had to add a way to manually set it. I'm not sure why you're getting those errors however, I don't see them on my build.

Plus the following warning which might be related to your changes:

1 warning generated.
/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Mapping.cpp:279:59: warning: extra ';' outside of a function is incompatible with C++98 [-Wc++98-compat-extra-semi]
int __attribute__((used, retain, weak)) SHARED(IsSPMDMode);

This is an existing warning that was exposed by my patch, previously we just built this stuff invoking the clang front-end manually, which didn't use any of the standard warning flags in CMake. I should be able to fix it.

@ms178
Copy link
Author

ms178 commented May 13, 2022

Sorry, I still see a build failure later on, but another one:

FAILED: projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o 
/usr/bin/clang++ -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -I/home/marcus/Downloads/llvm-git/src/_build/projects/openmp/libomptarget/DeviceRTL -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL -I/home/marcus/Downloads/llvm-git/src/_build/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/llvm/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/../include -O3 -march=native -fno-math-errno -fno-trapping-math -falign-functions=32 -fno-semantic-interposition -fcf-protection=none -flto=thin -g0 -Wp,-D_FORTIFY_SOURCE=0 -fPIC -fno-semantic-interposition -fvisibility-inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -pedantic -Wno-long-long -Wc++98-compat-extra-semi -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wsuggest-override -Wno-comment -Wstring-conversion -Wmisleading-indentation -fdiagnostics-color -ffunction-sections -fdata-sections -Wall -Wcast-qual -Wformat-pedantic -Wimplicit-fallthrough -Wsign-compare -Wno-extra -Wno-pedantic -std=c++14 -O3 -DNDEBUG -fopenmp -fopenmp-cuda-mode -foffload-lto -fvisibility=hidden -Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61 -mllvm -openmp-opt-disable -nocudalib -nogpulib -nostdinc -DSHARED_SCRATCHPAD_SIZE=512 --offload-arch=sm_35 --offload-arch=sm_37 --offload-arch=sm_50 --offload-arch=sm_52 --offload-arch=sm_53 --offload-arch=sm_60 --offload-arch=sm_61 --offload-arch=sm_62 --offload-arch=sm_70 --offload-arch=sm_72 --offload-arch=sm_75 --offload-arch=sm_80 --offload-arch=sm_86 --offload-arch=gfx700 --offload-arch=gfx701 --offload-arch=gfx801 --offload-arch=gfx803 --offload-arch=gfx900 --offload-arch=gfx902 --offload-arch=gfx906 --offload-arch=gfx908 --offload-arch=gfx90a --offload-arch=gfx90c --offload-arch=gfx940 --offload-arch=gfx1010 --offload-arch=gfx1030 --offload-arch=gfx1031 --offload-arch=gfx1032 --offload-arch=gfx1033 --offload-arch=gfx1034 --offload-arch=gfx1035 --offload-arch=gfx1036 -std=c++17 -MD -MT projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o -MF projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o.d -o projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o -c /home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Synchronization.cpp
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Synchronization.cpp:106:37: warning: extra ';' outside of a function is incompatible with C++98 [-Wc++98-compat-extra-semi]
uint32_t SHARED(namedBarrierTracker);

@ms178
Copy link
Author

ms178 commented May 13, 2022

By the way, I don't build the PTX target all (and would like to avoid doing so to save compilation time):

-D LLVM_TARGETS_TO_BUILD="AMDGPU;X86" \

@jhuber6
Copy link
Contributor

jhuber6 commented May 13, 2022

Sorry, I still see a build failure later on, but another one:

FAILED: projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o 
/usr/bin/clang++ -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -I/home/marcus/Downloads/llvm-git/src/_build/projects/openmp/libomptarget/DeviceRTL -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL -I/home/marcus/Downloads/llvm-git/src/_build/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/llvm/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/include -I/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/../include -O3 -march=native -fno-math-errno -fno-trapping-math -falign-functions=32 -fno-semantic-interposition -fcf-protection=none -flto=thin -g0 -Wp,-D_FORTIFY_SOURCE=0 -fPIC -fno-semantic-interposition -fvisibility-inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -pedantic -Wno-long-long -Wc++98-compat-extra-semi -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wsuggest-override -Wno-comment -Wstring-conversion -Wmisleading-indentation -fdiagnostics-color -ffunction-sections -fdata-sections -Wall -Wcast-qual -Wformat-pedantic -Wimplicit-fallthrough -Wsign-compare -Wno-extra -Wno-pedantic -std=c++14 -O3 -DNDEBUG -fopenmp -fopenmp-cuda-mode -foffload-lto -fvisibility=hidden -Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61 -mllvm -openmp-opt-disable -nocudalib -nogpulib -nostdinc -DSHARED_SCRATCHPAD_SIZE=512 --offload-arch=sm_35 --offload-arch=sm_37 --offload-arch=sm_50 --offload-arch=sm_52 --offload-arch=sm_53 --offload-arch=sm_60 --offload-arch=sm_61 --offload-arch=sm_62 --offload-arch=sm_70 --offload-arch=sm_72 --offload-arch=sm_75 --offload-arch=sm_80 --offload-arch=sm_86 --offload-arch=gfx700 --offload-arch=gfx701 --offload-arch=gfx801 --offload-arch=gfx803 --offload-arch=gfx900 --offload-arch=gfx902 --offload-arch=gfx906 --offload-arch=gfx908 --offload-arch=gfx90a --offload-arch=gfx90c --offload-arch=gfx940 --offload-arch=gfx1010 --offload-arch=gfx1030 --offload-arch=gfx1031 --offload-arch=gfx1032 --offload-arch=gfx1033 --offload-arch=gfx1034 --offload-arch=gfx1035 --offload-arch=gfx1036 -std=c++17 -MD -MT projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o -MF projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o.d -o projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o -c /home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Synchronization.cpp
clang-15: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Synchronization.cpp:106:37: warning: extra ';' outside of a function is incompatible with C++98 [-Wc++98-compat-extra-semi]
uint32_t SHARED(namedBarrierTracker);

We only support compiling this library with the same version of Clang that will be using it. I'm guessing that command line argument is just being ignore because I just added it. Can you verify that you're using the newest possible clang to compile the library?

By the way, I don't build the PTX target all (and would like to avoid doing so to save compilation time):

-D LLVM_TARGETS_TO_BUILD="AMDGPU;X86" \

This doesn't use any backends, it's a bitcode library. I think this used to be configured by something else. Are the compile times costing you a lot? They're relatively quick for me.

@llvmbot
Copy link
Member

llvmbot commented May 13, 2022

@llvm/issue-subscribers-openmp

@ms178
Copy link
Author

ms178 commented May 13, 2022

I'd prefer not to build any additional code which my system doesn't use due to lack of that hardware.

Compiling LLVM/Clang main ToT with the system's default LLVM/Clang-13.0.1 seems to compile fine but spams the log with:

[1219/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Debug.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1223/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Configuration.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1225/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Kernel.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1226/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Misc.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1228/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Mapping.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Mapping.cpp:279:59: warning: extra ';' outside of a function is incompatible with C++98 [-Wc++98-compat-extra-semi]
int __attribute__((used, retain, weak)) SHARED(IsSPMDMode);
                                                          ^
1 warning generated.
[1229/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Parallelism.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1261/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Reduction.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1264/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Synchronization.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1265/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/State.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/State.cpp:115:63: warning: extra ';' outside of a function is incompatible with C++98 [-Wc++98-compat-extra-semi]
static SharedMemorySmartStackTy SHARED(SharedMemorySmartStack);
                                                              ^
/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/State.cpp:236:30: warning: extra ';' outside of a function is incompatible with C++98 [-Wc++98-compat-extra-semi]
TeamStateTy SHARED(TeamState);
                             ^
2 warnings generated.
[1266/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Utils.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1267/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Tasking.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
[1277/5105] Building CXX object projects/openmp/libomptarget/DeviceRTL/CMakeFiles/omptarget.devicertl.dir/src/Workshare.cpp.o
clang-13: warning: argument unused during compilation: '-Xopenmp-target=nvptx64-nvidia-cuda --cuda-feature=+ptx61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_35' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_37' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_50' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_52' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_53' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_60' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_61' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_62' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_70' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_72' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_75' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_80' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=sm_86' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx700' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx701' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx801' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx803' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx900' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx902' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx906' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx908' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90a' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx90c' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx940' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1010' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1030' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1031' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1032' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1033' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1034' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1035' [-Wunused-command-line-argument]
clang-13: warning: argument unused during compilation: '--offload-arch=gfx1036' [-Wunused-command-line-argument]
/home/marcus/Downloads/llvm-git/src/llvm-project/openmp/libomptarget/DeviceRTL/src/Workshare.cpp:49:28: warning: extra ';' outside of a function is incompatible with C++98 [-Wc++98-compat-extra-semi]
static uint64_t SHARED(Cnt);
                           ^
1 warning generated.

@jhuber6
Copy link
Contributor

jhuber6 commented May 13, 2022

I'd prefer not to build any additional code which my system doesn't use due to lack of that hardware.

Compiling LLVM/Clang main ToT with the system's default LLVM/Clang-13.0.1 seems to compile fine but spams the log with:

It only looks like it's working, --offload-arch was a supported option for CUDA previously but was only recently added for OpenMP offloading. So this is just compiling for the host portion of the device runtime, which is completely empty. OpenMP is a runtime so it's only expected to be compiled with a new Clang, I don't think we officially support any other configuration. The generally suggested way is to remove openmp from the projects and instead do '-DLLVM_ENABLE_RUNTIMES=openmp'. If you really want to disable this you can probably set LIBOMPTARGET_NVPTX_COMPUTE_CAPABILITIES to empty. Or just disable libomptarget altogether.

@ms178
Copy link
Author

ms178 commented May 13, 2022

Hm, as I need OpenMP but not PTX/CUDA, I used to configure my build like this to get OpenMP:
-D LLVM_ENABLE_PROJECTS="polly;openmp;lld;compiler-rt;clang" \

This is also used by some distribution packages, hence your configuration advice is new to me. Is your way the only supported way forward? Thanks for your help.

@jhuber6
Copy link
Contributor

jhuber6 commented May 13, 2022

You'll probably be fine if you only need libomp. libomptarget development on the other hand moves pretty quickly. The requirement is that the the runtime should be compiled with the same clang that will be used with it. You can either do this manually with a two-step build, basically build clang once without OpenMP, then again with the newly created clang. The -DLLVM_ENABLE_RUNTIMES option is generally easier because it does this for you. Here's some information, https://openmp.llvm.org//SupportAndFAQ.html#q-how-to-build-an-openmp-gpu-offload-capable-compiler.

So I would just suggest doing what you have now but like -D LLVM_ENABLE_PROJECTS="polly;lld;compiler-rt;clang" -D LLVM_ENABLE_RUNTIMES="openmp"\. This requirement has always been around as far as I remember. The one downside to the RUNTIMES method is you won't get some tooling output, like with CMAKE_EXPORT_COMPILE_COMMANDS. Let me know if you have any problems.

ms178 added a commit to ms178/archpkgbuilds that referenced this issue May 13, 2022
As adviced in llvm/llvm-project#55446 (comment) due to new found errors, OpenMP is no longer built via "-D LLVM_ENABLE_PROJECTS=openmp" but with "-DLLVM_ENABLE_RUNTIMES=openmp".
@ms178
Copy link
Author

ms178 commented May 13, 2022

As I am a layman, I just want to clarify this a bit more. The link you provided is talking about a GPU offload-capable compiler, as I am just a casual user who doesn't need such a GPU-offload capable compiler, I wonder if my old build method is still viable going forward. The goal of my LLVM/Clang build is to get a minimalistic compiler setup for compiling some Arch Linux packages with custom CFLAGS, hence I hope that OpenMP doesn't gain a hidden dependency on that GPU-offload functionality (with the consequence to invest that additional compilation time and specific build method). Or is this now the case? Or was it before, and my method was wrong to begin with? As I just followed what distribution packages did here, I lack the insights to what is prefered or why one method is better than the other.

@jhuber6
Copy link
Contributor

jhuber6 commented May 13, 2022

I would say the OpenMP project is a runtime so it should ideally be built using the LLVM_ENABLE_RUNTIMES route. That being said, the standard libomp has been pretty stable so should probably work with older compilers and can be built as a standard project. libomptarget is used to handle OpenMP target offloading, if you don't want this you can use -DENABLE_LIBOMPTARGET=OFF to completely disable building it. You should be able to build libomptarget even without GPU libraries like ROCm or CUDA, but it does require an up-to-date Clang most of the time.

I've been overhauling the entire build system for offloading recently and it has the effect of breaking some stuff. Does this answer your question? Let me know if you can build successfully using the runtimes approach, it should work. If you can get to build I'll close the issue.

@ms178
Copy link
Author

ms178 commented May 13, 2022

Building succeeded with the suggested LLVM_ENABLE_RUNTIMES route, thanks. I will test my old way with the ToT build to be sure that this issue can be put to rest and will report back soon.

After each Linux installation I usually built a new LLVM/Clang package with the system default's LLVM/Clang for the first time, I hope that remains somewhat supported with the LLVM_ENABLE_RUNTIMES route if I don't need the GPU-offload capability? As I need the OpenMP capability for using Polly (just on the host CPU target), I suppose the LIBOMPTARGET still needs to be enabled?

@jhuber6
Copy link
Contributor

jhuber6 commented May 13, 2022

After each Linux installation I usually built a new LLVM/Clang package with the system default's LLVM/Clang for the first time, I hope that remains somewhat supported with the LLVM_ENABLE_RUNTIMES route if I don't need the GPU-offload capability? As I need the OpenMP capability for using Polly (just on the host CPU target), I suppose the LIBOMPTARGET still needs to be enabled?

It should be, as long as the system compiler is new enough to build LLVM itself. The runtime build will first build clang and all the targets. Then it will use the newly build clang to build the OpenMP runtime. If you're just using the host capabilities, you shouldn't need libomptarget, but I'd say it's a good idea to build it anyway unless you have a compelling reason not to.

@ms178
Copy link
Author

ms178 commented May 13, 2022

Thanks for your answers, I've added -DENABLE_LIBOMPTARGET=OFF to my personal configuration as I don't need the GPU offload capability and building with an older Clang is important on each new distribution install. As promised I was just testing the old method and it worked until I hit a system crash during the build process, but that should be unrelated to LLVM/Clang itself, hence I will close this issue for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants