Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[release/8.0-preview1] clang-9 causing build failures in linux arm64 #81555

Closed
carlossanlop opened this issue Feb 2, 2023 · 7 comments
Closed

Comments

@carlossanlop
Copy link
Member

carlossanlop commented Feb 2, 2023

Affecting the release/8.0-preview1 internal rolling build. Example: https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=results

cc @mmitche @hoyosjs @jkoritzinsky @agocke

Affected queues:
- CoreCLR Product Build linux arm64 release - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=f885dbec-8192-5917-c4f3-ae9a02ec6156&t=38bad756-fc6a-5edc-429b-a47524e1b030
- linux-arm64 release AllSubsets_Mono - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=310dc301-e421-594f-7aee-252ab13d3239&t=008ea0ed-a691-5bf9-cc79-c6abd57b1aab
- linux-arm64 release AllSubsets_Mono_LLVMJIT LLVMJIT - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=534f645c-cc65-50fc-aadd-4d0c6b9dd8f8&t=8d7e94c8-13dc-5af8-c54a-893e62f7e49d
- linux-arm64 release AllSubsets_Mono_LLVMAOT LLVMAOT - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=32edc0c6-a0eb-5eaf-91ea-42a8a9c9d6ad&t=882c7357-d1f3-52e7-710c-1c032d7a9315
- Libraries Build linux arm64 Release - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=a7185a84-0100-5e66-b360-01f256e68ff9&t=9042869a-47ff-55ee-f646-bdc9d047cbd3
- CoreCLR Product Build linux arm64 release PGO - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=c2e749ed-3e2c-51d8-078b-193121b9b774&t=202ba399-972e-576e-a62d-2f502b3545dc
- linux-arm64 release CrossAOT_Mono crossaot - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=143489d5-74d4-512f-2ac7-0f45bc6f28f4&t=8447cb88-0a79-55cb-e8f2-5f8cf1455fd8

CMake Error at /usr/share/cmake-3.25/Modules/CMakeTestCCompiler.cmake:70 (message):
  The C compiler

    "/usr/bin/clang-9"

  is not able to compile a simple test program.

  It fails with the following output:

    Change Dir: /__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeScratch/TryCompile-oItv5b
    
    Run Build Command(s):/usr/bin/make -f Makefile cmTC_1410a/fast && /usr/bin/make  -f CMakeFiles/cmTC_1410a.dir/build.make CMakeFiles/cmTC_1410a.dir/build
    make[1]: Entering directory '/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeScratch/TryCompile-oItv5b'
    Building C object CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o
    /usr/bin/clang-9 --target=aarch64-linux-gnu --gcc-toolchain=/crossrootfs/usr --sysroot=/crossrootfs    -MD -MT CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o -MF CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o.d -o CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o -c /__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeScratch/TryCompile-oItv5b/testCCompiler.c
    Linking C executable cmTC_1410a
    /usr/bin/cmake -E cmake_link_script CMakeFiles/cmTC_1410a.dir/link.txt --verbose=1
    /usr/bin/clang-9 --target=aarch64-linux-gnu --gcc-toolchain=/crossrootfs/usr --sysroot=/crossrootfs -Wl,--rpath-link=/crossrootfs/lib/aarch64-linux-gnu -Wl,--rpath-link=/crossrootfs/usr/lib/aarch64-linux-gnu -Wl,--rpath-link=/crossrootfs/lib/aarch64-linux-gnu -Wl,--rpath-link=/crossrootfs/usr/lib/aarch64-linux-gnu -fuse-ld=lld  CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o -o cmTC_1410a 
    ld.lld: error: cannot open crt1.o: No such file or directory
    ld.lld: error: cannot open crti.o: No such file or directory
    ld.lld: error: cannot open crtbegin.o: No such file or directory
    ld.lld: error: unable to find library -lgcc
    ld.lld: error: unable to find library -lgcc_s
    ld.lld: error: unable to find library -lc
    ld.lld: error: unable to find library -lgcc
    ld.lld: error: unable to find library -lgcc_s
    ld.lld: error: cannot open crtend.o: No such file or directory
    ld.lld: error: cannot open crtn.o: No such file or directory
    clang: error: linker command failed with exit code 1 (use -v to see invocation)
    make[1]: *** [CMakeFiles/cmTC_1410a.dir/build.make:100: cmTC_1410a] Error 1
    make[1]: Leaving directory '/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeScratch/TryCompile-oItv5b'
    make: *** [Makefile:127: cmTC_1410a/fast] Error 2

  CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
  CMakeLists.txt:16 (project)

-- Configuring incomplete, errors occurred!
See also "/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeOutput.log".
See also "/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeError.log".
/__w/1/s
/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release /__w/1/s
Executing make   runtime alljits paltests_install nativeaot spmi  -j 4
make: *** No rule to make target 'runtime'.  Stop.

I assume these two other failures caused by the above lack of artifacts generated:

Downloading artifacts for build: 2102620
##[error]Artifact CoreCLRProduct___linux_arm64_release not found for build 2102620. Please ensure you have published artifacts in any previous phases of the current build.
@ghost
Copy link

ghost commented Feb 2, 2023

Tagging subscribers to this area: @hoyosjs
See info in area-owners.md if you want to be subscribed.

Issue Details

Affecting the release/8.0-preview1 internal rolling build. Example: https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=results

cc@mmitche @hoyosjs @jkoritzinsky @agocke

Affected queues:
- CoreCLR Product Build linux arm64 release - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=f885dbec-8192-5917-c4f3-ae9a02ec6156&t=38bad756-fc6a-5edc-429b-a47524e1b030
- linux-arm64 release AllSubsets_Mono - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=310dc301-e421-594f-7aee-252ab13d3239&t=008ea0ed-a691-5bf9-cc79-c6abd57b1aab
- linux-arm64 release AllSubsets_Mono_LLVMJIT LLVMJIT - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=534f645c-cc65-50fc-aadd-4d0c6b9dd8f8&t=8d7e94c8-13dc-5af8-c54a-893e62f7e49d
- linux-arm64 release AllSubsets_Mono_LLVMAOT LLVMAOT - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=32edc0c6-a0eb-5eaf-91ea-42a8a9c9d6ad&t=882c7357-d1f3-52e7-710c-1c032d7a9315
- Libraries Build linux arm64 Release - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=a7185a84-0100-5e66-b360-01f256e68ff9&t=9042869a-47ff-55ee-f646-bdc9d047cbd3
- CoreCLR Product Build linux arm64 release PGO - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=c2e749ed-3e2c-51d8-078b-193121b9b774&t=202ba399-972e-576e-a62d-2f502b3545dc
- linux-arm64 release CrossAOT_Mono crossaot - https://dev.azure.com/dnceng/internal/_build/results?buildId=2102620&view=logs&j=143489d5-74d4-512f-2ac7-0f45bc6f28f4&t=8447cb88-0a79-55cb-e8f2-5f8cf1455fd8

CMake Error at /usr/share/cmake-3.25/Modules/CMakeTestCCompiler.cmake:70 (message):
  The C compiler

    "/usr/bin/clang-9"

  is not able to compile a simple test program.

  It fails with the following output:

    Change Dir: /__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeScratch/TryCompile-oItv5b
    
    Run Build Command(s):/usr/bin/make -f Makefile cmTC_1410a/fast && /usr/bin/make  -f CMakeFiles/cmTC_1410a.dir/build.make CMakeFiles/cmTC_1410a.dir/build
    make[1]: Entering directory '/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeScratch/TryCompile-oItv5b'
    Building C object CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o
    /usr/bin/clang-9 --target=aarch64-linux-gnu --gcc-toolchain=/crossrootfs/usr --sysroot=/crossrootfs    -MD -MT CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o -MF CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o.d -o CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o -c /__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeScratch/TryCompile-oItv5b/testCCompiler.c
    Linking C executable cmTC_1410a
    /usr/bin/cmake -E cmake_link_script CMakeFiles/cmTC_1410a.dir/link.txt --verbose=1
    /usr/bin/clang-9 --target=aarch64-linux-gnu --gcc-toolchain=/crossrootfs/usr --sysroot=/crossrootfs -Wl,--rpath-link=/crossrootfs/lib/aarch64-linux-gnu -Wl,--rpath-link=/crossrootfs/usr/lib/aarch64-linux-gnu -Wl,--rpath-link=/crossrootfs/lib/aarch64-linux-gnu -Wl,--rpath-link=/crossrootfs/usr/lib/aarch64-linux-gnu -fuse-ld=lld  CMakeFiles/cmTC_1410a.dir/testCCompiler.c.o -o cmTC_1410a 
    ld.lld: error: cannot open crt1.o: No such file or directory
    ld.lld: error: cannot open crti.o: No such file or directory
    ld.lld: error: cannot open crtbegin.o: No such file or directory
    ld.lld: error: unable to find library -lgcc
    ld.lld: error: unable to find library -lgcc_s
    ld.lld: error: unable to find library -lc
    ld.lld: error: unable to find library -lgcc
    ld.lld: error: unable to find library -lgcc_s
    ld.lld: error: cannot open crtend.o: No such file or directory
    ld.lld: error: cannot open crtn.o: No such file or directory
    clang: error: linker command failed with exit code 1 (use -v to see invocation)
    make[1]: *** [CMakeFiles/cmTC_1410a.dir/build.make:100: cmTC_1410a] Error 1
    make[1]: Leaving directory '/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeScratch/TryCompile-oItv5b'
    make: *** [Makefile:127: cmTC_1410a/fast] Error 2

  CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
  CMakeLists.txt:16 (project)

-- Configuring incomplete, errors occurred!
See also "/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeOutput.log".
See also "/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release/CMakeFiles/CMakeError.log".
/__w/1/s
/__w/1/s/artifacts/obj/coreclr/linux.arm64.Release /__w/1/s
Executing make   runtime alljits paltests_install nativeaot spmi  -j 4
make: *** No rule to make target 'runtime'.  Stop.

I assume these two other failures caused by the above lack of artifacts generated:

Downloading artifacts for build: 2102620
##[error]Artifact CoreCLRProduct___linux_arm64_release not found for build 2102620. Please ensure you have published artifacts in any previous phases of the current build.
Author: carlossanlop
Assignees: -
Labels:

arch-arm64, os-linux, area-Infrastructure-coreclr, blocking-official-build

Milestone: 8.0.0

@hoyosjs
Copy link
Member

hoyosjs commented Feb 2, 2023

This seems to be dotnet/arcade#12395

@hoyosjs
Copy link
Member

hoyosjs commented Feb 2, 2023

The fix is in the yml of #81354

@mmitche
Copy link
Member

mmitche commented Feb 2, 2023

Thanks @hoyosjs. @carlossanlop can you port that?

@carlossanlop
Copy link
Member Author

@mmitche sure I could do it, but I think it's covered by the arcade flow @hoyosjs just mentioned, right? #81354

@carlossanlop
Copy link
Member Author

Ah dumb me. It's a main PR. Yes, I can port it to the 8.0 branch.

@mmitche
Copy link
Member

mmitche commented Feb 2, 2023

That's under eng/pipelines/common/templates/pipeline-with-resources.yml not, **eng/common/**templates/pipeline-with-resources.yml. It's runtime specfic yaml

@ghost ghost added in-pr There is an active PR which will close this issue when it is merged and removed in-pr There is an active PR which will close this issue when it is merged labels Feb 2, 2023
@hoyosjs hoyosjs closed this as completed Feb 2, 2023
@ghost ghost locked as resolved and limited conversation to collaborators Mar 5, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants