openjdk team mailing list archive

Thread
Date
Bug#891573: openjdk-10: builds with unlimited 'make -j'

To: Debian Bug Tracking System <submit@xxxxxxxxxxxxxxx>
From: Andreas Beckmann <anbe@xxxxxxxxxx>
Date: Mon, 26 Feb 2018 19:56:54 +0100
Delivered-to: submit@xxxxxxxxxxxxxxx
Reply-to: Andreas Beckmann <anbe@xxxxxxxxxx>, 891573@xxxxxxxxxxxxxxx
Resent-cc: OpenJDK Team <openjdk@xxxxxxxxxxxxxxxxxxx>
Resent-date: Mon, 26 Feb 2018 19:00:02 +0000
Resent-from: Andreas Beckmann <anbe@xxxxxxxxxx>
Resent-message-id: <handler.891573.B.1519671419795@xxxxxxxxxxxxxxx>
Resent-to: debian-bugs-dist@xxxxxxxxxxxxxxxx
Source: openjdk-10
Version: 10~32-1
Severity: serious
Justification: make build machine unusable while building

Hi,

I just stumbled upon load 425 while rebuilding openjdk-10 in
experimental ... the build runs with DEB_BUILD_OPTIONS=parallel=4

There seem to be some unlimited 'make -j' calls ...

Unfortunately no such commands were logged in the build logfile, the
only evidence I have left is a screen full of
'ps aux | grep make | grep -- -j' output:

1234      3767  0.0  0.0   8892  1660 pts/40   SN+  18:34   0:00 /usr/bin/make -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/spec.gmk MAKE_LOG_FLAGS= LOG_LEVEL=debug LOG_NOFILE= L
OG_CMDLINES= LOG_PROFILE_TIMES_LOG= LOG_PROFILE_TIMES_FILE= -Onone -j 4 -f make/Main.gmk bootcycle-images
1234      3768  0.0  0.0   9668  1736 pts/40   S+   18:34   0:00 /bin/bash -o pipefail -e -c ( cd /build/openjdk-10-10~32 && \         /usr/bin/nice /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC
=/build/openjdk-10-10~32/build/spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -Onone \             -j 4 -f make/Main.gmk  \           
  bootcycle-images  > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/build.log >&2) && wait || \         ( exitcode=$? && \         /usr/bin/printf "\nERROR: Build failed for target 'bootcycle-images' in configuration '/build/openjdk-10-10~32/build' (exit code $exitcode) \n" \             > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/build.log >&2) && wait && \         cd /build/openjdk-10-10~32 && /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -j 1 -f make/Init.gmk \             HAS_SPEC=true on-failure ; \         exit $exitcode ) )
1234      3769  0.0  0.0   9668  1692 pts/40   S+   18:34   0:00 /bin/bash -o pipefail -e -c ( cd /build/openjdk-10-10~32 && \         /usr/bin/nice /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -Onone \             -j 4 -f make/Main.gmk  \             bootcycle-images  > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/build.log >&2) && wait || \         ( exitcode=$? && \         /usr/bin/printf "\nERROR: Build failed for target 'bootcycle-images' in configuration '/build/openjdk-10-10~32/build' (exit code $exitcode) \n" \             > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/build.log >&2) && wait && \         cd /build/openjdk-10-10~32 && /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -j 1 -f make/Init.gmk \             HAS_SPEC=true on-failure ; \         exit $exitcode ) )
1234     22671  0.0  0.0   9660  2428 pts/40   SN+  19:16   0:00 /bin/bash -o pipefail -e -c ( cd /build/openjdk-10-10~32 && \         /usr/bin/nice /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -Onone \             -j  -f make/Main.gmk  \             product-images  > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log >&2) && wait || \         ( exitcode=$? && \         /usr/bin/printf "\nERROR: Build failed for target 'product-images' in configuration '/build/openjdk-10-10~32/build' (exit code $exitcode) \n" \             > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log >&2) && wait && \         cd /build/openjdk-10-10~32 && /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -j 1 -f make/Init.gmk \             HAS_SPEC=true on-failure ; \         exit $exitcode ) )
1234     22672  0.0  0.0   9668  2040 pts/40   SN+  19:16   0:00 /bin/bash -o pipefail -e -c ( cd /build/openjdk-10-10~32 && \         /usr/bin/nice /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -Onone \             -j  -f make/Main.gmk  \             product-images  > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log >&2) && wait || \         ( exitcode=$? && \         /usr/bin/printf "\nERROR: Build failed for target 'product-images' in configuration '/build/openjdk-10-10~32/build' (exit code $exitcode) \n" \             > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log >&2) && wait && \         cd /build/openjdk-10-10~32 && /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -j 1 -f make/Init.gmk \             HAS_SPEC=true on-failure ; \         exit $exitcode ) )
1234     22673  0.0  0.0   8300  1620 pts/40   SN+  19:16   0:00 /usr/bin/make -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS= LOG_LEVEL=debug LOG_NOFILE= LOG_CMDLINES= LOG_PROFILE_TIMES_LOG= LOG_PROFILE_TIMES_FILE= -Onone -j -f make/Main.gmk product-images
1234     22674  0.0  0.0   9668  1564 pts/40   SN+  19:16   0:00 /bin/bash -o pipefail -e -c ( cd /build/openjdk-10-10~32 && \         /usr/bin/nice /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -Onone \             -j  -f make/Main.gmk  \             product-images  > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log >&2) && wait || \         ( exitcode=$? && \         /usr/bin/printf "\nERROR: Build failed for target 'product-images' in configuration '/build/openjdk-10-10~32/build' (exit code $exitcode) \n" \             > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log >&2) && wait && \         cd /build/openjdk-10-10~32 && /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -j 1 -f make/Init.gmk \             HAS_SPEC=true on-failure ; \         exit $exitcode ) )
1234     22675  0.0  0.0   9668  1628 pts/40   SN+  19:16   0:00 /bin/bash -o pipefail -e -c ( cd /build/openjdk-10-10~32 && \         /usr/bin/nice /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -Onone \             -j  -f make/Main.gmk  \             product-images  > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log >&2) && wait || \         ( exitcode=$? && \         /usr/bin/printf "\nERROR: Build failed for target 'product-images' in configuration '/build/openjdk-10-10~32/build' (exit code $exitcode) \n" \             > >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log) 2> >(/usr/bin/tee -a /build/openjdk-10-10~32/build/bootcycle-build/build.log >&2) && wait && \         cd /build/openjdk-10-10~32 && /usr/bin/make  -r -R -I /build/openjdk-10-10~32/make/common SPEC=/build/openjdk-10-10~32/build/bootcycle-spec.gmk MAKE_LOG_FLAGS=""  LOG_LEVEL=debug   LOG_NOFILE=   LOG_CMDLINES=   LOG_PROFILE_TIMES_LOG=   LOG_PROFILE_TIMES_FILE=  -j 1 -f make/Init.gmk \             HAS_SPEC=true on-failure ; \         exit $exitcode ) )

E.g. PID 22673 seems to be one of these bad make commands.

I've now blacklisted openjdk-10 to not again be targeted by my tests :-)
(It needs too much time anyway...)


Andreas
Follow ups

Bug#891573: Bug#891573: openjdk-10: builds with unlimited 'make -j'
From: Matthias Klose, 2018-03-14