musl-qemux86: do_compile_kernelmodules() failed


Naveen Saini
 

Hi Richard,

 

On master-next, do_compile_kernelmodules() is failing (with musl).

 

https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/4099

 

Error log:

 

| Assembler messages:

| Error: can't open /tmp/ccQzs5nT.s for reading: No such file or directory

| make[3]: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-shared/qemux86/kernel-source/scripts/Makefile.build:271: drivers/net/tun.o] Error 1

| make[2]: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-shared/qemux86/kernel-source/scripts/Makefile.build:514: drivers/net] Error 2

| make[1]: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-shared/qemux86/kernel-source/Makefile:1858: drivers] Error 2

| make: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-shared/qemux86/kernel-source/Makefile:220: __sub-make] Error 2

| make: Leaving directory '/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/linux-qemux86-standard-build'

| ERROR: oe_runmake failed

| WARNING: /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957:220 exit 1 from 'exit 1'

| WARNING: Backtrace (BB generated script):

|            #1: bbfatal_log, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 220

|            #2: die, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 204

|            #3: oe_runmake, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 199

|            #4: do_compile_kernelmodules, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 170

|            #5: main, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 223

NOTE: recipe linux-yocto-5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0: task do_compile_kernelmodules: Failed

ERROR: Task (/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-kernel/linux/linux-yocto_5.14.bb:do_compile_kernelmodules) failed with exit code '1'

 

Regards,

Naveen


Naveen Saini
 

It seems CentOS specific !

 

Same kernelmodules() failure during reproducible-centos:

https://autobuilder.yoctoproject.org/typhoon/#/builders/115/builds/766

 

And oe-selftest-centos failures too only on centos:

https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2644

 

Regards,

Naveen

 

 

From: swat@... <swat@...> On Behalf Of Naveen Saini
Sent: Monday, October 4, 2021 4:44 PM
To: swat@...
Cc: Bruce Ashfield <bruce.ashfield@...>
Subject: [swat] musl-qemux86: do_compile_kernelmodules() failed

 

Hi Richard,

 

On master-next, do_compile_kernelmodules() is failing (with musl).

 

https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/4099

 

Error log:

 

| Assembler messages:

| Error: can't open /tmp/ccQzs5nT.s for reading: No such file or directory

| make[3]: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-shared/qemux86/kernel-source/scripts/Makefile.build:271: drivers/net/tun.o] Error 1

| make[2]: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-shared/qemux86/kernel-source/scripts/Makefile.build:514: drivers/net] Error 2

| make[1]: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-shared/qemux86/kernel-source/Makefile:1858: drivers] Error 2

| make: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-shared/qemux86/kernel-source/Makefile:220: __sub-make] Error 2

| make: Leaving directory '/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/linux-qemux86-standard-build'

| ERROR: oe_runmake failed

| WARNING: /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957:220 exit 1 from 'exit 1'

| WARNING: Backtrace (BB generated script):

|            #1: bbfatal_log, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 220

|            #2: die, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 204

|            #3: oe_runmake, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 199

|            #4: do_compile_kernelmodules, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 170

|            #5: main, /home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/temp/run.do_compile_kernelmodules.1482957, line 223

NOTE: recipe linux-yocto-5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0: task do_compile_kernelmodules: Failed

ERROR: Task (/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-kernel/linux/linux-yocto_5.14.bb:do_compile_kernelmodules) failed with exit code '1'

 

Regards,

Naveen


Richard Purdie
 

Yes, it seems we have a problem on Centos 8 where files in /tmp are being
removed unexpectedly for unknown reasons and causing a variety of build
failures.

Michael: Were there any recent changes in the updates to the Centos 8 system
that would explain this?

Cheers,

Richard

On Mon, 2021-10-04 at 09:00 +0000, Naveen Saini wrote:
It seems CentOS specific !
 
Same kernelmodules() failure during reproducible-centos:
https://autobuilder.yoctoproject.org/typhoon/#/builders/115/builds/766
 
And oe-selftest-centos failures too only on centos:
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2644
 
Regards,
Naveen
 
 
From: swat@lists.yoctoproject.org <swat@lists.yoctoproject.org>On Behalf Of
Naveen Saini
Sent: Monday, October 4, 2021 4:44 PM
To: swat@lists.yoctoproject.org
Cc: Bruce Ashfield <bruce.ashfield@gmail.com>
Subject: [swat] musl-qemux86: do_compile_kernelmodules() failed
 
Hi Richard,
 
On master-next, do_compile_kernelmodules() is failing (with musl).
 
https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/4099
 
Error log:
 
| Assembler messages:
| Error: can't open /tmp/ccQzs5nT.s for reading: No such file or directory
| make[3]: *** [/home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work-shared/qemux86/kernel-
source/scripts/Makefile.build:271: drivers/net/tun.o] Error 1
| make[2]: *** [/home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work-shared/qemux86/kernel-
source/scripts/Makefile.build:514: drivers/net] Error 2
| make[1]: *** [/home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work-shared/qemux86/kernel-source/Makefile:1858:
drivers] Error 2
| make: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-
shared/qemux86/kernel-source/Makefile:220: __sub-make] Error 2
| make: Leaving directory '/home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/linux-qemux86-standard-build'
| ERROR: oe_runmake failed
| WARNING: /home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
r0/temp/run.do_compile_kernelmodules.1482957:220 exit 1 from 'exit 1'
| WARNING: Backtrace (BB generated script):
|            #1: bbfatal_log, /home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
r0/temp/run.do_compile_kernelmodules.1482957, line 220
|            #2: die, /home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
r0/temp/run.do_compile_kernelmodules.1482957, line 204
|            #3: oe_runmake, /home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
r0/temp/run.do_compile_kernelmodules.1482957, line 199
|            #4: do_compile_kernelmodules, /home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
r0/temp/run.do_compile_kernelmodules.1482957, line 170
|            #5: main, /home/pokybuild/yocto-worker/musl-
qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
r0/temp/run.do_compile_kernelmodules.1482957, line 223
NOTE: recipe linux-yocto-5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0:task
do_compile_kernelmodules: Failed
ERROR: Task (/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-
kernel/linux/linux-yocto_5.14.bb:do_compile_kernelmodules) failed with exit
code '1'
 
Regards,
Naveen


Michael Halstead <mhalstead@...>
 

Yes, after the tmp directories were filled and we had inode exhaustion I changed the tmpfiles.d configuration to delete tmp files immediately. I expected this to happen on boot only but it also happens once every day. I've changed settings to only remove files 3 days old or older. No builds last over 3 days so I expect this will fix the problem. 


On Mon, Oct 4, 2021 at 5:24 AM Richard Purdie <richard.purdie@...> wrote:
Yes, it seems we have a problem on Centos 8 where files in /tmp are being
removed unexpectedly for unknown reasons and causing a variety of build
failures.

Michael: Were there any recent changes in the updates to the Centos 8 system
that would explain this?

Cheers,

Richard


On Mon, 2021-10-04 at 09:00 +0000, Naveen Saini wrote:
> It seems CentOS specific !
>  
> Same kernelmodules() failure during reproducible-centos:
> https://autobuilder.yoctoproject.org/typhoon/#/builders/115/builds/766
>  
> And oe-selftest-centos failures too only on centos:
> https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2644
>  
> Regards,
> Naveen
>  
>  
> From: swat@... <swat@...>On Behalf Of
> Naveen Saini
> Sent: Monday, October 4, 2021 4:44 PM
> To: swat@...
> Cc: Bruce Ashfield <bruce.ashfield@...>
> Subject: [swat] musl-qemux86: do_compile_kernelmodules() failed
>  
> Hi Richard,
>  
> On master-next, do_compile_kernelmodules() is failing (with musl).
>  
> https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/4099
>  
> Error log:
>  
> | Assembler messages:
> | Error: can't open /tmp/ccQzs5nT.s for reading: No such file or directory
> | make[3]: *** [/home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work-shared/qemux86/kernel-
> source/scripts/Makefile.build:271: drivers/net/tun.o] Error 1
> | make[2]: *** [/home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work-shared/qemux86/kernel-
> source/scripts/Makefile.build:514: drivers/net] Error 2
> | make[1]: *** [/home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work-shared/qemux86/kernel-source/Makefile:1858:
> drivers] Error 2
> | make: *** [/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work-
> shared/qemux86/kernel-source/Makefile:220: __sub-make] Error 2
> | make: Leaving directory '/home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
> yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0/linux-qemux86-standard-build'
> | ERROR: oe_runmake failed
> | WARNING: /home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
> yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
> r0/temp/run.do_compile_kernelmodules.1482957:220 exit 1 from 'exit 1'
> | WARNING: Backtrace (BB generated script):
> |            #1: bbfatal_log, /home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
> yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
> r0/temp/run.do_compile_kernelmodules.1482957, line 220
> |            #2: die, /home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
> yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
> r0/temp/run.do_compile_kernelmodules.1482957, line 204
> |            #3: oe_runmake, /home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
> yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
> r0/temp/run.do_compile_kernelmodules.1482957, line 199
> |            #4: do_compile_kernelmodules, /home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
> yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
> r0/temp/run.do_compile_kernelmodules.1482957, line 170
> |            #5: main, /home/pokybuild/yocto-worker/musl-
> qemux86/build/build/tmp/work/qemux86-poky-linux-musl/linux-
> yocto/5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-
> r0/temp/run.do_compile_kernelmodules.1482957, line 223
> NOTE: recipe linux-yocto-5.14.6+gitAUTOINC+42d2cf670e_7ae156be3b-r0:task
> do_compile_kernelmodules: Failed
> ERROR: Task (/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-
> kernel/linux/linux-yocto_5.14.bb:do_compile_kernelmodules) failed with exit
> code '1'
>  
> Regards,
> Naveen >  




--
Michael Halstead
Linux Foundation / Yocto Project
Systems Operations Engineer