glibc 2.34 tests


Alexandre Belloni
 

Hello,

I've been testing multiple versions of Khem's branch for glibc2.34
Everything apart from non-gpl3 builds fine. There is a patch from Khem
to solve this issue, I didn't apply/test yet:

[yocto] [meta-gplv2] [PATCH] coreutils_6.9.bb: Fix build with glibc 2.34

On the tests side, systemd-journal was crashing, the last patch on
Khem's branch is solving the issue, thanks!

The remaining issues are on the ptests side:

https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2233/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1946/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2236/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1949/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2244/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1957/steps/12/logs/stdio

Issues happen both on qemux86-64 and qemuarm64 and they reproduced
every time:

'elfutils': ['run-backtrace-native.sh', 'run-backtrace-native-core.sh']

'strace': ['prlimit64.gen.test',
'xet_robust_list.gen.test',
'xet_robust_list--pidns-translation.gen.test'],

For valgrind, it is all over the place:

ARM has:
'valgrind': ['gdbserver_tests/hginfo',
'helgrind/tests/hg02_deadlock',
'drd/tests/boost_thread',
'drd/tests/pth_cond_race3',
'drd/tests/pth_create_chain',
'drd/tests/pth_detached',
'drd/tests/std_list',
'drd/tests/std_mutex',
'drd/tests/swapcontext',
'drd/tests/tc24_nonzero_sem',
'drd/tests/thread_name',
'drd/tests/thread_name_xml',
'drd/tests/threaded-fork-vcs',
'drd/tests/threaded-fork',
'drd/tests/tls_threads',
'massif/tests/deep-D']

x86 has:

'valgrind': ['gdbserver_tests/hginfo',
'memcheck/tests/supp_unknown',
'helgrind/tests/annotate_smart_pointer',
'helgrind/tests/bar_bad',
'helgrind/tests/hg01_all_ok',
'helgrind/tests/hg02_deadlock',
'helgrind/tests/pth_destroy_cond',
'helgrind/tests/rwlock_test',
'helgrind/tests/tc05_simple_race',
'helgrind/tests/tc06_two_races',
'helgrind/tests/tc06_two_races_xml',
'helgrind/tests/tc14_laog_dinphils',
'helgrind/tests/tc17_sembar',
'helgrind/tests/tc19_shadowmem',
'helgrind/tests/tc21_pthonce',
'helgrind/tests/tc22_exit_w_lock',
'helgrind/tests/tc23_bogus_condwait',
'helgrind/tests/tls_threads',
'drd/tests/annotate_barrier',
'drd/tests/annotate_barrier_xml',
'drd/tests/annotate_hb_race',
'drd/tests/annotate_hbefore',
'drd/tests/annotate_ignore_read',
'drd/tests/annotate_ignore_rw',
'drd/tests/annotate_ignore_rw2',
'drd/tests/annotate_ignore_write',
'drd/tests/annotate_ignore_write2',
'drd/tests/annotate_order_1',
'drd/tests/annotate_order_2',
'drd/tests/annotate_order_3',
'drd/tests/annotate_rwlock',
'drd/tests/annotate_sem',
'drd/tests/annotate_smart_pointer',
'drd/tests/annotate_smart_pointer2',
'drd/tests/annotate_spinlock',
'drd/tests/annotate_static',
'drd/tests/atomic_var',
'drd/tests/bar_bad',
'drd/tests/bar_bad_xml',
'drd/tests/bar_trivial',
'drd/tests/boost_thread',
'drd/tests/bug-235681',
'drd/tests/bug322621',
'drd/tests/circular_buffer',
'drd/tests/concurrent_close',
'drd/tests/dlopen',
'drd/tests/fork-parallel',
'drd/tests/fork-serial',
'drd/tests/fp_race',
'drd/tests/fp_race2',
'drd/tests/fp_race_xml',
'drd/tests/free_is_write',
'drd/tests/free_is_write2',
'drd/tests/hg01_all_ok',
'drd/tests/hg02_deadlock',
'drd/tests/hg03_inherit',
'drd/tests/hg04_race',
'drd/tests/hg05_race2',
'drd/tests/hg06_readshared',
'drd/tests/linuxthreads_det',
'drd/tests/matinv',
'drd/tests/monitor_example',
'drd/tests/pth_barrier',
'drd/tests/pth_barrier2',
'drd/tests/pth_barrier3',
'drd/tests/pth_barrier_race',
'drd/tests/pth_barrier_thr_cr',
'drd/tests/pth_broadcast',
'drd/tests/pth_cancel_locked',
'drd/tests/pth_cleanup_handler',
'drd/tests/pth_cond_race',
'drd/tests/pth_cond_race2',
'drd/tests/pth_cond_race3',
'drd/tests/pth_create_chain',
'drd/tests/pth_detached',
'drd/tests/pth_detached2',
'drd/tests/pth_detached3',
'drd/tests/pth_detached_sem',
'drd/tests/pth_inconsistent_cond_wait',
'drd/tests/pth_once',
'drd/tests/pth_spinlock',
'drd/tests/read_and_free_race',
'drd/tests/rwlock_race',
'drd/tests/rwlock_test',
'drd/tests/sem_as_mutex',
'drd/tests/sem_as_mutex2',
'drd/tests/sem_as_mutex3',
'drd/tests/sem_open',
'drd/tests/sem_open2',
'drd/tests/sem_open3',
'drd/tests/sem_open_traced',
'drd/tests/sigalrm',
'drd/tests/std_atomic',
'drd/tests/std_list',
'drd/tests/std_mutex',
'drd/tests/std_string',
'drd/tests/std_thread',
'drd/tests/swapcontext',
'drd/tests/tc01_simple_race',
'drd/tests/tc02_simple_tls',
'drd/tests/tc03_re_excl',
'drd/tests/tc05_simple_race',
'drd/tests/tc06_two_races',
'drd/tests/tc07_hbl1',
'drd/tests/tc08_hbl2',
'drd/tests/tc09_bad_unlock',
'drd/tests/tc11_XCHG',
'drd/tests/tc16_byterace',
'drd/tests/tc17_sembar',
'drd/tests/tc18_semabuse',
'drd/tests/tc19_shadowmem',
'drd/tests/tc21_pthonce',
'drd/tests/tc22_exit_w_lock',
'drd/tests/tc23_bogus_condwait',
'drd/tests/tc24_nonzero_sem',
'drd/tests/thread_name',
'drd/tests/thread_name_xml',
'drd/tests/threaded-fork-vcs',
'drd/tests/threaded-fork',
'drd/tests/tls_threads',
'massif/tests/deep-D']


It seems that
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2233
was under more load has it had python3 fail and more strace failures.

I'll triage the remaining intermittent ptest failures


--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com


Khem Raj <raj.khem@...>
 

On Sat, Jul 3, 2021 at 2:29 PM Alexandre Belloni
<alexandre.belloni@...> wrote:

Hello,

I've been testing multiple versions of Khem's branch for glibc2.34
Everything apart from non-gpl3 builds fine. There is a patch from Khem
to solve this issue, I didn't apply/test yet:

[yocto] [meta-gplv2] [PATCH] coreutils_6.9.bb: Fix build with glibc 2.34

On the tests side, systemd-journal was crashing, the last patch on
Khem's branch is solving the issue, thanks!

The remaining issues are on the ptests side:

https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2233/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1946/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2236/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1949/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2244/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1957/steps/12/logs/stdio

Issues happen both on qemux86-64 and qemuarm64 and they reproduced
every time:

'elfutils': ['run-backtrace-native.sh', 'run-backtrace-native-core.sh']

'strace': ['prlimit64.gen.test',
'xet_robust_list.gen.test',
'xet_robust_list--pidns-translation.gen.test'],

For valgrind, it is all over the place:

ARM has:
'valgrind': ['gdbserver_tests/hginfo',
'helgrind/tests/hg02_deadlock',
'drd/tests/boost_thread',
'drd/tests/pth_cond_race3',
'drd/tests/pth_create_chain',
'drd/tests/pth_detached',
'drd/tests/std_list',
'drd/tests/std_mutex',
'drd/tests/swapcontext',
'drd/tests/tc24_nonzero_sem',
'drd/tests/thread_name',
'drd/tests/thread_name_xml',
'drd/tests/threaded-fork-vcs',
'drd/tests/threaded-fork',
'drd/tests/tls_threads',
'massif/tests/deep-D']

x86 has:

'valgrind': ['gdbserver_tests/hginfo',
'memcheck/tests/supp_unknown',
'helgrind/tests/annotate_smart_pointer',
'helgrind/tests/bar_bad',
'helgrind/tests/hg01_all_ok',
'helgrind/tests/hg02_deadlock',
'helgrind/tests/pth_destroy_cond',
'helgrind/tests/rwlock_test',
'helgrind/tests/tc05_simple_race',
'helgrind/tests/tc06_two_races',
'helgrind/tests/tc06_two_races_xml',
'helgrind/tests/tc14_laog_dinphils',
'helgrind/tests/tc17_sembar',
'helgrind/tests/tc19_shadowmem',
'helgrind/tests/tc21_pthonce',
'helgrind/tests/tc22_exit_w_lock',
'helgrind/tests/tc23_bogus_condwait',
'helgrind/tests/tls_threads',
'drd/tests/annotate_barrier',
'drd/tests/annotate_barrier_xml',
'drd/tests/annotate_hb_race',
'drd/tests/annotate_hbefore',
'drd/tests/annotate_ignore_read',
'drd/tests/annotate_ignore_rw',
'drd/tests/annotate_ignore_rw2',
'drd/tests/annotate_ignore_write',
'drd/tests/annotate_ignore_write2',
'drd/tests/annotate_order_1',
'drd/tests/annotate_order_2',
'drd/tests/annotate_order_3',
'drd/tests/annotate_rwlock',
'drd/tests/annotate_sem',
'drd/tests/annotate_smart_pointer',
'drd/tests/annotate_smart_pointer2',
'drd/tests/annotate_spinlock',
'drd/tests/annotate_static',
'drd/tests/atomic_var',
'drd/tests/bar_bad',
'drd/tests/bar_bad_xml',
'drd/tests/bar_trivial',
'drd/tests/boost_thread',
'drd/tests/bug-235681',
'drd/tests/bug322621',
'drd/tests/circular_buffer',
'drd/tests/concurrent_close',
'drd/tests/dlopen',
'drd/tests/fork-parallel',
'drd/tests/fork-serial',
'drd/tests/fp_race',
'drd/tests/fp_race2',
'drd/tests/fp_race_xml',
'drd/tests/free_is_write',
'drd/tests/free_is_write2',
'drd/tests/hg01_all_ok',
'drd/tests/hg02_deadlock',
'drd/tests/hg03_inherit',
'drd/tests/hg04_race',
'drd/tests/hg05_race2',
'drd/tests/hg06_readshared',
'drd/tests/linuxthreads_det',
'drd/tests/matinv',
'drd/tests/monitor_example',
'drd/tests/pth_barrier',
'drd/tests/pth_barrier2',
'drd/tests/pth_barrier3',
'drd/tests/pth_barrier_race',
'drd/tests/pth_barrier_thr_cr',
'drd/tests/pth_broadcast',
'drd/tests/pth_cancel_locked',
'drd/tests/pth_cleanup_handler',
'drd/tests/pth_cond_race',
'drd/tests/pth_cond_race2',
'drd/tests/pth_cond_race3',
'drd/tests/pth_create_chain',
'drd/tests/pth_detached',
'drd/tests/pth_detached2',
'drd/tests/pth_detached3',
'drd/tests/pth_detached_sem',
'drd/tests/pth_inconsistent_cond_wait',
'drd/tests/pth_once',
'drd/tests/pth_spinlock',
'drd/tests/read_and_free_race',
'drd/tests/rwlock_race',
'drd/tests/rwlock_test',
'drd/tests/sem_as_mutex',
'drd/tests/sem_as_mutex2',
'drd/tests/sem_as_mutex3',
'drd/tests/sem_open',
'drd/tests/sem_open2',
'drd/tests/sem_open3',
'drd/tests/sem_open_traced',
'drd/tests/sigalrm',
'drd/tests/std_atomic',
'drd/tests/std_list',
'drd/tests/std_mutex',
'drd/tests/std_string',
'drd/tests/std_thread',
'drd/tests/swapcontext',
'drd/tests/tc01_simple_race',
'drd/tests/tc02_simple_tls',
'drd/tests/tc03_re_excl',
'drd/tests/tc05_simple_race',
'drd/tests/tc06_two_races',
'drd/tests/tc07_hbl1',
'drd/tests/tc08_hbl2',
'drd/tests/tc09_bad_unlock',
'drd/tests/tc11_XCHG',
'drd/tests/tc16_byterace',
'drd/tests/tc17_sembar',
'drd/tests/tc18_semabuse',
'drd/tests/tc19_shadowmem',
'drd/tests/tc21_pthonce',
'drd/tests/tc22_exit_w_lock',
'drd/tests/tc23_bogus_condwait',
'drd/tests/tc24_nonzero_sem',
'drd/tests/thread_name',
'drd/tests/thread_name_xml',
'drd/tests/threaded-fork-vcs',
'drd/tests/threaded-fork',
'drd/tests/tls_threads',
'massif/tests/deep-D']


It seems that
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2233
was under more load has it had python3 fail and more strace failures.

I'll triage the remaining intermittent ptest failures

thanks, the good thing is that these packages are quite sticky to
glibc internals so usually an upgrade if available
for them will sort things out, glibc is merging libpthread/librt etc
into libc so lot of valgrind failures could be due to that
I will see what I can find.

--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com


Randy MacLeod
 

Add  Tony who has been working on valgrind so he and Khem keep in sync.

../Randy

On 2021-07-06 5:01 a.m., Khem Raj wrote:
On Sat, Jul 3, 2021 at 2:29 PM Alexandre Belloni
<alexandre.belloni@...> wrote:
Hello,

I've been testing multiple versions of Khem's branch for glibc2.34
Everything apart from non-gpl3 builds fine. There is a patch from Khem
to solve this issue, I didn't apply/test yet:

[yocto] [meta-gplv2] [PATCH] coreutils_6.9.bb: Fix build with glibc 2.34

On the tests side, systemd-journal was crashing, the last patch on
Khem's branch is solving the issue, thanks!

The remaining issues are on the ptests side:

https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2233/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1946/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2236/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1949/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2244/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1957/steps/12/logs/stdio

Issues happen both on qemux86-64 and qemuarm64 and they reproduced
every time:

'elfutils': ['run-backtrace-native.sh', 'run-backtrace-native-core.sh']

'strace': ['prlimit64.gen.test',
'xet_robust_list.gen.test',
'xet_robust_list--pidns-translation.gen.test'],

For valgrind, it is all over the place:

ARM has:
'valgrind': ['gdbserver_tests/hginfo',
'helgrind/tests/hg02_deadlock',
'drd/tests/boost_thread',
'drd/tests/pth_cond_race3',
'drd/tests/pth_create_chain',
'drd/tests/pth_detached',
'drd/tests/std_list',
'drd/tests/std_mutex',
'drd/tests/swapcontext',
'drd/tests/tc24_nonzero_sem',
'drd/tests/thread_name',
'drd/tests/thread_name_xml',
'drd/tests/threaded-fork-vcs',
'drd/tests/threaded-fork',
'drd/tests/tls_threads',
'massif/tests/deep-D']

x86 has:

'valgrind': ['gdbserver_tests/hginfo',
'memcheck/tests/supp_unknown',
'helgrind/tests/annotate_smart_pointer',
'helgrind/tests/bar_bad',
'helgrind/tests/hg01_all_ok',
'helgrind/tests/hg02_deadlock',
'helgrind/tests/pth_destroy_cond',
'helgrind/tests/rwlock_test',
'helgrind/tests/tc05_simple_race',
'helgrind/tests/tc06_two_races',
'helgrind/tests/tc06_two_races_xml',
'helgrind/tests/tc14_laog_dinphils',
'helgrind/tests/tc17_sembar',
'helgrind/tests/tc19_shadowmem',
'helgrind/tests/tc21_pthonce',
'helgrind/tests/tc22_exit_w_lock',
'helgrind/tests/tc23_bogus_condwait',
'helgrind/tests/tls_threads',
'drd/tests/annotate_barrier',
'drd/tests/annotate_barrier_xml',
'drd/tests/annotate_hb_race',
'drd/tests/annotate_hbefore',
'drd/tests/annotate_ignore_read',
'drd/tests/annotate_ignore_rw',
'drd/tests/annotate_ignore_rw2',
'drd/tests/annotate_ignore_write',
'drd/tests/annotate_ignore_write2',
'drd/tests/annotate_order_1',
'drd/tests/annotate_order_2',
'drd/tests/annotate_order_3',
'drd/tests/annotate_rwlock',
'drd/tests/annotate_sem',
'drd/tests/annotate_smart_pointer',
'drd/tests/annotate_smart_pointer2',
'drd/tests/annotate_spinlock',
'drd/tests/annotate_static',
'drd/tests/atomic_var',
'drd/tests/bar_bad',
'drd/tests/bar_bad_xml',
'drd/tests/bar_trivial',
'drd/tests/boost_thread',
'drd/tests/bug-235681',
'drd/tests/bug322621',
'drd/tests/circular_buffer',
'drd/tests/concurrent_close',
'drd/tests/dlopen',
'drd/tests/fork-parallel',
'drd/tests/fork-serial',
'drd/tests/fp_race',
'drd/tests/fp_race2',
'drd/tests/fp_race_xml',
'drd/tests/free_is_write',
'drd/tests/free_is_write2',
'drd/tests/hg01_all_ok',
'drd/tests/hg02_deadlock',
'drd/tests/hg03_inherit',
'drd/tests/hg04_race',
'drd/tests/hg05_race2',
'drd/tests/hg06_readshared',
'drd/tests/linuxthreads_det',
'drd/tests/matinv',
'drd/tests/monitor_example',
'drd/tests/pth_barrier',
'drd/tests/pth_barrier2',
'drd/tests/pth_barrier3',
'drd/tests/pth_barrier_race',
'drd/tests/pth_barrier_thr_cr',
'drd/tests/pth_broadcast',
'drd/tests/pth_cancel_locked',
'drd/tests/pth_cleanup_handler',
'drd/tests/pth_cond_race',
'drd/tests/pth_cond_race2',
'drd/tests/pth_cond_race3',
'drd/tests/pth_create_chain',
'drd/tests/pth_detached',
'drd/tests/pth_detached2',
'drd/tests/pth_detached3',
'drd/tests/pth_detached_sem',
'drd/tests/pth_inconsistent_cond_wait',
'drd/tests/pth_once',
'drd/tests/pth_spinlock',
'drd/tests/read_and_free_race',
'drd/tests/rwlock_race',
'drd/tests/rwlock_test',
'drd/tests/sem_as_mutex',
'drd/tests/sem_as_mutex2',
'drd/tests/sem_as_mutex3',
'drd/tests/sem_open',
'drd/tests/sem_open2',
'drd/tests/sem_open3',
'drd/tests/sem_open_traced',
'drd/tests/sigalrm',
'drd/tests/std_atomic',
'drd/tests/std_list',
'drd/tests/std_mutex',
'drd/tests/std_string',
'drd/tests/std_thread',
'drd/tests/swapcontext',
'drd/tests/tc01_simple_race',
'drd/tests/tc02_simple_tls',
'drd/tests/tc03_re_excl',
'drd/tests/tc05_simple_race',
'drd/tests/tc06_two_races',
'drd/tests/tc07_hbl1',
'drd/tests/tc08_hbl2',
'drd/tests/tc09_bad_unlock',
'drd/tests/tc11_XCHG',
'drd/tests/tc16_byterace',
'drd/tests/tc17_sembar',
'drd/tests/tc18_semabuse',
'drd/tests/tc19_shadowmem',
'drd/tests/tc21_pthonce',
'drd/tests/tc22_exit_w_lock',
'drd/tests/tc23_bogus_condwait',
'drd/tests/tc24_nonzero_sem',
'drd/tests/thread_name',
'drd/tests/thread_name_xml',
'drd/tests/threaded-fork-vcs',
'drd/tests/threaded-fork',
'drd/tests/tls_threads',
'massif/tests/deep-D']


It seems that
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2233
was under more load has it had python3 fail and more strace failures.

I'll triage the remaining intermittent ptest failures

thanks, the good thing is that these packages are quite sticky to
glibc internals so usually an upgrade if available
for them will sort things out, glibc is merging libpthread/librt etc
into libc so lot of valgrind failures could be due to that
I will see what I can find.

--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com
--
# Randy MacLeod
# Wind River Linux