As issue summary, the previous ADT-installer fails are fixed, also for Build Appliance. No new Medium+/High bugs are found during this test run, though there
are several medium errors found in the BSP logs (like dmesg, rpm, Xorg, etc) none of which are considered blockers of the release atm. The full list of bugs is listed below, but it can be accessed also on the Full Pass test report link: https://wiki.yoctoproject.org/wiki/WW41_-_2014-10-11_-_Full_Pass_-_1.7_M4.rc4#Summary.
Testing data
Test type: Full Pass Release Test
Branch: master
Build name: 1.7_M4.rc4
poky commit: ccf5a4d2342c4fd40e4e0b332ea7e34e0bf175d4.tar
Eclipse Plugin commit Kepler: 4a167fd662262ebdaa3cf0d332ac0debb52d7904
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7.rc4/
Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 7 64 bit
Summary Report
|
Testing Summary Report
|
|
Test Run
|
Test Plan
|
Environment
|
Passed
|
Other issues
|
Failed
|
Failing bugs
|
Blocked
|
Blocking bugs
|
Complete
|
|
30283030
|
ADT: master branch
|
Fedora 20 i686
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
30273029
|
ADT: master branch
|
Ubuntu 14.04 x86_64
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
30053006
|
BSP/QEMU: master branch
|
Beaglebone Black
|
98.7%
|
none
|
1.3%
|
6665
|
0.0%
|
none
|
100.0%
|
|
30073008
|
BSP/QEMU: master branch
|
EdgeRouter
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
29892990
|
BSP/QEMU: master branch
|
generic-x86 on AtomPC
|
98.8%
|
none
|
1.2%
|
40056846684868496850
|
0.0%
|
none
|
100.0%
|
|
30113012
|
BSP/QEMU: master branch
|
genericx86-64 on Sugarbay
|
98.8%
|
none
|
1.2%
|
5834
|
0.0%
|
none
|
100.0%
|
|
30093010
|
BSP/QEMU: master branch
|
MPC8315e-rdb
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
30023003
|
BSP/QEMU: master branch
|
P1022ds
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
2999
|
BSP/QEMU: master branch
|
qemu-x86
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
30213022
|
BSP/QEMU: master branch
|
qemuarm
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
30253026
|
BSP/QEMU: master branch
|
qemumips
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
30233024
|
BSP/QEMU: master branch
|
qemuppc
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
29983000
|
BSP/QEMU: master branch
|
qemux86-64
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3014
|
Eclipse Plugin: master branch
|
Fedora 20 x86_64
|
90.9%
|
none
|
9.1%
|
5769528544035713
|
0.0%
|
none
|
100.0%
|
|
30193020
|
Meta-yocto: master branch
|
Ubuntu 14.04 x86_64
|
100.0%
|
6156
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
30163017
|
Hob: master branch
|
Ubuntu 14.04 x86_64
|
95.6%
|
none
|
0.0%
|
none
|
4.4%
|
4503
|
100.0%
|
|
3018
|
Toaster: master branch
|
Fedora 20 x86_64
|
96.7%
|
none
|
3.3%
|
6684
|
0.0%
|
none
|
100.0%
|
|
3013
|
Toaster: master branch
|
Ubuntu 14.04 LTS x86_64
|
83.3%
|
none
|
14.3%
|
5187668168326799683368006802
|
2.4%
|
none
|
100.0%
|
|
29932994
|
OE-Core: master branch
|
Ubuntu 14.04 x86_64
|
96.6%
|
none
|
3.4%
|
6804
|
0.0%
|
none
|
100.0%
|
|
29912992
|
BitBake: master branch
|
Ubuntu 14.04 x86_64
|
91.9%
|
none
|
5.4%
|
6752
|
2.7%
|
none
|
100.0%
|
|
3015
|
Runtime: master branch
|
Multiple Environments
|
100.0%
|
6733
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3004
|
Build Appliance: master branch
|
VMWare Workstation
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
Total: 22
|
|
|
|
|
Bug Status Report
|
|
|
|
ID
|
Priority
|
Status
|
Resolution
|
Test Runs
|
Description
|
Version
|
Target Milestone
|
Age (days)
|
|
4005
|
Low
|
NEW
|
|
2990
|
dmesg log errors in Atom-PC
|
1.3.1
|
1.7
|
579
|
|
4403
|
Medium
|
ACCEPTED
|
|
3014
|
stap fails on core-image-sato x86-64
|
1.4
|
Future
|
536
|
|
4503
|
Medium
|
VERIFIED
|
WORKSFORME
|
3017
|
Failed to build an non-GPLv3 image.
|
1.3.2
|
1.5
|
513
|
|
5187
|
Medium
|
ACCEPTED
|
|
3013
|
same cooker log file name used for several builds
|
unspecified
|
1.8
|
393
|
|
5285
|
Medium
|
NEW
|
|
3014
|
powertop: Output is useless
|
unspecified
|
Future
|
379
|
|
5713
|
Medium
|
NEW
|
|
3014
|
systemtap displays blank pop-up error window
|
1.5
|
1.7
|
274
|
|
5769
|
Low
|
NEW
|
|
3014
|
ssh connection doesn't disconnect when qemu is restarted/shut down
|
1.6
|
1.7
|
255
|
|
5834
|
Medium
|
NEW
|
|
3012
|
Cannot wake from suspend state using the USB mouse or keyboard
|
1.6
|
1.7
|
236
|
|
6156
|
Medium
|
ACCEPTED
|
|
3020
|
[crosstap] no trace message output on qemuarm
|
1.6
|
1.7
|
180
|
|
6665
|
Medium
|
NEW
|
|
3006
|
[Beaglebone] Xserver segmentation fault when reboot the system
|
1.7
|
1.7
|
44
|
|
6681
|
Medium
|
NEW
|
|
3013
|
Check if the number of errors from Build table matches the number of level entries with value 2 from LogMessage table.
|
1.7
|
1.7 M4
|
37
|
|
6684
|
Medium
|
NEW
|
|
3018
|
The content of the license column shouldn't be 4.0k.
|
1.7
|
1.7 M4
|
36
|
|
6733
|
Medium
|
NEW
|
|
3015
|
[LTP] some rwtest cases hang on mpc8315e-rdb
|
1.7
|
1.7
|
23
|
|
6752
|
Medium
|
NEW
|
|
2992
|
bitbake-prserv-tool has issues when it comes to exporting the PR database
|
1.7
|
1.7 M4
|
18
|
|
6799
|
Medium
|
NEW
|
|
3013
|
cpu_usage value 0 for tasks with outcome=0
|
1.7
|
1.8
|
5(Recent)
|
|
6800
|
Medium
|
NEW
|
|
3013
|
elapsed_time value null for tasks with outcome=0
|
1.7
|
1.8
|
5(Recent)
|
|
6802
|
Undecided
|
NEEDINFO
|
|
3013
|
Lots of empty fields in the database.
|
1.7
|
---
|
5(Recent)
|
|
6804
|
Medium
|
NEW
|
|
2994
|
do_rootfs fails for btrfs image build
|
1.7
|
1.7
|
5(Recent)
|
|
6832
|
Low
|
NEW
|
|
3013
|
disk_io value in database doesn't match sometime with the value in the task buildstats file
|
1.7
|
1.8
|
NEW
|
|
6833
|
Low
|
NEW
|
|
3013
|
elapsed_time value in database doesn't match sometime the value in the task stats file
|
1.7
|
1.8
|
NEW
|
|
6846
|
Medium
|
NEEDINFO
|
|
2990
|
DMESG error: check_tsc_sync_source failed
|
1.7
|
1.8
|
NEW
|
|
6848
|
Undecided
|
NEEDINFO
|
|
2990
|
BeagleBone Black errors in logs
|
1.7
|
---
|
NEW
|
|
6849
|
Medium
|
NEW
|
|
2990
|
EdgeRouter and Minnowboard Xorg Fatal Server Error
|
1.7
|
1.8
|
NEW
|
|
6850
|
Undecided
|
NEW
|
|
2990
|
Minnowboard Xorg Open ACPI failed error
|
1.7
|
---
|
NEW
|
|
Total: 24
|
|
Bug Trend
An overview of this week's Yocto Bug Trend charts
can be accessed on the following page
Build Performance Test
Detailed description on how performance test are run can be found on Performance
Test wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where
you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.
As a status, building kernel takes by 17 seconds less on average on Ubuntu and 4 secods on Fedora. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu
hosts. Building a sato image (with rmwork enabled) improved with 4 seconds on Ubuntu machine and 29 seconds on Fedora on average.
As a QA point of view, for the latter there is no great change in the build performance results to be a concern for the release candidate.
Performance Charts
For Bitbake core-image-sato with rm_work
Building the Virtual kernel
Building the rootfs
Distro Testing
Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions
used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing wiki.
Summary
At this point all buildsets are fine.
Distro Results
|
BRANCH
|
master
|
|
COMMIT
|
Poky: ccf5a4d2342c4fd40e4e0b332ea7e34e0bf175d4
|
|
RELEASE
|
1.7_M4.rc4
|
|
Ubuntu 14.04 LTS
|
|
|
• nighlty-world
|
PASS
|
|
• buildtools
|
PASS
|
|
• nightly-arm
|
PASS
|
|
• nightly-multilib
|
PASS
|
|
• nightly-qa-systemd
|
PASS
|
|
• nightly-x86
|
PASS
|
|
• nightly-x86-64
|
PASS
|
|
• nightly-x86-64-lsb
|
PASS
|
|
|
|
|
|
|
|
Fedora 20
|
|
|
• nighlty-world
|
PASS
|
|
• buildtools
|
PASS
|
|
• nightly-arm
|
PASS
|
|
• nightly-multilib
|
PASS
|
|
• nightly-qa-systemd
|
PASS
|
|
• nightly-x86
|
PASS
|
|
• nightly-x86-64
|
PASS
|
|
• nightly-x86-64-lsb
|
PASS
|
|
|
|
|
|
|
|
CentOS 7
|
|
|
• nighlty-world
|
PASS
|
|
• buildtools
|
PASS
|
|
• nightly-arm
|
PASS
|
|
• nightly-multilib
|
PASS
|
|
• nightly-qa-systemd
|
PASS
|
|
• nightly-x86
|
PASS
|
|
• nightly-x86-64
|
PASS
|
|
• nightly-x86-64-lsb
|
PASS
|
|
|
|
|
|
|
|
OpenSuse 13.1
|
|
|
• nighlty-world
|
PASS
|
|
• buildtools
|
PASS
|
|
• nightly-arm
|
PASS
|
|
• nightly-multilib
|
PASS
|
|
• nightly-qa-systemd
|
PASS
|
|
• nightly-x86
|
PASS
|
|
• nightly-x86-64
|
PASS
|
|
• nightly-x86-64-lsb
|
PASS
|
