Testing data
Test type: Full Pass Release Test
Branch: daisy
Build name: 1.6.2 rc2
poky commit: 30b8d9378b8260e452552b806610dc9b6fe0b69f
Eclipse Plugin commit Kepler: 932891014ea068e196fcf1f9efedb8a672fb81a0
Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.6.2.rc2
Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 7 64 bit
Summary Report
|
Testing Summary Report
|
|
Test Run
|
Test Plan
|
Environment
|
Passed
|
Other issues
|
Failed
|
Failing bugs
|
Blocked
|
Blocking bugs
|
Complete
|
|
3154
3155
|
ADT: daisy_branch
|
Fedora 20 i686
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3156
3157
|
ADT: daisy_branch
|
Ubuntu 14.04 x86_64
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3161
3162
|
BSP/QEMU: daisy branch
|
Beaglebone Black
|
97.3%
|
none
|
2.7%
|
6462 6665
|
0.0%
|
none
|
100.0%
|
|
3150
3151
|
BSP/QEMU: daisy branch
|
EdgeRouter
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3187
3188
|
BSP/QEMU: daisy branch
|
generic-x86 on AtomPC
|
98.6%
|
none
|
1.4%
|
4005
|
0.0%
|
none
|
100.0%
|
|
3189
3190
|
BSP/QEMU: daisy branch
|
genericx86-64 on Sugarbay
|
98.6%
|
none
|
1.4%
|
5834
|
0.0%
|
none
|
100.0%
|
|
3152
3153
|
BSP/QEMU: daisy branch
|
MPC8315e-rdb
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3159
3160
|
BSP/QEMU: daisy branch
|
P1022ds
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3164
3166
|
BSP/QEMU: daisy branch
|
qemu-x86
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3180
3181
|
BSP/QEMU: daisy branch
|
qemuarm
|
98.1%
|
none
|
1.9%
|
4024
|
0.0%
|
none
|
100.0%
|
|
3182
3183
|
BSP/QEMU: daisy branch
|
qemumips
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3184
3185
|
BSP/QEMU: daisy branch
|
qemuppc
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3165
3167
|
BSP/QEMU: daisy branch
|
qemux86-64
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3168
3169
3170
|
Eclipse Plugin: Daisy Branch
|
Fedora 20 x86_64
|
100.0%
|
5285
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3148
3149
|
meta-yocto: daisy branch
|
Ubuntu 14.04 x86_64
|
100.0%
|
6156
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3173
3174
|
HOB: daisy branch
|
Ubuntu 14.04 x86_64
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3186
3201
|
Toaster: daisy branch
|
Ubuntu 14.04 LTS x86_64
|
92.5%
|
none
|
7.5%
|
6684 68325485 68996114 69755255 52265811
|
0.0%
|
none
|
100.0%
|
|
3192
3193
|
OE-Core: daisy branch
|
Ubuntu 14.04 x86_64
|
96.6%
|
none
|
3.4%
|
6973
|
0.0%
|
none
|
100.0%
|
|
3194
3195
|
BitBake: daisy branch
|
Ubuntu 14.04 x86_64
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3191
|
Runtime: daisy branch
|
Multiple Environments
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
3158
|
Build Appliance: daisy branch
|
qemu-kvm on Ubuntu 12.04 libvirt
|
100.0%
|
none
|
0.0%
|
none
|
0.0%
|
none
|
100.0%
|
|
Total: 21
|
|
|
|
Test Case Status Report
|
|
Status
|
Count
|
|
FAILED
|
11
|
|
PASSED
|
1012
|
|
Total: 1023
|
|
|
|
|
Bug Status Report
|
|
|
|
ID
|
Priority
|
Status
|
Resolution
|
Test Runs
|
Description
|
Version
|
Target Milestone
|
Age (days)
|
|
4005
|
Low
|
NEW
|
|
3187
|
dmesg log errors in Atom-PC
|
1.3.1
|
1.8 M1
|
609
|
|
4024
|
Low
|
REOPENED
|
|
3180
|
start qemuarm with "core-image-sato", use "dmesg | grep -i error" shows 2 errors
|
1.4
|
1.8 M1
|
605
|
|
5226
|
Medium
|
NEW
|
|
3201
|
in 'variables' API, the 'changed' field seems to return always 'FALSE'
|
1.5
|
Future
|
418
|
|
5255
|
Medium
|
ACCEPTED
|
|
3201
|
source_url in the tasks table is empty
|
unspecified
|
Future
|
413
|
|
5285
|
Medium
|
NEW
|
|
3168
|
powertop: Output is useless
|
unspecified
|
Future
|
409
|
|
5485
|
Medium
|
RESOLVED
|
WONTFIX
|
3201
|
Buildstats info and database entries doesn't match sometimes
|
unspecified
|
1.6 M1
|
369
|
|
5811
|
Medium
|
IN PROGRESS IMPLEMENTATION
|
|
3201
|
the orm_variablehistory table should collect the variable value for each file
|
unspecified
|
Future
|
272
|
|
5834
|
Medium
|
NEW
|
|
3190
|
Cannot wake from suspend state using the USB mouse or keyboard
|
1.6
|
1.8
|
266
|
|
6114
|
Medium
|
RESOLVED
|
WONTFIX
|
3201
|
Elapsed_time value null for tasks with outcome=0
|
1.6.1
|
1.6.1
|
220
|
|
6156
|
Medium
|
ACCEPTED
|
|
3149
|
[crosstap] no trace message output on qemuarm
|
1.6
|
1.8
|
210
|
|
6462
|
Medium
|
NEEDINFO
|
|
3162
|
[1.6.1] watchdog doesn't work in beaglebone black
|
1.6.1
|
1.6.2
|
145
|
|
6665
|
Medium
|
NEW
|
|
3162
|
[Beaglebone] Xserver segmentation fault when reboot the system
|
1.7
|
1.8
|
74
|
|
6684
|
Medium
|
RESOLVED
|
FIXED
|
3186
|
The content of the license column shouldn't be 4.0k.
|
1.7
|
1.7.1
|
66
|
|
6832
|
Medium
|
ACCEPTED
|
|
3201
|
disk_io value in database doesn't match sometime with the value in the task buildstats file
|
1.7
|
1.7.1
|
27
|
|
6899
|
Medium
|
NEW
|
|
3201
|
cpu_usage value for some tasks doesn't match the value in the stats file
|
1.6.2
|
1.6.2
|
13
|
|
6973
|
Undecided
|
NEEDINFO
|
|
3192
|
Buildhistory-diff is not working
|
1.6.3
|
---
|
NEW
|
|
6975
|
Undecided
|
NEW
|
|
3201
|
elapsed_time value in database doesn't match sometime the value in the task stats file
|
1.6.2
|
---
|
NEW
|
|
Total: 17
|
|
Bug Trend
An overview of this week's Yocto Bug Trend charts
can be accessed on the following page
Build Performance Test
note: all the measurements displayed are against 1.6 release in the performance
test page.
§
Building the rootfs improved on Ubuntu host against 1.6 release by 5 seconds taking 4:35 minutes to build. On the Fedora the build time average takes
with 2 seconds less (against 1.6) with 4.34 seconds needed to build.
§
The kernel takes longer to build (against 1.6) with 30 seconds longer on average (12:32 minutes on Ubuntu and 11:23 on Fedora). Agasint 1.6.2.rc2 it
maintained the same performance due to no kernel changes.
§
A sato image with rmwork takes less, with 1:11:25 hours against 1:11:32 horurs on Ubuntu and 1:14:47 against 1:15:56 on Fedora Host. It's notable that
on 1.6.2.rc2 takes longer with 30 seconds on average against 1.6.2.rc1
Overall even if the kernel takes longer to build, the rootfs and images takes less on average.
Performance Charts
For Bitbake core-image-sato with rm_work
Building the Virtual kernel
Building the rootfs
Distro Testing
Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions
used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing wiki.
Summary
At this point all buildsets are fine on Ubuntu and Fedora. Due to an internal failure on our internal Distro setup, the tests on CentOS and OpenSuse were delayed. They will be updated
accordingly in the next few days.
Distro Results
|
BRANCH
|
master
|
|
COMMIT
|
Poky: 30b8d9378b8260e452552b806610dc9b6fe0b69f
|
|
RELEASE
|
1.6.2 rc2
|
|
Ubuntu 14.04 LTS
|
|
|
• nighlty-world
|
PASS
|
|
• buildtools
|
PASS
|
|
• nightly-arm
|
PASS
|
|
• nightly-multilib
|
PASS
|
|
• nightly-qa-systemd
|
PASS
|
|
• nightly-x86
|
PASS
|
|
• nightly-x86-64
|
PASS
|
|
• nightly-x86-64-lsb
|
PASS
|
|
|
|
|
|
|
|
Fedora 20
|
|
|
• nighlty-world
|
PASS
|
|
• buildtools
|
PASS
|
|
• nightly-arm
|
PASS
|
|
• nightly-multilib
|
PASS
|
|
• nightly-qa-systemd
|
PASS
|
|
• nightly-x86
|
PASS
|
|
• nightly-x86-64
|
PASS
|
|
• nightly-x86-64-lsb
|
PASS
|
|
|
|
|
|
|
|
CentOS 7
|
|
|
• nighlty-world
|
PASS
|
|
• buildtools
|
PASS
|
|
• nightly-arm
|
|
|
• nightly-multilib
|
|
|
• nightly-qa-systemd
|
|
|
• nightly-x86
|
|
|
• nightly-x86-64
|
|
|
• nightly-x86-64-lsb
|
|
|
|
|
|
|
|
|
OpenSuse 13.1
|
|
|
• nighlty-world
|
|
|
• buildtools
|
|
|
• nightly-arm
|
|
|
• nightly-multilib
|
|
|
• nightly-qa-systemd
|
|
|
• nightly-x86
|
|
|
• nightly-x86-64
|
|
|
• nightly-x86-64-lsb
|
|
