Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

I2C_transfer error; Standby failed;

Blacksand

GOOD

Everything runs well

Crownbay-emgd

GOOD

Xorg eat lots of cup's resource after standby

Sugarbay

GOOD

Everything runs well

Jasperforest-lsb

GOOD

I/OAT DMA engine init failed;

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Everything runs well

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

GOOD

Everything runs well

Core build system

BUGGY

Multilib could not work; lib32/lib64 build against qemux86/qemux86-64 could not work; x32 build not work due to broken source URL.

Power/Performance

GOOD

Power consumption of sugarbay and crownbay are 42.91W and 23.82W respectively
Build time for a sato image on Core i7 machine is 127 minutes.

Compliance

GOOD

No regression for LTP and POSIX

Stress

GOOD

Both Crashme/Helltest testing on Jasperforest and LTP testing on Beagleboard could pass 24 hours stress testing.

HOB

BUGGY

Switching package format in hob is unstable;

Critical bugs, more than 50% test cases are blocked

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

Normal, Major and Critical bugs, and more than 10% test cases failed

Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

63

0

61

2 (bug 310, 503)

0

n450 Sato-SDK

73

0

73

0

0

Crownbay-Sato-SDK

74

0

73

1 (bug 1258)

0

Sugarbay Sato-SDK

67

0

67

0

0

Jasperforest lsb-SDK

32

0

31

1 (bug 1188)

0

Beagleboard Sato-SDK

39

0

39

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

29

0

28

1 (bug 1174)

0

Qemux86-64 Sato-SDK

34

0

33

1 (bug 1174)

0

Qemux86 Sato

29

0

28

1 (bug 1174)

0

Qemux86 Sato-SDK

34

0

33

1 (bug 1174)

0

Qemuarm Sato

29

0

29

0

0

Qemuarm Sato-SDK

34

0

34

0

0

Qemumips Sato

29

0

29

0

0

Qemumips Sato-SDK

34

0

34

0

0

Qemuppc Sato

21

0

21

0

0

Qemuppc Sato-SDK

26

0

26

0

0

ADT

6

0

6

0

0

Core build system

31

0

22

9 (bug 1496, 1497, 1498, 1519, 1522, 1527, 1529)

0

Power & Performance

5

0

5

0

0

Compliance

2

0

2

0

0

Stress

3

0

3

0

0

HOB

26

0

24

2 (bug 1521)

0

Total

789

0

770

17

0

Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 503 - [emenlow] system cannot enter S3 standby mode

1.1

Bug 1082 - [x86_64] No icons shown on X desktop with sato image

1.0 M2

Bug 1174: [zypper/rpm] package install/removal costs lots of disk space

1.1 M3

Other

Bug 310 - [eMenlow] i2c_transfer error on e-Menlow

1.1

Bug 1188 - [japerforest] I/OAT DMA engine init failed

post 1.1

Bug 1258 -[crownbay] Xorg eats lots of CPU time after standby

1.1 M4

Core build system

New! Bug 1527 - [multilib] lib64 build against qemux86-64 failed during do_rootfs

1.1

New! Bug 1529 - [x32] x32 build broken due to kernel.org fetch failure

1.1

Bug 1496 - [multilib] no lib32-task-core-ssh-dropbear found for lib32 image build

1.1

Bug 1497 - [multilib] lib32 build against qemux86-64 failed during do_rootfs

1.1

Bug 1498 - [multilib] lib64 build against qemux86 failed during do_rootfs

1.1

Bug 1519 - [multilib/rpm] X not start up with lib32 build with connman against qemux86-64

Bug 1522 - [multilib/ipk] /var/lib/opkg/status changed after the 1st boot

Bug 1502 - [multilib] lib64-dpkg is unbuildable for lib64 build

post 1.1

Power & Performance

Power consumption of sugarbay and crownbay are 42.91W and 23.82W respectively.
Build time for a sato image on Core i7 machine is 127 minutes. Detailed result on https://wiki.yoctoproject.org/wiki/Performance_Test.

Compliance

LTP result: https://wiki.yoctoproject.org/wiki/LTP_result
POSIX result: https://wiki.pokylinux.org/wiki/Posix_result

Stress

Both Crashme and Helltest testing on Jasperforest could pass 24 hours stress testing.

Hob

Bug 1521 - Switching package format in hob is unstable

1.1