release-1.2-test-2017-09-27 Notes

Here are some notes on the 1.2 release:

flat problem list [edit section]

Resolution key:

Bugs seen:

table of current test status [edit section]

If a test is not listed here, it passes on all 4 platforms (bbb, ren1, min1, docker)

test  ^ bbb  ^ ren1  ^ min1  ^ docker  ^ notes  ^ disposition  ^
Benchmark.blobsallad missing SDL.h missing SDL.h can't open display :0 missing xrandr . document build problems
Benchmark.dbench . . . problem with hd_test_mount_prepare (spec=default), with spec=testdir, it's OK . ok for 1.2
Benchmark.Dhrystone ok measured time too small (spec=default) ok measure time too small (spec=default) . ok for 1.2
Benchmark.ffsb ok fixed ok ok . ok for 1.2
Benchmark.GLmark missing SDL.h missing SDL.h struct member is private in vector.h . Should provide instructions for adding libsdl to yocto build, or build it ourselves?? - actually, maybe should switch to newer glmark2, which tests OpenGL performance won't fix for 1.2
Benchmark.gtkperf configure error checking gtk+ gdk-pixbuf-query-loaders: command not found configure dies checking gtk+ . . needs review
Benchmark.Interbench test hangs on target ok ok . demonstrates a real bug with bbb ok for 1.2
Benchmark.iperf ok fixed ok . . ok for 1.2
Benchmark.lmbench2 ok ok fixed parser.py error . ok for 1.2
Benchmark.netperf ok fixed ok . . ok for 1.2
Benchmark.netpipe fixed fixed fixed . . ok for 1.2
Benchmark.reboot ok . run error can't cd to /tmp test dir not applicable . need review
Benchmark.signaltest . . . needs root (determined in run phase) . needs review
Benchmark.Stream fixed fixed fixed . . ok for 1.2
Benchmark.tiobench ok fixed ok ok . ok for 1.2
Benchmark.x11perf configure error - xmuu not found configure error - xmuu not found can't open display ':0' . . <empty cell>
Functional.aiostress missing libaio.o on target missing libaio.h missing libaio.so.1 on target . . <empty cell>
Functional.crashme ok expected 3000, got 507 ok . . <empty cell>
Functional.expat ok fixed fixed ok . ok for 1.2
Functional.ft2demos missing libXau and libXmcdp missing libscb.la ok . . <empty cell>
Functional.glib processor does not support Thumb mode program returns 143 exit code program returns 143 exit code . . needs review
Functional.kernel_build for scripts/mod/empty - unrecognized command line options to gcc unrecognized command line options to gcc ok . . needs review
Functional.LTP fixed fixed fixed . default timeout is 40m (too short for some boards, when build is included) ok for 1.2
Functional.LTP . criteria failure . . (with lengthened timeout, spec=default) <empty cell>
Functional.netperf ok fixed ok . . ok for 1.2
Functional.OpenSSL ok invalid option to make timeout . default timeout is 6m (too short) <empty cell>
Functional.rmaptest ok ok ok . . ok for 1.2
Functional.scrashme ok NR_SYSCALLS undeclared ok . . needs review
Query

original problems by test and board [edit section]

test  ^ bbb  ^ ren1  ^ min1  ^ docker  ^ notes  ^
Benchmark.blobsallad missing SDL.h missing SDL.h missing SDL.h . .
Benchmark.Dhrystone ok measured time too small (spec=default) ok . .
Benchmark.ffsb ok configure: machine aarch64-poky not recognized ok . .
Benchmark.GLmark missing SDL.h missing SDL.h missing SDL.h . .
Benchmark.gtkperf configure error checking gtk+ configure: machine aarch64-poky not recognized configure dies checking gtk+ . .
Benchmark.Interbench test hangs on target ok ok . .
Benchmark.iperf ok configure: machine aarch64-poky not recognized ok . .
Benchmark.lmbench2 ok ok run error - command not found . .
Benchmark.netperf ok configure: machine aarch64-poky not recognized ok
Benchmark.netpipe unpack error, missing plot unpack error, missing plot unpack error, missing plot . .
Benchmark.reboot ok . run error can't cd to /tmp test dir . .
Benchmark.Stream parser.py exception parser.py exception parser.py exception . .
Benchmark.tiobench ok crc32 build error ok . .
Benchmark.x11perf configure error - xmuu not found configure error - xmuu not found missing xmuu . .
Functional.aiostress missing libaio.o on target missing libaio.h missing libaio.so.1 on target . .
Functional.crashme ok expected 3000, got 507 ok . .
Functional.expat ok configure: machine aarch64-poky not recognized, cast loses precision in expat.h:674 cast loses precision in expat.h:674 . .
Functional.ft2demos missing libXau and libXmcdp configure: machine aarch64-poky not recognized ok . .
Functional.glib processor does not support Thumb mode configure: machine aarch64-poky not recognized program returns 143 exit code . .
Functional.kernel_build for scripts/mod/empty - unrecognized command line options to gcc unrecognized command line options to gcc ok . .
Functional.LTP timeout (transient failure) timeout . default timeout is 40m (too short for some boards, when build is included)
Functional.LTP . criteria failure . . (with lengthened timeout, spec=default)
Functional.netperf ok configure: machine aarch64-poky not recognized ok . .
Functional.OpenSSL ok invalid option to make timeout . default timeout is 6m (too short)
Functional.rmaptest ok ok ok . .
Functional.scrashme ok NR_SYSCALLS undeclared ok . .
Query