Release 1.2 To Do
priorities for 1.2 release [edit section]
Free form list of items to do: [edit section]
- add checkbox and replot to flot plots? (maybe not)
- review wiki and fix up all modified functions
- review items on CodeFixthisList
- fuego charts:
- remove or convert all chart_configs to proper files
- follow release check list on Fuego_release_process
- resolve items from release testing: See release-1.2-test-2017-09-27 Notes
Documentation [edit section]
Here are things needing documentation:- parser:parse_log
- parser:common
- per_job_build variable in spec files
- document new APIS
- function_is_on_sdk
What's left to do (tasks) [edit section]
item ^ | priority ^ | status ^ | notes ^ |
support AGL/JTA reports | high | open | Song Cai is interested in this work |
support unified output format | high | open | create results.json files for all tests (including functional tests) see Unified_Results_Format_Project |
Update wiki documentation for this release | high | open | In particular, update information about results files, main.sh, spec file format, testplan defaults |
fix LTP | high | open | make sure LTP works for docker and bbb |
automatically create a view for each board | medium | open | use a command line option on fuego add-nodes (--make_view) |
Stuff that got deferred [edit section]
item ^ | priority ^ | status ^ | notes ^ |
support LAVA transport | high | defer | Required for AGL/JTA integration |
support phase reordering | low | defer | May be useful for LAVA integration (don't want to run pre_test before build) |
web file transport | low | defer | could be useful for some interesting target cases |
Benchmark job created without a testplan has no plot link | medium | defer | If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
handle set -e differently | medium | defer | handle script errors explicitly, instead of relying on shell |
support separate build phase | medium | defer | don't want to hold board reserved during build, for lava integration and handling timeouts better |
handle timeouts automatically | medium | defer | should be in test and board, not in plan - but depends on spec, transport, build time etc |
Full table [edit section]
item ^ | priority ^ | status ^ | notes ^ |
modify ftc run-test for base script calling convention | high | closed | call main.sh instead of base script, and set TESTDIR and TESTNAME |
support LAVA transport | high | defer | Required for AGL/JTA integration |
Issue_0048 | high | closed | problem with LTP and libaio-dev installation (one toolchain overwrites another toolchains libaio.so symlink (see Issue_0048) |
support AGL/JTA reports | high | open | Song Cai is interested in this work |
ov_transport_connect/ov_transport_disconnect | high | closed | Sounds like Jan-Simon will do it |
support unified output format | high | open | create results.json files for all tests (including functional tests) see Unified_Results_Format_Project |
Update wiki documentation for this release | high | open | In particular, update information about results files, main.sh, spec file format, testplan defaults |
fix LTP | high | open | make sure LTP works for docker and bbb |
support phase reordering | low | defer | May be useful for LAVA integration (don't want to run pre_test before build) |
web file transport | low | defer | could be useful for some interesting target cases |
get rid of nbench-bytes | medium | closed | This is a dumb duplicate of nbench_bytes (see Fuego naming rules) |
Benchmark job created without a testplan has no plot link | medium | defer | If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
fix ftc device dictionary | medium | closed | used for board check and pre-populating options |
handle set -e differently | medium | defer | handle script errors explicitly, instead of relying on shell |
support separate build phase | medium | defer | don't want to hold board reserved during build, for lava integration and handling timeouts better |
handle timeouts automatically | medium | defer | should be in test and board, not in plan - but depends on spec, transport, build time etc |
automatically create a view for each board | medium | open | use a command line option on fuego add-nodes (--make_view) |
Data [edit section]
Edit the data here:item ^ | priority ^ | status ^ | notes ^ |
modify ftc run-test for base script calling convention | high | closed | call main.sh instead of base script, and set TESTDIR and TESTNAME |
support LAVA transport | high | defer | Required for AGL/JTA integration |
Issue_0048 | high | closed | problem with LTP and libaio-dev installation (one toolchain overwrites another toolchains libaio.so symlink (see Issue_0048) |
support AGL/JTA reports | high | open | Song Cai is interested in this work |
ov_transport_connect/ov_transport_disconnect | high | closed | Sounds like Jan-Simon will do it |
support unified output format | high | open | create results.json files for all tests (including functional tests) see Unified_Results_Format_Project |
Update wiki documentation for this release | high | open | In particular, update information about results files, main.sh, spec file format, testplan defaults |
fix LTP | high | open | make sure LTP works for docker and bbb |
support phase reordering | low | defer | May be useful for LAVA integration (don't want to run pre_test before build) |
web file transport | low | defer | could be useful for some interesting target cases |
get rid of nbench-bytes | medium | closed | This is a dumb duplicate of nbench_bytes (see Fuego naming rules) |
Benchmark job created without a testplan has no plot link | medium | defer | If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
fix ftc device dictionary | medium | closed | used for board check and pre-populating options |
handle set -e differently | medium | defer | handle script errors explicitly, instead of relying on shell |
support separate build phase | medium | defer | don't want to hold board reserved during build, for lava integration and handling timeouts better |
handle timeouts automatically | medium | defer | should be in test and board, not in plan - but depends on spec, transport, build time etc |
automatically create a view for each board | medium | open | use a command line option on fuego add-nodes (--make_view) |