Fuego 1.2 wiki

Release 1.2 To Do

Contents:

priorities for 1.2 release

Free form list of items to do:

Documentation

What's left to do (tasks)
Stuff that got deferred
Full table
Data

priorities for 1.2 release [edit section]

Free form list of items to do: [edit section]

add checkbox and replot to flot plots? (maybe not)

document parser:parse_log and parser:common

review wiki and fix up all modified functions
review items on CodeFixthisList
fuego charts:
- remove or convert all chart_configs to proper files
follow release check list on Fuego_release_process
resolve items from release testing: See release-1.2-test-2017-09-27 Notes

Documentation [edit section]

Here are things needing documentation:

parser:parse_log
parser:common
per_job_build variable in spec files
document new APIS
- function_is_on_sdk

What's left to do (tasks) [edit section]

item ^ priority ^ status ^ notes ^

support AGL/JTA reports high open Song Cai is interested in this work

support unified output format high open create results.json files for all tests (including functional tests) see Unified_Results_Format_Project

Update wiki documentation for this release high open In particular, update information about results files, main.sh, spec file format, testplan defaults

fix LTP high open make sure LTP works for docker and bbb

automatically create a view for each board medium open use a command line option on fuego add-nodes (--make_view)

Edit the data below.

Stuff that got deferred [edit section]

item ^	priority ^	status ^	notes ^
support LAVA transport	high	defer	Required for AGL/JTA integration
Benchmark job created without a testplan has no plot link	medium	defer	If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png
handle set -e differently	medium	defer	handle script errors explicitly, instead of relying on shell
support separate build phase	medium	defer	don't want to hold board reserved during build, for lava integration and handling timeouts better
handle timeouts automatically	medium	defer	should be in test and board, not in plan - but depends on spec, transport, build time etc
support phase reordering	low	defer	May be useful for LAVA integration (don't want to run pre_test before build)
web file transport	low	defer	could be useful for some interesting target cases

Edit the data below.

Full table [edit section]

item ^	priority ^	status ^	notes ^
modify ftc run-test for base script calling convention	high	closed	call main.sh instead of base script, and set TESTDIR and TESTNAME
support LAVA transport	high	defer	Required for AGL/JTA integration
Issue_0048	high	closed	problem with LTP and libaio-dev installation (one toolchain overwrites another toolchains libaio.so symlink (see Issue_0048)
support AGL/JTA reports	high	open	Song Cai is interested in this work
ov_transport_connect/ov_transport_disconnect	high	closed	Sounds like Jan-Simon will do it
support unified output format	high	open	create results.json files for all tests (including functional tests) see Unified_Results_Format_Project
Update wiki documentation for this release	high	open	In particular, update information about results files, main.sh, spec file format, testplan defaults
fix LTP	high	open	make sure LTP works for docker and bbb
get rid of nbench-bytes	medium	closed	This is a dumb duplicate of nbench_bytes (see Fuego naming rules)
Benchmark job created without a testplan has no plot link	medium	defer	If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png
fix ftc device dictionary	medium	closed	used for board check and pre-populating options
handle set -e differently	medium	defer	handle script errors explicitly, instead of relying on shell
support separate build phase	medium	defer	don't want to hold board reserved during build, for lava integration and handling timeouts better
handle timeouts automatically	medium	defer	should be in test and board, not in plan - but depends on spec, transport, build time etc
automatically create a view for each board	medium	open	use a command line option on fuego add-nodes (--make_view)
support phase reordering	low	defer	May be useful for LAVA integration (don't want to run pre_test before build)
web file transport	low	defer	could be useful for some interesting target cases

Data [edit section]

Edit the data here:

item ^	priority ^	status ^	notes ^
handle set -e differently	medium	defer	handle script errors explicitly, instead of relying on shell
handle timeouts automatically	medium	defer	should be in test and board, not in plan - but depends on spec, transport, build time etc
support separate build phase	medium	defer	don't want to hold board reserved during build, for lava integration and handling timeouts better
support phase reordering	low	defer	May be useful for LAVA integration (don't want to run pre_test before build)
fix ftc device dictionary	medium	closed	used for board check and pre-populating options
ov_transport_connect/ov_transport_disconnect	high	closed	Sounds like Jan-Simon will do it
web file transport	low	defer	could be useful for some interesting target cases
automatically create a view for each board	medium	open	use a command line option on fuego add-nodes (--make_view)
fix LTP	high	open	make sure LTP works for docker and bbb
get rid of nbench-bytes	medium	closed	This is a dumb duplicate of nbench_bytes (see Fuego naming rules)
Benchmark job created without a testplan has no plot link	medium	defer	If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png
Update wiki documentation for this release	high	open	In particular, update information about results files, main.sh, spec file format, testplan defaults
support unified output format	high	open	create results.json files for all tests (including functional tests) see Unified_Results_Format_Project
support AGL/JTA reports	high	open	Song Cai is interested in this work
support LAVA transport	high	defer	Required for AGL/JTA integration
modify ftc run-test for base script calling convention	high	closed	call main.sh instead of base script, and set TESTDIR and TESTNAME
Issue_0048	high	closed	problem with LTP and libaio-dev installation (one toolchain overwrites another toolchains libaio.so symlink (see Issue_0048)

Query