PR# 18184 Auto-Test Improvements

The following ideas were submitted to Manu by way of Skype. He asked me to submit them here. There are two:

One

The first attachment shows an interesting matter. The "Fail: 2" indicator includes 1 failure from the currently running test cycle and 1 failure from a previous cycle. What is confusing is to have a 2 and not have specific knowledge of what what the "previous 1" is all about (e.g. what test actually failed or is still failing).

What might be nice is to have all of the tests below (e.g. the ones queued up for running) marked with dimmed or greyed-out icons indicating what their last status was (pass, unresolved or fail). Thus, the items on the list would have a greyed-out pass checkmark or a greyed-out fail-mark showing what the last run of the test was. Moreover, if the test was new to the running list, then it would have no icon at all.

Two

Also in attachment two, show a grid with columns for each level, where (for instance) "class" would have three columns to the right of it showing counts for pass, fail and unresolved. Each successive "tag" level would have the same three columns to the right, aggregating the individual tests based on the last run. 

Moreover, you might be able to include additional columns like: "Total run time" so we can get a sense of how long it takes to run all of the tests in that category (e.g. tag). Moreover, you might want to get average, min and max time columns as well.

I think such things as above are probably fairly low-hanging fruit of useful information that will put another layer of spit-n-polish on the Auto-test tool.

NOTE: The attachments are NOT the originals sent by way of Skype to Manu. They are simply placeholders to show the area being referenced above. Please ask Manu for the originals PNG files. That said -- they matter very little really. The ideas above probably speak for themselves.

Attachments for problem report #18184