Viewing Test Results
The Cycle Report Dashboard displays test results while tests are running as well as after tests have completed. It presents test launch summaries through a navigation sidebar. Testers can drill down through the sidebar to pick a specific test case, and the dashboard will present a detailed view for it.
Viewing test runs
The navigation sidebar on the left displays test launches for all Cycle test types: features, playlists, and group tests. It presents them from top to bottom in reverse chronological order of their start time. Each test run "card" shows the test name, start time, duration time, and final result. A green checkmark indicates a passing result, while a red X indicates a failure.
Navigating to children
When selecting a card by clicking it, the navigation sidebar will update to show all the test's children.
- A feature will show all its scenarios.
- A playlist will show all its features, which in turn will show their scenarios when selected.
- A group test will show all its groups, then workers, and finally scenarios.
The example below shows the selection of a feature with one scenario. The card for each child shows its test name, start time, duration time, and final result. The sidebar title displays breadcrumbs for the navigation path.
Viewing scenarios
Scenarios are the "terminal" nodes for navigation. When a tester selects a scenario, the navigation sidebar automatically collapses, and the dashboard displays the detailed results for the scenario. In the scenario view, the left column displays the overall scenario result with a step-by-step trace, and the right column displays information about the selected step.
Scenario results and trace
The left column displays the results for a scenario, including:
- the scenario's name
- the scenario's result status
- the scenario's duration time
- the scenario's start time
- an expandable tree view of all the scenario's steps, with result status icons for each step
Tailing
The "Tailing" option is displayed in the upper-right corner of the center column. If this option is enabled, then while a test is running live, the dashboard will put focus on the most recent steps completed as if it is "tailing" a log file. This option is helpful for tracking real-time status of a test as it runs.
Jump to Failure
The "Jump to Failure" button is displayed in the upper-right corner of the center column underneath the "Tailing" option. If the scenario has a failure, then when this button is clicked, the dashboard will expand the tree view of the steps to focus on the failing step. Jumping directly to the failing step is much more convenient than manually navigating through steps to find the failure.
Collapse All
The "Collapse All" button is displayed in the upper-right corner of the center column directly to the right of the "Jump to Failure" button. When this button is clicked, the tree view for steps is fully collapsed.
Viewing steps
The right column displays information about a single step. To view a step, select it from the scenario's list of steps. Step details include:
- the step's text
- the absolute filepath to the feature file containing the step
- the line number in that file where the step appears
- the step's duration time
- if the step used any variables, a table of variable names and values
- if the step failed, the error message for the failure
- any screenshots the step captured
Step Result Details
The rightmost column may appear to be narrow, depending upon screen sizes. You can view "Step Result Details" in a wider modal by clicking the pop-out icon in the upper-left corner of the column.
Navigating to other results
When a scenario is selected, the dashboard automatically collapses the navigation sidebar to the left to give as much space as possible for displaying scenario results. To expand the navigation sidebar again, click the thin blue column on the left. Then, you can navigate through test run cards again to find the next tests you wish to view.
