Viewing Test Results

The Cycle Report Dashboard displays test results while tests are running as well as after tests have completed. It presents test launch summaries through a navigation sidebar. Testers can drill down through the sidebar to pick a specific test case, and the dashboard presents a detailed view for it.

Viewing test runs

The navigation sidebar on the left displays test launches for all Cycle test types: Feature Files, playlists, and group tests. It presents them from top to bottom in reverse chronological order of their start time. Each test run card shows the final result, the test name, the duration, and the start time. A green checkmark indicates a passing result, while a red X indicates a failure.

Navigating to children

When selecting a card by clicking it, the navigation sidebar updates to show all the test's children.

• A Feature File shows all its Scenarios.
• A playlist shows all its Feature Files, which in turn show their Scenarios when selected.
• A group test shows all its groups, then workers, and finally Scenarios.

The example below shows the selection of a Feature File with three Scenarios. The card for each child shows its final result, test name, duration, and start time. The sidebar title shows the parent test name. Click the back arrow next to the title to return to the previous level.

Deleting old or unneeded results

When running multiple tests or running tests multiple times, the sidebar can become congested with data that is no longer required. For this case, a trash can icon appears on top-level cards upon mouse hover that lets you remove the test run card, all children, and any stored results data on disk.

Upon clicking the trash can icon, Cycle prompts with a popup dialog to ask for confirmation before continuing to delete. Ensure you are deleting the proper test, as once deletion occurs the data is completely removed from the system. Upon accepting this dialog by clicking Yes, the card shows a deleting state. Navigation of the app is returned to the client and, even on a reload, the deletion status icon continues to show until the test run is deleted.

Viewing Scenarios

Scenarios are the terminal nodes for navigation. When a tester selects a Scenario, the navigation sidebar automatically collapses, and the dashboard displays the detailed results for the Scenario. In the Scenario view, the left column displays the overall Scenario result with a step-by-step trace, and the right column displays information about the selected step.

Scenario results and trace

The left column displays the results for a Scenario, including:

• The Scenario's name
• The Scenario's result status
• The Scenario's duration time
• The Scenario's start time
• An expandable tree view of all the Scenario's steps, with result status icons and duration times for each step

The tree view highlights step keywords, values, and variable references in color. Control flow steps such as If and While expand to show the steps they ran, and each pass through a While loop appears as its own numbered Loop entry.

The Scenario header contains three icon buttons in the upper-right corner of the left column. From left to right, they are Jump to Failure, Collapse All, and Tailing. Hover over a button to see its name.

Jump to Failure

If the Scenario has a failure, then when the Jump to Failure button is clicked, the dashboard expands the tree view of the steps to focus on the failing step. Jumping directly to the failing step is more convenient than manually navigating through steps to find the failure.

Collapse All

When the Collapse All button is clicked, the tree view for steps is fully collapsed. The button then changes to Expand. Click Expand to open the top level of the tree again.

Tailing

When tailing is enabled, then while a test is running live, the dashboard puts focus on the most recent steps completed as if it is tailing a log file. This option is helpful for tracking real-time status of a test as it runs. Click the Tailing button to turn tailing on or off.

Searching for a step

The search box below the Scenario header finds steps by their text. Type a search term and press Enter. The dashboard expands the tree view to the first matching step, selects it, and shows the match count next to the search box. Use the up and down arrows to move to the previous or next match.

Viewing steps

The right column displays information about a single step. To view a step, select it from the Scenario's list of steps. Step details include:

• The step's text
• The step's result status
• The step's duration time
• The line number in the Feature File where the step appears
• The absolute filepath to the Feature File containing the step
• If the step used any variables, a collapsible Variables section with variable names and values
• If the step failed, the error message for the failure
• Any screenshots the step captured

Viewing terminal captures

Cycle automatically captures the terminal text as a screenshot for every terminal step. The Report Dashboard displays the capture in the step view under Terminal Capture. The capture is text, so you can copy and paste it.

Opening a step in the editor

The Feature File path in the step details is a link. Click it to open the Feature File at the step's line, so you can go straight from a result to the step that produced it. Hover over the link to see which editor it opens.

Which editor opens depends on how you opened the dashboard:

• If you opened the dashboard from the Desktop IDE, the link opens the file in the Desktop IDE.
• If you opened the dashboard any other way, such as from the CLI, the link opens the file in VS Code.

If the Desktop IDE is not already running when you click the link, it starts and opens the file, but not at the step's line. If VS Code is not installed, the browser shows its own message for the link, and the dashboard keeps working.

Step result details

The right column may appear to be narrow, depending upon screen sizes. You can view Step Result Details in a wider modal by clicking the pop-out icon in the upper-right corner of the column.

Navigating to other results

When a Scenario is selected, the dashboard automatically collapses the navigation sidebar to the left to give as much space as possible for displaying Scenario results. To expand the navigation sidebar again, click the thin blue column on the left. Then you can navigate through test run cards again to find the next tests you wish to view.

Switching between light and dark mode

The icon in the upper-right corner of the top bar switches the dashboard between light mode and dark mode. In light mode, click the moon icon to switch to dark mode. In dark mode, click the sun icon to switch to light mode.