Track and analyze build, release, and product quality

ALM Octane contains all the information that you need to analyze your product development progress and quality.

Use ALM Octane's various dashboards, overview widgets, and grids to track and analyze various types of information:

  • Track the progress of your backlog development.

  • Track test run results on application modules to determine your product quality.

  • Track test run results on backlog items to determine your release quality.

  • Follow your tests' coverage of various testing environments.

In the Pipelines module, you can open a pipeline to see all of its runs, dating back to when the pipeline was added to ALM Octane. When you open a specific run, you can learn more:

  • Gain insight into build quality by analyzing failed automated tests.

  • Track changes committed by your developers and testers, and their affect on build stability.

Analyze overall quality in the Dashboard

ALM Octane's dashboard comes with many useful charts and graphs for analyzing release and product quality. You can also design your own by configuring widgets.

  1. Open the Dashboard module.

  2. Click to select the layout you prefer.

  3. Organize graphs relevant to you on the dashboard:

    Click + to add a widget to the dashboard. You can select widgets from ALM Octane's widget gallery, or click Add custom graph to design your own. For details, see Set up the dashboard.

  4. In each widget, click the menu in the top-right corner to access the following actions: 

    Reload, Full screen, Export report, Configure, Remove.

    Select Configure to customize the content and filtering for the specific chart or graph.

  5. On the widgets, click an area in a chart or graph to view more detailed information.

Note: Charts and graphs based on test runs display only the following summarized run statuses: Passed, Failed, Planned, and Blocked. Each individual, native test run status falls into one of these categories. This is for clarity of analysis.

Back to top

View an overview of your product or release quality

  1. In the Quality module or the Backlog module, select the Overview tab.

  2. Add widgets, customize them, or design your own, as you would on the Dashboard. For details, see Use the ALM Octane Dashboard.

  3. Include or exclude various types of information from the graph:

    1. Use the filter panel on the right to include or exclude, for example, environment details, releases, and tags.

      Or

      Define additional widget filters in the widget configurations. For details, see Configure widget data settings.

    2. View widget filter icons and tooltips to see if and how the results have been filtered without having to expand the right pane and without having to look at widget configurations. When filters have been defined in widget configurations, the filter icon is marked orange.

  4. Hover over or click various areas of a chart or graph to view more detailed information.

The various widgets display information for the application module or backlog item that you select in the tree.

Note: Charts and graphs based on test runs display only the following summarized run statuses: Passed, Failed, Planned, and Blocked. Each individual, native test run status falls into one of these categories. This is for clarity of analysis.

For details, see Analyze release progress and quality and Analyze product quality.

Back to top

Analyze product and release quality in ALM Octane grids

After you run tests from ALM Octane, the test run results are displayed in the various grids: Quality > Tests, Backlog > Tests / Features / Stories

The results are aggregated and filtered according to the tags you select in the filter, the items you select in the tree, and so on.

Back to top

Analyze build quality using pipeline data

Using pipelines, ALM Octane collects information about pipeline runs, build failures, automated test runs, and SCM commits.

This information can be linked with your backlog and application modules, to provide a comprehensive picture of the connection between your build quality, and your release and product progress and quality.

  • In the Dashboard, select widgets from the DevOps and Analytics section. You can also create custom widgets based on pipeline information. Create a custom widget, and in Scope > Item type, select Pipeline runs, Test runs, or Commits.

    If you add tags to your pipeline runs, you can use the Pipeline runs by user tag dashboard widget to view your pipeline runs, divided according to your tags.

    Example:  

    1. Create tags that describe different reasons for build failure. For example,

      • Database problem

      • Broken build

      • Out of memory

      • Merge issues

    2. In the dashboard, add the Pipeline runs by user tag widget to your dashboard.

    3. The widget shows you how many of your pipeline runs are failing for each reason you listed.

  • In the Pipelines module, you can find several layers of information.

    • The Summary tab provides a high level live view of each pipeline's history, its current status, and its progress.

    • In the Pipelines tab, you can see all the pipelines that are being tracked, and filter to see the ones that interest you.

      You can see summary information about each pipeline's last completed run, and more detailed information about the selected pipeline.

    • You can open an individual pipeline or pipeline run to learn more about its status, its run history, related code changes, affected application modules, and more.

      You can also find analytic information about failed tests and tools to help you analyze failures.

For details, see Run and analyze pipelines

Back to top