Analyze results of testing

PRO

For the analysis of tests in Boomq are available:

• The comparison dashboard. Comparison of two tests using tables and graphs in the Grafana dashboard. For more information, see Compare tests.

• Trend report. A report is created based on the results of two or more load tests and allows you to analyze the trend of changes in the parameters of the testing system. The results are displayed in tables and graphs. For more information, see Create trend reports.

For more information on how to view all tests, see View the performed tests.

See also

• Visualizing tests in Grafana

View the performed tests

FREE STANDARD PRO

To view the performed tests, open the All tests page:

For each test, the following is displayed:

• On the left: the test status. Possible values:

  • Finished

  • Failed

  • Canceled

  • Initialized

  • Pending

  • Running

• On the right: the SLA execution status. Possible values:

  • NOT_COUNTED: the status before calculation of SLA.

  • SUCCESS: the test results match SLA.

  • FAILURE: the test results don’t match SLA.

You can filter a list of the tests by Test project, Test status, Label, or User.

To filter the list of the tests, follow these steps:

1. Click on one of the drop-down lists, for example, Test status:

   

2. Select the values from the drop-down list:

Compare tests

PRO

Boomq allows you to compare the results of two tests in one Grafana dashboard.

To compare tests, follow these steps:

1. Open the All tests page.

2. Select the checkboxes for the two tests.

3. Click Compare tests. The Grafana dashboard opens:

   

For more information about the metrics of the comparison dashboard, see Metrics.

Create trend reports

PRO

Trend report is a report that is created based on the results of two or more load tests and allows you to analyze the trend of changes in the parameters of the testing system. The results are displayed in tables and graphs.

All trend reports are available in the Trending page:

To create trend reports, follow these steps:

1. Use one of the following methods:

   • On the All tests page, open the test and click + Trend.

   • Open the Trending page and click + Add new trend report.

2. Select tests for report using one of the following methods:

   • Choose the specific project and tests:

     

   • Set test selection criteria:

     1. Select the test project.

     2. Enter the number and period for which the tests were run: recent weeks, recent months, or enter the number of recent runs: recent runs.

     3. Select the test labels if needed.

     4. Select the test status:

     

3. Click Next. The SLA report items pane opens:

   

4. Click Add chart and select SLA. You can display several SLAs on one chart. The chart is normalized automatically.

5. Click Add table and select SLA. You can display several SLAs in one table.

   Note

   You can add an unlimited number of graphs and tables to the trend report.

6. For the table, configure the values:

   1. Select one of the values in the list:

      • Absolute value. Select to show absolute SLA values.

      • Test-to-test difference. Select to compare SLA values with the previous test. You can see the difference in absolute values or in percentages.

      • Baseline difference. Select to compare SLA values with the baseline test. You can see the difference in absolute values or in percentages.

   2. Select the required checkboxes for the Test-to-test difference and Baseline difference value settings.

7. Click Copy embed code if needed. The HTML code of the report copies. For more information, see Embed a trend report.

8. Click Save.

Example of the table in the trend report:

Example of the chart in the trend report:

To edit the trend report, click .

To delete the trend report, click .

Embed a trend report

1. Open the trend report you want to embed.

2. Click Copy embed code for the required chart or table. The button is available when the trend report changes are saved. The HTML code is copied:

   <div id="The ID of the chart or table">
   <script src="The link to the JS script"></script>
   <script>
   boomq &&
   typeof boomq.getSlaReportChart === "function" &&
   boomq.getSlaReportChart("Boomq URL", "SLA report profile id", "The ID of the chart or table", "GUI language", "API token")
   </script>
   </div>
   

3. Paste the code into your website HTML, for example a Confluence page.

Example of a chart’s embedded code

<div id="chart-d4fb16c8-af76-4ac7-889a-0d1d30894e5d">
<script src="https://mycompany.boomq.io/trending.js"></script>
<script>
boomq &&
typeof boomq.getSlaReportChart === "function" &&
boomq.getSlaReportChart("https://mycompany.boomq.io", "1", "d4fb16c8-af76-4ac7-889a-0d1d30894e5d", "en", "API token")
</script>
</div>

Example of a table’s embedded code

<div id="table-d4fb16c8-af76-4ac7-889a-0d1d30894e5d">
<script src="https://mycompany.boomq.io/trending.js"></script>
<script>
boomq &&
typeof boomq.getSlaReportTable === "function" &&
boomq.getSlaReportTable("https://mycompany.boomq.io", "1", "d4fb16c8-af76-4ac7-889a-0d1d30894e5d", "en", "API token")
</script>
</div>