(DV-1711) ERP Report Execution & Backend

ERP Report Test Case Execution

When an ERP Report Test Case is added to a Test Plan then a new backend Test Run is automatically created and a Run ID is generated. The description holds the technical name of the Test Plan and the Test Case. All of the Report Variants selected during the creation of ERP Report Test Case are automatically added into Report Variant selection for the generated Test Run.

To execute an ERP Report Test Case from the Test Management click on  ‘Execute’, which will display the standard ERP Report Testing scenario.

Report based testing

The reports are executed with background jobs and their output is saved to spool. The outputs are then read after the execution and are compared based on your preferred settings. 

Recommendations:

• A maximum of 1000 Table variants should be used for one Table testing run.

Test scenario EQS_ERP (Report testing)

_{Report Testing Scenario}

Report testing contains following steps:

1. Selecting Report Variants
2. Generation of before image tasks
3. Creation of before images
4. Performing specific task in system outside Validate
5. Generation of after image tasks
6. Specifying comparison settings
7. Generation of comparison tasks
8. Execution of comparison tasks
9. Display of results

Select Report Variants

By double clicking on the first Test Step 'Select Report Variants' you can define which Report variants are to be used in the specified run for testing, or you can create new Report Variants, these consist of all the selected Report Variants for this Test Run. 
Once you have the variants selected for the Test Run you need to save the selection by clicking on the 'Save' button (Ctrl + s) in main screen of the Report variants selection.
You can add Report Variants in the following ways:
Create New Report Variant- you can create new Report Variant by clicking on 'Create New Report Variant' button (Shift + F4). For more information please refer to 7.6.1Create New Report Variant chapter. 
Add Existing Report Variant – You can display all of the existing Report variants in system and by clicking on the 'Add Existing Report Variant' button (SHIFT + F5), select one or more variants to be added into the Test Run. 
Add Report Variants of Run - By clicking on the 'Add Report Variants of Run' button (SHIFT + F6) you can select another (distinct from current) run, and add all of the Report Variants used also into the current Test Run. 
Copy Report Variants of Run - By clicking on the 'Copy Report Variants of Run' button (SHIFT + F8) you can select another (distinct from current) run, and add all of the Report Variants used also into the current Test Run as copies. 
Add Variants of Test Case - By clicking on the 'Add Variants of Test Case' button (SHIFT + F11) you can select existing Test Case, and add all of the Report Variants used into the current Test Run.
Copy Variants of Test Case - By clicking on the 'Copy Variants of Test Case' button (SHIFT + F12) you can select existing Test Case, and add all of the Report Variants used into the current Test Run as copies. 
Copy Variants - Please refer to 7.1.14 7.6.5 ("Copy Report Variants") section for function details.

Generate tasks for before image

To generate the tasks, you can double click to execute, this will prepares the tasks for the following step 'Create before images'.

Create before images

By double clicking on this step, you first define number of background jobs to be used to create the before image for each of the specified Report variants.

Generate tasks for after image

To generate the tasks, you can double click to execute, this will prepares the tasks for the following step 'Create after images'.

Create after images

You define the number of background jobs to be used in the creation of the after image of the specified Report variants.

Set Comparison settings

By double clicking on this step you can define some standard settings that should be used during comparison of reports output. 

_{Figure 214 Report comparison settings}

You can define:

1. Report comparator type – Validate comes by default with one report comparator (Simple Report Comparator) that compares output of report row by row. Or you can select your own comparator implementation to be used. To create your own BADI comparator you need to create implementation of Validate '/DVD/EQS_BADI_REP_COMP' BADI.
2. Ignore TimeStamps – Validate default report comparator is capable of ignoring time stamps in number of standard formats that often cause difference in output of reports as they are executed in different times.
3. Compare only table data – Validate default report comparator can ignore headers of standard reports and compare only actual table data saved in spool output of executed reports.

You save the specified compare setting by clicking on 'Enter' button.

Generate tasks for comparison

To generate the tasks, you can double click to execute, this will prepares the tasks for the following step 'Compare before and after images'.

Display of results

By clicking on this step you can review the output and comparison results of reports executed in steps before. There are some differences between report testing scenario and other scenarios, which are specified more in detail in section Reports Display Results.