Page Comparison

ERP Report Test Case Execution

When an ERP Report Test Case is added to a Test Plan, then a new backend Test Run is automatically created and a Run ID is generated. The description holds the technical name of the Test Plan and the Test Case. All of the Report Variants selected during the creation of ERP Report Test Case are automatically added into Report Variant selection for the generated Test Run.

To execute an ERP Report Test Case from the Test Management click on Execute , which will display the standard ERP Report Testing scenario.

Report based testing

...

Report testing contains following steps:

1. Selecting Selection of Report Variants
2. Generation of before image tasks
3. Creation of before images
4. Performing specific task in the system outside Validate (like conversion, migration, etc.)
5. Generation of after image tasks
6. Specifcation Specification of  comparison settings
7. Generation of comparison tasks
8. Execution of comparison tasks
9. Display Displaying of results

Select Report Variants

By double clicking on the first Test Step Select Report Variants, you can define which Report variants are to be used in the specified Test Run for testing, or you can create new Report Variants. 
Once you have the variants selected for the Test Run, you need to save the selection by clicking on the button Save  (Ctrl + S) in the main screen of the Report variants selection.
You can add Report Variants in the following ways:

Create New Report Variant –  you – you can create new Report Variant by clicking on Create New Report Variant button (Shift + F4). For more information please refer to Create New Report Variant section . 
Add Existing Report Variant – you can display all of the existing Report variants in the system and by clicking on the Add Existing Report Variant button (SHIFT + F5), select one or more variants to be added into the Test Run. 
Add Report Variants of Run – by clicking on the Add Report Variants of Run button (SHIFT + F6), you can select another (distinct from current) run , and add all of the Report Variants used in this Test Run also into the current Test Run. 
Copy Report Variants of Run – by clicking on the Copy Report Variants of Run button (SHIFT + F8), you can select another (distinct from current) run , and add all of the Report Variants used in this Test Run also into the current Test Run as copies. 
Add Variants of Test Case – by clicking on the Add Variants of Test Case button (SHIFT + F11) you can select existing Test Case , and add all of the Report Variants used in this Test Case into the current Test Run.
Copy Variants of Test Case – by clicking on the Copy Variants of Test Case button (SHIFT + F12) you can select existing Test Case , and add all of the Report Variants used in this Test Case into the current Test Run as copies. 
Copy Variants – please refer to Copy Variants section for function details.

...

You can execute generation of tasks by double click clicking on generate step or selecting generate step and click on Execute  button. This will prepare the tasks for the following step Create before images.

...

You can execute generation of tasks by double click clicking on generate step or selecting generate step and click clicking on Execute  button. This will prepare the tasks for the following step Create after images.

...

1. Report comparator type – Datavard Validate comes by default with three report comparators.
   1. Simple Report Comparator compares the output of the report row by row so matching lines has have to be on in the same position. 
   2. Advanced Report Comparator searches for exact match of the row from Before Image in After Image rows independent of the position of the row.
   3. Report Comparator with Threshold compares each line of Before Image with each line of After Image and calculates their similarity. It evaluates if the line has a match according to the line similarity threshold with default value 1 which represents exact match. Overall similarity of reports is calculated as arithmetic mean of matched values.
   4. You can also select your own comparator implementation to be used. To create your own BADI comparator, you need to create implementation of Validate /DVD/EQS_BADI_REP_COMP BADI. See (DV-2002) ERP Report - BADI comparator page for more information.
2. Ignore TimeStamps – Datavard Validate default report comparator is capable of ignoring time stamps in number of standard formats that often cause the difference in the output of reports as they are executed in different times.
3. Compare only table data – Datavard Validate default report comparator can ignore headers of standard reports and compare only actual table data saved in the spool output of executed reports.
4. Use predefined mapping – Datavard Validate default report comparator can use predefined content to match some of known differencies differences in standard report outputs caused by different versions of a SAP system. Available only with Advanced report comparator.
5. Line similarity threshold - available only with Report Comparator with Threshold. It sets the threshold to evaluate minimal similarity of the line from before image to any line from after image to consider it as a matched line. Valid input is a float value of the range from 0 to 1. Default value is 1 which means exact match of lines.
6. Report similarity threshold - available only with Report Comparator with Threshold. It sets the threshold to evaluate minimal similarity of report outputs to consider them as identical. Valid input is a float value of the range from 0 to 1. Default value is 1 which means exact match of report outputs.

Specified compare settings are automatically saved when you leave the screen.

Generate tasks for comparison

You can execute generation of tasks by double click clicking on generate step or selecting generate step and click clicking on Execute  button. This will prepare the tasks for the following step Compare before and after images.

...

Display of results

By clicking on this step, you can review the output and comparison results of reports executed in previous steps before. There are some differences between the report testing scenario and other scenarios, which are specified in more details in detail in the section Reports Display Results.