(DV-2002) Table Execution & Backend testing

Owned by SNP
Last updated: Mar 13, 2020 by Marian Vidra

Table Test Case Execution

When a Table Test Case is added to the Test Plan a new backend Test Run is automatically created and a Run ID is generated. The description holds the technical name of the Test Plan and the Test Case. All Table Variants selected during creation of Table Test Case are automatically added into the Table Variant selection for generated Test Run.
To execute a Table Test Case from Test Management, click on  'Execute' and the standard Table Testing scenario is displayed. Please refer to 8.5.1 ('Test Scenario EQS_TABLE (Table testing)') section for more detailed description about each scenario step.

Table based backend testing

Table based testing uses data directly from the database tables. Based on specifications set by the user, the table columns are read from the database table and are used to create before and after image. These images are then compared.
Recommendations:

  • For one Table testing run a maximum of 1000 Table variants should be used.

Test Scenario EQS_TABLE (Table testing)



Figure 212 Table Testing Scenario


Table testing contains following steps:

  1. Selecting of Table Variants
  2. Generating of before image tasks
  3. Creating of before images
  4. Performing of specific tasks in the system outside Validate (like conversion, migration, etc.)
  5. Generating of after image tasks
  6. Creating of after images
  7. Generating of comparison tasks
  8. Executing of comparison tasks
  9. Displaying of results

Select Table Variants

By double clicking on the first Test Step 'Select Table Variants', you can define which Table variants are to be used in this Test Run for testing, or you can simply create new Table variants.
Once you have the variants selected for the Test Run, you need to save the selection by clicking on the 'Save' button (Ctrl + S) in the main screen of the Table variants selection.
You can add Table Variants in the following ways:


Create New Table Variant – You can create new Table Variant by clicking on 'Create New Table Variant' button (Shift + F1). For more information please refer to Create new Table Variant chapter. 
Add Existing Table Variant – You can display all existing Table variants in the system by clicking on the 'Add Existing Table Variant' button (Shift + F2). You can then select one or more variants to be added into this Test Run. 
Add Table Variants of Run – By clicking on the 'Add Table Variants of Run' button (Shift + F4), you can select another (distinct from current) run and add all Table Variants of selected run into the current Test Run. 
Copy Table Variants of Run – By clicking on the 'Copy Table Variants of Run' button (Shift + F8), you can select another (distinct from current) run and add all Table Variants of selected run into the current Test Run as copies. 
Add Variants of Test Case – By clicking on the 'Add Variants of Test Case' button (Shift + F11), you can select an existing Test Case and add all Table Variants of selected Test Case into the current Test Run.
Copy Variants of Test Case – By clicking on the 'Copy Variants of Test Case' button (Shift + F12), you can select an existing Test Case and add all Table Variants of selected Test Case into the current Test Run as copies. 
Copy Variants – Please refer to 'Copy Table Variants' section for function details.

Generate tasks for before image

To generate tasks, you can double click the Test Step 'Generate tasks for before image' to execute it. This will prepare all tasks for the following step 'Create before images'.

Create before images

By double clicking on this step, you first define the number of background jobs to be used to create before image for each of the specified Table variants. The Image creation of some Table variants can fail due to too many rows read. This is a safety limit and can be adjusted by changing the setting 'Max. Table image row size'. See Settings section for more details on how to change this setting. 
Validate is capable of handling numeric aggregation overflows. Automatic overflow handling is executed when 'Table own aggregation' setting is set to 'X' and aggregation of results fails because of numeric overflow. In cases of a problematic overflowing, the key figure is set to 0 for all returned rows. And in cases of multiple overflowing key figures these will be set to 0. Overflow handling is always logged. This feature enables you to create images for Tables that normally wouldn't be possible because of an overflow error on DB level. DB aggregation is always preferred for performance reasons and own aggregation should be used for handling special situations.

Generate tasks for after image

To generate tasks, you can double click the Test Step 'Generate tasks for the after image' to execute it. This will prepare all tasks for the following step 'Create after images'.

Create after images

By double clicking on this step, you first define number of background jobs to be used to create the before image for each of the specified Table variants. The Image creation of some Table variants can fail due to too many rows being read. A limit can be set/ adjusted by changing the setting 'Max. Table image row size'. See Settings section for more details on how to change this setting. 
Validate is capable of handling numeric aggregation overflows. Automatic overflow handling is executed when 'Table own aggregation' setting is set to 'X' and aggregation of results fails because of numeric overflow. In cases of a problematic overflowing the key figure is set to 0 for all returned rows. In cases of multiple overflowing key figures these will be set to 0. Overflow handling is always logged. This feature enables you to create images for Tables that normally would not be possible because of an overflow error on DB level. DB aggregation is always preferred for performance reasons and own aggregation should be used for handling special situations.

Generate tasks for comparison

To generate the tasks, you can double click the Test Step 'Generate tasks for comparison' to execute it. This will prepare all tasks for the following step 'Compare before and after images'.

Compare before and after images

You define the number of background jobs to be used for tasks execution. Each of the tasks compares before image data with after image data for one Table Variant, please refer to the (Comparison logic) chapter.

Display results

You can view the outputs and their comparison results for Table Variants executions, please refer to ('Results overview') chapter.