(Glue-2102) Capturing of deleted entries

In addition to standard SAP table to Storage extraction, the SAP Table Fetcher with trigger delta can be set up to transfer also deleted records. These records will have only key field values filled in the target Glue table. If you want to distinguish them further, a deletion flag field can be added to the Glue table, which will have a value ‘D' filled for deleted records using rule ‘Delete flag’ in the Extraction Process transformation mapping. Please note, that deleted records are transferred after standard inserted/updated records. Because of this, the 'Deduplicate entries’ functionality might be useful. It will remove unnecessary deleted records - that means records with keys for which there was an insert/update operation after delete operation.

Additional steps to standard SAP table to Storage extraction

1. To add the deletion flag field, go to Glue Table and add the GLDELFLAG field using the button Add deletion flag. You can also add your own field, but in that case, the rule in the Extraction process won’t be assigned automatically.

    

   Open

   

    

2. In the SAP Table Fetcher, check the Read deleted entries checkbox and Deduplicate entries (optional, please note that deduplication might lower the performance significantly)

    

   Open

   

    

3. In the Extraction Process, the rule Delete flag should be assigned automatically using the Suggest transformation mapping button, if the default deletion flag field was used in step 1. Otherwise, select the rule manually.