(Glue-2005) "Heavy lifting" extraction

Owned by SNP
Jun 02, 2020
2 min read

"Heavy lifting" scenario can be useful when SAP Table to Storage scenario is not applicable due to constantly running processes on SAP table, which makes replication of huge amounts of data to external storage time-consuming. This may be e.g. extraction of large volumes of data from a SAP HANA system or from Advanced DSO. During the replication process, the source table is locked and all the operations are blocked. In case such a table is critical for other processes within the SAP system or customer doesn't want to post-pone BW reporting, the "Heavy lifting" extraction can be used.

This scenario incorporates additional step into SAP Table to Storage scenario, which saves the data from a SAP table first to a temporary place (FIFO cluster) at a minimal runtime and enables the extraction process to perform the further transfer to external storage regardless of other processes on a SAP system. 


Below, you can find a step by step manual of how to set up and execute the extraction of data between SAP Table to FIFO cluster to Storage.

  1. Transfer data from SAP Table to FIFO cluster
    1. Create SAP Table Fetcher
    2. Create (Glue-2005) FIFO Consumer
    3. Create (Glue-2005) Extraction Process
    4. Execute extraction

  2. Transfer data from FIFO cluster to Storage
    1. Create (Glue-2005) FIFO Fetcher
    2. Create a Glue Table
    3. Create Glue Table Consumer
    4. Create Extraction Process
    5. Execute extraction

When the extraction to storage is finished, the records from FIFO cluster are deleted automatically.