(GLUE-1902) SAP Table to Storage Extractor
You can use SAP Table to Storage extractor to transfer structured data from a SAP table to an external storage (for example to Hadoop).
To create SAP Table to Storage extractor follow these steps:
- Go to Glue Extractor Workbench
- Right-click on SAP Table to Storage, select Create Extractor
- Specify following parameters:
- Extractor name - enter a technical name of the extractor
- Description
- Extractor type - this value is predefined, but you can change it using a simple drop-down menu.
- Source table - defines a source SAP (DDIC) table or a view from which data is transferred.
- Target table - target external (Hadoop) table
4. Specify a Package
5. Define a Delta Type to specify which data should be extracted and ensure data synchronization.
Following types are supported:
- FULL - Standard full load. Data is transferred and appended to the target table.
- VALUE - Value based delta load. Only entries with new distinct values are transferred during the next execution of the extractor.
- DATE - Date based delta load. In the first run, all the data with a date older than the current date is transferred. In the following extractor runs, only data with a date newer than the latest date and older than current date is transferred.
- TMSTMP - Timestamp based delta. In the first run, all data is transferred. In the following extractor runs, only data with a timestamp greater than the latest timestamp from the previous run is transferred.
- TRIGGER - Trigger based delta.
See the the chapter Delta mechanisms for more information.
6. Fieldname Mapping is automatically generated.
Field mapping of the extractor is used to map fields of a source table to fields of a target table.
When target and source tables contain fields with the same names, they are linked automatically. If these field names are not the same, you must fill them manually. Please note, that all key fields of source table must be included.
Field mapping also contains settings for transfer rules. For more information click here.
The Selection column in the Fieldname Mapping table is used to select fields, which are used for filtering (selection) of data by the variant definition. More information can be found in the part Variant Selection.
Please note: Maximum number of selected fields is 100.
7. Before you use an extractor, save it and activate it. In the case you activate an unsaved extractor, it is saved automatically before activation.
8. The next step is to create a (GLUE-1902) Variant.