(Glue-2011) How To Set Delta Types

Owned by SNP
Last updated: Dec 15, 2020 by Marian Vidra
4 min read

For more information about the delta mechanism, please see the chapter (Glue-2011) Delta Mechanisms. This text provides a description of how to set delta types. 

Access the delta mechanisms through the Delta Tools .

Properties

Properties tab contains general information about the extractor and the delta details:

  • Delta type
  • Status - actual status of the extractor (Saved or Active)
  • Source - the name of the source view or table
  • Last extraction - date and time of the last extraction
  • Full load - indicates whether a full load was executed

The Properties section shows:

  • Truncate target table - if you select this checkbox, all data in the target table is deleted before new extraction .
  • Delta volume - number of records that will be extracted in the next load run and additional information which depends on a delta type, see below. Click Calculate to calculate the Delta volume.

Delta Tools - Properties tab

Properties section by the delta types:

  • Full mode


  • Trigger

Skip initial full load - if this field is checked, the very first extraction will be the Trigger delta; full load isn't performed. Choose this option if you want to transport any changes to data (insert, update, delete), which will be performed after the activation of an extractor.

In the case of Trigger delta, records which are stored in shadow table are transported.

Shadow table - click Display to view a shadow table that is generated if the Trigger delta is used. The shadow table displays all the modifications performed on the source table since the last extraction.

Read deleted entries - if this field is checked, also deleted entries are transferred during extraction. Deleted entries have only key fields values, other fields are empty.


  • Date

Skip initial full load - if this field is checked, the very first extraction will not transport any data, but it will only initialize the "Highest date" value. Choose this option if you don't want to transport any historical data, only actual data that will be generated after the initial delta run.

The first extraction sets up the Highest date to the current date.

Date field - name of a field that contains the date, based on which the extraction is executed

Highest date - value of the highest date of the last extraction


  • TMSTMP

Skip initial full load - if this field is checked, the very first extraction will not transport any data, but it will only initialize the "Last timestamp" value. Choose this option if you don't want to transport any historical data, only actual data that will be generated after the initial delta run.

The first extraction sets up the Last timestamp to the current timestamp.

Timestamp field - name of the field, based on which the extraction is executed

Last timestamp - value of the highest timestamp of the last extraction


  • Value

Value field - name of the field, based on which the extraction is executed

Skip initial full load - if this field is checked, the very first extraction will not transport any data, but it will only initialize "Highest value". Choose this option if you don't want to transport any historical data, only actual data that will be generated after the initial delta run.

Highest value - the highest value of the chosen Value field of the last extraction.


  • Distinct Value

Value field - name of the field, based on which the extraction is executed

Skip initial full load - if this field is checked, the very first extraction will not transport any data, but it will only initialize distinct values for a specified field. Choose this option if you don't want to transport any historical data, only actual data that will be generated after the initial delta run.


Manage

Switch to Manage to execute the extraction.

Common functionality for all deltas

First, select an existing variant. If only one variant is created, then Variant is automatically filled. In the case more variants exist, choose one of them. For more information about variants, see the chapter (Glue-2011) Variant.

Click RUN and choose to:

  • Perform a full load or
  • Perform Immediate Delta run

                      

Additional manage actions by the delta types:

  • Date

Set delta date - new delta value

  • TMSTMP

                Set delta timestamp - new delta value

                     

  • Value

                Set delta numeric value - new delta value

                

  • Distinct value

                Reset delta value - button for delta value reset