Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

For more information about the delta mechanism, please see (Glue-2008) Delta Mechanisms. This text provides a description how to set delta types. 

Access the delta mechanisms through the Delta Tools Image Modified.

Properties

Properties tab contains general information about the extractor and the delta details:

  • Delta type
  • Status - actual status of the extractor (Saved or Active)
  • Source - the name of the source view or table
  • Last extraction - date and time of the last extraction
  • Full load - indicates whether a full load was executed

The Properties section shows:

  • Truncate target table - if you select this checkbox, all data in the target table is deleted before new extraction .
  • Delta volume - number of records that will be extracted in the next load run and additional information which depends on a delta type, see below. Click Calculate to calculate the Delta volume.

Image Modified




















                                            Delta Tools - Properties tab

Properties section by the delta types:

  • Full mode

Image Modified


  • Trigger

Skip initial full load if this field is checked, the very first extraction will be the Trigger delta; full load isn't performed. Choose this option if you want to transport any changes to data (insert, update, delete), which will be performed after the activation of an extractor.

In the case of Trigger delta, records which are stored in shadow table are transported.

Shadow table - click Display to view a shadow table that is generated if the Trigger delta is used. The shadow table displays all the modifications performed on the source table since the last extraction.

Read deleted entries - if this field is checked, also deleted entries are transferred during extraction. Deleted entries have only key fields values, other fields are empty.








  • Date

Skip initial full load - if this field is checked, the very first extraction will not transport any data, but it will only initialize "Highest date" value. Choose this option if you don't want to transport any historical data, only actual  data that will be generated after initial delta run.

The first extraction sets up the Highest date to the current date.

Date field - name of a field that contains the date, based on which the extraction is executed

Highest date - value of the highest date of the last extraction







  • TMSTMP

Skip initial full load - if this field is checked, the very first extraction will not transport any data, but it will only initialize "Last timestamp" value. Choose this option if you don't want to transport any historical data, only actual data that will be generated after initial delta run.

The first extraction sets up the Last timestamp to the current timestamp.

Timestamp field - name of the field, based on which the extraction is executed

Last timestamp - value of the highest timestamp of the last extraction







  • Value

Value field - name of the field, based on which the extraction is executed

Skip initial full load if this field is checked, the very first extraction will not transport any data, but it will only initialize "Highest value". Choose this option if you don't want to transport any historical data, only actual data that will be generated after initial delta run.

Highest value - highest value of the chosen Value field of the last extraction.

Image RemovedImage Added






  • Distinct Value

Value field - name of the field, based on which the extraction is executed

Skip initial full load if this field is checked, the very first extraction will not transport any data, but it will only initialize distinct values for specified field. Choose this option if you don't want to transport any historical data, only actual data that will be generated after initial delta run.

Image RemovedImage Added



       

Manage

Switch to Manage to execute the extraction.

Common functionality for all deltas

First, select an existing variant. If only one variant is created, then Variant is automatically filled. In the case of more variants exist, choose one of them. For more information about variants, see (Glue-2008) Variant.

Click RUN and choose to:

  • Perform a full load or
  • Perform Immediate Delta run

Image RemovedImage Added















                         

                 

Additional manage actions by the delta types:

  • Date

Set delta date new delta value

Image Modified

  • TMSTMP

                Set delta timestamp - new delta value

...