(Glue-2111) Glue Queue Consumer

Owned by SNP
Nov 22, 2021
1 min read

 

Glue Queue Consumer stores data in a Queue object cluster table in a byte string form. This enables to save data from the source in the fastest way. Later on, this data can be read using the Glue Queue Fetcher. For more information about the use of Queue Consumer, check the "Heavy lifting" extraction in common scenarios.

Creation of Glue Queue Consumer

Perform steps outlined in How to Create a Consumer Object with the option Glue Queue Consumer under the Component implementation dropdown of step 4.

Activation of Glue Queue Consumer

After creation, the object is in the saved state. For activation, all mandatory inputs need to be filled in.

  • Glue Queue objects

    • name of the Queue object from which we are going to read data

    • provided with F4 help

Glue Queue

Upon execution of an extraction process, the data is written to the Queue cluster table.

Merge operation

Some types of tabular storages support inserting the “delta data” using the merge operation.