(Glue-2408) Glue Queue

Owned by SNP
Aug 20, 2024
4 min read

The SNP GlueTM Queue object stores data in a cluster table (same for all queues) in byte-string form. This enables saving data from the source in the fastest way possible. Later on, this data can be read using one or multiple SNP Glue™ Queue Fetcher.

Creation of SNP Glue™ Queue

  1. Run the transaction /DVD/GL80 to open Object Navigator.

  2. In the context menu of the desired package, select the option Create SNP GlueTM Queue.

  3. Enter the name of the new queue in the queue name.

  4. Confirm the popup.

Activation of SNP Glue™ Queue

After creation, the object is in its saved state. For activation, all mandatory inputs need to be filled in.

  • SNP GlueTM Table Structure:

The SNP GlueTM Queue is not supported with meaningful fields set in the SNP GlueTM table.

  • DDIC structure:

    • Queue structure based on DDIC structure

    • Provided with F4 help.

Queue Subscribers

A queue subscriber is an active Queue Fetcher pointing to an existing queue. The queue can have an unlimited number of subscribers, and each one can push data to different Consumers.

With this approach, it is possible to replicate the same data to multiple destinations.

 

Active queue subscribers are visible on the main queue object screen.

Queue content preview is available after clicking on Show content in the application toolbar.

Cleanup

The queue is cleared once all data has been successfully transferred to target storage (in the case of multiple subscribers, every subscriber must transfer all data from the queue), and at the same time, there are no filling Extraction processes for the queue running.

In some cases, the SNP GlueTM queue can collect duplicates during transport.
since the SNP GlueTM queue can contain duplicates. If your target storage type is Azure SQL,

Queue Overview

You can open Queue Overview from SNP Glue™ Cockpit (transaction/DVDGlueTM/GLUE) by clicking on the overview icon (Shift+F11) or via the menu bar Tools > Glue utilities > Queue overview. You can also do it simply by running the transaction /DVD/GL_Q_OVERVIEW.

After accessing the queue overview, a filter for queues comes up where you can specify your selection based on the following fields: 

  • Queue name: Name of the Queue object.

  • Package: Name of the package which should contain Queue objects.

  • User name: Name of the user who created the Queue objects.

  • Maximum No. of Hits: Maximum number of records displayed.

After clicking on the Execute button, the Queue Overview displays all queues according to the selection.

Above the selected queues, some additional information is displayed: Number of queues and ClustIDs older than (h/d/w/m).

Calculate

The list of queues contains seven columns with uncalculated values (Subscribers, Packages, Size (MB), Age > 1h, Age > 1d, Age > 1w, Age > 1m). For the calculation of the values, it is necessary to first mark all desired rows and click on the button Calculate to list the toolbar.

After the calculation:

  • The list of the Queues will provide additional information about selected Queues.

  • Number of Queues will provide information about the number of Queues used for the previous calculation.

  • ClustIDs older than (h/d/w/m) will provide information about the number of cluster IDs stored in the Queue for different periods of time.