(Glue-2411) Migration Report for Delta Watchdogs and Extraction Scheduler

Owned by SNP
Nov 20, 2024
5 min read

The primary purpose of the migration report is to minimize the effort for transferring processes and their configuration from outdated Delta watchdogs and Extraction schedulers to the new Glue Scheduler. The report can be found in Glue cockpit (/DVD/GLUE) in Tools > Glue utilities > Watchdog migration.

Migration report in Glue cockpit

 

 Supported types of watchdogs:

  • Trigger watchdog

  • Queue watchdog

  • Extraction scheduler

Configuration is transferred only when a new Glue scheduler is created. The existing scheduler is not affected.

Processes that were deleted after they had been added to the delta watchdog or extraction scheduler are skipped.

Transferring trigger watchdogs

Trigger delta watchdogs can be found in the Glue watchdog cockpit in the first 3 tabs.

Trigger watchdogs

Configuration migration

The configuration is transferred in the following scope (only when a new Glue scheduler is created):

  • Maximum number of jobs.

  • Max jobs used for full loads: Constant 50%.

  • Execution type: If the check period was in seconds, the type is Stream, otherwise Batch.

Migration step list:

  1. Open the migration tool.

  2. Select Watchdog type. The first 3 rows of search help are trigger watchdogs.

  3. Choose Select existing Glue scheduler or Create new Glue scheduler.

    1. Select existing Glue scheduler copies data of the selected watchdog to the existing Glue scheduler. In this case, it’s possible to select only the scheduler with the type trigger.

    2. Create new Glue scheduler creates new Glue scheduler with a type trigger.

  4. Run the report.

  5. After the tool is launched, status messages are displayed.

Transferring queue watchdogs

Queue delta watchdogs can be found in the Glue watchdog cockpit in the second 3 tabs.

Queue watchdogs

Configuration migration

The configuration is transferred in the following scope (only when a new Glue scheduler is created):

  • Package size

  • Allow parallelization

  • Maximum number of jobs

  • Max jobs used for full loads: Constant 50%.

  • Execution type: If the check period was in seconds, the type is set to Stream, otherwise type is set to Batch.

Migration step list:

  1. Open the migration tool.

  2. Select Watchdog type. The second 3 rows of search help are queue watchdogs.

  3. Choose Select existing Glue scheduler or Create new Glue scheduler.

    1. Select existing Glue scheduler copies data of selected watchdog to existing Glue scheduler. In this case, it’s possible to select only the scheduler with a type queue.

    2. Create new Glue scheduler creates new Glue scheduler with a type queue.

  4. Run the report.

  5. After the tool is launched, status messages are displayed.

Transferring Glue extraction scheduler

Glue extraction scheduler can be found in Glue Cockpit > Tools > Glue utilities > Extraction scheduler.

Extraction scheduler

 

The extraction processes scheduled for extraction are saved in variants.

Variants in the Extraction scheduler

 

Be aware that only extraction processes type Ext2 can be transferred. Processes with type Ext are skipped.

Configuration migration

The configuration is transferred in the following scope (only when a new Glue scheduler is created):

  • Maximum number of jobs

  • Load type

Migration step list:

  1. Open the migration tool.

  2. Select Watchdog type. The last row of search help is the Extraction scheduler.

  3. After choosing the Extraction scheduler it is necessary to hit Enter and the variant input field will be displayed.

  4. Select variant. Only variants containing at least one Ext2 extraction process are shown.

  5. Choose Select existing Glue scheduler or Create new Glue scheduler.

    1. Select existing Glue scheduler copies data of selected variant of extraction scheduler to existing Glue scheduler. It’s possible to choose only a scheduler with type ext2.

    2. Create new Glue scheduler creates new Glue scheduler with type ext2.

  6. Run the report. Only extraction processes type Ext2 are transferred.

  7. After the tool is launched, status messages are displayed.

Step list after transferring.

  1. Open Glue Scheduler. It can be found in the Glue cockpit.

  2. Setup/check created/filled scheduler properties based on preferred settings.

  3. Stop the previously used watchdog and start the Glue scheduler.