(Glue 2402) SNP Glue™ Settings

SNP Glue™ Main Settings

Once the transaction /DVD/GL_SETT is executed, the screen with SNP Glue™ Main Settings will be opened and the following settings will be displayed:

File (Binary) storage settings 

This category of settings enables you to set up parameters for extraction to file storages like Microsoft Azure, GCP (Google Cloud Platform) and BigQuery, AWS S3, Hadoop or others.

• ALLOW_ZEROS: Allow glrequest to have leading zeros in filename. Input value: X = enabled. Default value: ''.
• BIN_DATA_FILE: Binary data file name. Input value: file name with placeholders. Supported placeholders are listed below. Default value: <GLUE_TABNAME>_<GLUE_REQUEST>. It is possible to create subfolders for example <LOAD_TYPE>/<GLUE_REQUEST>. This feature is not supported for BINFILE and Google cloud storage.
• BIN_EMPTY_LOAD_DATA_FILE: Indicates whether the (empty) data file should be generated for loads that contain no data e.g., empty delta load. Set the value = X in order to allow empty data files to transfer. 
• BIN_EMPTY_LOAD_METADATA: Indicates whether the metadata JSON file should be generated for loads that contain no data e.g., empty delta load. Set the value = X in order to allow the generation of metadata files for these loads.
• BIN_REQUEST_METADATA_FILE: Binary request metadata file name. Input value: file name with placeholders. Supported placeholders are listed below. Default value: <GLUE_TABNAME>_<GLUE_REQUEST>.
• BIN_TABLE_METADATA_FILE: Binary table metadata file name. Input value: file name with placeholders. Supported placeholders are listed below. Default value: <GLUE_TABNAME>_<TIMESTAMP>.
• SEL_DEL_FILE_NAME: Name of the files created by soft selective deletion. Input value: file name with placeholders. Supported placeholders are listed below. Default value:  <GLUE_TABNAME>_<GLUE_REQUEST>_SEL_DEL.
• DELTA_LAKE_REPEAT: Number of the table lock attempts during delta lake JSON creation.
• DELTA_LAKE_REPEAT_DELAY: Number of seconds to wait between locking attempts during delta lake JSON creation.

If an unsupported placeholder is used, a warning message is displayed.

• MASS_APPEND_PART_VALUE - Mass Execution: Append partitioning value to the filename: If set to X, the value used to split data into partitions via (Glue 2402) Mass Execution functionality is appended at the end of the filename. 

  This functionality uses only the first value of the select option and handles just single values and intervals. Therefore, we do not recommend using it in case the complex select-option values are expected for the partitioning field. 

Extractor 2.0 settings

Category of settings related to Extractor 2.0 objects. For more information about the Extractor 2.0 concept refer to the documentation (Glue 2402) Extractor 2.0 Objects.

• ALLOW_DELTA_DURING_FULL_LOAD: Allows execution of delta load when repair full load (without delta init) is running. Input value: X = enabled. Default value: space.
• EXT2_CUSTOM_LIB_INCL: Custom libraries include in Extractor 2.0. Input value: name of INCLUDE. Default value: space. In order to specify more than one include, use the semicolon (';') as a separator, e.g. ZDVD_INCLUDE1;ZDVD_INCLUDE2;ZDVD_INCLUDE3.
• EXT2_DEF_START_RT_CODE: Default start routine code in Extractor 2.0. Input value: ABAP code. Default value: space.
• EXT2_DEF_END_RT_CODE: Default end routine code in Extractor 2.0. Input value: ABAP code. Default value: space.
• ENABLE_DATA_VALIDATION: Displays the Data Validation checkbox in Extraction Process reports, which use SNP Glue™ Consumers. When the checkbox is checked, data extracted to the storage will be verified with the source data using the XOR hash function. Based on the type of target storage the data will be either verified by packages after every write operation or at the end of the extraction. Input value: X = enabled. Default value: space.
  Please note, that while this will prove that the load was successful and consistent, it will also slow down the data extraction process.
• EXT2_ENHANCED_LOGS: Enhanced logging messages for Extractor 2.0 objects when marked. Input value: X = enabled. Default value: space.
• SAP_FETCHER_READ_ALL_CLIENTS: Enables Read all clients functionality for SAP Table Fetcher.  Input value: X = enabled. Default value: space.

FIFO settings

Category of settings related to FIFO object types.

• FIFO_CLUSTER_CALC_INTERVAL: Interval in minutes after which the recalculation of cluster size will be executed. Default value: 30.  
• FIFO_CLUSTER_MAX_SIZE: Maximum size of the cluster in GB. Default value: 1. To turn off the functionality use value: 0.
• FIFO_CONFIRM_ATTEMPTS_NUM: Number of attempts to acquire the lock for FIFO Confirmation. Default value: 1200.
• FIFO_CONFIRM_WAITING_TIME: Waiting time for FIFO Confirmation to acquire the lock again. Default value: 0.4.
• FIFO_CONSUMER_ATTEMPTS_NUM: Number of attempts to acquire the lock for FIFO Consumer. Input value: Integer. Default value: 600.
• FIFO_CONSUMER_WAITING_TIME: Waiting time for FIFO Consumer to acquire the lock again. Input value: Decimal number. Default value: 0.2
• FIFO_FETCHER_ATTEMPTS_NUM: Number of attempts to acquire the lock. Input value: Integer. Default value: 300.
• FIFO_FETCHER_WAITING_TIME: Waiting time for FIFO Fetcher to acquire the lock again. Input value: Decimal number. Default value: 2
• FIFO_FETCHER_COMMIT_BATCH_SIZE: Batch size to process queue CLUIDs in Fetcher commit phase. Input value: Integer. Default value: 1000

Other settings

• ALLOW_BIN_DEL: Allows data deletion. Input value: X = allow. Default value: space.
• ALLOW_BIN_DELETION: (Obsolete setting)  Allows data deletion from the binary storage. Input value: X = allow. Default value: space.
• BIN_DF: Binary data file name. Input value: file name with placeholders. Default value: <GLUE_TABNAME>_<GLUE_REQUEST>. Supported placeholders: <TIMESTAMP>, <DATE>, <USERNAME>, <GLUE_TABNAME>,<GLUE_REQUEST>, <GLUE_CR_DATE>, <GLUE_CR_TIME>, <STORAGE_ID>, <EXTRACTION_TIMESTAMP>, <EXTRACTION_DATE>, <LOAD_TYPE>,
• BIN_EMPTY_LF: Generates CSV data file for empty load. Input value: X - generate CSV data file. Default value: space
• BIN_EMPTY_LM: Generates JSON metadata file for empty load. Default value: X - generate JSON metadata file.
• BIN_REQUEST_MF: Request metadata file name. Input value: file name with placeholders. Default value: <GLUE_TABNAME>_<GLUE_REQUEST>. Supported placeholders: <TIMESTAMP>, <DATE>, <USERNAME>, <GLUE_TABNAME>,<GLUE_REQUEST>, <GLUE_CR_DATE>, <GLUE_CR_TIME>, <STORAGE_ID>, <EXTRACTION_TIMESTAMP>, <EXTRACTION_DATE>.
• BIN_TABLE_MF: Table metadata file name. Input value: file name with placeholders. Default value: <GLUE_TABNAME>_<TIMESTAMP> Supported placeholders: <TIMESTAMP>, <DATE>, <USERNAME>, <GLUE_TABNAME> <GLUE_REQUEST>, <GLUE_CR_DATE>, <GLUE_CR_TIME>, <STORAGE_ID>, <EXTRACTION_TIMESTAMP>, <EXTRACTION_DATE> .
• DEFAULT_DATE_FORMAT: Default date format used within Date format business function defined in the SNP Glue™ extraction process e.g., DD/MMM/YYYY. This parameter is used in action Apply date format function and can be overwritten manually. Default value: space.
• DEFAULT_TIME_FORMAT: Default time format used within the Time format business function defined in the SNP Glue™ extraction process e.g., HH:MM:SS. This parameter is used in action Apply time format function and can be overwritten manually. Default value: space.
• ENABLE_BO_BROWSER: Enables Business Objects browser. Input value: X = enabled. Default value: X.
• ENABLE_GL80_FOLDERS: Enable folders in Object tree in (Glue 2402) Object Navigator. Input value: X = enabled. Default value: space.
• ENABLE_LOGICAL_GL80_FOLDERS: Enables Logical folders in Object navigator tree. Input value: X = enabled. Default value: space.
• ENHANCEMENT_ID: Enhancement ID used in Dynamic Selection using BAdi. Input value: name for enhancement ID. Default value: space.
• EXTEND_ESCAPING: Option for replacing escape characters(such as newline, backspace, tabulator, etc. ) by the 'space' character. Use when your data contain escape characters. Customization can be done in table '/DVD/RL_EXT_ESC'. A default set of values can be filled by transaction '/DVD/RL_DEFAULT_ESC'.
• MASS_APPEND_PART_V - Mass Execution: Append partitioning value to the filename: If set to X, the value used to split data into partitions via (Glue 2402) Mass Execution functionality is appended at the end of the filename. 
• ROLLNAME_REPLACEMENT_DATE: Data element used to replace original data elements with technical type d. In case you wish to use date format function, the replacement needs to be character-like and compatible with your date format. E.g., date format DD/MMM/YYYY requires at least 11 characters. The data elements are replaced while importing fields to the SNP Glue™ table and can be manually overwritten. However, invalid data types might lead to extraction failure. Default value: space.
• ROLLNAME_REPLACEMENT_TIME: Data element used to replace original data elements with technical type t. In case you wish to use time format function, the replacement needs to be character-like and compatible with your time format. E.g., time format HH:MM:SS requires at least 8 characters. The data elements are replaced while importing fields to the SNP Glue™ table and can be manually overwritten. However, invalid data types might lead to extraction failure. Default value: space.
• S_DEL_FILE_NAME: Name of files created by soft selective deletion. Input value: file name with placeholders. Supported placeholders: <TIMESTAMP>, <DATE>, <USERNAME>, <GLUE_TABNAME>, <GLUE_REQUEST>, <GLUE_CR_DATE>, <GLUE_CR_TIME>, <STORAGE_ID>, <EXTRACTION_TIMESTAMP>, <EXTRACTION_DATE>, <LOAD_TYPE>.
• TRG_BUFFER_PROCESSED_RECORDS: Enables buffering of processed records during trigger delta extraction, for them to be used for clearing the shadow table at the end of the extraction
• TRG_PR_BUFFER_SIZE: Number of rows of processed records during trigger delta extraction to be stored in memory, before the buffer contents are stored in the database
• TRG_TIMESTAMP_OFFSET: Offset in seconds to add to the current timestamp during trigger delta extraction, records from the shadow table are read up to this timestamp

SNP Glue™ Expert Settings

You can open SNP Glue™ Expert Settings from the SNP Glue™ Main Settings (transaction /DVD/GL_SETT) by clicking on Expert settings, as shown in the screenshot below, or by running the transaction /DVD/GL_SETT_EXPERT.

Once the transaction /DVD/GL_SETT_EXPERT is executed, the screen with SNP Glue™ Expert Settings will be opened and the following settings will be displayed:

Customizing settings

• ALLOW_DELETE_GLREQUEST: Allows you to delete a field GLREQUEST from the SNP Glue™ table in SNP Glue™ Data Dictionary. Input value: X = enabled. Default value: space.
• ALLOW_DELTA_VALUE_RESET: Adds an option in Delta Tools pop-up to overwrite last delta value for extractor delta types DATE, TMSTMP and NUM_RNG. Input value: X = enabled. Default value: space.
• ALLOW_TRIGGER_OPERATIONS: Adds a trigger status option in Delta Tools pop-up to and option to Enable/Disable trigger for extractors with delta type TRIGGER. Input value: X = enabled. Default value: space.
• AUTH_CHECK_MODIFIABLE: Allows you to create, edit, and delete the functionality of SNP Glue™ object when SNP Glue™ variants are forbidden for systems that are not modifiable (based on the field CCNOCLIIND from table T000). Input value: X = enabled. Default value: X.

SNP Glue™ authorization objects settings

These settings allow you to turn on/off authentication checks for SNP Glue™/SAP objects.

• AUTH_OBJ_GLUE: Enables the authentication for auth. object - GLUE. Input value: X = enabled. Default value: space.
• AUTH_OBJ_GL_OBJ: Enables the authentication for auth. object - GL_OBJ. Input value: X = enabled. Default value: space.
• AUTH_OBJ_SAP: Enables the authentication for auth. object - SAP. Input value: X = enabled. Default value: space.
• AUTH_OBJ_SAP_CUBE: Enables the authentication for auth. object - SAP_CUBE. Input value: X = enabled. Default value: space.
• AUTH_OBJ_SAP_ODS: Enables the authentication for auth. object - SAP_ODS. Input value: X = enabled. Default value: space.
• AUTH_OBJ_STOR: Enables the authentication for auth. object - STOR. Input value: X = enabled. Default value: space.

Transporting settings

In order to transport SNP Glue™ settings into a target system, you need to perform actions within the transaction /DVD/GLTR. More information can be found in the chapter Standard transport.

Display history

All changes made in transactions /DVD/GL_SETT and /DVD/GL_SETT_EXPERT are saved and can be accessed by clicking on Display History, as shown in the screenshot below.

SNP Glue™ Profile Settings

SNP Glue™ Profile Settings can be accessed by clicking on Profile settings in the toolbar.