(Glue-2311) Release Notes 2311

New Features

Kafka

SNP Glue now supports the ingestion of data to Kafka. The integration allows you to automatically create a topic derived from the source object name, send JSON serialized messages, and integrate with the Schema Registry.

Huawei OBS

SNP Glue can extract data to Huawei OBS storage. Huawei OBS is a scalable service that provides cloud storage for large volumes of data.

Improvements

Data Dictionary

• Fields tab in the Data Dictionary has been changed to make the insertion of custom fields to Glue tables easier and more intuitive.

Extractors

• The performance of the extraction process has been improved significantly.

• You can use Automatic data split, where the data is split automatically into data packages of the defined size. On top of that, the implementation of the Mass execution data split has been reworked to provide a better user experience.

Glue scheduler

• Glue scheduler now displays the Load mode of the last executed extraction. This information is available for Queue and Trigger scheduler type.

• A new Glue scheduler type Sequence has been introduced. The scheduler enables you to define the order of execution of individual extraction processes.
  Before the execution, processes are sorted based on the sequence number.
  First, processes with the lowest sequence number are launched. Processes with a higher sequence number are executed only after all the processes with a lower sequence are finished.

CDC

• There is a new option in the Trigger management, that allows you to specify advanced trigger settings like sequence cache, triggers lock timeout, etc.

• Sybase ASE DB triggers now support delta capture on cluster tables.

• With the new release, when creating a fetcher with trigger delta, the Read deleted entries checkbox is enabled by default.

General

• SNP Glue now provides a tool for displaying and filtering SAP application logs. Please refer to the documentation for more information.

• To improve the usability of the Object navigator, we have reordered the columns of the tree structure. Now, the Status column is displayed after the Object name column.

• SNP Glue cockpit has been reorganized. A separate Schedule section has been created. This provides information about running stream and batch configurations and enables you to navigate to the Glue scheduler.

Storage Management

• When connecting to ADLS Gen2 storage, you can now bypass the SAP ICM component and use SNP JCO instead.
  With the latest enhancement, SNP JCO supports also a configuration with an HTTP Proxy. Use the following link for more information.

• In data transfer to Azure SQL, the data sent to referenced BLOB storage can be accessed via System Assigned Managed Identity

• SNP Glue now creates transient tables in Snowflake instead of permanent ones.
  The benefit is that this approach decreases a footprint within Snowflake, and for high churn tables can significantly decrease costs for the Snowflake environment.

• The performance of the read operation from AWS Redshift has been improved dramatically.

Fixes

Extractors

• You could edit the merge parameters of an active consumer. This is no longer possible in the new version.

• BEx Query fetcher (BICS) has been corrected to properly handle scenarios that leverage customer-exit variables.

• You can now edit some of a fetcher’s parameters without reactivating any dependent objects.

• You can run delta extraction using Advanced DSO Fetcher even if there is an active request in the Advanced DSO.

CDC

• It was not possible to specify the lock wait timeout of the HANA database.

• In the previous release, there was a problem when inserting special characters into the MS SQL Database. This has been corrected and the functionality can now handle special characters as well.

Glue scheduler

• Glue scheduler logging has been improved.

• When scheduling a job, the Glue scheduler didn’t consider the Use alternative time zone checkbox in the scheduling dialog.