Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 14 Next »

New Features

Kafka

SNP Glue now supports the ingestion of data to Kafka. The integration allows you to automatically create a topic derived from the source object name, send JSON serialized messages, and integrate with the Schema Registry.

The connectivity has been tested with Confluent Kafka and Apache Kafka, but it should be compatible with any Kafka distribution or Kafka-compatible API.

Huawei OBS

SNP Glue can extract data to Huawei OBS storage. Huawei OBS is a scalable service that provides cloud storage for large volumes of data.

Improvements

Data Dictionary

  • Fields tab in the Data Dictionary has been changed to make the insertion of custom fields to Glue tables easier and more intuitive.

Extractors

  • The performance of the extraction process has been improved significantly.

  • You can use Automatic data split, where the data is split automatically into data packages of the defined size. On top of that, the implementation of the Mass execution data split has been reworked to provide a better user experience.

Glue scheduler

  • Glue scheduler now displays the Load mode of the last executed extraction. This information is available for Queue and Trigger scheduler type.

  • A new Glue scheduler type Sequence has been introduced. The scheduler enables you to define the order of execution of individual extraction processes.
    Before the execution, processes are sorted based on the sequence number.
    First, processes with the lowest sequence number are launched. Processes with a higher sequence number are executed only after all the processes with a lower sequence are finished.

A Glue Scheduler is a tool for scheduling Glue extractions and a central place for scheduling and management of all the replication jobs.
This tool replaces existing Trigger and Queue watchdogs and Extraction Scheduler. These will be deprecated after the 24.02 release

CDC

  • There is a new option in the Trigger management, that allows you to specify advanced trigger settings like sequence cache, triggers lock timeout, etc.

  • Sybase ASE DB triggers now support delta capture on cluster tables.

  • With the new release, when creating a fetcher with trigger delta, the Read deleted entries checkbox is enabled by default.

General

  • SNP Glue now provides a tool for displaying and filtering SAP application logs. Please refer to the documentation for more information.

  • To improve the usability of the Object navigator, we have reordered the columns of the tree structure. Now, the Status column is displayed after the Object name column.

  • SNP Glue cockpit has been reorganized. A separate Schedule section has been created. This provides information about running stream and batch configurations and enables you to navigate to the Glue scheduler.

Storage Management

  • When connecting to ADLS Gen2 storage, you can now bypass the SAP ICM component and use SNP JCO instead.
    With the latest enhancement, SNP JCO supports also a configuration with an HTTP Proxy. Use the following /wiki/spaces/ReuseLib/pages/1580793888for more information.

  • In data transfer to Azure SQL, the data sent to referenced BLOB storage can be accessed via System Assigned Managed Identity

  • SNP Glue now creates transient tables in Snowflake instead of permanent ones.
    The benefit is that this approach decreases a footprint within Snowflake, and for high churn tables can significantly decrease costs for the Snowflake environment.

  • The performance of the read operation from AWS Redshift has been improved dramatically.

Fixes

Extractors

  • You could edit the merge parameters of an active consumer. This is no longer possible in the new version.

  • BEx Query fetcher (BICS) has been corrected to properly handle scenarios that leverage customer-exit variables.

  • You can now edit some of a fetcher’s parameters without reactivating any dependent objects.

  • You can run delta extraction using Advanced DSO Fetcher even if there is an active request in the Advanced DSO.

CDC

  • It was not possible to specify the lock wait timeout of the HANA database.

  • In the previous release, there was a problem when inserting special characters into the MS SQL Database. This has been corrected and the functionality can now handle special characters as well.

Glue scheduler

  • Glue scheduler logging has been improved.

  • When scheduling a job, the Glue scheduler didn’t consider the Use alternative time zone checkbox in the scheduling dialog.

  • No labels