[Preview setting] Additional insert and Update timestamp

[Preview setting] Additional insert and Update timestamp

Overview

This feature introduces support for tracking record creation and modification times within the SNP Snowflake Native Merge Application. It introduce two new fields:

  • Insert timestamp: Time when the record first enters Snowflake.

  • Update timestamp: Time when the record was last updated.


Purpose

To improve data lineage, auditability and compliance by capturing both the insert and update times of records processed through Kyano Glue and Snowflake.


Changes in Kyano Glue (ABAP Layer)

  • Tables in Kyano Glue must include a Commit timestamp field (This means the field with name as Update timestamp in the Snowflake application, and the used rollname must be GLCOMMITTIME). This field will be used as the Update Timestamp in Snowflake.

  • The Insert Timestamp is managed only on the Snowflake side and will be presented only in the merge table.


Changes in the Snowflake Application

New settings
  • The toggle Preview Feature insert and update timestamp was added.

  • Once enabled:

    • A new section appears in the metadata settings.

    • Users can activate insert and update timestamps.

    • Field names must be entered for both timestamps.

Merge task behavior

Condition

Insert timestamp

Update timestamp

Condition

Insert timestamp

Update timestamp

New record

Set to the current time

Set to the current time

Existing record

Remains unchanged

Set to the current time

  • This applies to new merge tasks. For existing tasks, you need to redeploy the merge tasks via:

    call core.redeploy_merge("DB", "SOURCE", "TABLE") -- for single table call core.redeploy_merge("DB", "SOURCE") -- for all tables in schema call core.redeploy_merge("DB") -- for all tables in database
View behavior
  • Views adopt the same timestamp logic as merge tasks, which ensures consistency.


Implementation Summary

For existing tables:

  1. In SAP, execute the report /DVD/GL_DD_ADJUST_TABLE to alter the Glue table.

  2. Add a field with the same name as entry in the update timestamp field in the Snowflake application and use rollname /DVD/SM_COMMIT_TIME.

  3. Enable the Preview Feature in the Snowflake application settings.

  4. Define the names of the fields Insert Timestamp and Update Timestamp in the Snowflake application metadata settings.

  5. Redeploy the merge tasks for the altered tables.

For new tables:

  1. Enable the Preview Feature in the Snowflake application settings.

  2. Define the names of the fields Insert Timestamp and Update Timestamp in the Snowflake application metadata settings.

  3. In SAP, before the table activation, add a field with the same name as entry in the Update Timestamp field the Snowflake application to Glue tables and use rollname /DVD/SM_COMMIT_TIME.