(Glue-2311) Google Cloud Cortex Integration

SNP Glue™ provides an option to integrate the Google Cloud Cortex framework via BigQuery storage.

Deployment

Create BigQuery storage

For Google Cloud Cortex integration connection to BigQuery has to be set up via Storage Management.

Create DDIC to Storage mapping for Data Elements

DDIC to Storage mapping needs to be adjusted before generating tables in BigQuery.

Two Data elements below have to be added to BigQuery mapping.

Mapping

DDIC Data Element

Storage Data Type

Mapping

DDIC Data Element

Storage Data Type

DATA ELEMENT

/DVD/GL_CDC_TIMESTAMP

TIMESTAMP

DATA ELEMENT

/DVD/SM_BQR_BOOLEAN

BOOL

Create Extraction Objects

Via Glue Objects Generator create Extraction objects for needed SAP tables.

  1. Fill in the select option with SAP table names

  2. Use previously created BigQuery storage ID and check the Google Cloud Cortex checkbox in Glue Table Settings

  3. Choose delta type Trigger and enable Read deleted entries in Extraction Process Settings.

  4. Execute the generation of objects.

After successful generation, tables compatible with the Google Cloud Cortex framework are created in Google BigQuery.

Transfer data to BigQuery

To complete the data transfer the extraction via the generated Extraction Process needs to be executed. For that, the Delta Watchdog can be used or the user can manually perform the extraction.