(Glue-2308) Google Cloud Cortex Integration
- SNP
- Marian Vidra
- Igor Strba
SNP Glue™ provides an option to integrate the Google Cloud Cortex framework via BigQuery storage.
Deployment
Create BigQuery storage
For Google Cloud Cortex integration connection to BigQuery has to be set up via Storage Management.
Create DDIC to Storage mapping for Data Elements
DDIC to Storage mapping needs to be adjusted before generating tables in BigQuery.
Two Data elements below have to be added to BigQuery mapping.
Mapping | DDIC Data Element | Storage Data Type |
|---|---|---|
DATA ELEMENT | /DVD/GL_CDC_TIMESTAMP | TIMESTAMP |
DATA ELEMENT | /DVD/SM_BQR_BOOLEAN | BOOL |
Create Extraction Objects
Via Glue Objects Generator create Extraction objects for needed SAP tables.
Fill in the select option with SAP table names
Use previously created BigQuery storage ID and check the Google Cloud Cortex checkbox in Glue Table Settings
Choose delta type Trigger and enable Read deleted entries in Extraction Process Settings.
Execute the generation of objects.
After successful generation, tables compatible with the Google Cloud Cortex framework are created in Google BigQuery.
Transfer data to BigQuery
To complete the data transfer the extraction via the generated Extraction Process needs to be executed. For that, the Delta Watchdog can be used or the user can manually perform the extraction.