(SM-2402) SAP - GCP Communication

Communication to the Google Cloud platform is established through the Java connector using Google SDK.

The data transfer process is following a standard pattern of a phased approach:

  1. Data is fetched from SAP with the open cursor with a defined package size

  2. Data package is transferred into Google Storage using Java APIs (com.google.cloud.storage)

  3. (Optional) The complete dataset is ingested into Google BigQuery from Google Storage using Java APIs (com.google.cloud.bigquery)

 

High-level Communication Diagram

Communication with Google Cloud Platform

When communicating with the Google Cloud Platform, a Java connector (implemented by SNP) is used. This connector wraps SQL queries using Google SDK and forwards them to the engine.

 

Detailed Communication Diagram