(SM-2102) SAP - GCP communication

Communication to Google Cloud platform is established through the Datavard Java connector using Google SDK.

Data transfer process is following a standard pattern of a phased approach:

  1. Data is fetched from SAP with the open cursor with defined package size

  2. Data package is transferred into Google Storage using Java APIs (com.google.cloud.storage)

  3. (Optional) Complete dataset is ingested into Google BigQuery from Google Storage using Java APIs (com.google.cloud.bigquery)

 

Detailed communication diagram: