(SM-2002) SAP - GCP communication

Communication to Google Cloud platform is established through Datavard Java connector using Google SDK.

Data transfer process is following a standard pattern of 2 phased approach:

  1. Data is fetched from SAP with open cursor with defined package size

  2. Data package is saved temporarily as a csv file

  3. File is transferred into Google Storage using Java APIs (com.google.cloud.storage)

  4. Files are ingested into Google BigQuery from Google Storage using Java APIs (com.google.cloud.bigquery)

 

Detailed communication diagram: