(SM-2002) SAP - GCP communication
Communication to Google Cloud platform is established through Datavard Java connector using Google SDK.
Data transfer process is following a standard pattern of 2 phased approach:
Data is fetched from SAP with open cursor with defined package size
Data package is saved temporarily as a csv file
File is transferred into Google Storage using Java APIs (com.google.cloud.storage)
Files are ingested into Google BigQuery from Google Storage using Java APIs (com.google.cloud.bigquery)
Detailed communication diagram: