(SM-2105) SAP - AWS communication

Owned by SNP
May 13, 2021
1 min read

Communication with the AWS platform is established through the Datavard Java connector using AWS S3 SDK and JDBC for the Redshift DB.

Data transfer process is following a standard pattern of a phased approach:

  1. Data is fetched from SAP with the open cursor with defined package size

  2. Data package is transferred into S3 storage using Java AWS S3 SDK

  3. (Optional) Complete dataset is ingested into AWS Redshift from AWS S3 storage using JDBC SQL commands

 

Detailed communication diagram: