(SM 2005) SAP - AWS communication

Communication to AWS platform is established through Datavard Java connector using AWS S3 SDK and JDBC.

Data transfer process is following a standard pattern of 2 phased approach:

1. Data is fetched from SAP with open cursor with defined package size

2. Data package is saved temporarily as a csv file

3. File is transferred into S3 storage using Java AWS S3 SDK

4. Files are ingested into Redshift from S3 storage using JDBC SQL commands

Detailed communication diagram: