(SM 2005) SAP - AWS communication

Communication to AWS platform is established through Datavard Java connector using AWS S3 SDK and JDBC.

Data transfer process is following a standard pattern of 2 phased approach:

  1. Data is fetched from SAP with open cursor with defined package size

  2. Data package is saved temporarily as a csv file

  3. File is transferred into S3 storage using Java AWS S3 SDK

  4. Files are ingested into Redshift from S3 storage using JDBC SQL commands

 

Detailed communication diagram: