(SM 2005) SAP - AWS communication
Communication to AWS platform is established through Datavard Java connector using AWS S3 SDK and JDBC.
Data transfer process is following a standard pattern of 2 phased approach:
Data is fetched from SAP with open cursor with defined package size
Data package is saved temporarily as a csv file
File is transferred into S3 storage using Java AWS S3 SDK
Files are ingested into Redshift from S3 storage using JDBC SQL commands
Detailed communication diagram: