(SM-2108) SAP-Azure communication
Communication with the Azure platform is established through the Datavard Java connector using Azure RestAPI and JDBC connection.
The data transfer process is following a standard pattern of a phased approach:
Data is fetched from SAP with the open cursor with defined package size
Data package is transferred into Azure storage using RestAPIs
(Optional) MS SQL database can be utilized as a target instead
(Optional) Complete data set is ingested into Azure Databricks from the storage layer using JDBC connection
Detailed communication diagram: