(SM-2205) SAP-Azure communication

Communication with the Azure platform is established through the Java connector using Azure RestAPI and JDBC connection.

The data transfer process is following a standard pattern of a phased approach:

  1. Data is fetched from SAP with the open cursor with defined package size

  2. Data package is transferred into Azure storage using RestAPIs

    1. (Optional) MS SQL database can be utilized as a target instead

  3. (Optional) Complete data set is ingested into Azure Databricks from the storage layer using JDBC connection

Detailed communication diagram: