Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Connection to Snowflake is provided by Datavard component - Storage Management (SM). 

...

Communication with Snowflake Internal Stage is provided via Java connector (extended JDBC API form upload/download streams).

Snowflake Database (DB)

Snowflake is an analytic data warehouse provided as Software-as-a-Service (SaaS). Snowflake provides a data warehouse that is faster, easier to use, and far more flexible than traditional data warehouse offerings. Snowflake is a cloud data platform with a data warehouse that supports the most common standardized version of SQL (ANSI) for powerful relational database querying.

For purpose of data transfer to Snowflake DB, also Snowflake Internal Stage storage is used. Firstly, the data is moved in form of a .csv file to Snowflake Internal Stage, and afterward, the engine loads the transferred data. 

High-level Communication Diagram

Communication with Snowflake

When communicating with the Snowflake DB engine, a Java connector (implemented by Datavard) is used. This connector wraps SQL queries using JDBC jars and forwards them to the engine.

Drawio
simple0
zoom1
inComment0
custContentId2376990797
pageId2376826928
diagramDisplayNamesap-snowflake-high-level-schema
lbox1
contentVer2
revision3
baseUrlhttps://datavard.atlassian.net/wiki
diagramNamesap-hadoop-high-level-schema
pCenter0
aspectundefined
width700.5
linksundefined
tbstyleundefined
height662

Div
stylepage-break-after:always;


Detailed Communication Diagram

Drawio
simple0
zoom1
inComment0
custContentId2852061246
pageId2696773639
diagramDisplayNamesnowflake_detailed_diagram.xml
lbox1
contentVer1
revision2
baseUrlhttps://datavard.atlassian.net/wiki
diagramNames3_redshift_detailed_diagram.xml
pCenter0
aspectundefined
width796.9385714285713
links
tbstyle
height729.9999999999999

Authentication

Java JDBC Service - uses dedicated DB user's credentials. The snowflake user by default has also created Snowflake Internal Stage used as binary storage. The user's DB credentials may have specials grants on DB level for accessing dedicated schemes, read/write dedicated objects and so on. Java JDBC Service is responsible for handling security when communicating with the Snowflake ecosystem.

...