(Glue-2011) BEx Query to Storage

Owned by SNP
Last updated: Jan 05, 2021

BEx Query to Storage scenario can be used if you want to replicate the data from BEx Query to data storage. 

The only requirement is the BEx Query/BEx Query View must have tabular data format, i.e. enabled hierarchies in characteristics should be disabled and there must not be any double structures in columns. Having structure in rows is however allowed, but not recommended.

Datavard Glue extraction process executes BEx Query with the specified variable selection, performs a transformation of the data, and stores it in the target storage. This can be RDBMS storage (Oracle, MSSQL, etc.), file system (HDFS, Azure Blob, Azure Data Lake Storage, AWS S3, etc.), Hadoop (Hive, Impala) or cloud solution (AWS Redshift, Azure Databricks, Google BigQuery). For more information, please see Storage Management documentation.

Below, you can find a step by step manual of how to set up and execute the extraction of data from BEx Query to Storage.

  1. Create source Glue Table based on the existing data structure on the source storage
  2. Create (Glue-2011) BEx Query Fetcher
  3. Create target Glue Table (with the use of option "Import fields" from "BEx Query/View") defining the data structure on the target storage
  4. Create (Glue-2011) Glue Table Consumer using target Glue table
  5. Create (Glue-2011) Extraction Process
  6. Execute extraction