(Glue-2008) Q: How can we link Hadoop fields to SAP fields? Is there some data lineage feature?
Glue can provide such information – both for the Glue data dictionary as well as for the link between the SAP DDIC and he Glue DDIC, thus providing data lineage functionality.
The easiest way to achieve this is to create a special view in the SAP DDIC which joins three Glue tables together. You can of course also ask your Datavard Glue consultant for an out of the box transport which ships this view.
The required Glue tables and their join conditions are these:
/DVD/GL_EH NAME = /DVD/GL_EFM NAME
/DVD/GL_DD_TS TABNAME = /DVD/GL_EH TARGET_TABLE
/DVD/GL_DD_TS FIELDNAME = /DVD/GL_EFM FIELDNAME
You will want to use these fields from the tables to access the information you need:
HADOOP_TABLE
FIELDPOS
HADOOP_FIELD
SAP_TABLE
SAP_FIELD
DESCRIPTION
Note: you may want to filter on the field STATUS from the base tables with value 'A' to only receive the actually existing table information (active version).
To leverage this lineage information, you will want to replicate this view to Hadoop.