(Glue-2002) Q: How can we link Hadoop fields to SAP fields? Is there some data lineage feature?

Glue can provide such information – both for the Glue data dictionary as well as for the link between the SAP DDIC and he Glue DDIC, thus providing data lineage functionality.

The easiest way to achieve this is to create a special view in the SAP DDIC which joins three Glue tables together. You can of course also ask your Datavard Glue consultant for an out of the box transport which ships this view.

The required Glue tables and their join conditions are these:

/DVD/GL_EH           NAME              =    /DVD/GL_EFM    NAME

/DVD/GL_DD_TS    TABNAME       =    /DVD/GL_EH      TARGET_TABLE

/DVD/GL_DD_TS    FIELDNAME    =    /DVD/GL_EFM    FIELDNAME

You will want to use these fields from the tables to access the information you need:

HADOOP_TABLE

FIELDPOS

HADOOP_FIELD

SAP_TABLE

SAP_FIELD

DESCRIPTION

Note: you may want to filter on the field STATUS from the base tables with value 'A' to only receive the actually existing table information (active version).

To leverage this lineage information, you will want to replicate this view to Hadoop.