(GLUE-1808) Data Dictionary

Data Dictionary

Transaction

/DVD/GL11

Glue Data Dictionary(DDIC) module represents the central component of Glue. It provides the structural information necessary for data to be understood(structured). DDIC specifies transparent data and enables manipulation with it. Whether you will read, insert, transform or virtualize data, all these processes always heavily rely on GLUE DDIC module.

Metaobject

Glue table

The module itself offers data modeling and maintenance of Glue tables similar to standard SAP SE11 transaction thus the transaction /DVD/GL11. It allows you to create/edit/display/delete the main Glue metaobject - the Glue table. The Glue tables are pushed to a predefined Storage and can be created in a transparent way, as well.


Glue DDIC provides a UI that enables us to create a Glue table and its metadata which represent data structure and data destination of the table.


Glue table

Is a Glue metadata object, holding information about data destination, data structure, and other settings.
Destination is helping us to locate the data in given storages e.g. all kinds of databases. Storage ID specifies more precisely the location of the data. For more information about how to set up a Storage ID see the (GLUE-1808) Storage Management guide.
Structure is defined by the user directly. The creation process is transparent, describing each structural component one by one directly in the SAP data types.
Other settings hold information about the parameters of a Glue table


Other settings of a Glue table

By the creation of a Glue table, you should specify further settings (table description, package name, Use meaningful fields option, etc.) which support proper handling and behavior of the Glue table functionality.
Glue serves as both, link to the already existing table in storage, or as a tool capable of creating such tables.

System events

DDIC stands on the top of the hierarchy of GLUE metaobjects. For this reason, other metaobjects are directly dependent on it. 

Activation of a Glue table

This step does not influence other Glue components.

Deactivation of a Glue table

This step affects Glue extractors, InfoProviders and BPL. If a table is deactivated, all relevant extractors, InfoProviders and BPL are deactivated, too.

Deletion of a Glue table

This step is similar to deactivation of a Glue table but with an extra pop-up which deletes the relevant objects.

Alterations to a Glue table

This step does not influence other Glue components.

After alternation is for correct functionality of other Glue metaobjects recommended their reactivation.

Glue Dictionary screens

Initial screen

Glue dictionary maintains Glue tables. You can create, display or change desired Glue tables. Its initial screen is an entry for more complicated screens with details.

Here you can:

  1. Create a Glue table: Metadata object along with an external table in a defined storage
  2. Create a Glue table as a link to an existing table in a defined storage
  3. Activate a table
  4. Delete a table
  5. Display a list of glue objects where a particular table is used


Attributes screen

Here you set up the Package (only virtual, no real object can be seen in SE80), storage and choose additional features, for example, Use meaningful values (see more detailed info bellow).

Fields screen

Defines a structure of the fields.

You can set up the field name and set it as a key field, define its type (with a data element or direct ABAP type), add a description or set up a partitioning for a table.

Please be aware that if you use Hive or Impala storage, you mustn't select all the fields in the column PartitioningSelecting too granular data for partitioning may decrease performance and stability of the whole cluster.


Import Fields creates a Glue table structure based on either existing SAP table structure, InfoProvider or from a file.

Please be cautious when you change the content of table after fields import.


You can also define customized fields using  button and filling in data element attributes.


Please note that the following data types are not supported when creating a Glue table:

LRAW, RAW, RSTR, VARC

Please note that the total number of characters by primary keys is restricted to 338.


Features:

Meaningful fields

SAP table fields tend to have field names that are not self-explanatory. An unskilled SAP-user doesn't understand the meaning of these fields. This can be solved by setting the Use meaningful fields checkbox during the creation of the table.

Example:

Here is a comparison of 2 tables, both created from SAP SFLIGHT table. The first table was created with original fields names, the second using Meaningful fields.

Original field namesMeaningful field names


Meaningful values

Data inserted into the DB does not always have values which can be easily understood. The values are often represented by their simplified or shortened versions. To display the more explicit versions of the values select the checkbox Use meaningful values in the Attributes tab.


Please note: After the installation of Glue it is necessary to execute the report '/DVD/GL_BPL_SPKFL_CONTENT_GEN'  and  '/DVD/GL_DD_SPKFL_CONTENT_GEN' which generate some of the meaningful values.


Example:

Table: SFLIGHT: field CARRID (Airline Code):

value in SAP table = translation to meaningful value

  • AA  = American Airlines
  • AB = Air Berlin
  • AC = Air Canada
  • AF = Air France
  • AZ = Alitalia
  • BA = British Airways

As a result, instead of the shortened values such as AA, AB, AC e.t.c., the descriptive terms: American Airlines, Air Berlin, and Air Canada are inserted into the Glue table.

Data Enrichment

Data enrichment (or denormalization) includes data from SAP master data into transactional data, e.g. by inserting the text of a G/L account into the line items, or the name of a vendor into a purchase order. 

During the ingestion of data, basic de-normalization of data from the original relational database model is performed. Such de-normalization is referred to as data enrichment. It includes additional fields in the structure of tables when generating them on external storage. Such fields are for example used to store the name of a customer or the text of a material number and include this data in the transactional data. 

Update

Update functionality creates another GLUE table without GLREQUEST field which will store and update data transferred to original GLUE table.

To enable update select checkbox Enable update in Attributes tab.

After selecting the checkbox new settings appear:

Keep old data: When checked all data transferred to original table will be stored. Otherwise there will be no data in original table.

Update table: Name of the update table which will store updated data.

After activating table, update table is created and activated automatically and settings are saved. When extracting data to original table, update table is automatically updated with new data.