Page Comparison

The purpose of this document is to provide to the end-user a list of new features [NEW], improvements [IMP] and bug fixes [BUG] included in the Datavard GLUE support packages.

...

New Features

Extractor 2.0

A new concept of data extraction using 3 extraction components:

• Fetcher - provides the data from some source (URL, SAP SLT, Table ...).
• Consumer - stores/beams the data or consumes the data in any other way defined.
• Extraction process that starts with Fetcher, ends with Consumer and allows the definition of data transformation in between.

The following features were introduced to the new Extractor 2.0 concept:

• ADSO extraction
  • Enables to extract all types of ADSO objects.
  • Delta extraction is supported.
• BEx Query extraction
  • Support of BEx Query and Query Views extraction into tabular form. 
  • Customer exists are also supported.
  • Option to import fields from BEx Query/View into a Glue table.
• FIFO extraction
  • This type of extraction enables to extract data from SAP table in a short time by copying it to a cluster table in order to move it subsequently to Glue table.  
  • The data extraction consists of the following steps:
    1. Copy data from a SAP table to a cluster table.
    2. Copy data from a cluster table to a target Glue table.
    3. Delete the data from a cluster table (automatic operation).

Parallelization of Glue extractions

There are 2 new approaches available to extract the data in parallel (to speed up the extraction process): 

1. Generate variants, based on one of the fields specified for selection in Glue Extractor, and use Task Handler to execute them.
2. Use Mass Execution, which automizes the generation of variants. Also in this option, the Task Handler is used for an execution.   

Glue API

• Glue API was extended of a selective deletion.

Trigger delta for cluster tables

• You can extract data from cluster tables using trigger delta

Improvements

• Data Dictionary
  • Glue table defines, in the case of File Storage, the destination container/folder where the generated files will be stored.
    The container field in File Storage options is by default pre-filled with the Glue table name.
    Also case sensitive container names are supported.
  • GLREQUEST is by default non-key field.

• Glue extractors
  • You can define the variant package size in MBs.
  • It is possible to skip the records during the extraction process.
  • Data enrichment and meaningful values options were reorganized.
  • In the extractor manage screen, you can clear request metadata of an extractor.
  • You can reset delta information and start the extraction from the beginning.
  • Trigger the delta supports extraction with an operation details.
  • You can export the data into .csv with the compression.
  • Users cannot select the fields with data type FLTP for a selection.
  • Multiple triggers can be created for one table
  • You can specify escaping characters
    
    
  • ABAP extractor interface was adjusted to support custom post-extraction processing. 
    
    
• BW extractors 
  • DSO extractor gives you an option to reset the delta values. 
  • FULL delta extraction and BADI selection introduced to InfoCube and DSO extractors
  • InfoCube Mass Extraction allows filtering on Request ID

• Transport Management
  
  • The transport procedure was reworked. See this documentation for more information.
    
    
• Storage Management
  • Added possibility to configure the name file generated in AWS S3 storage
  • Added extraction into a single file in AWS S3

Fixes

• Data Dictionary
  • Alter a table did work on Glue tables with File Storage.
  • Glue table description was changing when switching between meaningful fields
  • Could not re-activate the Glue table in case the 'Enable update' checkbox was enabled and removed
  • Glue table schema JSON corrupted if the description contains double-quotes character "
• Glue Browser
  • Selection screen didn't work if the character ` was part of the Glue Data Dictionary description.
  • Glue Browser was dumping when multiple sessions accessed the same table.
• Glue Workbench
  • DF34_DEC data type was not supported.
  • Glue Workbench terminated when a user was recreating previously transported extractor.
  • Relevant performance issues on a currency conversion routines solved
  • Variant Generator
    • The variant generator was accessible only from the extractor workbench, not from the Object Navigator.
    • The generated variant was asking for save action.
    • When selecting multiple single values or other complex selections on the selection screen for mass execution, the values were cleared immediately after the confirmation of the selection. Therefore it was impossible to use different selection types than single values or range.
  • Timestamp delta was missing an option to capture all delays.
  • '\t' delimiter was not handled correctly when generating CSV files
    
    
  • ABAP extractor type was not working with CSVs.

• Transport Management
  • Activation of transported Glue tables with File Storage was failing on the target system.
  • The extractor with trigger delta was not transported correctly.
  • Skip full load flag was not transported