(1811) DataTiering Settings Tab


To access Settings of a specific DataProvider you can choose the Settings button, as shown on the figure below. To access the general settings click on the Settings tab.

Under DP Settings you can either change the general setting for all DataProviders by clicking Display or you can change the settings for one DataProvider by entering its name.


SETTINGS

Setting element

Description


Group ID

Name of the Group ID for mass processing of DataProviders. For better processing should a Group ID contain DataProviders that have a  common characteristic.

Group ID is a global setting and may be changed only for all DataProviders.
The Group ID is set to the value "Default". You can edit the name of the default Group ID by clicking Edit. The name should contain maximum 10 characters.

Source storage

Name of the storage from which data is offloaded.

Source storage is a global setting and may be changed only for all DataProviders.
You can change the default source storage by clicking Edit.

Target storage

Name of the storage to which data is offloaded. 

Target storage is a global setting and may be changed only for all DataProviders.
You can change the default target storage by clicking Edit.

Enable parallel processing

Allows parallel processing for offloading. The parallel processing is used only, if the size of the source data, which will be offloaded, is larger than the value set in Package volume for subrequests. During parallel processing, every request is divided into multiple subrequests which represent individual packages.

By clicking Edit you may turn parallel processing on or off.

Max BG jobs for subrequest processing


Maximum number of background jobs for parallel processing. Relevant only when parallel processing is enabled. Please note that by parallel processing, the system creates first a job for offloading, and after that it creates other jobs for the subrequests.
You can edit the maximum number of background jobs by clicking Edit. Please consider your system settings and set an appropriate value.
Fetch package sizeMaximum number of records in one package fetched from the source storage.By clicking Edit you can change the maximum number of records in one package. The recommended minimum value is 100 000 rows.
Package volume for subrequestMaximum size of a subrequest. Relevant only when parallel processing is enabled.By clicking Edit you can change the maximum size of one subrequest. The recommended value is between 500-1000 MB.
Minimum offloaded rowsMinimum number of offloaded rows for offloading process. If the parameter isn't high enough, it may influence the storage performance (too many partitions are created). Also, the offloading condition should be defined as lower or equal to this parameter. In the case number of offloaded rows is less than the parameter Minimum offloaded rows a confirmation message appears.

By clicking Edit you can change the minimum  number of offloaded rows. The recommended value is 100 000 rows.


For more information how to transport settings to another system please see the chapter (1811) Transport of DataProviders and Settings to Other Systems.

Storage Management

Storage Management provides an interface for connecting to secondary databases / storages.

Following operations are available:

  • New – creates new storage
  • Edit – changes existing storage
  • Delete – deletes storage
  • Check – checks whether specified storage is running

For more information on how to configure Storage Management, please ask for a separate Storage Management for Hadoop documentation.