(DTERP-2302) Mass archiving

The process of archiving could be a complex process where you have to decide what needs to be archived and where. This includes also customizing archiving objects and the creation of execution variants. The execution itself requires good timing in order not to create too much stress on the system. All these challenges could be addressed by our mass archiving wizard, which will guide you through the necessary steps and enable you to carry out execution easily.

In this section:

Prerequisites

Analysis

To be able to suggest which data could/should be archived you need to execute the analysis. You could choose an analysis that will simulate the archiving itself and tell you what could be archived and what not together with data distribution on your system. If you want to quickly proceed with mass archiving and don’t want to know so much detailed information, you can execute a quick distribution analysis. More information can be found in the chapter Analyzer.

Archiving object customizing

Before you start with archiving, you need to customize archiving object. Here you can find an item that needs to be completed:

  • Setup of content repository

    • transaction OAC0

  • Archiving object customizing

    • transaction SARA → Customizing → (Archiving Object-Specific Customizing) Technical Settings

      • Set Content repository

        • Place File in Storage System → Content Repository

      • Set 'Not Scheduled' for the Delete program

        • Settings for Delete Program → Delete Jobs → 'Not Scheduled'

Customizing is accessible directly from the wizard.

There are several checks in place:

  • The logical file path is not entirely maintained

  • An automatic deletion program run is scheduled

  • Event-Driven Start of Delete Job is in place

  • Write after deletion is set

  • The content repository is not set for Archiving object

  • Automatic Storage of Archive Files in the Storage System is on

  • If store before delete is not set, then a pop-up for confirmation will appear

Retention management

If you want retention management for your desired archiving object, you need to do customizing. More information can be found in the Retention management chapter.

Transparent archive

Archived data could be replicated to desired transparent storage, if you want to use this functionality, you need to do a setup for the chosen archiving object. More information can be found in the Transparent archive chapter.

Supported archiving objects

Mass archiving is currently available for a limited number of archiving objects. Here you can find a list of the supported objects.

Archiving run creation

Transaction: /DVD/EM_MA

Here you will find how to create and set up a mass archiving run for specific archiving objects. Each archiving run manages the execution of one archiving object for a given data selection and selected phases. The mass archiving wizard will guide you through the necessary setup steps to complete the run configuration.

Wizard

Archiving object

The step will define which archiving object you want to use. Please check the supported archiving object firstly

  • Test mode - by selecting the Test Mode checkbox you will produce a test run where no data will be archived.

  • Use already existing analysis - online analysis is the default analysis. If you want to use other existing analyses for the selected archiving objects you can do so by choosing one from the search help menu.

Archiving area

Based on the selected archiving object, you can define using selection options which archiving area of the online data should be archived in this run.

  • Variant generation parameters(optional):

    • Min - the number of objects to be included in a single variant. If the amount of objects is lower than this number, no variants will be created. We recommend considering the size of the table before setting the value.

    • Max - the maximum amount of objects to be included in a single variant. If the amount of objects is higher than this number, the objects will be included in the next variant.

  • Execute variant generation in the background - if there are too many variants to generate, you can opt to create variants in the background. There will be a refresh button on the next screen.

  • Time slice distribution - by checking this box you can divide the objects into variants by the selected time frame.

  • Distinct parameter - for each distinct parameter there will be generated a new variant. The legal field customized in Retention Management is mandatory checked and cannot be unchecked.

If both parameters Min and Max in Variant generation parameters are filled then if the last split variant should contain less than the Min object it will not be excluded.

Relative condition

If there are variant parameters compatible with a relative condition for the Run ID, you can see the "Use relative condition" checkbox. If it is checked, these fields are displayed:

  • variant parameter

  • comparison operator

  • rounding unit

  • period value

Relative condition is calculated by selecting a variant parameter and then subtracting a user-specified period value from the current date, which based on user selection is rounded up to:

  • a day

  • a month

  • a quarter

  • a year

After all of the fields are filled, press the "Calculate" button which will fill the chosen variant parameter with absolute values calculated from the relative condition.

Variants

Once you decided which data you want to archive, here you will see the variants that would be generated for the execution. You can download the variant table, adjust it for example in Excel and import it back to the wizard. You can adjust which combination of the displayed values of characteristics should be added to which variant. You can group two lines into variants by simply changing the variant name to the same value. If there is a time field (date) customized in Retention management you can do time increments of 1, 3, or 6 months to split the variant if you find it too big. By clicking on the variant name you can display the variant. Please don't change the generated variant manually.

Phases

For each variant that was defined in the previous screen, you can decide which archiving phases should be executed. By clicking the Settings buttons you can access system customizing relevant to that phase.

Some phases (Store, Transparent archive, Retention management) require the previous customization. Please check the prerequisites for more info.

Execution parameters

The last step before the execution of the archiving itself is to decide how execution will be carried out. Here you will decide the order of the execution of the variant and phases and whether you would like to be notified about the progress using email messages.

Finish

When you set everything according to your plan, you can complete the setup of the run by hitting the Finish button on at the last step. By this action, the defined variants are generated, and added respective phases are added to the execution tree.

When you finish the run it will be locked for further changes except for the execution notification parameter.

List of runs

Transaction: /DVD/EM_MA

The main screen of mass archiving contains a list of already created runs. Each row consists of run details like the description archiving object and the overall status of the run.

Parameter name

Description

Parameter name

Description

Run description

Description of the run filled by its creator

Run type

Defines the type of the run, you can determine this type by parameter Test run in the first step of the wizard. If the Test run is checked then it is a Test run if not then it is a Initial run and if run is copied from Initial run than it is Regular run.

RunID

The technical name of the run is assigned automatically during run creation. RunID is always in the form:

EMA<7 alfa numerical characters>

Archiving object

The technical name of the archiving object.

Filter

Filter list by object name.

Status

Contains icons with technical status.

Possible statuses:

  • Setup isn’t finished

    • the last step of the wizard wasn’t confirmed yet

  • Ready for execution

    • Wizard was completed and tasks are ready to be executed

  • Running

    • the run is running currently

  • Released

    • the run is not currently running but at least one task/phase has already been finished

  • Finished with warning

    • all of the tasks in the run are done but at least one finished with the warning status

  • Finished with error

    • all of the tasks in the run are done but at least one finished with the error status

  • Execution failed

    • all of the tasks in the run are done but at least one finished with the execution failed status

Progress

Display the progress of the execution. Showing a number of all tasks that need to be done versus tasks that are done already.

Wizard

Displays wizard.

Monitor

Displays monitor. This icon will appear only when the wizard is finished.

Created by

The user that created the run.

Created on

Date when the run was created.

ERT

Calculated from previous finished runs, separately for each phase then totaled.

Start date

Date when the run was executed. Earliest date of execution task for a run.

Start time

The time when the run was executed. The earliest time of execution task for a run.

End date

Date when the run was finished. Latest date of execution task.

End time

The time when the run was finished. Latest time of execution task.

Changed by

Last used that that changes wizard parameters.

Changed on

Last date when wizard parameters were changed.

Scheduling calendar

Mass archiving contains an assistant in form of a calendar that visualizes already executed and scheduled runs. You can then better decide when it would be suitable to schedule the next execution of the archiving run. The calendar contains scheduled runs and indicates their estimated runtime. When runtime overreach calendar cell it is duplicated to the next one until its expected finish.

The calendar can display three time periods.

  • Day

  • Week

  • Month

You can navigate using buttons to next, previous, and period that show the current date. There is also a possibility to add user-specified jobs selection in the calendar. You can see archiving run together with other jobs that will be executed on the system.

Filter for mass archiving run objects

The ALV table on Mass archiving’s main screen can include a lot of RunIDs objects. To get a higher performance it is necessary to have the option to filter those records by certain parameters. If the number of mass archiving run objects exceeds a certain number, the filter is automatically displayed. The filter can also be opened by the filter button.

Expert setting

The number to enable the filter can be set through the expert setting (Expert → Settings → Mass Archiving → RUNS_TO_FILTER).