(Glue-2008) Q: How can I perform an initial full load of mass data with several jobs in parallel?
It's possible by creating multiple variants. Please follow these steps:
- Create an extractor with full load delta type.
- Create multiple variants with different selections. All variants combined must cover all data. For example if we do selections on a field containing a year, we need to have a variant for each year.
- Run extraction for all created variants.
If you want to use some delta mechanism for extraction after a full load, please follow these steps:
- Add global setting to allow delta value reset. This can be done in transaction /DVD/RL_TM. Choose table /DVD/GL_CUS_VALS and add setting ALLOW_DELTA_VALUE_RESET.
- Create another extractor with desired delta type (same source and a target as the first full load extractor).
- Go to delta tools manage tab.
- Edit delta value to last value which was extracted. For example if we did a full load using variants with selections on a field containing a year, we need to set the last year in selection as the value of delta.
- Perform delta run only from manage tab. Do not execute variant directly because full load would be done again as it would be the first execution of extractor.