Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

During the extraction process itself, the two types of files are created, These are data files and metadata files for extraction (Glue request). The creation of the files is dependent on the settings defined within File storage options. In the next section, we are going to discuss the particular files and how they can be configured,

...

In the default configuration, the data file is created as a CSV file for each transferred package. Each data file has an iteration (package) number appended to its name and is stored in the destination defined by File storage options within the Glue table. The data file naming can be configured using Glue Settings - Binary Storage settings using parameter Binary data file name.

...

With the default configuration, one metadata file is created for each Glue request transferred to storage. Using the default configuration, the metadata JSON files are stored within the same location as defined in File storage options.

...

The name of the metadata files is defined and can be configured via Glue Settings - Binary storage settings using parameter Binary request metadata file name.

...