(GLUE-1808) Local File to HDFS

Local File to HDFS

To create an extractor, to transfer a local file to HDFS, fill in following fields:

  • File to upload – local path to the file
  • HDFS path – path in Hadoop HDFS filesystem where the file will be copied
  • HDFS filename – the name of the file after it is transferred
  • RFC destination – RFC (Remote Function Call) which is used for the transfer

Then, save and activate the extractor.


Local File to HDFS Extractor


To start loading data, create a variant for the existing extractor.

Right-click on the active extractor, enter a name and a description of the variant, save and activate it.

Finally, press Execute button to upload the file.


Local File to HDFS Variant 


The executed background job can be monitored with transaction M37 or with Job monitor available in the toolbar.