Examples with CopyListing org.apache.hadoop.tools.CopyListing used on opensource projects

Example 6 with CopyListing

use of org.apache.hadoop.tools.CopyListing in project hadoop by apache.

the class DistCp method createInputFileListing.

/**
   * Create input listing by invoking an appropriate copy listing
   * implementation. Also add delegation tokens for each path
   * to job's credential store
   *
   * @param job - Handle to job
   * @return Returns the path where the copy listing is created
   * @throws IOException - If any
   */
protected Path createInputFileListing(Job job) throws IOException {
    Path fileListingPath = getFileListingPath();
    CopyListing copyListing = CopyListing.getCopyListing(job.getConfiguration(), job.getCredentials(), inputOptions);
    copyListing.buildListing(fileListingPath, inputOptions);
    return fileListingPath;
}