public class SimpleCopyListing extends CopyListing
Modifier | Constructor and Description |
---|---|
protected |
SimpleCopyListing(Configuration configuration,
Credentials credentials)
Protected constructor, to initialize configuration.
|
Modifier and Type | Method and Description |
---|---|
void |
doBuildListing(Path pathToListingFile,
DistCpOptions options)
The interface to be implemented by sub-classes, to create the source/target file listing.
|
protected long |
getBytesToCopy()
Return the total bytes that distCp should copy for the source paths
This doesn't consider whether file is same should be skipped during copy
|
protected long |
getNumberOfPaths()
Return the total number of paths to distcp, includes directories as well
This doesn't consider whether file/dir is already present and should be skipped during copy
|
protected void |
validatePaths(DistCpOptions options)
Validate input and output paths
|
buildListing, getCopyListing, getCredentials, setCredentials
getConf, setConf
protected SimpleCopyListing(Configuration configuration, Credentials credentials)
configuration
- The input configuration, with which the source/target FileSystems may be accessed.credentials
- - Credentials object on which the FS delegation tokens are cached. If null
delegation token caching is skippedprotected void validatePaths(DistCpOptions options) throws IOException, org.apache.hadoop.tools.CopyListing.InvalidInputException
CopyListing
validatePaths
in class CopyListing
options
- - Input optionsIOException
org.apache.hadoop.tools.CopyListing.InvalidInputException
public void doBuildListing(Path pathToListingFile, DistCpOptions options) throws IOException
doBuildListing
in class CopyListing
pathToListingFile
- Path on HDFS where the listing file is written.options
- Input Options for DistCp (indicating source/target paths.)IOException
protected long getBytesToCopy()
getBytesToCopy
in class CopyListing
protected long getNumberOfPaths()
getNumberOfPaths
in class CopyListing
Copyright © 2013 Apache Software Foundation. All rights reserved.