Package | Description |
---|---|
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.fs.http.server | |
org.apache.hadoop.hdfs |
A distributed implementation of
FileSystem . |
org.apache.hadoop.mapred | |
org.apache.hadoop.mapred.lib | |
org.apache.hadoop.mapreduce.lib.input | |
org.apache.hadoop.mapreduce.v2.jobhistory |
Modifier and Type | Class and Description |
---|---|
class |
GlobFilter
A filter for POSIX glob pattern with brace expansions.
|
Modifier and Type | Method and Description |
---|---|
FileStatus[] |
FileContext.Util.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
protected RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f,
PathFilter filter)
Listing a directory
The returned results include its block location if it is a file
The results are filtered by the given path filter
|
FileStatus[] |
FileContext.Util.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileContext.Util.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
Constructor and Description |
---|
GlobFilter(String filePattern,
PathFilter filter)
Creates a glob filter with the specified file pattern and an user filter.
|
Modifier and Type | Class and Description |
---|---|
static class |
FSOperations.FSListStatus
Executor that performs a list-status FileSystemAccess files system operation.
|
Modifier and Type | Method and Description |
---|---|
protected RemoteIterator<LocatedFileStatus> |
DistributedFileSystem.listLocatedStatus(Path p,
PathFilter filter) |
Modifier and Type | Class and Description |
---|---|
class |
OutputLogFilter
This class filters log files from directory given
It doesnt accept paths having _logs.
|
static class |
Utils.OutputFileUtils.OutputFilesFilter
This class filters output(part) files from the given directory
It does not accept files with filenames _logs and _SUCCESS.
|
static class |
Utils.OutputFileUtils.OutputLogFilter
This class filters log files from directory given
It doesnt accept paths having _logs.
|
Modifier and Type | Method and Description |
---|---|
static PathFilter |
FileInputFormat.getInputPathFilter(JobConf conf)
Get a PathFilter instance of the filter set for the input paths.
|
Modifier and Type | Method and Description |
---|---|
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results.
|
Modifier and Type | Method and Description |
---|---|
static void |
FileInputFormat.setInputPathFilter(JobConf conf,
Class<? extends PathFilter> filter)
Set a PathFilter to be applied to the input paths for the map-reduce job.
|
Modifier and Type | Method and Description |
---|---|
protected void |
CombineFileInputFormat.createPool(JobConf conf,
PathFilter... filters)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
protected void |
CombineFileInputFormat.createPool(JobConf conf,
List<PathFilter> filters)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
static PathFilter |
FileInputFormat.getInputPathFilter(JobContext context)
Get a PathFilter instance of the filter set for the input paths.
|
Modifier and Type | Method and Description |
---|---|
protected void |
FileInputFormat.addInputPathRecursively(List<FileStatus> result,
FileSystem fs,
Path path,
PathFilter inputFilter)
Add files in the input path recursively into the results.
|
protected void |
CombineFileInputFormat.createPool(PathFilter... filters)
Create a new pool and add the filters to it.
|
Modifier and Type | Method and Description |
---|---|
protected void |
CombineFileInputFormat.createPool(List<PathFilter> filters)
Create a new pool and add the filters to it.
|
static void |
FileInputFormat.setInputPathFilter(Job job,
Class<? extends PathFilter> filter)
Set a PathFilter to be applied to the input paths for the map-reduce job.
|
Modifier and Type | Method and Description |
---|---|
static PathFilter |
JobHistoryUtils.getConfFileFilter()
Gets a PathFilter which would match configuration files.
|
static PathFilter |
JobHistoryUtils.getHistoryFileFilter()
Gets a PathFilter which would match job history file names.
|
Modifier and Type | Method and Description |
---|---|
static List<FileStatus> |
JobHistoryUtils.localGlobber(FileContext fc,
Path root,
String tail,
PathFilter filter) |
static List<FileStatus> |
JobHistoryUtils.localGlobber(FileContext fc,
Path root,
String tail,
PathFilter filter,
AtomicBoolean hasFlatFiles) |
Copyright © 2013 Apache Software Foundation. All rights reserved.