Package | Description |
---|---|
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.fs.viewfs | |
org.apache.hadoop.hdfs |
A distributed implementation of
FileSystem . |
org.apache.hadoop.hdfs.web | |
org.apache.hadoop.mapred | |
org.apache.hadoop.mapreduce.lib.input |
Modifier and Type | Class and Description |
---|---|
class |
BlockStorageLocation
Wrapper for
BlockLocation that also adds VolumeId volume
location information for each replica. |
class |
HdfsBlockLocation
Wrapper for
BlockLocation that also includes a LocatedBlock ,
allowing more detailed queries to the datanode about a block. |
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
LocatedFileStatus.getBlockLocations()
Get the file's block locations
|
BlockLocation[] |
FilterFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len) |
BlockLocation[] |
FileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
BlockLocation[] |
HarFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Get block locations from the underlying fs and fix their
offsets and lengths.
|
BlockLocation[] |
Hdfs.getFileBlockLocations(Path p,
long start,
long len) |
abstract BlockLocation[] |
AbstractFileSystem.getFileBlockLocations(Path f,
long start,
long len)
The specification of this method matches that of
FileContext.getFileBlockLocations(Path, long, long) except that
Path f must be for this file system. |
BlockLocation[] |
FilterFs.getFileBlockLocations(Path f,
long start,
long len) |
BlockLocation[] |
FileContext.getFileBlockLocations(Path f,
long start,
long len)
Return blockLocation of the given file for the given offset and len.
|
BlockLocation[] |
FileSystem.getFileBlockLocations(Path p,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
BlockLocation[] |
DelegateToFileSystem.getFileBlockLocations(Path f,
long start,
long len) |
Constructor and Description |
---|
BlockStorageLocation(BlockLocation loc,
VolumeId[] volumeIds) |
HdfsBlockLocation(BlockLocation loc,
LocatedBlock block) |
LocatedFileStatus(FileStatus stat,
BlockLocation[] locations)
Constructor
|
LocatedFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path,
BlockLocation[] locations)
Constructor
|
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
ViewFileSystem.getFileBlockLocations(FileStatus fs,
long start,
long len) |
BlockLocation[] |
ViewFs.getFileBlockLocations(Path f,
long start,
long len) |
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
DFSClient.getBlockLocations(String src,
long start,
long length)
Get block location info about file
getBlockLocations() returns a list of hostnames that store
data for a specific file region.
|
BlockLocation[] |
DistributedFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len) |
BlockLocation[] |
DistributedFileSystem.getFileBlockLocations(Path p,
long start,
long len) |
static BlockLocation[] |
DFSUtil.locatedBlocks2Locations(List<LocatedBlock> blocks)
Convert a List
|
static BlockLocation[] |
DFSUtil.locatedBlocks2Locations(LocatedBlocks blocks)
Convert a LocatedBlocks to BlockLocations[]
|
Modifier and Type | Method and Description |
---|---|
BlockStorageLocation[] |
DFSClient.getBlockStorageLocations(List<BlockLocation> blockLocations)
Get block location information about a list of
HdfsBlockLocation . |
BlockStorageLocation[] |
DistributedFileSystem.getFileBlockStorageLocations(List<BlockLocation> blocks)
Used to query storage location information for a list of blocks.
|
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
WebHdfsFileSystem.getFileBlockLocations(FileStatus status,
long offset,
long length) |
BlockLocation[] |
WebHdfsFileSystem.getFileBlockLocations(Path p,
long offset,
long length) |
Modifier and Type | Method and Description |
---|---|
protected int |
FileInputFormat.getBlockIndex(BlockLocation[] blkLocations,
long offset) |
protected String[] |
FileInputFormat.getSplitHosts(BlockLocation[] blkLocations,
long offset,
long splitSize,
NetworkTopology clusterMap)
This function identifies and returns the hosts that contribute
most for a given split.
|
Modifier and Type | Method and Description |
---|---|
protected BlockLocation[] |
CombineFileInputFormat.getFileBlockLocations(FileSystem fs,
FileStatus stat) |
Modifier and Type | Method and Description |
---|---|
protected int |
FileInputFormat.getBlockIndex(BlockLocation[] blkLocations,
long offset) |
Copyright © 2013 Apache Software Foundation. All rights reserved.