Package | Description |
---|---|
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.fs.viewfs | |
org.apache.hadoop.hdfs |
A distributed implementation of
FileSystem . |
org.apache.hadoop.hdfs.protocol | |
org.apache.hadoop.hdfs.protocolPB | |
org.apache.hadoop.hdfs.server.namenode |
Modifier and Type | Method and Description |
---|---|
FSDataOutputStream |
AbstractFileSystem.create(Path f,
EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts)
The specification of this method matches that of
FileContext.create(Path, EnumSet, Options.CreateOpts...) except
that the Path f must be fully qualified and the permission is absolute
(i.e. |
abstract FSDataOutputStream |
AbstractFileSystem.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
Options.ChecksumOpt checksumOpt,
boolean createParent)
The specification of this method matches that of
AbstractFileSystem.create(Path, EnumSet, Options.CreateOpts...) except that the opts
have been declared explicitly. |
FSDataOutputStream |
FilterFs.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
Options.ChecksumOpt checksumOpt,
boolean createParent) |
void |
Hdfs.createSymlink(Path target,
Path link,
boolean createParent) |
void |
AbstractFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
The specification of this method matches that of
FileContext.createSymlink(Path, Path, boolean) ; |
void |
FilterFs.createSymlink(Path target,
Path link,
boolean createParent) |
boolean |
Hdfs.delete(Path f,
boolean recursive) |
abstract boolean |
AbstractFileSystem.delete(Path f,
boolean recursive)
The specification of this method matches that of
FileContext.delete(Path, boolean) except that Path f must be for
this file system. |
boolean |
FilterFs.delete(Path f,
boolean recursive) |
boolean |
ChecksumFs.delete(Path f,
boolean recursive)
Implement the delete(Path, boolean) in checksum
file system.
|
abstract T |
FileSystemLinkResolver.doCall(Path p)
FileSystem subclass-specific implementation of superclass method.
|
BlockLocation[] |
Hdfs.getFileBlockLocations(Path p,
long start,
long len) |
abstract BlockLocation[] |
AbstractFileSystem.getFileBlockLocations(Path f,
long start,
long len)
The specification of this method matches that of
FileContext.getFileBlockLocations(Path, long, long) except that
Path f must be for this file system. |
BlockLocation[] |
FilterFs.getFileBlockLocations(Path f,
long start,
long len) |
FileChecksum |
Hdfs.getFileChecksum(Path f) |
abstract FileChecksum |
AbstractFileSystem.getFileChecksum(Path f)
The specification of this method matches that of
FileContext.getFileChecksum(Path) except that Path f must be for
this file system. |
FileChecksum |
FilterFs.getFileChecksum(Path f) |
FileStatus |
Hdfs.getFileLinkStatus(Path f) |
FileStatus |
FilterFs.getFileLinkStatus(Path f) |
FileStatus |
Hdfs.getFileStatus(Path f) |
abstract FileStatus |
AbstractFileSystem.getFileStatus(Path f)
The specification of this method matches that of
FileContext.getFileStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path. |
FileStatus |
FilterFs.getFileStatus(Path f) |
FsStatus |
AbstractFileSystem.getFsStatus(Path f)
The specification of this method matches that of
FileContext.getFsStatus(Path) except that Path f must be for this
file system. |
FsStatus |
FilterFs.getFsStatus(Path f) |
RemoteIterator<LocatedFileStatus> |
AbstractFileSystem.listLocatedStatus(Path f)
The specification of this method matches that of
FileContext.listLocatedStatus(Path) except that Path f
must be for this file system. |
FileStatus[] |
Hdfs.listStatus(Path f) |
abstract FileStatus[] |
AbstractFileSystem.listStatus(Path f)
The specification of this method matches that of
FileContext.Util.listStatus(Path) except that Path f must be
for this file system. |
FileStatus[] |
FilterFs.listStatus(Path f) |
FileStatus[] |
ChecksumFs.listStatus(Path f) |
RemoteIterator<FileStatus> |
Hdfs.listStatusIterator(Path f) |
RemoteIterator<FileStatus> |
AbstractFileSystem.listStatusIterator(Path f)
The specification of this method matches that of
FileContext.listStatus(Path) except that Path f must be for this
file system. |
void |
Hdfs.mkdir(Path dir,
FsPermission permission,
boolean createParent) |
abstract void |
AbstractFileSystem.mkdir(Path dir,
FsPermission permission,
boolean createParent)
The specification of this method matches that of
FileContext.mkdir(Path, FsPermission, boolean) except that the Path
f must be fully qualified and the permission is absolute (i.e. |
void |
FilterFs.mkdir(Path dir,
FsPermission permission,
boolean createParent) |
abstract T |
FSLinkResolver.next(AbstractFileSystem fs,
Path p)
Generic helper function overridden on instantiation to perform a
specific operation on the given file system using the given path
which may result in an UnresolvedLinkException.
|
FSDataInputStream |
AbstractFileSystem.open(Path f)
The specification of this method matches that of
FileContext.open(Path) except that Path f must be for this
file system. |
FSDataInputStream |
FilterFs.open(Path f) |
HdfsDataInputStream |
Hdfs.open(Path f,
int bufferSize) |
abstract FSDataInputStream |
AbstractFileSystem.open(Path f,
int bufferSize)
The specification of this method matches that of
FileContext.open(Path, int) except that Path f must be for this
file system. |
FSDataInputStream |
FilterFs.open(Path f,
int bufferSize) |
FSDataInputStream |
ChecksumFs.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
void |
AbstractFileSystem.rename(Path src,
Path dst,
Options.Rename... options)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
void |
Hdfs.renameInternal(Path src,
Path dst) |
abstract void |
AbstractFileSystem.renameInternal(Path src,
Path dst)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system and NO OVERWRITE is performed. |
void |
FilterFs.renameInternal(Path src,
Path dst) |
void |
ChecksumFs.renameInternal(Path src,
Path dst)
Rename files/dirs.
|
void |
Hdfs.renameInternal(Path src,
Path dst,
boolean overwrite) |
void |
AbstractFileSystem.renameInternal(Path src,
Path dst,
boolean overwrite)
The specification of this method matches that of
FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
void |
FilterFs.renameInternal(Path src,
Path dst,
boolean overwrite) |
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path.
|
Path |
AbstractFileSystem.resolvePath(Path p)
Return the fully-qualified path of path f resolving the path
through any internal symlinks or mount point
|
Path |
FilterFs.resolvePath(Path p) |
Path |
FileContext.resolvePath(Path f)
Resolve the path following any symlinks or mount points
|
void |
Hdfs.setOwner(Path f,
String username,
String groupname) |
abstract void |
AbstractFileSystem.setOwner(Path f,
String username,
String groupname)
The specification of this method matches that of
FileContext.setOwner(Path, String, String) except that Path f must
be for this file system. |
void |
FilterFs.setOwner(Path f,
String username,
String groupname) |
void |
Hdfs.setPermission(Path f,
FsPermission permission) |
abstract void |
AbstractFileSystem.setPermission(Path f,
FsPermission permission)
The specification of this method matches that of
FileContext.setPermission(Path, FsPermission) except that Path f
must be for this file system. |
void |
FilterFs.setPermission(Path f,
FsPermission permission) |
boolean |
Hdfs.setReplication(Path f,
short replication) |
abstract boolean |
AbstractFileSystem.setReplication(Path f,
short replication)
The specification of this method matches that of
FileContext.setReplication(Path, short) except that Path f must be
for this file system. |
boolean |
FilterFs.setReplication(Path f,
short replication) |
boolean |
ChecksumFs.setReplication(Path src,
short replication)
Set replication for an existing file.
|
void |
Hdfs.setTimes(Path f,
long mtime,
long atime) |
abstract void |
AbstractFileSystem.setTimes(Path f,
long mtime,
long atime)
The specification of this method matches that of
FileContext.setTimes(Path, long, long) except that Path f must be
for this file system. |
void |
FilterFs.setTimes(Path f,
long mtime,
long atime) |
void |
FilterFs.setVerifyChecksum(boolean verifyChecksum) |
Modifier and Type | Method and Description |
---|---|
FSDataOutputStream |
ViewFs.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
Options.ChecksumOpt checksumOpt,
boolean createParent) |
void |
ViewFs.createSymlink(Path target,
Path link,
boolean createParent) |
boolean |
ViewFs.delete(Path f,
boolean recursive) |
BlockLocation[] |
ViewFs.getFileBlockLocations(Path f,
long start,
long len) |
FileChecksum |
ViewFs.getFileChecksum(Path f) |
FileStatus |
ViewFs.getFileStatus(Path f) |
FileStatus[] |
ViewFs.listStatus(Path f) |
RemoteIterator<FileStatus> |
ViewFs.listStatusIterator(Path f) |
void |
ViewFs.mkdir(Path dir,
FsPermission permission,
boolean createParent) |
FSDataInputStream |
ViewFs.open(Path f,
int bufferSize) |
void |
ViewFs.renameInternal(Path src,
Path dst) |
void |
ViewFs.renameInternal(Path src,
Path dst,
boolean overwrite) |
Path |
ViewFs.resolvePath(Path f) |
void |
ViewFs.setOwner(Path f,
String username,
String groupname) |
void |
ViewFs.setPermission(Path f,
FsPermission permission) |
boolean |
ViewFs.setReplication(Path f,
short replication) |
void |
ViewFs.setTimes(Path f,
long mtime,
long atime) |
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
DFSClient.getBlockLocations(String src,
long start,
long length)
Get block location info about file
getBlockLocations() returns a list of hostnames that store
data for a specific file region.
|
DFSInputStream |
DFSClient.open(String src) |
DFSInputStream |
DFSClient.open(String src,
int buffersize,
boolean verifyChecksum)
Create an input stream that obtains a nodelist from the
namenode, and then reads from all the right places.
|
DFSInputStream |
DFSClient.open(String src,
int buffersize,
boolean verifyChecksum,
FileSystem.Statistics stats)
Deprecated.
Use
DFSClient.open(String, int, boolean) instead. |
DFSOutputStream |
DFSClient.primitiveCreate(String src,
FsPermission absPermission,
EnumSet<CreateFlag> flag,
boolean createParent,
short replication,
long blockSize,
Progressable progress,
int buffersize,
Options.ChecksumOpt checksumOpt)
Same as {
#create(String, FsPermission, EnumSet, short, long,
Progressable, int, ChecksumOpt) except that the permission
is absolute (ie has already been masked with umask. |
Modifier and Type | Class and Description |
---|---|
class |
UnresolvedPathException
Thrown when a symbolic link is encountered in a path.
|
Modifier and Type | Method and Description |
---|---|
void |
ClientProtocol.abandonBlock(ExtendedBlock b,
String src,
String holder)
The client can give up on a block by calling abandonBlock().
|
LocatedBlock |
ClientProtocol.addBlock(String src,
String clientName,
ExtendedBlock previous,
DatanodeInfo[] excludeNodes,
long fileId,
String[] favoredNodes)
A client that wants to write an additional block to the
indicated filename (which must currently be open for writing)
should call addBlock().
|
LocatedBlock |
ClientProtocol.append(String src,
String clientName)
Append to the end of the file.
|
boolean |
ClientProtocol.complete(String src,
String clientName,
ExtendedBlock last,
long fileId)
The client is done writing data to the given filename, and would
like to complete it.
|
void |
ClientProtocol.concat(String trg,
String[] srcs)
Moves blocks from srcs to trg and delete srcs
|
HdfsFileStatus |
ClientProtocol.create(String src,
FsPermission masked,
String clientName,
EnumSetWritable<CreateFlag> flag,
boolean createParent,
short replication,
long blockSize)
Create a new file entry in the namespace.
|
void |
ClientProtocol.createSymlink(String target,
String link,
FsPermission dirPerm,
boolean createParent)
Create symlink to a file or directory.
|
boolean |
ClientProtocol.delete(String src,
boolean recursive)
Delete the given file or directory from the file system.
|
void |
ClientProtocol.fsync(String src,
String client,
long lastBlockLength)
Write all metadata for this file into persistent storage.
|
LocatedBlock |
ClientProtocol.getAdditionalDatanode(String src,
ExtendedBlock blk,
DatanodeInfo[] existings,
DatanodeInfo[] excludes,
int numAdditionalNodes,
String clientName)
Get a datanode for an existing pipeline.
|
LocatedBlocks |
ClientProtocol.getBlockLocations(String src,
long offset,
long length)
Get locations of the blocks of the specified file within the specified range.
|
ContentSummary |
ClientProtocol.getContentSummary(String path)
Get
ContentSummary rooted at the specified directory. |
HdfsFileStatus |
ClientProtocol.getFileInfo(String src)
Get the file info for a specific file or directory.
|
HdfsFileStatus |
ClientProtocol.getFileLinkInfo(String src)
Get the file info for a specific file or directory.
|
DirectoryListing |
ClientProtocol.getListing(String src,
byte[] startAfter,
boolean needLocation)
Get a partial listing of the indicated directory
|
long |
ClientProtocol.getPreferredBlockSize(String filename)
Get the block size for the given file.
|
boolean |
ClientProtocol.isFileClosed(String src)
Get the close status of a file
|
boolean |
ClientProtocol.mkdirs(String src,
FsPermission masked,
boolean createParent)
Create a directory (or hierarchy of directories) with the given
name and permission.
|
boolean |
ClientProtocol.rename(String src,
String dst)
Rename an item in the file system namespace.
|
void |
ClientProtocol.rename2(String src,
String dst,
Options.Rename... options)
Rename src to dst.
|
void |
ClientProtocol.setOwner(String src,
String username,
String groupname)
Set Owner of a path (i.e.
|
void |
ClientProtocol.setPermission(String src,
FsPermission permission)
Set permissions for an existing file/directory.
|
void |
ClientProtocol.setQuota(String path,
long namespaceQuota,
long diskspaceQuota)
Set the quota for a directory.
|
boolean |
ClientProtocol.setReplication(String src,
short replication)
Set replication for an existing file.
|
void |
ClientProtocol.setTimes(String src,
long mtime,
long atime)
Sets the modification and access time of the file to the specified time.
|
Modifier and Type | Method and Description |
---|---|
void |
ClientNamenodeProtocolTranslatorPB.abandonBlock(ExtendedBlock b,
String src,
String holder) |
LocatedBlock |
ClientNamenodeProtocolTranslatorPB.addBlock(String src,
String clientName,
ExtendedBlock previous,
DatanodeInfo[] excludeNodes,
long fileId,
String[] favoredNodes) |
LocatedBlock |
ClientNamenodeProtocolTranslatorPB.append(String src,
String clientName) |
boolean |
ClientNamenodeProtocolTranslatorPB.complete(String src,
String clientName,
ExtendedBlock last,
long fileId) |
void |
ClientNamenodeProtocolTranslatorPB.concat(String trg,
String[] srcs) |
HdfsFileStatus |
ClientNamenodeProtocolTranslatorPB.create(String src,
FsPermission masked,
String clientName,
EnumSetWritable<CreateFlag> flag,
boolean createParent,
short replication,
long blockSize) |
void |
ClientNamenodeProtocolTranslatorPB.createSymlink(String target,
String link,
FsPermission dirPerm,
boolean createParent) |
boolean |
ClientNamenodeProtocolTranslatorPB.delete(String src,
boolean recursive) |
void |
ClientNamenodeProtocolTranslatorPB.fsync(String src,
String client,
long lastBlockLength) |
LocatedBlock |
ClientNamenodeProtocolTranslatorPB.getAdditionalDatanode(String src,
ExtendedBlock blk,
DatanodeInfo[] existings,
DatanodeInfo[] excludes,
int numAdditionalNodes,
String clientName) |
LocatedBlocks |
ClientNamenodeProtocolTranslatorPB.getBlockLocations(String src,
long offset,
long length) |
ContentSummary |
ClientNamenodeProtocolTranslatorPB.getContentSummary(String path) |
HdfsFileStatus |
ClientNamenodeProtocolTranslatorPB.getFileInfo(String src) |
HdfsFileStatus |
ClientNamenodeProtocolTranslatorPB.getFileLinkInfo(String src) |
DirectoryListing |
ClientNamenodeProtocolTranslatorPB.getListing(String src,
byte[] startAfter,
boolean needLocation) |
long |
ClientNamenodeProtocolTranslatorPB.getPreferredBlockSize(String filename) |
boolean |
ClientNamenodeProtocolTranslatorPB.isFileClosed(String src) |
boolean |
ClientNamenodeProtocolTranslatorPB.mkdirs(String src,
FsPermission masked,
boolean createParent) |
boolean |
ClientNamenodeProtocolTranslatorPB.rename(String src,
String dst) |
void |
ClientNamenodeProtocolTranslatorPB.rename2(String src,
String dst,
Options.Rename... options) |
void |
ClientNamenodeProtocolTranslatorPB.setOwner(String src,
String username,
String groupname) |
void |
ClientNamenodeProtocolTranslatorPB.setPermission(String src,
FsPermission permission) |
void |
ClientNamenodeProtocolTranslatorPB.setQuota(String path,
long namespaceQuota,
long diskspaceQuota) |
boolean |
ClientNamenodeProtocolTranslatorPB.setReplication(String src,
short replication) |
void |
ClientNamenodeProtocolTranslatorPB.setTimes(String src,
long mtime,
long atime) |
Modifier and Type | Method and Description |
---|---|
INode |
FSDirectory.getINode(String src)
Get
INode associated with the file / directory. |
INode |
FSDirectory.getINode4Write(String src)
Get
INode associated with the file / directory. |
INodesInPath |
FSDirectory.getINodesInPath4Write(String src)
Get
INode associated with the file / directory. |
INodesInPath |
FSDirectory.getLastINodeInPath(String src)
Get
INode associated with the file / directory. |
Copyright © 2013 Apache Software Foundation. All rights reserved.