Interface | Description |
---|---|
BlockReader |
A BlockReader is responsible for reading a single block
from a single datanode.
|
Class | Description |
---|---|
BlockReaderFactory |
Utility class to create BlockReader implementations.
|
ByteRangeInputStream |
To support HTTP byte streams, a new connection to an HTTP server needs to be
created each time.
|
ByteRangeInputStream.URLOpener |
This class wraps a URL and provides method to open connection.
|
CorruptFileBlockIterator |
Provides an iterator interface for listCorruptFileBlocks.
|
DeprecatedUTF8 |
A simple wrapper around
UTF8 . |
DFSClient |
DFSClient can connect to a Hadoop Filesystem and
perform basic file tasks.
|
DFSClient.Conf |
DFSClient configuration
|
DFSClient.DFSDataInputStream | Deprecated
use
HdfsDataInputStream instead. |
DFSClient.Renewer | |
DFSClientFaultInjector |
Used for injecting faults in DFSClient and DFSOutputStream tests.
|
DFSConfigKeys |
This class contains constants for configuration keys used
in hdfs.
|
DFSInputStream |
DFSInputStream provides bytes from a named file.
|
DFSInputStream.ReadStatistics | |
DFSOutputStream |
DFSOutputStream creates files from a stream of bytes.
|
DFSUtil | |
DFSUtil.ConfiguredNNAddress |
Represent one of the NameNodes configured in the cluster.
|
DFSUtil.DecomStaleComparator |
Comparator for sorting DataNodeInfo[] based on decommissioned/stale states.
|
DistributedFileSystem |
Implementation of the abstract FileSystem for the DFS system.
|
DistributedFileSystem.DiskStatus | Deprecated
Use
FsStatus instead |
HAUtil | |
HdfsConfiguration |
Adds deprecated keys into the configuration.
|
HDFSPolicyProvider |
PolicyProvider for HDFS protocols. |
HftpFileSystem |
An implementation of a protocol for accessing filesystems over HTTP.
|
HftpFileSystem.TokenManager | |
HsftpFileSystem |
An implementation of a protocol for accessing filesystems over HTTPS.
|
HsftpFileSystem.DummyHostnameVerifier |
Dummy hostname verifier that is used to bypass hostname checking
|
HsftpFileSystem.DummyTrustManager |
Dummy trustmanager that is used to trust all server certificates
|
NameNodeProxies |
Create proxy objects to communicate with a remote NN.
|
NameNodeProxies.ProxyAndInfo<PROXYTYPE> |
Wrapper for a client proxy as well as its associated service ID.
|
RemoteBlockReader | Deprecated
this is an old implementation that is being left around
in case any issues spring up with the new
RemoteBlockReader2 implementation. |
RemoteBlockReader2 |
This is a wrapper around connection to datanode
and understands checksum, offset etc.
|
Exception | Description |
---|---|
BlockMissingException |
This exception is thrown when a read encounters a block that has no locations
associated with it.
|
A distributed implementation of FileSystem
. This is loosely modelled after
Google's GFS.
The most important difference is that unlike GFS, Hadoop DFS files have strictly one writer at any one time. Bytes are always appended to the end of the writer's stream. There is no notion of "record appends" or "mutations" that are then checked or reordered. Writers simply emit a byte stream. That byte stream is guaranteed to be stored in the order written.
Copyright © 2013 Apache Software Foundation. All rights reserved.