Package | Description |
---|---|
org.apache.hadoop.hdfs |
A distributed implementation of
FileSystem . |
org.apache.hadoop.hdfs.protocol | |
org.apache.hadoop.hdfs.protocolPB | |
org.apache.hadoop.hdfs.server.blockmanagement | |
org.apache.hadoop.hdfs.server.datanode | |
org.apache.hadoop.hdfs.server.namenode | |
org.apache.hadoop.hdfs.server.protocol |
Modifier and Type | Method and Description |
---|---|
static ClientDatanodeProtocol |
DFSUtil.createClientDatanodeProtocolProxy(DatanodeID datanodeid,
Configuration conf,
int socketTimeout,
boolean connectToDnViaHostname,
LocatedBlock locatedBlock)
Create a
ClientDatanodeProtocol proxy |
static BlockReader |
BlockReaderFactory.newBlockReader(DFSClient.Conf conf,
String file,
ExtendedBlock block,
Token<BlockTokenIdentifier> blockToken,
long startOffset,
long len,
boolean verifyChecksum,
String clientName,
Peer peer,
DatanodeID datanodeID,
org.apache.hadoop.hdfs.DomainSocketFactory domSockFactory,
org.apache.hadoop.hdfs.PeerCache peerCache,
org.apache.hadoop.hdfs.FileInputStreamCache fisCache,
boolean allowShortCircuitLocalReads,
CachingStrategy cachingStrategy)
Create a new BlockReader specifically to satisfy a read.
|
static BlockReader |
RemoteBlockReader2.newBlockReader(String file,
ExtendedBlock block,
Token<BlockTokenIdentifier> blockToken,
long startOffset,
long len,
boolean verifyChecksum,
String clientName,
Peer peer,
DatanodeID datanodeID,
org.apache.hadoop.hdfs.PeerCache peerCache,
CachingStrategy cachingStrategy)
Create a new BlockReader specifically to satisfy a read.
|
static RemoteBlockReader |
RemoteBlockReader.newBlockReader(String file,
ExtendedBlock block,
Token<BlockTokenIdentifier> blockToken,
long startOffset,
long len,
int bufferSize,
boolean verifyChecksum,
String clientName,
Peer peer,
DatanodeID datanodeID,
org.apache.hadoop.hdfs.PeerCache peerCache,
CachingStrategy cachingStrategy)
Deprecated.
Create a new BlockReader specifically to satisfy a read.
|
Constructor and Description |
---|
RemoteBlockReader2(String file,
String bpid,
long blockId,
DataChecksum checksum,
boolean verifyChecksum,
long startOffset,
long firstChunkOffset,
long bytesToRead,
Peer peer,
DatanodeID datanodeID,
org.apache.hadoop.hdfs.PeerCache peerCache) |
Modifier and Type | Class and Description |
---|---|
class |
DatanodeInfo
This class extends the primary identifier of a Datanode with ephemeral
state, eg usage information, current administrative state, and the
network location that is communicated to clients.
|
Modifier and Type | Field and Description |
---|---|
static DatanodeID[] |
DatanodeID.EMPTY_ARRAY |
Modifier and Type | Method and Description |
---|---|
int |
DatanodeID.compareTo(DatanodeID that)
Compare based on data transfer address.
|
void |
ClientProtocol.updatePipeline(String clientName,
ExtendedBlock oldBlock,
ExtendedBlock newBlock,
DatanodeID[] newNodes)
Update a pipeline for a block under construction
|
void |
DatanodeID.updateRegInfo(DatanodeID nodeReg)
Update fields when a new registration request comes in.
|
Constructor and Description |
---|
DatanodeID(DatanodeID from) |
DatanodeInfo(DatanodeID nodeID) |
DatanodeInfo(DatanodeID nodeID,
String location) |
DatanodeInfo(DatanodeID nodeID,
String location,
long capacity,
long dfsUsed,
long remaining,
long blockPoolUsed,
long lastUpdate,
int xceiverCount,
DatanodeInfo.AdminStates adminState) |
UnregisteredNodeException(DatanodeID nodeID,
DatanodeInfo storedNode)
The exception is thrown if a different data-node claims the same
storage id as the existing one.
|
Modifier and Type | Method and Description |
---|---|
static DatanodeID |
PBHelper.convert(HdfsProtos.DatanodeIDProto dn) |
static DatanodeID[] |
PBHelper.convert(HdfsProtos.DatanodeIDProto[] did) |
Modifier and Type | Method and Description |
---|---|
void |
DatanodeProtocolClientSideTranslatorPB.commitBlockSynchronization(ExtendedBlock block,
long newgenerationstamp,
long newlength,
boolean closeFile,
boolean deleteblock,
DatanodeID[] newtargets,
String[] newtargetstorages) |
static HdfsProtos.DatanodeIDProto |
PBHelper.convert(DatanodeID dn) |
static HdfsProtos.DatanodeIDProto[] |
PBHelper.convert(DatanodeID[] did) |
void |
ClientNamenodeProtocolTranslatorPB.updatePipeline(String clientName,
ExtendedBlock oldBlock,
ExtendedBlock newBlock,
DatanodeID[] newNodes) |
Constructor and Description |
---|
ClientDatanodeProtocolTranslatorPB(DatanodeID datanodeid,
Configuration conf,
int socketTimeout,
boolean connectToDnViaHostname)
Constructor.
|
ClientDatanodeProtocolTranslatorPB(DatanodeID datanodeid,
Configuration conf,
int socketTimeout,
boolean connectToDnViaHostname,
LocatedBlock locatedBlock) |
Modifier and Type | Class and Description |
---|---|
class |
DatanodeDescriptor
This class extends the DatanodeInfo class with ephemeral information (eg
health, capacity, what blocks are associated with the Datanode) that is
private to the Namenode, ie this class is not exposed to clients.
|
Modifier and Type | Method and Description |
---|---|
BlocksWithLocations |
BlockManager.getBlocks(DatanodeID datanode,
long size)
return a list of blocks & their locations on
datanode whose
total size is size |
DatanodeDescriptor |
DatanodeManager.getDatanode(DatanodeID nodeID)
Get data node by storage ID.
|
void |
BlockManager.processIncrementalBlockReport(DatanodeID nodeID,
String poolId,
ReceivedDeletedBlockInfo[] blockInfos)
The given node is reporting incremental information about some blocks.
|
void |
BlockManager.processReport(DatanodeID nodeID,
String poolId,
BlockListAsLongs newReport)
The given datanode is reporting all its blocks.
|
void |
DatanodeManager.removeDatanode(DatanodeID node)
Remove a datanode
|
void |
DatanodeDescriptor.updateRegInfo(DatanodeID nodeReg) |
Constructor and Description |
---|
DatanodeDescriptor(DatanodeID nodeID)
DatanodeDescriptor constructor
|
DatanodeDescriptor(DatanodeID nodeID,
long capacity,
long dfsUsed,
long remaining,
long bpused,
int xceiverCount,
int failedVolumes)
DatanodeDescriptor constructor
|
DatanodeDescriptor(DatanodeID nodeID,
String networkLocation)
DatanodeDescriptor constructor
|
DatanodeDescriptor(DatanodeID nodeID,
String networkLocation,
long capacity,
long dfsUsed,
long remaining,
long bpused,
int xceiverCount,
int failedVolumes)
DatanodeDescriptor constructor
|
Modifier and Type | Method and Description |
---|---|
DatanodeID |
DataNode.getDatanodeId() |
Modifier and Type | Method and Description |
---|---|
static InterDatanodeProtocol |
DataNode.createInterDataNodeProtocolProxy(DatanodeID datanodeid,
Configuration conf,
int socketTimeout,
boolean connectToDnViaHostname) |
static void |
DataNode.setNewStorageID(DatanodeID dnId) |
Modifier and Type | Method and Description |
---|---|
void |
HostFileManager.MutableEntrySet.add(DatanodeID datanodeID) |
HostFileManager.Entry |
HostFileManager.EntrySet.find(DatanodeID datanodeID) |
boolean |
HostFileManager.isExcluded(DatanodeID dn) |
boolean |
HostFileManager.isIncluded(DatanodeID dn) |
void |
FSNamesystem.processIncrementalBlockReport(DatanodeID nodeID,
String poolId,
ReceivedDeletedBlockInfo[] blockInfos) |
Modifier and Type | Class and Description |
---|---|
class |
DatanodeRegistration
DatanodeRegistration class contains all information the name-node needs
to identify and verify a data-node when it contacts the name-node.
|
Modifier and Type | Method and Description |
---|---|
void |
DatanodeProtocol.commitBlockSynchronization(ExtendedBlock block,
long newgenerationstamp,
long newlength,
boolean closeFile,
boolean deleteblock,
DatanodeID[] newtargets,
String[] newtargetstorages)
Commit block synchronization in lease recovery
|
Constructor and Description |
---|
DatanodeRegistration(DatanodeID dn,
StorageInfo info,
ExportedBlockKeys keys,
String softwareVersion) |
DisallowedDatanodeException(DatanodeID nodeID) |
Copyright © 2013 Apache Software Foundation. All rights reserved.