Package | Description |
---|---|
org.apache.hadoop.hdfs |
A distributed implementation of
FileSystem . |
org.apache.hadoop.hdfs.protocol | |
org.apache.hadoop.hdfs.protocol.datatransfer | |
org.apache.hadoop.hdfs.protocolPB | |
org.apache.hadoop.hdfs.security.token.block | |
org.apache.hadoop.hdfs.server.common | |
org.apache.hadoop.hdfs.server.datanode |
Modifier and Type | Method and Description |
---|---|
protected BlockReader |
DFSInputStream.getBlockReader(InetSocketAddress dnAddr,
DatanodeInfo chosenNode,
String file,
ExtendedBlock block,
Token<BlockTokenIdentifier> blockToken,
long startOffset,
long len,
int bufferSize,
boolean verifyChecksum,
String clientName)
Retrieve a BlockReader suitable for reading.
|
static BlockReader |
BlockReaderFactory.newBlockReader(DFSClient.Conf conf,
String file,
ExtendedBlock block,
Token<BlockTokenIdentifier> blockToken,
long startOffset,
long len,
boolean verifyChecksum,
String clientName,
Peer peer,
DatanodeID datanodeID,
org.apache.hadoop.hdfs.DomainSocketFactory domSockFactory,
org.apache.hadoop.hdfs.PeerCache peerCache,
org.apache.hadoop.hdfs.FileInputStreamCache fisCache,
boolean allowShortCircuitLocalReads,
CachingStrategy cachingStrategy)
Create a new BlockReader specifically to satisfy a read.
|
static BlockReader |
RemoteBlockReader2.newBlockReader(String file,
ExtendedBlock block,
Token<BlockTokenIdentifier> blockToken,
long startOffset,
long len,
boolean verifyChecksum,
String clientName,
Peer peer,
DatanodeID datanodeID,
org.apache.hadoop.hdfs.PeerCache peerCache,
CachingStrategy cachingStrategy)
Create a new BlockReader specifically to satisfy a read.
|
static RemoteBlockReader |
RemoteBlockReader.newBlockReader(String file,
ExtendedBlock block,
Token<BlockTokenIdentifier> blockToken,
long startOffset,
long len,
int bufferSize,
boolean verifyChecksum,
String clientName,
Peer peer,
DatanodeID datanodeID,
org.apache.hadoop.hdfs.PeerCache peerCache,
CachingStrategy cachingStrategy)
Deprecated.
Create a new BlockReader specifically to satisfy a read.
|
Modifier and Type | Method and Description |
---|---|
Token<BlockTokenIdentifier> |
LocatedBlock.getBlockToken() |
Modifier and Type | Method and Description |
---|---|
BlockLocalPathInfo |
ClientDatanodeProtocol.getBlockLocalPathInfo(ExtendedBlock block,
Token<BlockTokenIdentifier> token)
Retrieves the path names of the block file and metadata file stored on the
local file system.
|
HdfsBlocksMetadata |
ClientDatanodeProtocol.getHdfsBlocksMetadata(List<ExtendedBlock> blocks,
List<Token<BlockTokenIdentifier>> tokens)
Retrieves volume location information about a list of blocks on a datanode.
|
void |
LocatedBlock.setBlockToken(Token<BlockTokenIdentifier> token) |
Modifier and Type | Method and Description |
---|---|
void |
Sender.blockChecksum(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken) |
void |
DataTransferProtocol.blockChecksum(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken)
Get block checksum (MD5 of CRC32).
|
void |
Sender.copyBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken) |
void |
DataTransferProtocol.copyBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken)
Copy a block.
|
void |
Sender.readBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
String clientName,
long blockOffset,
long length,
boolean sendChecksum,
CachingStrategy cachingStrategy) |
void |
DataTransferProtocol.readBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
String clientName,
long blockOffset,
long length,
boolean sendChecksum,
CachingStrategy cachingStrategy)
Read a block.
|
void |
Sender.replaceBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
String delHint,
DatanodeInfo source) |
void |
DataTransferProtocol.replaceBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
String delHint,
DatanodeInfo source)
Receive a block from a source datanode
and then notifies the namenode
to remove the copy from the original datanode.
|
void |
Sender.requestShortCircuitFds(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
int maxVersion) |
void |
DataTransferProtocol.requestShortCircuitFds(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
int maxVersion)
Request short circuit access file descriptors from a DataNode.
|
void |
Sender.transferBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
String clientName,
DatanodeInfo[] targets) |
void |
DataTransferProtocol.transferBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
String clientName,
DatanodeInfo[] targets)
Transfer a block to another datanode.
|
void |
Sender.writeBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
String clientName,
DatanodeInfo[] targets,
DatanodeInfo source,
BlockConstructionStage stage,
int pipelineSize,
long minBytesRcvd,
long maxBytesRcvd,
long latestGenerationStamp,
DataChecksum requestedChecksum,
CachingStrategy cachingStrategy) |
void |
DataTransferProtocol.writeBlock(ExtendedBlock blk,
Token<BlockTokenIdentifier> blockToken,
String clientName,
DatanodeInfo[] targets,
DatanodeInfo source,
BlockConstructionStage stage,
int pipelineSize,
long minBytesRcvd,
long maxBytesRcvd,
long latestGenerationStamp,
DataChecksum requestedChecksum,
CachingStrategy cachingStrategy)
Write a block to a datanode pipeline.
|
Modifier and Type | Method and Description |
---|---|
static Token<BlockTokenIdentifier> |
PBHelper.convert(SecurityProtos.TokenProto blockToken) |
Modifier and Type | Method and Description |
---|---|
BlockLocalPathInfo |
ClientDatanodeProtocolTranslatorPB.getBlockLocalPathInfo(ExtendedBlock block,
Token<BlockTokenIdentifier> token) |
HdfsBlocksMetadata |
ClientDatanodeProtocolTranslatorPB.getHdfsBlocksMetadata(List<ExtendedBlock> blocks,
List<Token<BlockTokenIdentifier>> tokens) |
Modifier and Type | Field and Description |
---|---|
static Token<BlockTokenIdentifier> |
BlockTokenSecretManager.DUMMY_TOKEN |
Modifier and Type | Method and Description |
---|---|
BlockTokenIdentifier |
BlockTokenSecretManager.createIdentifier()
Create an empty block token identifier
|
BlockTokenIdentifier |
BlockPoolTokenSecretManager.createIdentifier()
Return an empty BlockTokenIdentifer
|
Modifier and Type | Method and Description |
---|---|
Token<BlockTokenIdentifier> |
BlockTokenSecretManager.generateToken(ExtendedBlock block,
EnumSet<BlockTokenSecretManager.AccessMode> modes)
Generate an block token for current user
|
Token<BlockTokenIdentifier> |
BlockPoolTokenSecretManager.generateToken(ExtendedBlock b,
EnumSet<BlockTokenSecretManager.AccessMode> of)
|
Token<BlockTokenIdentifier> |
BlockTokenSecretManager.generateToken(String userId,
ExtendedBlock block,
EnumSet<BlockTokenSecretManager.AccessMode> modes)
Generate a block token for a specified user
|
Token<BlockTokenIdentifier> |
BlockTokenSelector.selectToken(Text service,
Collection<Token<? extends TokenIdentifier>> tokens) |
Modifier and Type | Method and Description |
---|---|
void |
BlockTokenSecretManager.checkAccess(BlockTokenIdentifier id,
String userId,
ExtendedBlock block,
BlockTokenSecretManager.AccessMode mode)
Check if access should be allowed.
|
void |
BlockPoolTokenSecretManager.checkAccess(BlockTokenIdentifier id,
String userId,
ExtendedBlock block,
BlockTokenSecretManager.AccessMode mode)
|
protected byte[] |
BlockTokenSecretManager.createPassword(BlockTokenIdentifier identifier)
Create a new password/secret for the given block token identifier.
|
byte[] |
BlockPoolTokenSecretManager.createPassword(BlockTokenIdentifier identifier) |
byte[] |
BlockTokenSecretManager.retrievePassword(BlockTokenIdentifier identifier)
Look up the token password/secret for the given block token identifier.
|
byte[] |
BlockPoolTokenSecretManager.retrievePassword(BlockTokenIdentifier identifier) |
Modifier and Type | Method and Description |
---|---|
void |
BlockTokenSecretManager.checkAccess(Token<BlockTokenIdentifier> token,
String userId,
ExtendedBlock block,
BlockTokenSecretManager.AccessMode mode)
Check if access should be allowed.
|
void |
BlockPoolTokenSecretManager.checkAccess(Token<BlockTokenIdentifier> token,
String userId,
ExtendedBlock block,
BlockTokenSecretManager.AccessMode mode)
|
Modifier and Type | Method and Description |
---|---|
static void |
JspHelper.streamBlockInAscii(InetSocketAddress addr,
String poolId,
long blockId,
Token<BlockTokenIdentifier> blockToken,
long genStamp,
long blockSize,
long offsetIntoBlock,
long chunkSizeToView,
javax.servlet.jsp.JspWriter out,
Configuration conf,
DFSClient.Conf dfsConf,
DataEncryptionKey encryptionKey) |
Modifier and Type | Method and Description |
---|---|
BlockLocalPathInfo |
DataNode.getBlockLocalPathInfo(ExtendedBlock block,
Token<BlockTokenIdentifier> token) |
HdfsBlocksMetadata |
DataNode.getHdfsBlocksMetadata(List<ExtendedBlock> blocks,
List<Token<BlockTokenIdentifier>> tokens) |
Copyright © 2013 Apache Software Foundation. All rights reserved.