Modifier and Type | Method and Description |
---|---|
Configuration |
Configurable.getConf()
Return the configuration used by this object.
|
Configuration |
Configured.getConf() |
Modifier and Type | Method and Description |
---|---|
static void |
Configuration.dumpConfiguration(Configuration config,
Writer out)
Writes out all the parameters and their properties (final and resource) to
the given
Writer
The format of the output would be
{ "properties" : [ {key1,value1,key1.isFinal,key1.resource}, {key2,value2,
key2.isFinal,key2.resource}... |
static Collection<ReconfigurationUtil.PropertyChange> |
ReconfigurationUtil.getChangedProperties(Configuration newConf,
Configuration oldConf) |
void |
Configurable.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
Configured.setConf(Configuration conf) |
Constructor and Description |
---|
Configuration(Configuration other)
A new configuration with the same settings cloned from another.
|
Configured(Configuration conf)
Construct a Configured.
|
ReconfigurableBase(Configuration conf)
Construct a ReconfigurableBase with the
Configuration
conf. |
Constructor and Description |
---|
BookKeeperJournalManager(Configuration conf,
URI uri,
NamespaceInfo nsInfo)
Construct a Bookkeeper journal manager.
|
Modifier and Type | Method and Description |
---|---|
static BigDecimal |
QuasiMonteCarlo.estimatePi(int numMaps,
long numPoints,
Path tmpDir,
Configuration conf)
Run a map/reduce job for estimating Pi.
|
Modifier and Type | Method and Description |
---|---|
static Summation |
SummationWritable.read(Class<?> clazz,
Configuration conf)
Read sigma from conf
|
static void |
SummationWritable.write(Summation sigma,
Class<?> clazz,
Configuration conf)
Write sigma to conf
|
Modifier and Type | Method and Description |
---|---|
Configuration |
TeraSort.SimplePartitioner.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
TeraSort.SimplePartitioner.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static void |
DistributedCache.addLocalArchives(Configuration conf,
String str)
Deprecated.
|
static void |
DistributedCache.addLocalFiles(Configuration conf,
String str)
Deprecated.
|
static void |
DistributedCache.createAllSymlink(Configuration conf,
File jobCacheDir,
File workDir)
Deprecated.
Internal to MapReduce framework. Use DistributedCacheManager
instead.
|
static FileStatus |
DistributedCache.getFileStatus(Configuration conf,
URI cache)
Deprecated.
|
static long |
DistributedCache.getTimestamp(Configuration conf,
URI cache)
Deprecated.
|
static void |
DistributedCache.setArchiveTimestamps(Configuration conf,
String timestamps)
Deprecated.
|
static void |
DistributedCache.setFileTimestamps(Configuration conf,
String timestamps)
Deprecated.
|
static void |
DistributedCache.setLocalArchives(Configuration conf,
String str)
Deprecated.
|
static void |
DistributedCache.setLocalFiles(Configuration conf,
String str)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
Configuration |
FilterFileSystem.getConf() |
Configuration |
HarFileSystem.getConf() |
Modifier and Type | Method and Description |
---|---|
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems.
|
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge).
|
static AbstractFileSystem |
AbstractFileSystem.createFileSystem(URI uri,
Configuration conf)
Create a file system instance for the specified uri using the conf.
|
File |
LocalDirAllocator.createTmpFileForWrite(String pathStr,
long size,
Configuration conf)
Creates a temporary file in the local FS.
|
static FileSystem |
FileSystem.get(Configuration conf)
Returns the configured filesystem implementation.
|
static AbstractFileSystem |
AbstractFileSystem.get(URI uri,
Configuration conf)
The main factory method for creating a file system.
|
static FileSystem |
FileSystem.get(URI uri,
Configuration conf)
Returns the FileSystem for this URI's scheme and authority.
|
static FileSystem |
FileSystem.get(URI uri,
Configuration conf,
String user)
Get a filesystem instance based on the uri, the passed
configuration and the user
|
Iterable<Path> |
LocalDirAllocator.getAllLocalPathsToRead(String pathStr,
Configuration conf)
Get all of the paths that currently exist in the working directories.
|
static URI |
FileSystem.getDefaultUri(Configuration conf)
Get the default filesystem URI from a configuration.
|
static FileContext |
FileContext.getFileContext(AbstractFileSystem defFS,
Configuration aConf)
Create a FileContext with specified FS as default using the specified
config.
|
static FileContext |
FileContext.getFileContext(Configuration aConf)
Create a FileContext using the passed config.
|
static FileContext |
FileContext.getFileContext(URI defaultFsUri,
Configuration aConf)
Create a FileContext for specified default URI using the specified config.
|
FileSystem |
Path.getFileSystem(Configuration conf)
Return the FileSystem that owns this Path.
|
static Class<? extends FileSystem> |
FileSystem.getFileSystemClass(String scheme,
Configuration conf) |
protected static FileSystem |
FileSystem.getFSofPath(Path absOrFqPath,
Configuration conf) |
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs,
Path home)
Get an instance of the configured TrashPolicy based on the value
of the configuration parameter fs.trash.classname.
|
static LocalFileSystem |
FileSystem.getLocal(Configuration conf)
Get the local file system.
|
static FileContext |
FileContext.getLocalFSFileContext(Configuration aConf) |
Path |
LocalDirAllocator.getLocalPathForWrite(String pathStr,
Configuration conf)
Get a path from the local FS.
|
Path |
LocalDirAllocator.getLocalPathForWrite(String pathStr,
long size,
Configuration conf)
Get a path from the local FS.
|
Path |
LocalDirAllocator.getLocalPathForWrite(String pathStr,
long size,
Configuration conf,
boolean checkWrite)
Get a path from the local FS.
|
Path |
LocalDirAllocator.getLocalPathToRead(String pathStr,
Configuration conf)
Get a path from the local FS for reading.
|
static FileSystem |
FileSystem.getNamed(String name,
Configuration conf)
Deprecated.
call #get(URI,Configuration) instead.
|
boolean |
LocalDirAllocator.ifExists(String pathStr,
Configuration conf)
We search through all the configured dirs for the file's existence
and return true when we find
|
void |
TrashPolicyDefault.initialize(Configuration conf,
FileSystem fs,
Path home) |
abstract void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs,
Path home)
Used to setup the trash policy.
|
void |
FilterFileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed.
|
void |
RawLocalFileSystem.initialize(URI uri,
Configuration conf) |
void |
FileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed.
|
void |
HarFileSystem.initialize(URI name,
Configuration conf)
Initialize a Har filesystem per har archive.
|
void |
LocalFileSystem.initialize(URI name,
Configuration conf) |
static boolean |
Trash.moveToAppropriateTrash(FileSystem fs,
Path p,
Configuration conf)
In case of the symlinks or mount points, one has to move the appropriate
trashbin in the actual volume of the path p being deleted.
|
static FileSystem |
FileSystem.newInstance(Configuration conf)
Returns a unique configured filesystem implementation.
|
static FileSystem |
FileSystem.newInstance(URI uri,
Configuration conf)
Returns the FileSystem for this URI's scheme and authority.
|
static FileSystem |
FileSystem.newInstance(URI uri,
Configuration conf,
String user)
Returns the FileSystem for this URI's scheme and authority and the
passed user.
|
static LocalFileSystem |
FileSystem.newInstanceLocal(Configuration conf)
Get a unique local file system object
|
void |
ChecksumFileSystem.setConf(Configuration conf) |
static void |
FileSystem.setDefaultUri(Configuration conf,
String uri)
Set the default filesystem URI in a configuration.
|
static void |
FileSystem.setDefaultUri(Configuration conf,
URI uri)
Set the default filesystem URI in a configuration.
|
Constructor and Description |
---|
DelegateToFileSystem(URI theUri,
FileSystem theFsImpl,
Configuration conf,
String supportedScheme,
boolean authorityRequired) |
DF(File path,
Configuration conf) |
DU(File path,
Configuration conf)
Keeps track of disk usage.
|
FsShell(Configuration conf)
Construct a FsShell with the given configuration.
|
FsUrlStreamHandlerFactory(Configuration conf) |
Trash(Configuration conf)
Construct a trash can accessor.
|
Trash(FileSystem fs,
Configuration conf)
Construct a trash can accessor for the FileSystem provided.
|
Modifier and Type | Method and Description |
---|---|
void |
FTPFileSystem.initialize(URI uri,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
HttpFSFileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed.
|
Constructor and Description |
---|
HttpFSServerWebApp(String homeDir,
Configuration config)
Constructor used for testing purposes.
|
HttpFSServerWebApp(String homeDir,
String configDir,
String logDir,
String tempDir,
Configuration config)
Constructor used for testing purposes.
|
Modifier and Type | Method and Description |
---|---|
static FsPermission |
FsPermission.getUMask(Configuration conf)
Get the user file creation mask (umask)
UMASK_LABEL config param has umask value that is either symbolic
or octal. |
static void |
FsPermission.setUMask(Configuration conf,
FsPermission umask)
Set the user file creation mask (umask)
|
Modifier and Type | Method and Description |
---|---|
void |
FileSystemStore.initialize(URI uri,
Configuration conf) |
void |
S3Credentials.initialize(URI uri,
Configuration conf) |
void |
S3FileSystem.initialize(URI uri,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
NativeS3FileSystem.initialize(URI uri,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static PathData[] |
PathData.expandAsGlob(String pattern,
Configuration conf)
Expand the given path as a glob pattern.
|
Command |
CommandFactory.getInstance(String cmdName,
Configuration conf)
Get an instance of the requested command
|
Constructor and Description |
---|
Command(Configuration conf)
Constructor
|
CommandFactory(Configuration conf)
Factory constructor for commands
|
Count(String[] cmd,
int pos,
Configuration conf)
Deprecated.
invoke via
FsShell |
FsCommand(Configuration conf) |
PathData(String pathString,
Configuration conf)
Creates an object to wrap the given parameters as fields.
|
PathData(URI localPath,
Configuration conf)
Creates an object to wrap the given parameters as fields.
|
Modifier and Type | Method and Description |
---|---|
static void |
ConfigUtil.addLink(Configuration conf,
String mountTableName,
String src,
URI target)
Add a link to the config for the specified mount table
|
static void |
ConfigUtil.addLink(Configuration conf,
String src,
URI target)
Add a link to the config for the default mount table
|
static String |
ConfigUtil.getHomeDirValue(Configuration conf)
Get the value of the home dir conf value for default mount table
|
static String |
ConfigUtil.getHomeDirValue(Configuration conf,
String mountTableName)
Get the value of the home dir conf value for specfied mount table
|
void |
ViewFileSystem.initialize(URI theUri,
Configuration conf)
Called after a new FileSystem instance is constructed.
|
static void |
ConfigUtil.setHomeDirConf(Configuration conf,
String homedir)
Add config variable for homedir for default mount table
|
static void |
ConfigUtil.setHomeDirConf(Configuration conf,
String mountTableName,
String homedir)
Add config variable for homedir the specified mount table
|
Constructor and Description |
---|
ViewFileSystem(Configuration conf)
Convenience Constructor for apps to call directly
|
ViewFs(Configuration conf) |
Modifier and Type | Field and Description |
---|---|
protected Configuration |
ZKFailoverController.conf |
Modifier and Type | Method and Description |
---|---|
static NodeFencer |
NodeFencer.create(Configuration conf,
String confKey) |
HAServiceProtocol |
HAServiceTarget.getProxy(Configuration conf,
int timeoutMs) |
ZKFCProtocol |
HAServiceTarget.getZKFCProxy(Configuration conf,
int timeoutMs) |
void |
HAAdmin.setConf(Configuration conf) |
Constructor and Description |
---|
FailoverController(Configuration conf,
HAServiceProtocol.RequestSource source) |
ZKFailoverController(Configuration conf,
HAServiceTarget localTarget) |
Constructor and Description |
---|
HAServiceProtocolClientSideTranslatorPB(InetSocketAddress addr,
Configuration conf) |
HAServiceProtocolClientSideTranslatorPB(InetSocketAddress addr,
Configuration conf,
SocketFactory socketFactory,
int timeout) |
ZKFCProtocolClientSideTranslatorPB(InetSocketAddress addr,
Configuration conf,
SocketFactory socketFactory,
int timeout) |
Modifier and Type | Class and Description |
---|---|
class |
HdfsConfiguration
Adds deprecated keys into the configuration.
|
Modifier and Type | Method and Description |
---|---|
static Configuration |
HAUtil.getConfForOtherNode(Configuration myConf)
Given the configuration for this node, return a Configuration object for
the other node in an HA setup.
|
Modifier and Type | Method and Description |
---|---|
static void |
DFSUtil.addPBProtocol(Configuration conf,
Class<?> protocol,
com.google.protobuf.BlockingService service,
RPC.Server server)
Add protobuf based protocol to the
RPC.Server |
void |
HftpFileSystem.TokenManager.cancel(Token<?> token,
Configuration conf) |
void |
DFSClient.Renewer.cancel(Token<?> token,
Configuration conf) |
static ClientDatanodeProtocol |
DFSUtil.createClientDatanodeProtocolProxy(DatanodeID datanodeid,
Configuration conf,
int socketTimeout,
boolean connectToDnViaHostname,
LocatedBlock locatedBlock)
Create a
ClientDatanodeProtocol proxy |
static ClientDatanodeProtocol |
DFSUtil.createClientDatanodeProtocolProxy(InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory)
Create a
ClientDatanodeProtocol proxy |
static <T> FailoverProxyProvider<T> |
NameNodeProxies.createFailoverProxyProvider(Configuration conf,
Class<FailoverProxyProvider<T>> failoverProxyProviderClass,
Class<T> xface,
URI nameNodeUri)
Creates the Failover proxy provider instance
|
static <T> NameNodeProxies.ProxyAndInfo<T> |
NameNodeProxies.createNonHAProxy(Configuration conf,
InetSocketAddress nnAddr,
Class<T> xface,
UserGroupInformation ugi,
boolean withRetries)
Creates an explicitly non-HA-enabled proxy object.
|
static <T> NameNodeProxies.ProxyAndInfo<T> |
NameNodeProxies.createProxy(Configuration conf,
URI nameNodeUri,
Class<T> xface)
Creates the namenode proxy with the passed protocol.
|
static <T> NameNodeProxies.ProxyAndInfo<T> |
NameNodeProxies.createProxyWithLossyRetryHandler(Configuration config,
URI nameNodeUri,
Class<T> xface,
int numResponseToDrop)
Generate a dummy namenode proxy instance that utilizes our hacked
LossyRetryInvocationHandler . |
static Set<String> |
DFSUtil.getAllNnPrincipals(Configuration conf) |
static String |
DFSUtil.getBackupNameServiceId(Configuration conf)
Get nameservice Id for the BackupNode based on backup node RPC address
matching the local node address.
|
static Map<String,Map<String,InetSocketAddress>> |
DFSUtil.getBackupNodeAddresses(Configuration conf)
Returns list of InetSocketAddress corresponding to backup node rpc
addresses from the configuration.
|
static Configuration |
HAUtil.getConfForOtherNode(Configuration myConf)
Given the configuration for this node, return a Configuration object for
the other node in an HA setup.
|
static <T> Class<FailoverProxyProvider<T>> |
NameNodeProxies.getFailoverProxyProviderClass(Configuration conf,
URI nameNodeUri,
Class<T> xface)
Gets the configured Failover proxy provider's class
|
static Map<String,Map<String,InetSocketAddress>> |
DFSUtil.getHaNnRpcAddresses(Configuration conf)
Returns list of InetSocketAddress corresponding to HA NN RPC addresses from
the configuration.
|
static String |
DFSUtil.getInfoServer(InetSocketAddress namenodeAddr,
Configuration conf,
boolean httpsAddress)
return server http or https address from the configuration for a
given namenode rpc address.
|
static float |
DFSUtil.getInvalidateWorkPctPerIteration(Configuration conf)
Get DFS_NAMENODE_INVALIDATE_WORK_PCT_PER_ITERATION from configuration.
|
static String |
HAUtil.getNameNodeId(Configuration conf,
String nsId)
Get the namenode Id by matching the
addressKey
with the the address of the local node. |
static String |
HAUtil.getNameNodeIdFromAddress(Configuration conf,
InetSocketAddress address,
String... keys)
|
static String |
HAUtil.getNameNodeIdOfOtherNode(Configuration conf,
String nsId)
Get the NN ID of the other node in an HA setup.
|
static Collection<String> |
DFSUtil.getNameNodeIds(Configuration conf,
String nsId)
Namenode HighAvailability related configuration.
|
static String |
DFSUtil.getNamenodeNameServiceId(Configuration conf)
Get nameservice Id for the
NameNode based on namenode RPC address
matching the local node address. |
static String |
DFSUtil.getNamenodeServiceAddr(Configuration conf,
String nsId,
String nnId)
Map a logical namenode ID to its service address.
|
static String |
DFSUtil.getNameServiceIdFromAddress(Configuration conf,
InetSocketAddress address,
String... keys)
Given the InetSocketAddress this method returns the nameservice Id
corresponding to the key with matching address, by doing a reverse
lookup on the list of nameservices until it finds a match.
|
static Collection<String> |
DFSUtil.getNameServiceIds(Configuration conf)
Returns collection of nameservice Ids from the configuration.
|
static Collection<URI> |
DFSUtil.getNameServiceUris(Configuration conf,
String... keys)
Get a URI for each configured nameservice.
|
static Map<String,Map<String,InetSocketAddress>> |
DFSUtil.getNNServiceRpcAddresses(Configuration conf)
Returns list of InetSocketAddresses corresponding to namenodes from the
configuration.
|
static Collection<URI> |
DFSUtil.getNsServiceRpcUris(Configuration conf)
Get a URI for each configured nameservice.
|
static String |
DFSUtil.getOnlyNameServiceIdOrNull(Configuration conf)
If the configuration refers to only a single nameservice, return the
name of that nameservice.
|
static int |
DFSUtil.getReplWorkMultiplier(Configuration conf)
Get DFS_NAMENODE_REPLICATION_WORK_MULTIPLIER_PER_ITERATION from
configuration.
|
static Map<String,Map<String,InetSocketAddress>> |
DFSUtil.getSecondaryNameNodeAddresses(Configuration conf)
Returns list of InetSocketAddresses of corresponding to secondary namenode
http addresses from the configuration.
|
static String |
DFSUtil.getSecondaryNameServiceId(Configuration conf)
Get nameservice Id for the secondary node based on secondary http address
matching the local node address.
|
static String |
DFSUtil.getSpnegoKeytabKey(Configuration conf,
String defaultKey)
Get SPNEGO keytab Key from configuration
|
void |
HftpFileSystem.initialize(URI name,
Configuration conf) |
void |
HsftpFileSystem.initialize(URI name,
Configuration conf) |
void |
DistributedFileSystem.initialize(URI uri,
Configuration conf) |
static boolean |
HAUtil.isHAEnabled(Configuration conf,
String nsId)
Returns true if HA for namenode is configured for the given nameservice
|
static boolean |
HAUtil.isLogicalUri(Configuration conf,
URI nameNodeUri) |
static String |
DFSUtil.nnAddressesAsString(Configuration conf) |
long |
HftpFileSystem.TokenManager.renew(Token<?> token,
Configuration conf) |
long |
DFSClient.Renewer.renew(Token<?> token,
Configuration conf) |
static void |
HAUtil.setAllowStandbyReads(Configuration conf,
boolean val) |
static void |
DFSUtil.setGenericConf(Configuration conf,
String nameserviceId,
String nnId,
String... keys)
Sets the node specific setting into generic configuration key.
|
static boolean |
HAUtil.shouldAllowStandbyReads(Configuration conf)
This is used only by tests at the moment.
|
static boolean |
HAUtil.usesSharedEditsDir(Configuration conf)
Returns true if HA is using a shared edits directory.
|
Constructor and Description |
---|
DFSClient.Conf(Configuration conf) |
DFSClient(Configuration conf)
Deprecated.
Deprecated at 0.21
|
DFSClient(InetSocketAddress address,
Configuration conf) |
DFSClient(URI nameNodeUri,
ClientProtocol rpcNamenode,
Configuration conf,
FileSystem.Statistics stats)
Create a new DFSClient connected to the given nameNodeUri or rpcNamenode.
|
DFSClient(URI nameNodeUri,
Configuration conf)
Same as this(nameNodeUri, conf, null);
|
DFSClient(URI nameNodeUri,
Configuration conf,
FileSystem.Statistics stats)
Same as this(nameNodeUri, null, conf, stats);
|
DistributedFileSystem(InetSocketAddress namenode,
Configuration conf)
Deprecated.
|
HdfsConfiguration(Configuration conf) |
Constructor and Description |
---|
HdfsAdmin(URI uri,
Configuration conf)
Create a new HdfsAdmin client.
|
Constructor and Description |
---|
Mountd(List<String> exports,
Configuration config) |
RpcProgramMountd(List<String> exports,
Configuration config) |
Constructor and Description |
---|
Nfs3(List<String> exports,
Configuration config) |
RpcProgramNfs3(Configuration config) |
Modifier and Type | Method and Description |
---|---|
static ReplaceDatanodeOnFailure |
ReplaceDatanodeOnFailure.get(Configuration conf)
Get the setting from configuration.
|
void |
ReplaceDatanodeOnFailure.write(Configuration conf)
Write the setting to configuration.
|
Constructor and Description |
---|
ClientDatanodeProtocolTranslatorPB(DatanodeID datanodeid,
Configuration conf,
int socketTimeout,
boolean connectToDnViaHostname)
Constructor.
|
ClientDatanodeProtocolTranslatorPB(DatanodeID datanodeid,
Configuration conf,
int socketTimeout,
boolean connectToDnViaHostname,
LocatedBlock locatedBlock) |
ClientDatanodeProtocolTranslatorPB(InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory) |
DatanodeProtocolClientSideTranslatorPB(InetSocketAddress nameNodeAddr,
Configuration conf) |
InterDatanodeProtocolTranslatorPB(InetSocketAddress addr,
UserGroupInformation ugi,
Configuration conf,
SocketFactory factory,
int socketTimeout) |
Constructor and Description |
---|
IPCLoggerChannel(Configuration conf,
NamespaceInfo nsInfo,
String journalId,
InetSocketAddress addr) |
QuorumJournalManager(Configuration conf,
URI uri,
NamespaceInfo nsInfo) |
Modifier and Type | Method and Description |
---|---|
Configuration |
JournalNode.getConf() |
static Configuration |
JournalNodeHttpServer.getConfFromContext(javax.servlet.ServletContext context) |
Modifier and Type | Method and Description |
---|---|
protected boolean |
GetJournalEditServlet.isValidRequestor(javax.servlet.http.HttpServletRequest request,
Configuration conf) |
void |
JournalNode.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Token<DelegationTokenIdentifier> |
DelegationTokenSelector.selectToken(URI nnUri,
Collection<Token<?>> tokens,
Configuration conf)
Select the delegation token for hdfs.
|
Modifier and Type | Method and Description |
---|---|
void |
BlockManager.activate(Configuration conf) |
static BlockPlacementPolicy |
BlockPlacementPolicy.getInstance(Configuration conf,
FSClusterStats stats,
NetworkTopology clusterMap)
Get an instance of the configured Block Placement Policy based on the
value of the configuration paramater dfs.block.replicator.classname.
|
void |
BlockPlacementPolicyDefault.initialize(Configuration conf,
FSClusterStats stats,
NetworkTopology clusterMap) |
protected abstract void |
BlockPlacementPolicy.initialize(Configuration conf,
FSClusterStats stats,
NetworkTopology clusterMap)
Used to setup a BlockPlacementPolicy object.
|
void |
BlockPlacementPolicyWithNodeGroup.initialize(Configuration conf,
FSClusterStats stats,
NetworkTopology clusterMap) |
void |
DatanodeManager.refreshNodes(Configuration conf)
Rereads conf to get hosts and exclude list file names.
|
Constructor and Description |
---|
BlockManager(Namesystem namesystem,
FSClusterStats stats,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static DatanodeInfo |
JspHelper.bestNode(DatanodeInfo[] nodes,
boolean doRandom,
Configuration conf) |
static DatanodeInfo |
JspHelper.bestNode(LocatedBlock blk,
Configuration conf) |
static DatanodeInfo |
JspHelper.bestNode(LocatedBlocks blks,
Configuration conf) |
static UserGroupInformation |
JspHelper.getDefaultWebUser(Configuration conf)
If security is turned off, what is the default web user?
|
static UserGroupInformation |
JspHelper.getUGI(javax.servlet.http.HttpServletRequest request,
Configuration conf)
Same as getUGI(null, request, conf).
|
static UserGroupInformation |
JspHelper.getUGI(javax.servlet.ServletContext context,
javax.servlet.http.HttpServletRequest request,
Configuration conf)
Same as getUGI(context, request, conf, KERBEROS_SSL, true).
|
static UserGroupInformation |
JspHelper.getUGI(javax.servlet.ServletContext context,
javax.servlet.http.HttpServletRequest request,
Configuration conf,
UserGroupInformation.AuthenticationMethod secureAuthMethod,
boolean tryUgiParameter)
Get
UserGroupInformation and possibly the delegation token out of
the request. |
static void |
JspHelper.streamBlockInAscii(InetSocketAddress addr,
String poolId,
long blockId,
Token<BlockTokenIdentifier> blockToken,
long genStamp,
long blockSize,
long offsetIntoBlock,
long chunkSizeToView,
javax.servlet.jsp.JspWriter out,
Configuration conf,
DFSClient.Conf dfsConf,
DataEncryptionKey encryptionKey) |
Modifier and Type | Method and Description |
---|---|
static DataNode |
DataNode.createDataNode(String[] args,
Configuration conf)
Instantiate & Start a single datanode daemon and wait for it to finish.
|
static DataNode |
DataNode.createDataNode(String[] args,
Configuration conf,
SecureDataNodeStarter.SecureResources resources)
Instantiate & Start a single datanode daemon and wait for it to finish.
|
static InterDatanodeProtocol |
DataNode.createInterDataNodeProtocolProxy(DatanodeID datanodeid,
Configuration conf,
int socketTimeout,
boolean connectToDnViaHostname) |
static DFSClient |
DatanodeJspHelper.getDFSClient(javax.servlet.http.HttpServletRequest request,
DataNode datanode,
Configuration conf,
UserGroupInformation ugi)
Get DFSClient for a namenode corresponding to the BPID from a datanode
|
static InetSocketAddress |
DataNode.getInfoAddr(Configuration conf)
Determine the http server's effective addr
|
static SecureDataNodeStarter.SecureResources |
SecureDataNodeStarter.getSecureResources(SSLFactory sslFactory,
Configuration conf) |
static DataNode |
DataNode.instantiateDataNode(String[] args,
Configuration conf)
Instantiate a single datanode object.
|
static DataNode |
DataNode.instantiateDataNode(String[] args,
Configuration conf,
SecureDataNodeStarter.SecureResources resources)
Instantiate a single datanode object, along with its secure resources.
|
void |
DataNode.refreshNamenodes(Configuration conf) |
Constructor and Description |
---|
DNConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
AvailableSpaceVolumeChoosingPolicy.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
FsDatasetSpi.addBlockPool(String bpid,
Configuration conf)
add new block pool ID
|
static FsDatasetSpi.Factory<?> |
FsDatasetSpi.Factory.getFactory(Configuration conf) |
abstract D |
FsDatasetSpi.Factory.newInstance(DataNode datanode,
DataStorage storage,
Configuration conf)
Create a new object.
|
void |
AvailableSpaceVolumeChoosingPolicy.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl |
FsDatasetFactory.newInstance(DataNode datanode,
DataStorage storage,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static DataNodeMetrics |
DataNodeMetrics.create(Configuration conf,
String dnName) |
Modifier and Type | Field and Description |
---|---|
protected Configuration |
NameNode.conf |
Modifier and Type | Method and Description |
---|---|
static Configuration |
NameNodeHttpServer.getConfFromContext(javax.servlet.ServletContext context) |
Modifier and Type | Method and Description |
---|---|
static void |
NameNode.checkAllowFormat(Configuration conf) |
static NameNode |
NameNode.createNameNode(String[] argv,
Configuration conf) |
protected org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer |
NameNode.createRpcServer(Configuration conf)
Create the RPC server implementation.
|
protected org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer |
BackupNode.createRpcServer(Configuration conf) |
static void |
NameNode.format(Configuration conf)
Format a new filesystem.
|
static InetSocketAddress |
NameNode.getAddress(Configuration conf) |
static InetSocketAddress |
SecondaryNameNode.getHttpAddress(Configuration conf) |
static InetSocketAddress |
NameNode.getHttpAddress(Configuration conf) |
protected InetSocketAddress |
NameNode.getHttpServerAddress(Configuration conf) |
protected InetSocketAddress |
BackupNode.getHttpServerAddress(Configuration conf) |
protected String |
NameNode.getNameServiceId(Configuration conf)
Get the name service Id for the node
|
protected String |
BackupNode.getNameServiceId(Configuration conf) |
static Collection<URI> |
FSNamesystem.getNamespaceDirs(Configuration conf) |
static List<URI> |
FSNamesystem.getNamespaceEditsDirs(Configuration conf)
Return an ordered list of edits directories to write to.
|
static List<URI> |
FSNamesystem.getNamespaceEditsDirs(Configuration conf,
boolean includeShared) |
static Collection<URI> |
FSNamesystem.getRequiredNamespaceEditsDirs(Configuration conf)
Get all edits dirs which are required.
|
protected InetSocketAddress |
NameNode.getRpcServerAddress(Configuration conf) |
protected InetSocketAddress |
BackupNode.getRpcServerAddress(Configuration conf) |
protected String |
NameNode.getRpcServerBindHost(Configuration conf)
Given a configuration get the bind host of the client rpc server
If the bind host is not configured returns null.
|
static InetSocketAddress |
NameNode.getServiceAddress(Configuration conf,
boolean fallback)
Fetches the address for services to use when connecting to namenode
based on the value of fallback returns null if the special
address is not specified or returns the default namenode address
to be used by both clients and services.
|
protected InetSocketAddress |
NameNode.getServiceRpcServerAddress(Configuration conf)
Given a configuration get the address of the service rpc server
If the service rpc is not configured returns null
|
protected InetSocketAddress |
BackupNode.getServiceRpcServerAddress(Configuration conf) |
protected String |
NameNode.getServiceRpcServerBindHost(Configuration conf)
Given a configuration get the bind host of the service rpc server
If the bind host is not configured returns null.
|
static List<URI> |
FSNamesystem.getSharedEditsDirs(Configuration conf)
Returns edit directories that are shared between primary and secondary.
|
static DataTransferThrottler |
GetImageServlet.getThrottler(Configuration conf)
Construct a throttler from conf
|
void |
AuditLogger.initialize(Configuration conf)
Called during initialization of the logger.
|
protected void |
NameNode.initialize(Configuration conf)
Initialize name-node.
|
protected void |
BackupNode.initialize(Configuration conf) |
static void |
NameNode.initializeGenericKeys(Configuration conf,
String nameserviceId,
String namenodeId)
In federation configuration is set for a set of
namenode and secondary namenode/backup/checkpointer, which are
grouped under a logical nameservice ID.
|
static boolean |
NameNode.initializeSharedEdits(Configuration conf) |
static boolean |
NameNode.initializeSharedEdits(Configuration conf,
boolean force) |
static FSNamesystem |
FSNamesystem.loadFromDisk(Configuration conf)
Instantiates an FSNamesystem loaded from the image and edits
directories specified in the passed Configuration.
|
protected void |
NameNode.loadNamesystem(Configuration conf) |
protected void |
BackupNode.loadNamesystem(Configuration conf) |
protected void |
NameNode.setHttpServerAddress(Configuration conf) |
protected void |
BackupNode.setHttpServerAddress(Configuration conf) |
protected void |
NameNode.setRpcServerAddress(Configuration conf,
InetSocketAddress rpcAddress) |
protected void |
BackupNode.setRpcServerAddress(Configuration conf,
InetSocketAddress addr) |
protected void |
NameNode.setRpcServiceServerAddress(Configuration conf,
InetSocketAddress serviceRPCAddress)
Modifies the configuration passed to contain the service rpc address setting
|
protected void |
BackupNode.setRpcServiceServerAddress(Configuration conf,
InetSocketAddress addr) |
static void |
NameNode.setServiceAddress(Configuration conf,
String address)
Set the configuration property for the service rpc address
to address
|
protected void |
NameNode.validateConfigurationSettings(Configuration conf)
Verifies that the final Configuration Settings look ok for the NameNode to
properly start up
Things to check for include:
- HTTP Server Port does not equal the RPC Server Port
|
Constructor and Description |
---|
CheckpointConf(Configuration conf) |
EditLogFileOutputStream(Configuration conf,
File name,
int size)
Creates output buffers and file object.
|
FileJournalManager(Configuration conf,
Storage.StorageDirectory sd,
StorageErrorReporter errorReporter) |
FSImage(Configuration conf)
Construct an FSImage
|
FSImage(Configuration conf,
Collection<URI> imageDirs,
List<URI> editsDirs)
Construct the FSImage.
|
NameNode(Configuration conf)
Start NameNode.
|
NameNode(Configuration conf,
HdfsServerConstants.NamenodeRole role) |
NameNodeHttpServer(Configuration conf,
NameNode nn,
InetSocketAddress bindAddress) |
NameNodeResourceChecker(Configuration conf)
Create a NameNodeResourceChecker, which will check the edits dirs and any
additional dirs to check set in
conf . |
NNStorage(Configuration conf,
Collection<URI> imageDirs,
Collection<URI> editsDirs)
Construct the NNStorage.
|
NNStorageRetentionManager(Configuration conf,
NNStorage storage,
org.apache.hadoop.hdfs.server.namenode.LogsPurgeable purgeableLogs) |
NNStorageRetentionManager(Configuration conf,
NNStorage storage,
org.apache.hadoop.hdfs.server.namenode.LogsPurgeable purgeableLogs,
org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager.StoragePurger purger) |
SecondaryNameNode(Configuration conf)
Create a connection to the primary namenode.
|
SecondaryNameNode(Configuration conf,
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.CommandLineOpts commandLineOpts) |
Modifier and Type | Method and Description |
---|---|
Configuration |
BootstrapStandby.getConf() |
Modifier and Type | Method and Description |
---|---|
static int |
BootstrapStandby.run(String[] argv,
Configuration conf) |
void |
BootstrapStandby.setConf(Configuration conf) |
Constructor and Description |
---|
ConfiguredFailoverProxyProvider(Configuration conf,
URI uri,
Class<T> xface) |
EditLogTailer(FSNamesystem namesystem,
Configuration conf) |
StandbyCheckpointer(Configuration conf,
FSNamesystem ns) |
Modifier and Type | Method and Description |
---|---|
static NameNodeMetrics |
NameNodeMetrics.create(Configuration conf,
HdfsServerConstants.NamenodeRole r) |
Modifier and Type | Method and Description |
---|---|
static Configuration |
DFSHAAdmin.addSecurityConfiguration(Configuration conf)
Add the requisite security principal settings to the given Configuration,
returning a copy.
|
Modifier and Type | Method and Description |
---|---|
static Configuration |
DFSHAAdmin.addSecurityConfiguration(Configuration conf)
Add the requisite security principal settings to the given Configuration,
returning a copy.
|
static DFSZKFailoverController |
DFSZKFailoverController.create(Configuration conf) |
protected InetSocketAddress |
GetGroups.getProtocolAddress(Configuration conf) |
void |
GetGroups.setConf(Configuration conf) |
void |
DFSHAAdmin.setConf(Configuration conf) |
Constructor and Description |
---|
DFSAdmin(Configuration conf)
Construct a DFSAdmin object.
|
DFSck(Configuration conf)
Filesystem checker.
|
DFSck(Configuration conf,
PrintStream out) |
GetGroups(Configuration conf) |
GetGroups(Configuration conf,
PrintStream out) |
NNHAServiceTarget(Configuration conf,
String nsId,
String nnId) |
Modifier and Type | Method and Description |
---|---|
void |
WebHdfsFileSystem.DtRenewer.cancel(Token<?> token,
Configuration conf) |
void |
WebHdfsFileSystem.initialize(URI uri,
Configuration conf) |
static boolean |
WebHdfsFileSystem.isEnabled(Configuration conf,
org.apache.commons.logging.Log log)
Is WebHDFS enabled in conf?
|
long |
WebHdfsFileSystem.DtRenewer.renew(Token<?> token,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
int |
BufferSizeParam.getValue(Configuration conf) |
long |
BlockSizeParam.getValue(Configuration conf) |
short |
ReplicationParam.getValue(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected void |
HttpServer.addDefaultApps(org.eclipse.jetty.server.handler.ContextHandlerCollection parent,
String appDir,
Configuration conf)
Add default apps.
|
void |
HttpServer.addSslListener(InetSocketAddress addr,
Configuration sslConf,
boolean needCertsAuth)
Configure an ssl listener on the server.
|
org.eclipse.jetty.server.ServerConnector |
HttpServer.createBaseListener(Configuration conf)
Create a required listener for the Jetty instance listening on the port
provided.
|
static org.eclipse.jetty.server.Server |
HttpServer.createServer(Configuration conf) |
abstract void |
FilterInitializer.initFilter(FilterContainer container,
Configuration conf)
Initialize a Filter to a FilterContainer.
|
protected void |
HttpServer.initSpnego(Configuration conf,
String usernameConfKey,
String keytabConfKey) |
Constructor and Description |
---|
HttpServer(String name,
String bindAddress,
int port,
boolean findPort,
Configuration conf)
Create a status server on the given port.
|
HttpServer(String name,
String bindAddress,
int port,
boolean findPort,
Configuration conf,
AccessControlList adminsAcl) |
HttpServer(String name,
String bindAddress,
int port,
boolean findPort,
Configuration conf,
AccessControlList adminsAcl,
org.eclipse.jetty.server.ServerConnector connector)
Create a status server on the given port.
|
HttpServer(String name,
String bindAddress,
int port,
boolean findPort,
Configuration conf,
AccessControlList adminsAcl,
org.eclipse.jetty.server.ServerConnector connector,
String[] pathSpecs,
org.eclipse.jetty.server.Server server)
Create a status server on the given port.
|
HttpServer(String name,
String bindAddress,
int port,
boolean findPort,
Configuration conf,
org.eclipse.jetty.server.ServerConnector connector) |
HttpServer(String name,
String bindAddress,
int port,
boolean findPort,
Configuration conf,
String[] pathSpecs)
Create a status server on the given port.
|
Modifier and Type | Method and Description |
---|---|
void |
StaticUserWebFilter.initFilter(FilterContainer container,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
ObjectWritable.getConf() |
Configuration |
AbstractMapWritable.getConf() |
Configuration |
GenericWritable.getConf() |
Configuration |
EnumSetWritable.getConf() |
Modifier and Type | Method and Description |
---|---|
static <T extends Writable> |
WritableUtils.clone(T orig,
Configuration conf)
Make a copy of a writable object using serialization to a buffer.
|
static void |
IOUtils.copyBytes(InputStream in,
OutputStream out,
Configuration conf)
Copies from one stream to another.
|
static void |
IOUtils.copyBytes(InputStream in,
OutputStream out,
Configuration conf,
boolean close)
Copies from one stream to another.
|
protected SequenceFile.Reader |
MapFile.Reader.createDataFileReader(Path dataFile,
Configuration conf,
SequenceFile.Reader.Option... options)
Override this method to specialize the type of
SequenceFile.Reader returned. |
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
SequenceFile.Writer.Option... opts)
Create a new Writer with the given options.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileContext fc,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata,
EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts)
Construct the preferred type of SequenceFile Writer.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Deprecated.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index.
|
static Class<?> |
WritableName.getClass(String name,
Configuration conf)
Return the class for a name.
|
static SequenceFile.CompressionType |
SequenceFile.getDefaultCompressionType(Configuration job)
Get the compression type for the reduce outputs
|
static <K> K |
DefaultStringifier.load(Configuration conf,
String keyName,
Class<K> itemClass)
Restores the object from the configuration.
|
static <K> K[] |
DefaultStringifier.loadArray(Configuration conf,
String keyName,
Class<K> itemClass)
Restores the array of objects from the configuration.
|
static Class<?> |
ObjectWritable.loadClass(Configuration conf,
String className)
Find and load the class with given name className by first finding
it in the specified conf.
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c,
Configuration conf)
Create a new instance of a class with a defined factory.
|
protected void |
MapFile.Reader.open(Path dir,
WritableComparator comparator,
Configuration conf,
SequenceFile.Reader.Option... options) |
static Object |
ObjectWritable.readObject(DataInput in,
Configuration conf)
|
static Object |
ObjectWritable.readObject(DataInput in,
ObjectWritable objectWritable,
Configuration conf)
|
void |
ObjectWritable.setConf(Configuration conf) |
void |
AbstractMapWritable.setConf(Configuration conf) |
void |
GenericWritable.setConf(Configuration conf) |
void |
EnumSetWritable.setConf(Configuration conf) |
static void |
SequenceFile.setDefaultCompressionType(Configuration job,
SequenceFile.CompressionType val)
Set the default compression type for sequence files.
|
static void |
MapFile.Writer.setIndexInterval(Configuration conf,
int interval)
Sets the index interval and stores it in conf
|
static <K> void |
DefaultStringifier.store(Configuration conf,
K item,
String keyName)
Stores the item in the configuration with the given keyName.
|
static <K> void |
DefaultStringifier.storeArray(Configuration conf,
K[] items,
String keyName)
Stores the array of items in the configuration with the given keyName.
|
static void |
ObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf)
|
static void |
ObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf,
boolean allowCompactArrays)
|
Constructor and Description |
---|
ArrayFile.Reader(FileSystem fs,
String file,
Configuration conf)
Construct an array reader for the named file.
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class<? extends Writable> valClass)
Create the named file for values of the named class.
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named file for values of the named class.
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Deprecated.
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Deprecated.
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf,
boolean open)
Deprecated.
|
BloomMapFile.Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... options) |
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated.
|
BloomMapFile.Writer(Configuration conf,
Path dir,
SequenceFile.Writer.Option... options) |
DefaultStringifier(Configuration conf,
Class<T> c) |
MapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Deprecated.
|
MapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Deprecated.
|
MapFile.Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... opts) |
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated.
Use Writer(Configuration, Path, Option...)} instead.
|
MapFile.Writer(Configuration conf,
Path dirName,
SequenceFile.Writer.Option... opts) |
SequenceFile.Reader(Configuration conf,
SequenceFile.Reader.Option... opts) |
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Deprecated.
Use Reader(Configuration, Option...) instead.
|
SequenceFile.Reader(FSDataInputStream in,
int buffersize,
long start,
long length,
Configuration conf)
Deprecated.
Use Reader(Configuration, Reader.Option...) instead.
|
SequenceFile.Sorter(FileSystem fs,
Class<? extends WritableComparable> keyClass,
Class valClass,
Configuration conf)
Sort and merge files containing the named classes.
|
SequenceFile.Sorter(FileSystem fs,
RawComparator comparator,
Class keyClass,
Class valClass,
Configuration conf)
Sort and merge using an arbitrary
RawComparator . |
SequenceFile.Sorter(FileSystem fs,
RawComparator comparator,
Class keyClass,
Class valClass,
Configuration conf,
SequenceFile.Metadata metadata)
Sort and merge using an arbitrary
RawComparator . |
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated.
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated.
|
SetFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a set reader for the named set.
|
SetFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a set reader for the named set using the named comparator.
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
SequenceFile.CompressionType compress)
Create a set naming the element class and compression type.
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
SequenceFile.CompressionType compress)
Create a set naming the element comparator and compression type.
|
Modifier and Type | Method and Description |
---|---|
Configuration |
Lz4Codec.getConf()
Return the configuration used by this object.
|
Configuration |
SnappyCodec.getConf()
Return the configuration used by this object.
|
Configuration |
DefaultCodec.getConf() |
Configuration |
BZip2Codec.getConf()
Return the configuration used by this object.
|
Modifier and Type | Method and Description |
---|---|
static List<Class<? extends CompressionCodec>> |
CompressionCodecFactory.getCodecClasses(Configuration conf)
Get the list of codecs discovered via a Java ServiceLoader, or
listed in the configuration.
|
static Compressor |
CodecPool.getCompressor(CompressionCodec codec,
Configuration conf)
Get a
Compressor for the given CompressionCodec from the
pool or a new one. |
void |
Compressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
static void |
CompressionCodecFactory.setCodecClasses(Configuration conf,
List<Class> classes)
Sets a list of codec classes in the configuration.
|
void |
Lz4Codec.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
SnappyCodec.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
DefaultCodec.setConf(Configuration conf) |
void |
BZip2Codec.setConf(Configuration conf)
Set the configuration to be used by this object.
|
Constructor and Description |
---|
CompressionCodecFactory(Configuration conf)
Find the codecs specified in the config value io.compression.codecs
and register them.
|
Modifier and Type | Method and Description |
---|---|
static int |
Bzip2Factory.getBlockSize(Configuration conf) |
static Compressor |
Bzip2Factory.getBzip2Compressor(Configuration conf)
Return the appropriate implementation of the bzip2 compressor.
|
static Class<? extends Compressor> |
Bzip2Factory.getBzip2CompressorType(Configuration conf)
Return the appropriate type of the bzip2 compressor.
|
static Decompressor |
Bzip2Factory.getBzip2Decompressor(Configuration conf)
Return the appropriate implementation of the bzip2 decompressor.
|
static Class<? extends Decompressor> |
Bzip2Factory.getBzip2DecompressorType(Configuration conf)
Return the appropriate type of the bzip2 decompressor.
|
static String |
Bzip2Factory.getLibraryName(Configuration conf) |
static int |
Bzip2Factory.getWorkFactor(Configuration conf) |
static boolean |
Bzip2Factory.isNativeBzip2Loaded(Configuration conf)
Check if native-bzip2 code is loaded & initialized correctly and
can be loaded for this job.
|
void |
BZip2DummyCompressor.reinit(Configuration conf) |
void |
Bzip2Compressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration.
|
static void |
Bzip2Factory.setBlockSize(Configuration conf,
int blockSize) |
static void |
Bzip2Factory.setWorkFactor(Configuration conf,
int workFactor) |
Constructor and Description |
---|
Bzip2Compressor(Configuration conf)
Creates a new compressor, taking settings from the configuration.
|
Modifier and Type | Method and Description |
---|---|
void |
Lz4Compressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
Modifier and Type | Method and Description |
---|---|
void |
SnappyCompressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
Modifier and Type | Method and Description |
---|---|
static ZlibCompressor.CompressionLevel |
ZlibFactory.getCompressionLevel(Configuration conf) |
static ZlibCompressor.CompressionStrategy |
ZlibFactory.getCompressionStrategy(Configuration conf) |
static Compressor |
ZlibFactory.getZlibCompressor(Configuration conf)
Return the appropriate implementation of the zlib compressor.
|
static Class<? extends Compressor> |
ZlibFactory.getZlibCompressorType(Configuration conf)
Return the appropriate type of the zlib compressor.
|
static Decompressor |
ZlibFactory.getZlibDecompressor(Configuration conf)
Return the appropriate implementation of the zlib decompressor.
|
static Class<? extends Decompressor> |
ZlibFactory.getZlibDecompressorType(Configuration conf)
Return the appropriate type of the zlib decompressor.
|
static boolean |
ZlibFactory.isNativeZlibLoaded(Configuration conf)
Check if native-zlib code is loaded & initialized correctly and
can be loaded for this job.
|
void |
ZlibCompressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration.
|
void |
BuiltInZlibDeflater.reinit(Configuration conf)
reinit the compressor with the given configuration.
|
static void |
ZlibFactory.setCompressionLevel(Configuration conf,
ZlibCompressor.CompressionLevel level) |
static void |
ZlibFactory.setCompressionStrategy(Configuration conf,
ZlibCompressor.CompressionStrategy strategy) |
Constructor and Description |
---|
ZlibCompressor(Configuration conf)
Creates a new compressor, taking settings from the configuration.
|
Constructor and Description |
---|
TFile.Reader(FSDataInputStream fsdis,
long fileLength,
Configuration conf)
Constructor
|
TFile.Writer(FSDataOutputStream fsdos,
int minBlockSize,
String compressName,
String comparator,
Configuration conf)
Constructor
|
Modifier and Type | Method and Description |
---|---|
static RetryPolicy |
RetryUtils.getDefaultRetryPolicy(Configuration conf,
String retryPolicyEnabledKey,
boolean defaultRetryPolicyEnabled,
String retryPolicySpecKey,
String defaultRetryPolicySpec,
Class<? extends Exception> remoteExceptionToRetry)
Return the default retry policy set in conf.
|
static RetryPolicy |
RetryUtils.getMultipleLinearRandomRetry(Configuration conf,
String retryPolicyEnabledKey,
boolean defaultRetryPolicyEnabled,
String retryPolicySpecKey,
String defaultRetryPolicySpec)
Return the MultipleLinearRandomRetry policy specified in the conf,
or null if the feature is disabled.
|
Constructor and Description |
---|
SerializationFactory(Configuration conf)
Serializations are found by reading the
io.serializations
property from conf , which is a comma-delimited list of
classnames. |
Modifier and Type | Method and Description |
---|---|
static void |
Server.bind(ServerSocket socket,
InetSocketAddress address,
int backlog,
Configuration conf,
String rangeConf) |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
Configuration conf)
Make a call, passing
param , to the IPC server running at
address which is servicing the protocol protocol,
with the ticket credentials, rpcTimeout as
timeout and conf as conf for this connection, returning the
value. |
Writable |
Client.call(Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
Configuration conf)
Same as
Client.call(RPC.RpcKind, Writable, InetSocketAddress,
Class, UserGroupInformation, int, Configuration)
except that rpcKind is writable. |
Writable |
Client.call(Writable param,
InetSocketAddress addr,
Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
int serviceClass,
Configuration conf)
Same as
Client.call(Writable, InetSocketAddress,
Class, UserGroupInformation, int, Configuration)
except that specifying serviceClass. |
Client |
ClientCache.getClient(Configuration conf)
Construct & cache an IPC client with the default SocketFactory
and default valueClass if no cached client exists.
|
Client |
ClientCache.getClient(Configuration conf,
SocketFactory factory)
Construct & cache an IPC client with the user-provided SocketFactory
if no cached client exists.
|
Client |
ClientCache.getClient(Configuration conf,
SocketFactory factory,
Class<? extends Writable> valueClass)
Construct & cache an IPC client with the user-provided SocketFactory
if no cached client exists.
|
ProtocolProxy<ProtocolMetaInfoPB> |
WritableRpcEngine.getProtocolMetaInfoProxy(Client.ConnectionId connId,
Configuration conf,
SocketFactory factory) |
ProtocolProxy<ProtocolMetaInfoPB> |
ProtobufRpcEngine.getProtocolMetaInfoProxy(Client.ConnectionId connId,
Configuration conf,
SocketFactory factory) |
ProtocolProxy<ProtocolMetaInfoPB> |
RpcEngine.getProtocolMetaInfoProxy(Client.ConnectionId connId,
Configuration conf,
SocketFactory factory)
Returns a proxy for ProtocolMetaInfoPB, which uses the given connection
id.
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
SocketFactory factory)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> T |
RPC.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Construct a client-side proxy object with the default SocketFactory
|
static <T> T |
RPC.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
static <T> T |
RPC.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout) |
static <T> T |
RPC.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
WritableRpcEngine.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy)
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy) |
<T> ProtocolProxy<T> |
RpcEngine.getProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy)
Construct a client-side proxy object.
|
RPC.Server |
WritableRpcEngine.getServer(Class<?> protocolClass,
Object protocolImpl,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig) |
RPC.Server |
ProtobufRpcEngine.getServer(Class<?> protocol,
Object protocolImpl,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig) |
RPC.Server |
RpcEngine.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig)
Construct a server for a protocol implementation instance.
|
static int |
Client.getTimeout(Configuration conf)
The time after which a RPC will timeout.
|
void |
Server.refreshServiceAcl(Configuration conf,
PolicyProvider provider)
Refresh the service authorization ACL for the service handled by this server.
|
static void |
Client.setConnectTimeout(Configuration conf,
int timeout)
set the connection timeout value in configuration
|
static void |
Client.setPingInterval(Configuration conf,
int pingInterval)
set the ping interval value in configuration
|
static void |
RPC.setProtocolEngine(Configuration conf,
Class<?> protocol,
Class<?> engine)
Set a protocol to use a non-default RpcEngine.
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
long timeout)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
long connTimeout)
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> T |
RPC.waitForProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Get a proxy connection to a remote server
|
static <T> T |
RPC.waitForProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
int rpcTimeout,
long timeout)
Get a proxy connection to a remote server
|
static <T> T |
RPC.waitForProxy(Class<T> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
long connTimeout)
Get a proxy connection to a remote server
|
Constructor and Description |
---|
Client(Class<? extends Writable> valueClass,
Configuration conf)
Construct an IPC client with the default SocketFactory
|
Client(Class<? extends Writable> valueClass,
Configuration conf,
SocketFactory factory)
Construct an IPC client whose values are of the given
Writable
class. |
ProtobufRpcEngine.Server(Class<?> protocolClass,
Object protocolImpl,
Configuration conf,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig)
Construct an RPC server.
|
RPC.Builder(Configuration conf) |
RPC.Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig) |
Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf) |
Server(String bindAddress,
int port,
Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
SecretManager<? extends TokenIdentifier> secretManager) |
Server(String bindAddress,
int port,
Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig)
Constructs a server listening on the named port and address.
|
WritableRpcEngine.Server(Class<?> protocolClass,
Object protocolImpl,
Configuration conf,
String bindAddress,
int port)
Construct an RPC server.
|
WritableRpcEngine.Server(Class<?> protocolClass,
Object protocolImpl,
Configuration conf,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
SecretManager<? extends TokenIdentifier> secretManager,
String portRangeConfig)
Construct an RPC server.
|
WritableRpcEngine.Server(Object instance,
Configuration conf,
String bindAddress,
int port)
Deprecated.
Use #Server(Class, Object, Configuration, String, int)
|
WritableRpcEngine.Server(Object protocolImpl,
Configuration conf,
String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
SecretManager<? extends TokenIdentifier> secretManager)
Deprecated.
use Server#Server(Class, Object,
Configuration, String, int, int, int, int, boolean, SecretManager)
|
Modifier and Type | Method and Description |
---|---|
Configuration |
Server.getConfig()
Returns the server configuration.
|
protected Configuration |
BaseService.getServiceConfig()
Returns the service configuration properties.
|
Constructor and Description |
---|
Server(String name,
String homeDir,
Configuration config)
Creates a server instance.
|
Server(String name,
String homeDir,
String configDir,
String logDir,
String tempDir,
Configuration config)
Creates a server instance.
|
Modifier and Type | Method and Description |
---|---|
Configuration |
FileSystemAccess.getFileSystemConfiguration() |
Modifier and Type | Method and Description |
---|---|
FileSystem |
FileSystemAccess.createFileSystem(String user,
Configuration conf) |
<T> T |
FileSystemAccess.execute(String user,
Configuration conf,
FileSystemAccess.FileSystemExecutor<T> executor) |
Modifier and Type | Method and Description |
---|---|
Configuration |
FileSystemAccessService.getFileSystemConfiguration() |
Modifier and Type | Method and Description |
---|---|
protected FileSystem |
FileSystemAccessService.createFileSystem(Configuration namenodeConf) |
FileSystem |
FileSystemAccessService.createFileSystem(String user,
Configuration conf) |
FileSystem |
FileSystemAccessService.createFileSystemInternal(String user,
Configuration conf) |
<T> T |
FileSystemAccessService.execute(String user,
Configuration conf,
FileSystemAccess.FileSystemExecutor<T> executor) |
protected void |
FileSystemAccessService.setRequiredServiceHadoopConf(Configuration conf) |
Constructor and Description |
---|
ServerWebApp(String name,
String homeDir,
Configuration config)
Constructor for testing purposes.
|
ServerWebApp(String name,
String homeDir,
String configDir,
String logDir,
String tempDir,
Configuration config)
Constructor for testing purposes.
|
Modifier and Type | Method and Description |
---|---|
static Configuration |
ConfigurationUtils.resolve(Configuration conf)
Returns a new ConfigurationUtils instance with all inline values resolved.
|
Modifier and Type | Method and Description |
---|---|
static void |
ConfigurationUtils.copy(Configuration source,
Configuration target)
Copy configuration key/value pairs from one configuration to another if a property exists in the target, it gets
replaced.
|
static void |
ConfigurationUtils.injectDefaults(Configuration source,
Configuration target)
Injects configuration key/value pairs from one configuration to another if the key does not exist in the target
configuration.
|
static void |
ConfigurationUtils.load(Configuration conf,
InputStream is)
Create a configuration from an InputStream.
|
static Configuration |
ConfigurationUtils.resolve(Configuration conf)
Returns a new ConfigurationUtils instance with all inline values resolved.
|
Modifier and Type | Class and Description |
---|---|
class |
JobConf
A map/reduce job configuration.
|
Modifier and Type | Field and Description |
---|---|
protected Configuration |
SequenceFileRecordReader.conf |
Modifier and Type | Method and Description |
---|---|
Configuration |
YarnOutputFiles.getConf() |
Configuration |
MapOutputFile.getConf() |
Configuration |
Task.getConf() |
Configuration |
RunningJob.getConfiguration()
Get the underlying job configuration
|
Modifier and Type | Method and Description |
---|---|
Map<JobACL,AccessControlList> |
JobACLsManager.constructJobACLs(Configuration conf)
Construct the jobACLs from the configuration so that they can be kept in
the memory.
|
ClientProtocol |
YarnClientProtocolProvider.create(Configuration conf) |
ClientProtocol |
LocalClientProtocolProvider.create(Configuration conf) |
ClientProtocol |
YarnClientProtocolProvider.create(InetSocketAddress addr,
Configuration conf) |
ClientProtocol |
LocalClientProtocolProvider.create(InetSocketAddress addr,
Configuration conf) |
ApplicationSubmissionContext |
YARNRunner.createApplicationSubmissionContext(Configuration jobConf,
String jobSubmitDir,
Credentials ts) |
protected static <INKEY,INVALUE,OUTKEY,OUTVALUE> |
Task.createReduceContext(Reducer<INKEY,INVALUE,OUTKEY,OUTVALUE> reducer,
Configuration job,
TaskAttemptID taskId,
RawKeyValueIterator rIter,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<OUTKEY,OUTVALUE> output,
OutputCommitter committer,
StatusReporter reporter,
RawComparator<INKEY> comparator,
Class<INKEY> keyClass,
Class<INVALUE> valueClass) |
static int |
SkipBadRecords.getAttemptsToStartSkipping(Configuration conf)
Get the number of Task attempts AFTER which skip mode
will be kicked off.
|
static boolean |
SkipBadRecords.getAutoIncrMapperProcCount(Configuration conf)
Get the flag which if set to true,
SkipBadRecords.COUNTER_MAP_PROCESSED_RECORDS is incremented
by MapRunner after invoking the map function. |
static boolean |
SkipBadRecords.getAutoIncrReducerProcCount(Configuration conf)
Get the flag which if set to true,
SkipBadRecords.COUNTER_REDUCE_PROCESSED_GROUPS is incremented
by framework after invoking the reduce function. |
protected static List<FileSystem.Statistics> |
Task.getFsStatistics(Path path,
Configuration conf)
Gets a handle to the Statistics instance based on the scheme associated
with path.
|
static long |
SkipBadRecords.getMapperMaxSkipRecords(Configuration conf)
Get the number of acceptable skip records surrounding the bad record PER
bad record in mapper.
|
static InetSocketAddress |
Master.getMasterAddress(Configuration conf) |
static String |
Master.getMasterPrincipal(Configuration conf) |
static String |
Master.getMasterUserName(Configuration conf) |
static SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format.
|
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem ignored,
Path dir,
Configuration conf)
Open the output generated by this format.
|
static long |
SkipBadRecords.getReducerMaxSkipGroups(Configuration conf)
Get the number of acceptable skip groups surrounding the bad group PER
bad group in reducer.
|
protected org.apache.hadoop.mapred.ShuffleHandler.Shuffle |
ShuffleHandler.getShuffle(Configuration conf) |
static Path |
SkipBadRecords.getSkipOutputPath(Configuration conf)
Get the directory to which skipped records are written.
|
static <K,V> RawKeyValueIterator |
Merger.merge(Configuration conf,
FileSystem fs,
Class<K> keyClass,
Class<V> valueClass,
CompressionCodec codec,
List<Merger.Segment<K,V>> segments,
int mergeFactor,
int inMemSegments,
Path tmpDir,
RawComparator<K> comparator,
Progressable reporter,
boolean sortSegments,
Counters.Counter readsCounter,
Counters.Counter writesCounter,
Progress mergePhase) |
static <K,V> RawKeyValueIterator |
Merger.merge(Configuration conf,
FileSystem fs,
Class<K> keyClass,
Class<V> valueClass,
CompressionCodec codec,
List<Merger.Segment<K,V>> segments,
int mergeFactor,
Path tmpDir,
RawComparator<K> comparator,
Progressable reporter,
boolean sortSegments,
Counters.Counter readsCounter,
Counters.Counter writesCounter,
Progress mergePhase) |
static <K,V> RawKeyValueIterator |
Merger.merge(Configuration conf,
FileSystem fs,
Class<K> keyClass,
Class<V> valueClass,
CompressionCodec codec,
Path[] inputs,
boolean deleteInputs,
int mergeFactor,
Path tmpDir,
RawComparator<K> comparator,
Progressable reporter,
Counters.Counter readsCounter,
Counters.Counter writesCounter,
Counters.Counter mergedMapOutputsCounter,
Progress mergePhase) |
static <K,V> RawKeyValueIterator |
Merger.merge(Configuration conf,
FileSystem fs,
Class<K> keyClass,
Class<V> valueClass,
CompressionCodec codec,
Path[] inputs,
boolean deleteInputs,
int mergeFactor,
Path tmpDir,
RawComparator<K> comparator,
Progressable reporter,
Counters.Counter readsCounter,
Counters.Counter writesCounter,
Progress mergePhase) |
static <K,V> RawKeyValueIterator |
Merger.merge(Configuration conf,
FileSystem fs,
Class<K> keyClass,
Class<V> valueClass,
List<Merger.Segment<K,V>> segments,
int mergeFactor,
int inMemSegments,
Path tmpDir,
RawComparator<K> comparator,
Progressable reporter,
boolean sortSegments,
Counters.Counter readsCounter,
Counters.Counter writesCounter,
Progress mergePhase) |
static <K,V> RawKeyValueIterator |
Merger.merge(Configuration conf,
FileSystem fs,
Class<K> keyClass,
Class<V> valueClass,
List<Merger.Segment<K,V>> segments,
int mergeFactor,
Path tmpDir,
RawComparator<K> comparator,
Progressable reporter,
boolean sortSegments,
Counters.Counter readsCounter,
Counters.Counter writesCounter,
Progress mergePhase) |
static <K,V> RawKeyValueIterator |
Merger.merge(Configuration conf,
FileSystem fs,
Class<K> keyClass,
Class<V> valueClass,
List<Merger.Segment<K,V>> segments,
int mergeFactor,
Path tmpDir,
RawComparator<K> comparator,
Progressable reporter,
Counters.Counter readsCounter,
Counters.Counter writesCounter,
Progress mergePhase) |
static String |
Task.normalizeStatus(String status,
Configuration conf) |
protected void |
TaskAttemptListenerImpl.registerHeartbeatHandler(Configuration conf) |
protected void |
ResourceMgrDelegate.serviceInit(Configuration conf) |
protected void |
TaskAttemptListenerImpl.serviceInit(Configuration conf) |
protected void |
ShuffleHandler.serviceInit(Configuration conf) |
static void |
SkipBadRecords.setAttemptsToStartSkipping(Configuration conf,
int attemptsToStartSkipping)
Set the number of Task attempts AFTER which skip mode
will be kicked off.
|
static void |
SkipBadRecords.setAutoIncrMapperProcCount(Configuration conf,
boolean autoIncr)
Set the flag which if set to true,
SkipBadRecords.COUNTER_MAP_PROCESSED_RECORDS is incremented
by MapRunner after invoking the map function. |
static void |
SkipBadRecords.setAutoIncrReducerProcCount(Configuration conf,
boolean autoIncr)
Set the flag which if set to true,
SkipBadRecords.COUNTER_REDUCE_PROCESSED_GROUPS is incremented
by framework after invoking the reduce function. |
void |
YarnOutputFiles.setConf(Configuration conf) |
void |
MROutputFiles.setConf(Configuration conf) |
void |
SequenceFileInputFilter.RegexFilter.setConf(Configuration conf)
configure the Filter by checking the configuration
|
void |
SequenceFileInputFilter.PercentFilter.setConf(Configuration conf)
configure the filter by checking the configuration
|
void |
SequenceFileInputFilter.MD5Filter.setConf(Configuration conf)
configure the filter according to configuration
|
void |
MapOutputFile.setConf(Configuration conf) |
void |
Task.setConf(Configuration conf) |
static void |
SequenceFileInputFilter.setFilterClass(Configuration conf,
Class filterClass)
set the filter class
|
static void |
SequenceFileInputFilter.PercentFilter.setFrequency(Configuration conf,
int frequency)
set the frequency and stores it in conf
|
static void |
SequenceFileInputFilter.MD5Filter.setFrequency(Configuration conf,
int frequency)
set the filtering frequency in configuration
|
static void |
SkipBadRecords.setMapperMaxSkipRecords(Configuration conf,
long maxSkipRecs)
Set the number of acceptable skip records surrounding the bad record PER
bad record in mapper.
|
static void |
SequenceFileInputFilter.RegexFilter.setPattern(Configuration conf,
String regex) |
static void |
SkipBadRecords.setReducerMaxSkipGroups(Configuration conf,
long maxSkipGrps)
Set the number of acceptable skip groups surrounding the bad group PER
bad group in reducer.
|
static <K,V> void |
Merger.writeFile(RawKeyValueIterator records,
IFile.Writer<K,V> writer,
Progressable progressable,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
abstract org.apache.hadoop.mapred.gridmix.GridmixJob |
JobCreator.createGridmixJob(Configuration conf,
long submissionMillis,
JobStory jobdesc,
Path outRoot,
UserGroupInformation ugi,
int seq)
Create Gridmix simulated job.
|
protected org.apache.hadoop.mapred.gridmix.JobFactory |
Gridmix.createJobFactory(org.apache.hadoop.mapred.gridmix.JobSubmitter submitter,
String traceIn,
Path scratchDir,
Configuration conf,
CountDownLatch startFlag,
UserResolver resolver) |
protected org.apache.hadoop.mapred.gridmix.JobMonitor |
Gridmix.createJobMonitor(Statistics stats,
Configuration conf) |
protected JobStoryProducer |
Gridmix.createJobStoryProducer(String traceIn,
Configuration conf)
Create an appropriate
JobStoryProducer object for the
given trace. |
protected static org.apache.hadoop.mapred.gridmix.GridmixJobSubmissionPolicy |
Gridmix.getJobSubmissionPolicy(Configuration conf) |
static JobCreator |
JobCreator.getPolicy(Configuration conf,
JobCreator defaultPolicy) |
boolean |
SubmitterUserResolver.setTargetUsers(URI userdesc,
Configuration conf) |
boolean |
UserResolver.setTargetUsers(URI userdesc,
Configuration conf)
Configure the user map given the URI and configuration.
|
boolean |
EchoUserResolver.setTargetUsers(URI userdesc,
Configuration conf) |
boolean |
RoundRobinUserResolver.setTargetUsers(URI userloc,
Configuration conf) |
protected void |
Gridmix.writeDistCacheData(Configuration conf)
Write random bytes in the distributed cache files that will be used by all
simulated jobs of current gridmix run, if files are to be generated.
|
Constructor and Description |
---|
SerialJobFactory(org.apache.hadoop.mapred.gridmix.JobSubmitter submitter,
JobStoryProducer jobProducer,
Path scratch,
Configuration conf,
CountDownLatch startFlag,
UserResolver resolver)
Creating a new instance does not start the thread.
|
SleepJob(Configuration conf,
long submissionMillis,
JobStory jobdesc,
Path outRoot,
UserGroupInformation ugi,
int seq,
int numLocations,
String[] hosts) |
Statistics(Configuration conf,
int pollingInterval,
CountDownLatch startFlag) |
StressJobFactory(org.apache.hadoop.mapred.gridmix.JobSubmitter submitter,
JobStoryProducer jobProducer,
Path scratch,
Configuration conf,
CountDownLatch startFlag,
UserResolver resolver)
Creating a new instance does not start the thread.
|
Modifier and Type | Method and Description |
---|---|
void |
ResourceUsageMatcher.configure(Configuration conf,
ResourceCalculatorPlugin monitor,
ResourceUsageMetrics metrics,
Progressive progress)
Configure the
ResourceUsageMatcher to load the configured plugins
and initialize them. |
void |
TotalHeapUsageEmulatorPlugin.initialize(Configuration conf,
ResourceUsageMetrics metrics,
ResourceCalculatorPlugin monitor,
Progressive progress) |
void |
ResourceUsageEmulatorPlugin.initialize(Configuration conf,
ResourceUsageMetrics metrics,
ResourceCalculatorPlugin monitor,
Progressive progress)
Initialize the plugin.
|
void |
CumulativeCpuUsageEmulatorPlugin.initialize(Configuration conf,
ResourceUsageMetrics metrics,
ResourceCalculatorPlugin monitor,
Progressive progress) |
Modifier and Type | Method and Description |
---|---|
Configuration |
CompositeRecordReader.getConf()
Return the configuration used by this object.
|
Modifier and Type | Method and Description |
---|---|
void |
CompositeRecordReader.setConf(Configuration conf)
Set the configuration to be used by this object.
|
Constructor and Description |
---|
CombineFileRecordReaderWrapper(FileInputFormat<K,V> inputFormat,
CombineFileSplit split,
Configuration conf,
Reporter reporter,
Integer idx) |
Constructor and Description |
---|
Submitter(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected InetSocketAddress |
GetGroups.getProtocolAddress(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
JobContext.getConfiguration()
Return the configuration for the job.
|
Modifier and Type | Method and Description |
---|---|
static JobContext |
ContextFactory.cloneContext(JobContext original,
Configuration conf)
Clone a
JobContext or TaskAttemptContext with a
new configuration. |
static <K1,V1,K2,V2> |
ContextFactory.cloneMapContext(MapContext<K1,V1,K2,V2> context,
Configuration conf,
RecordReader<K1,V1> reader,
RecordWriter<K2,V2> writer)
Copy a custom WrappedMapper.Context, optionally replacing
the input and output.
|
static QueueInfo |
TypeConverter.fromYarn(QueueInfo queueInfo,
Configuration conf) |
static JobStatus[] |
TypeConverter.fromYarnApps(List<ApplicationReport> applications,
Configuration conf) |
static QueueInfo[] |
TypeConverter.fromYarnQueueInfo(List<QueueInfo> queues,
Configuration conf) |
static int |
Job.getCompletionPollInterval(Configuration conf)
The interval at which waitForCompletion() should check.
|
static Job |
Job.getInstance(Cluster ignored,
Configuration conf)
Deprecated.
|
static Job |
Job.getInstance(Cluster cluster,
JobStatus status,
Configuration conf)
|
static Job |
Job.getInstance(Configuration conf)
|
static Job |
Job.getInstance(Configuration conf,
String jobName)
|
static Job |
Job.getInstance(JobStatus status,
Configuration conf)
|
static int |
Job.getProgressPollInterval(Configuration conf)
The interval at which monitorAndPrintJob() prints status
|
static Path |
JobSubmissionFiles.getStagingDir(Cluster cluster,
Configuration conf)
Initializes the staging directory and returns the path.
|
static Job.TaskStatusFilter |
Job.getTaskOutputFilter(Configuration conf)
Get the task output filter.
|
static void |
Job.setTaskOutputFilter(Configuration conf,
Job.TaskStatusFilter newValue)
Modify the Configuration to set the task output filter.
|
Constructor and Description |
---|
Cluster(Configuration conf) |
Cluster(InetSocketAddress jobTrackAddr,
Configuration conf) |
Job(Configuration conf)
Deprecated.
|
Job(Configuration conf,
String jobName)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
static void |
DistributedCache.addArchiveToClassPath(Path archive,
Configuration conf)
Deprecated.
Use
Job.addArchiveToClassPath(Path) instead |
static void |
DistributedCache.addArchiveToClassPath(Path archive,
Configuration conf,
FileSystem fs)
Deprecated.
Add an archive path to the current set of classpath entries.
|
static void |
DistributedCache.addCacheArchive(URI uri,
Configuration conf)
Deprecated.
Use
Job.addCacheArchive(URI) instead |
static void |
DistributedCache.addCacheFile(URI uri,
Configuration conf)
Deprecated.
Use
Job.addCacheFile(URI) instead |
static void |
DistributedCache.addFileToClassPath(Path file,
Configuration conf)
Deprecated.
Use
Job.addFileToClassPath(Path) instead |
static void |
DistributedCache.addFileToClassPath(Path file,
Configuration conf,
FileSystem fs)
Deprecated.
Add a file path to the current set of classpath entries.
|
static void |
DistributedCache.createSymlink(Configuration conf)
Deprecated.
This is a NO-OP.
|
static void |
ClientDistributedCacheManager.determineCacheVisibilities(Configuration job,
Map<URI,FileStatus> statCache)
Determines the visibilities of the distributed cache files and
archives.
|
static void |
ClientDistributedCacheManager.determineTimestamps(Configuration job,
Map<URI,FileStatus> statCache)
Determines timestamps of files to be cached, and stores those
in the configuration.
|
static void |
ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(Configuration job)
Determines timestamps of files to be cached, and stores those
in the configuration.
|
static Path[] |
DistributedCache.getArchiveClassPaths(Configuration conf)
Deprecated.
Use
JobContext.getArchiveClassPaths() instead |
static long[] |
DistributedCache.getArchiveTimestamps(Configuration conf)
Deprecated.
Use
JobContext.getArchiveTimestamps() instead |
static boolean[] |
DistributedCache.getArchiveVisibilities(Configuration conf)
Deprecated.
Get the booleans on whether the archives are public or not.
|
static URI[] |
DistributedCache.getCacheArchives(Configuration conf)
Deprecated.
Use
JobContext.getCacheArchives() instead |
static URI[] |
DistributedCache.getCacheFiles(Configuration conf)
Deprecated.
Use
JobContext.getCacheFiles() instead |
static void |
ClientDistributedCacheManager.getDelegationTokens(Configuration job,
Credentials credentials)
For each archive or cache file - get the corresponding delegation token
|
static Path[] |
DistributedCache.getFileClassPaths(Configuration conf)
Deprecated.
Use
JobContext.getFileClassPaths() instead |
static long[] |
DistributedCache.getFileTimestamps(Configuration conf)
Deprecated.
Use
JobContext.getFileTimestamps() instead |
static boolean[] |
DistributedCache.getFileVisibilities(Configuration conf)
Deprecated.
Get the booleans on whether the files are public or not.
|
static Path[] |
DistributedCache.getLocalCacheArchives(Configuration conf)
Deprecated.
Use
JobContext.getLocalCacheArchives() instead |
static Path[] |
DistributedCache.getLocalCacheFiles(Configuration conf)
Deprecated.
Use
JobContext.getLocalCacheFiles() instead |
static boolean |
DistributedCache.getSymlink(Configuration conf)
Deprecated.
symlinks are always created.
|
static void |
DistributedCache.setCacheArchives(URI[] archives,
Configuration conf)
Deprecated.
Use
Job.setCacheArchives(URI[]) instead |
static void |
DistributedCache.setCacheFiles(URI[] files,
Configuration conf)
Deprecated.
Use
Job.setCacheFiles(URI[]) instead |
Modifier and Type | Method and Description |
---|---|
static FSDataInputStream |
JobHistoryCopyService.getPreviousJobHistoryFileStream(Configuration conf,
ApplicationAttemptId applicationAttemptId) |
protected void |
JobHistoryCopyService.serviceInit(Configuration conf) |
protected void |
JobHistoryEventHandler.serviceInit(Configuration conf) |
Constructor and Description |
---|
HistoryViewer(String historyFile,
Configuration conf,
boolean printAll)
Constructs the HistoryViewer object
|
Modifier and Type | Method and Description |
---|---|
static Configuration |
ValueAggregatorJob.setAggregatorDescriptors(Class<? extends ValueAggregatorDescriptor>[] descriptors) |
Modifier and Type | Method and Description |
---|---|
void |
ValueAggregatorDescriptor.configure(Configuration conf)
Configure the object
|
void |
ValueAggregatorBaseDescriptor.configure(Configuration conf)
get the input file name.
|
void |
UserDefinedValueAggregatorDescriptor.configure(Configuration conf)
Do nothing.
|
static Job |
ValueAggregatorJob.createValueAggregatorJob(Configuration conf,
String[] args)
Create an Aggregate based map/reduce job.
|
protected static ArrayList<ValueAggregatorDescriptor> |
ValueAggregatorJobBase.getAggregatorDescriptors(Configuration conf) |
protected static ValueAggregatorDescriptor |
ValueAggregatorJobBase.getValueAggregatorDescriptor(String spec,
Configuration conf) |
static void |
ValueAggregatorJobBase.setup(Configuration job) |
Constructor and Description |
---|
UserDefinedValueAggregatorDescriptor(String className,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected static Configuration |
Chain.getChainElementConf(Configuration jobConf,
String confKey)
Creates a
Configuration for the Map or Reduce in the chain. |
Modifier and Type | Method and Description |
---|---|
protected static void |
Chain.addMapper(boolean isMap,
Job job,
Class<? extends Mapper> klass,
Class<?> inputKeyClass,
Class<?> inputValueClass,
Class<?> outputKeyClass,
Class<?> outputValueClass,
Configuration mapperConf)
Adds a Mapper class to the chain job.
|
static void |
ChainMapper.addMapper(Job job,
Class<? extends Mapper> klass,
Class<?> inputKeyClass,
Class<?> inputValueClass,
Class<?> outputKeyClass,
Class<?> outputValueClass,
Configuration mapperConf)
Adds a
Mapper class to the chain mapper. |
static void |
ChainReducer.addMapper(Job job,
Class<? extends Mapper> klass,
Class<?> inputKeyClass,
Class<?> inputValueClass,
Class<?> outputKeyClass,
Class<?> outputValueClass,
Configuration mapperConf)
Adds a
Mapper class to the chain reducer. |
protected static void |
Chain.checkReducerAlreadySet(boolean isMap,
Configuration jobConf,
String prefix,
boolean shouldSet) |
protected static Configuration |
Chain.getChainElementConf(Configuration jobConf,
String confKey)
Creates a
Configuration for the Map or Reduce in the chain. |
protected static int |
Chain.getIndex(Configuration conf,
String prefix) |
protected static void |
Chain.setMapperConf(boolean isMap,
Configuration jobConf,
Class<?> inputKeyClass,
Class<?> inputValueClass,
Class<?> outputKeyClass,
Class<?> outputValueClass,
Configuration mapperConf,
int index,
String prefix) |
protected static void |
Chain.setReducer(Job job,
Class<? extends Reducer> klass,
Class<?> inputKeyClass,
Class<?> inputValueClass,
Class<?> outputKeyClass,
Class<?> outputValueClass,
Configuration reducerConf)
Sets the Reducer class to the chain job.
|
static void |
ChainReducer.setReducer(Job job,
Class<? extends Reducer> klass,
Class<?> inputKeyClass,
Class<?> inputValueClass,
Class<?> outputKeyClass,
Class<?> outputValueClass,
Configuration reducerConf)
Sets the
Reducer class to the chain job. |
protected static void |
Chain.setReducerConf(Configuration jobConf,
Class<?> inputKeyClass,
Class<?> inputValueClass,
Class<?> outputKeyClass,
Class<?> outputValueClass,
Configuration reducerConf,
String prefix) |
protected static void |
Chain.validateKeyValueTypes(boolean isMap,
Configuration jobConf,
Class<?> inputKeyClass,
Class<?> inputValueClass,
Class<?> outputKeyClass,
Class<?> outputValueClass,
int index,
String prefix) |
Modifier and Type | Method and Description |
---|---|
Configuration |
DBConfiguration.getConf() |
Configuration |
DBInputFormat.getConf() |
Modifier and Type | Method and Description |
---|---|
static void |
DBConfiguration.configureDB(Configuration job,
String driverClass,
String dbUrl)
Sets the DB access related fields in the JobConf.
|
static void |
DBConfiguration.configureDB(Configuration conf,
String driverClass,
String dbUrl,
String userName,
String passwd)
Sets the DB access related fields in the
Configuration . |
protected RecordReader<LongWritable,T> |
DataDrivenDBInputFormat.createDBRecordReader(DBInputFormat.DBInputSplit split,
Configuration conf) |
protected RecordReader<LongWritable,T> |
OracleDataDrivenDBInputFormat.createDBRecordReader(DBInputFormat.DBInputSplit split,
Configuration conf) |
protected RecordReader<LongWritable,T> |
DBInputFormat.createDBRecordReader(DBInputFormat.DBInputSplit split,
Configuration conf) |
static void |
DataDrivenDBInputFormat.setBoundingQuery(Configuration conf,
String query)
Set the user-defined bounding query to use with a user-defined query.
|
void |
DBInputFormat.setConf(Configuration conf)
Set the configuration to be used by this object.
|
static void |
OracleDBRecordReader.setSessionTimeZone(Configuration conf,
Connection conn)
Set session time zone
|
List<InputSplit> |
BigDecimalSplitter.split(Configuration conf,
ResultSet results,
String colName) |
List<InputSplit> |
IntegerSplitter.split(Configuration conf,
ResultSet results,
String colName) |
List<InputSplit> |
FloatSplitter.split(Configuration conf,
ResultSet results,
String colName) |
List<InputSplit> |
DBSplitter.split(Configuration conf,
ResultSet results,
String colName)
Given a ResultSet containing one record (and already advanced to that record)
with two columns (a low value, and a high value, both of the same type), determine
a set of splits that span the given values.
|
List<InputSplit> |
DateSplitter.split(Configuration conf,
ResultSet results,
String colName) |
List<InputSplit> |
TextSplitter.split(Configuration conf,
ResultSet results,
String colName)
This method needs to determine the splits between two user-provided strings.
|
List<InputSplit> |
BooleanSplitter.split(Configuration conf,
ResultSet results,
String colName) |
Modifier and Type | Field and Description |
---|---|
protected Configuration |
SequenceFileRecordReader.conf |
Modifier and Type | Method and Description |
---|---|
Configuration |
SequenceFileInputFilter.FilterBase.getConf() |
Modifier and Type | Method and Description |
---|---|
static List<FileSplit> |
NLineInputFormat.getSplitsForFile(FileStatus status,
Configuration conf,
int numLinesPerSplit) |
void |
SequenceFileInputFilter.RegexFilter.setConf(Configuration conf)
configure the Filter by checking the configuration
|
void |
SequenceFileInputFilter.PercentFilter.setConf(Configuration conf)
configure the filter by checking the configuration
|
void |
SequenceFileInputFilter.MD5Filter.setConf(Configuration conf)
configure the filter according to configuration
|
static void |
SequenceFileInputFilter.PercentFilter.setFrequency(Configuration conf,
int frequency)
set the frequency and stores it in conf
|
static void |
SequenceFileInputFilter.MD5Filter.setFrequency(Configuration conf,
int frequency)
set the filtering frequency in configuration
|
static void |
SequenceFileInputFilter.RegexFilter.setPattern(Configuration conf,
String regex)
Define the filtering regex and stores it in conf
|
Constructor and Description |
---|
KeyValueLineRecordReader(Configuration conf) |
Constructor and Description |
---|
ControlledJob(Configuration conf)
Construct a job.
|
Modifier and Type | Field and Description |
---|---|
protected Configuration |
CompositeRecordReader.conf |
Modifier and Type | Method and Description |
---|---|
Configuration |
CompositeRecordReader.getConf()
Return the configuration used by this object.
|
Modifier and Type | Method and Description |
---|---|
void |
CompositeRecordReader.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
CompositeInputFormat.setFormat(Configuration conf)
Interpret a given string as a composite expression.
|
Constructor and Description |
---|
JoinRecordReader(int id,
Configuration conf,
int capacity,
Class<? extends WritableComparator> cmpcl) |
MultiFilterRecordReader(int id,
Configuration conf,
int capacity,
Class<? extends WritableComparator> cmpcl) |
Modifier and Type | Method and Description |
---|---|
Configuration |
WrappedMapper.Context.getConfiguration() |
Modifier and Type | Method and Description |
---|---|
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(Path dir,
Configuration conf)
Open the output generated by this format.
|
Modifier and Type | Method and Description |
---|---|
Configuration |
KeyFieldBasedComparator.getConf() |
Configuration |
TotalOrderPartitioner.getConf() |
Configuration |
KeyFieldBasedPartitioner.getConf() |
Configuration |
BinaryPartitioner.getConf() |
Modifier and Type | Method and Description |
---|---|
static String |
TotalOrderPartitioner.getPartitionFile(Configuration conf)
Get the path to the SequenceFile storing the sorted partition keyset.
|
void |
KeyFieldBasedComparator.setConf(Configuration conf) |
void |
TotalOrderPartitioner.setConf(Configuration conf)
Read in the partition file and build indexing data structures.
|
void |
KeyFieldBasedPartitioner.setConf(Configuration conf) |
void |
BinaryPartitioner.setConf(Configuration conf) |
static void |
BinaryPartitioner.setLeftOffset(Configuration conf,
int offset)
Set the subarray to be used for partitioning to
bytes[offset:] in Python syntax. |
static void |
BinaryPartitioner.setOffsets(Configuration conf,
int left,
int right)
Set the subarray to be used for partitioning to
bytes[left:(right+1)] in Python syntax. |
static void |
TotalOrderPartitioner.setPartitionFile(Configuration conf,
Path p)
Set the path to the SequenceFile storing the sorted partition keyset.
|
static void |
BinaryPartitioner.setRightOffset(Configuration conf,
int offset)
Set the subarray to be used for partitioning to
bytes[:(offset+1)] in Python syntax. |
Constructor and Description |
---|
InputSampler(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
WrappedReducer.Context.getConfiguration() |
Modifier and Type | Method and Description |
---|---|
abstract ClientProtocol |
ClientProtocolProvider.create(Configuration conf) |
abstract ClientProtocol |
ClientProtocolProvider.create(InetSocketAddress addr,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static void |
TokenCache.cleanUpTokenReferral(Configuration conf)
Remove jobtoken referrals which don't make sense in the context
of the task execution.
|
static Credentials |
TokenCache.loadTokens(String jobTokenFile,
Configuration conf)
Deprecated.
Use
Credentials.readTokenStorageFile(org.apache.hadoop.fs.Path, org.apache.hadoop.conf.Configuration) instead,
this method is included for compatibility against Hadoop-1. |
static void |
TokenCache.obtainTokensForNamenodes(Credentials credentials,
Path[] ps,
Configuration conf)
Convenience method to obtain delegation tokens from namenodes
corresponding to the paths passed.
|
Modifier and Type | Method and Description |
---|---|
static void |
JobSplitWriter.createSplitFiles(Path jobSubmitDir,
Configuration conf,
FileSystem fs,
InputSplit[] splits) |
static <T extends InputSplit> |
JobSplitWriter.createSplitFiles(Path jobSubmitDir,
Configuration conf,
FileSystem fs,
List<InputSplit> splits) |
static <T extends InputSplit> |
JobSplitWriter.createSplitFiles(Path jobSubmitDir,
Configuration conf,
FileSystem fs,
T[] splits) |
static JobSplit.TaskSplitMetaInfo[] |
SplitMetaInfoReader.readSplitMetaInfo(JobID jobId,
FileSystem fs,
Configuration conf,
Path jobSubmitDir) |
Modifier and Type | Method and Description |
---|---|
Configuration |
JobContextImpl.getConfiguration()
Return the configuration for the job.
|
Constructor and Description |
---|
JobContextImpl(Configuration conf,
JobID jobId) |
MapContextImpl(Configuration conf,
TaskAttemptID taskid,
RecordReader<KEYIN,VALUEIN> reader,
RecordWriter<KEYOUT,VALUEOUT> writer,
OutputCommitter committer,
StatusReporter reporter,
InputSplit split) |
ReduceContextImpl(Configuration conf,
TaskAttemptID taskid,
RawKeyValueIterator input,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<KEYOUT,VALUEOUT> output,
OutputCommitter committer,
StatusReporter reporter,
RawComparator<KEYIN> comparator,
Class<KEYIN> keyClass,
Class<VALUEIN> valueClass) |
TaskAttemptContextImpl(Configuration conf,
TaskAttemptID taskId) |
TaskAttemptContextImpl(Configuration conf,
TaskAttemptID taskId,
StatusReporter reporter) |
TaskInputOutputContextImpl(Configuration conf,
TaskAttemptID taskid,
RecordWriter<KEYOUT,VALUEOUT> output,
OutputCommitter committer,
StatusReporter reporter) |
Constructor and Description |
---|
InMemoryReader(MergeManagerImpl<K,V> merger,
TaskAttemptID taskAttemptId,
byte[] data,
int start,
int length,
Configuration conf) |
Constructor and Description |
---|
CLI(Configuration conf) |
Constructor and Description |
---|
HSClientProtocolPBClientImpl(long clientVersion,
InetSocketAddress addr,
Configuration conf) |
MRClientProtocolPBClientImpl(long clientVersion,
InetSocketAddress addr,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
JobEndNotifier.getConf() |
Modifier and Type | Method and Description |
---|---|
protected Job |
MRAppMaster.createJob(Configuration conf,
JobStateInternal forcedState,
String diagnostic)
Create and initialize (but don't start) a single job.
|
protected Speculator |
MRAppMaster.createSpeculator(Configuration conf,
AppContext context) |
protected FileSystem |
MRAppMaster.getFileSystem(Configuration conf)
Create the default file System for this job.
|
KerberosInfo |
MRClientSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
TokenInfo |
MRClientSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
protected void |
MRAppMaster.initJobCredentialsAndUGI(Configuration conf)
Obtain the tokens needed by the job and put them in the UGI
|
protected void |
TaskHeartbeatHandler.serviceInit(Configuration conf) |
protected void |
MRAppMaster.serviceInit(Configuration conf) |
void |
JobEndNotifier.setConf(Configuration conf)
Parse the URL that needs to be notified of the end of the job, along
with the number of retries in case of failure, the amount of time to
wait between retries and proxy settings
|
Constructor and Description |
---|
MRAppMaster.RunningAppContext(Configuration config) |
Modifier and Type | Method and Description |
---|---|
protected void |
CommitterEventHandler.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
Job.loadConfFile() |
Modifier and Type | Method and Description |
---|---|
Configuration |
JobImpl.loadConfFile() |
Modifier and Type | Method and Description |
---|---|
protected FileSystem |
JobImpl.getFileSystem(Configuration conf)
Create the default file System for this job.
|
Constructor and Description |
---|
JobImpl(JobId jobId,
ApplicationAttemptId applicationAttemptId,
Configuration conf,
EventHandler eventHandler,
TaskAttemptListener taskAttemptListener,
JobTokenSecretManager jobTokenSecretManager,
Credentials jobCredentials,
Clock clock,
Map<TaskId,JobHistoryParser.TaskInfo> completedTasksFromPreviousRun,
MRAppMetrics metrics,
OutputCommitter committer,
boolean newApiCommitter,
String userName,
long appSubmitTime,
List<AMInfo> amInfos,
AppContext appContext,
JobStateInternal forcedState,
String forcedDiagnostic) |
Modifier and Type | Method and Description |
---|---|
protected void |
ContainerLauncherImpl.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected void |
LocalContainerAllocator.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected void |
RMContainerRequestor.serviceInit(Configuration conf) |
protected void |
RMCommunicator.serviceInit(Configuration conf) |
protected void |
RMContainerAllocator.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
ExponentiallySmoothedTaskRuntimeEstimator.contextualize(Configuration conf,
AppContext context) |
void |
NullTaskRuntimesEngine.contextualize(Configuration conf,
AppContext context) |
void |
TaskRuntimeEstimator.contextualize(Configuration conf,
AppContext context) |
Constructor and Description |
---|
DefaultSpeculator(Configuration conf,
AppContext context) |
DefaultSpeculator(Configuration conf,
AppContext context,
Clock clock) |
DefaultSpeculator(Configuration conf,
AppContext context,
TaskRuntimeEstimator estimator,
Clock clock) |
Constructor and Description |
---|
AppController(App app,
Configuration conf,
Controller.RequestContext ctx) |
AppController(App app,
Configuration conf,
Controller.RequestContext ctx,
String title) |
Modifier and Type | Method and Description |
---|---|
Configuration |
CompletedJob.loadConfFile() |
Configuration |
PartialJob.loadConfFile() |
Configuration |
HistoryFileManager.HistoryFileInfo.loadConfFile() |
Modifier and Type | Method and Description |
---|---|
protected JHSDelegationTokenSecretManager |
JobHistoryServer.createJHSSecretManager(Configuration conf) |
protected void |
JobHistoryServer.doSecureLogin(Configuration conf) |
protected void |
JobHistoryServer.serviceInit(Configuration conf) |
void |
CachedHistoryStorage.serviceInit(Configuration conf) |
protected void |
HistoryFileManager.serviceInit(Configuration conf) |
protected void |
JobHistory.serviceInit(Configuration conf) |
Constructor and Description |
---|
CompletedJob(Configuration conf,
JobId jobId,
Path historyFile,
boolean loadTasks,
String userName,
HistoryFileManager.HistoryFileInfo info,
JobACLsManager aclsMgr) |
Modifier and Type | Method and Description |
---|---|
void |
MapReduceTrackingUriPlugin.setConf(Configuration conf) |
Constructor and Description |
---|
HsWebServices(HistoryContext ctx,
Configuration conf,
WebApp webapp) |
Modifier and Type | Method and Description |
---|---|
static String |
JobHistoryUtils.getConfiguredHistoryIntermediateDoneDirPrefix(Configuration conf)
Gets the configured directory prefix for intermediate done history files.
|
static String |
JobHistoryUtils.getConfiguredHistoryServerDoneDirPrefix(Configuration conf)
Gets the configured directory prefix for Done history files.
|
static String |
JobHistoryUtils.getConfiguredHistoryStagingDirPrefix(Configuration conf,
String jobId)
Gets the configured directory prefix for In Progress history files.
|
static String |
JobHistoryUtils.getHistoryIntermediateDoneDirForUser(Configuration conf)
Gets the user directory for intermediate done history files.
|
static Path |
JobHistoryUtils.getPreviousJobHistoryPath(Configuration conf,
ApplicationAttemptId applicationAttemptId) |
static boolean |
JobHistoryUtils.shouldCreateNonUserDirectory(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
MRDelegationTokenRenewer.cancel(Token<?> token,
Configuration conf) |
protected MRClientProtocol |
MRDelegationTokenRenewer.instantiateHistoryProxy(Configuration conf,
InetSocketAddress hsAddress) |
long |
MRDelegationTokenRenewer.renew(Token<?> token,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
KerberosInfo |
ClientHSSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
TokenInfo |
ClientHSSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
ScriptBasedMapping.getConf() |
Configuration |
AbstractDNSToSwitchMapping.getConf() |
Configuration |
SocksSocketFactory.getConf() |
Configuration |
TableMapping.getConf() |
Modifier and Type | Method and Description |
---|---|
static SocketFactory |
NetUtils.getDefaultSocketFactory(Configuration conf)
Get the default socket factory as specified by the configuration
parameter hadoop.rpc.socket.factory.default
|
static NetworkTopology |
NetworkTopology.getInstance(Configuration conf)
Get an instance of NetworkTopology based on the value of the configuration
parameter net.topology.impl.
|
static SocketFactory |
NetUtils.getSocketFactory(Configuration conf,
Class<?> clazz)
Get the socket factory for the given class according to its
configuration parameter
hadoop.rpc.socket.factory.class.<ClassName>.
|
static SocketFactory |
NetUtils.getSocketFactoryFromProperty(Configuration conf,
String propValue)
Get the socket factory corresponding to the given proxy URI.
|
void |
ScriptBasedMapping.setConf(Configuration conf)
Set the configuration to be used by this object.
|
void |
AbstractDNSToSwitchMapping.setConf(Configuration conf) |
void |
SocksSocketFactory.setConf(Configuration conf) |
void |
TableMapping.setConf(Configuration conf) |
Constructor and Description |
---|
AbstractDNSToSwitchMapping(Configuration conf)
Create an instance, caching the configuration file.
|
ScriptBasedMapping(Configuration conf)
Create an instance from the given configuration
|
Modifier and Type | Method and Description |
---|---|
static NfsExports |
NfsExports.getInstance(Configuration conf) |
Constructor and Description |
---|
Nfs3Base(MountdBase mountd,
RpcProgram program,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
LdapGroupsMapping.getConf() |
Modifier and Type | Method and Description |
---|---|
static UserGroupInformation.AuthenticationMethod |
SecurityUtil.getAuthenticationMethod(Configuration conf) |
abstract KerberosInfo |
SecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf)
Get the KerberosInfo for a given protocol.
|
static KerberosInfo |
SecurityUtil.getKerberosInfo(Class<?> protocol,
Configuration conf)
Look up the KerberosInfo for a given protocol.
|
KerberosInfo |
AnnotatedSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
abstract TokenInfo |
SecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf)
Get the TokenInfo for a given protocol.
|
static TokenInfo |
SecurityUtil.getTokenInfo(Class<?> protocol,
Configuration conf)
Look up the TokenInfo for a given protocol.
|
TokenInfo |
AnnotatedSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
static Groups |
Groups.getUserToGroupsMappingService(Configuration conf)
Get the groups being used to map user-to-groups.
|
static void |
SaslRpcServer.init(Configuration conf) |
void |
AuthenticationFilterInitializer.initFilter(FilterContainer container,
Configuration conf)
Initializes hadoop-auth AuthenticationFilter.
|
static void |
SecurityUtil.login(Configuration conf,
String keytabFileKey,
String userNameKey)
Login as a principal specified in config.
|
static void |
SecurityUtil.login(Configuration conf,
String keytabFileKey,
String userNameKey,
String hostname)
Login as a principal specified in config.
|
static Credentials |
Credentials.readTokenStorageFile(File filename,
Configuration conf)
Convenience method for reading a token storage file, and loading the Tokens
therein in the passed UGI
|
static Credentials |
Credentials.readTokenStorageFile(Path filename,
Configuration conf)
Convenience method for reading a token storage file, and loading the Tokens
therein in the passed UGI
|
static void |
SecurityUtil.setAuthenticationMethod(UserGroupInformation.AuthenticationMethod authenticationMethod,
Configuration conf) |
void |
LdapGroupsMapping.setConf(Configuration conf) |
static void |
UserGroupInformation.setConfiguration(Configuration conf)
Set the static configuration for UGI.
|
static void |
HadoopKerberosName.setConfiguration(Configuration conf)
Set the static configuration to get the rules.
|
void |
Credentials.writeTokenStorageFile(Path filename,
Configuration conf) |
Constructor and Description |
---|
Groups(Configuration conf) |
SaslRpcClient(UserGroupInformation ugi,
Class<?> protocol,
InetSocketAddress serverAddr,
Configuration conf)
Create a SaslRpcClient that can be used by a RPC client to negotiate
SASL authentication with a RPC server
|
Modifier and Type | Method and Description |
---|---|
void |
ServiceAuthorizationManager.authorize(UserGroupInformation user,
Class<?> protocol,
Configuration conf,
InetAddress addr)
Authorize the user to access the protocol being used.
|
static void |
ProxyUsers.authorize(UserGroupInformation user,
String remoteAddress,
Configuration newConf)
Authorize the superuser which is doing doAs
|
void |
ServiceAuthorizationManager.refresh(Configuration conf,
PolicyProvider provider) |
static void |
ProxyUsers.refreshSuperUserGroupsConfiguration(Configuration conf)
refresh configuration
|
Modifier and Type | Method and Description |
---|---|
Configuration |
FileBasedKeyStoresFactory.getConf()
Returns the configuration of the factory.
|
Modifier and Type | Method and Description |
---|---|
void |
FileBasedKeyStoresFactory.setConf(Configuration conf)
Sets the configuration for the factory.
|
Constructor and Description |
---|
SSLFactory(SSLFactory.Mode mode,
Configuration conf)
Creates an SSLFactory.
|
Modifier and Type | Method and Description |
---|---|
void |
Token.cancel(Configuration conf)
Cancel this delegation token
|
abstract void |
TokenRenewer.cancel(Token<?> token,
Configuration conf)
Cancel the given token
|
void |
Token.TrivialRenewer.cancel(Token<?> token,
Configuration conf) |
long |
Token.renew(Configuration conf)
Renew this delegation token
|
abstract long |
TokenRenewer.renew(Token<?> token,
Configuration conf)
Renew the given token.
|
long |
Token.TrivialRenewer.renew(Token<?> token,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
AbstractService.getConfig() |
Configuration |
Service.getConfig()
Get the configuration of this service.
|
Modifier and Type | Method and Description |
---|---|
void |
AbstractService.init(Configuration conf)
Initialize the service.
|
void |
Service.init(Configuration config)
Initialize the service.
|
protected void |
CompositeService.serviceInit(Configuration conf) |
protected void |
AbstractService.serviceInit(Configuration conf)
All initialization code needed by a service.
|
protected void |
AbstractService.setConfig(Configuration conf)
Set the configuration for this service.
|
Modifier and Type | Field and Description |
---|---|
protected Configuration |
StreamJob.config_ |
Modifier and Type | Method and Description |
---|---|
Configuration |
StreamJob.getConf() |
Configuration |
LoadTypedBytes.getConf() |
Configuration |
DumpTypedBytes.getConf() |
Configuration |
PipeMapRed.getConfiguration()
Returns the Configuration.
|
Modifier and Type | Method and Description |
---|---|
static Class |
StreamUtil.goodClassOrNull(Configuration conf,
String className,
String defaultPackage)
It may seem strange to silently switch behaviour when a String
is not a classname; the reason is simplified Usage:
|
void |
StreamJob.setConf(Configuration conf) |
void |
LoadTypedBytes.setConf(Configuration conf) |
void |
DumpTypedBytes.setConf(Configuration conf) |
Constructor and Description |
---|
DumpTypedBytes(Configuration conf) |
LoadTypedBytes(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
DistCpV1.getConf() |
Configuration |
Logalyzer.LogComparator.getConf() |
Configuration |
HadoopArchives.getConf() |
Modifier and Type | Method and Description |
---|---|
static void |
DistCpOptionSwitch.addToConf(Configuration conf,
DistCpOptionSwitch option)
Helper function to set an option to hadoop configuration object
|
static void |
DistCpOptionSwitch.addToConf(Configuration conf,
DistCpOptionSwitch option,
String value)
Helper function to add an option to hadoop configuration object
|
void |
DistCpOptions.appendToConf(Configuration conf)
Add options to configuration.
|
static void |
DistCpV1.copy(Configuration conf,
String srcPath,
String destPath,
Path logPath,
boolean srcAsList,
boolean ignoreReadFailures)
Deprecated.
|
static CopyListing |
CopyListing.getCopyListing(Configuration configuration,
Credentials credentials,
DistCpOptions options)
Public Factory method with which the appropriate CopyListing implementation may be retrieved.
|
protected abstract InetSocketAddress |
GetGroupsBase.getProtocolAddress(Configuration conf)
Must be overridden by subclasses to get the address where the
GetUserMappingsProtocol implementation is running. |
void |
DistCpV1.setConf(Configuration conf) |
void |
Logalyzer.LogComparator.setConf(Configuration conf) |
void |
HadoopArchives.setConf(Configuration conf) |
Constructor and Description |
---|
CopyListing(Configuration configuration,
Credentials credentials)
Protected constructor, to initialize configuration.
|
DistCp(Configuration configuration,
DistCpOptions inputOptions)
Public Constructor.
|
DistCpV1(Configuration conf) |
FileBasedCopyListing(Configuration configuration,
Credentials credentials)
Constructor, to initialize base-class.
|
GetGroupsBase(Configuration conf)
Create an instance of this tool using the given configuration.
|
GetGroupsBase(Configuration conf,
PrintStream out)
Used exclusively for testing.
|
GlobbedCopyListing(Configuration configuration,
Credentials credentials)
Constructor, to initialize the configuration.
|
HadoopArchives(Configuration conf) |
SimpleCopyListing(Configuration configuration,
Credentials credentials)
Protected constructor, to initialize configuration.
|
Modifier and Type | Method and Description |
---|---|
void |
DefaultInputDemuxer.bindTo(Path path,
Configuration conf) |
void |
InputDemuxer.bindTo(Path path,
Configuration conf)
Bind the
InputDemuxer to a particular file. |
void |
DefaultOutputter.init(Path path,
Configuration conf) |
void |
Outputter.init(Path path,
Configuration conf)
Initialize the
Outputter to a specific path. |
Constructor and Description |
---|
ClusterTopologyReader(Path path,
Configuration conf)
Constructor.
|
JobTraceReader(Path path,
Configuration conf)
Constructor.
|
ZombieCluster(Path path,
MachineNode defaultNode,
Configuration conf)
Construct a homogeneous cluster.
|
ZombieJobProducer(Path path,
ZombieCluster cluster,
Configuration conf)
Constructor
|
ZombieJobProducer(Path path,
ZombieCluster cluster,
Configuration conf,
long randomSeed)
Constructor
|
Modifier and Type | Method and Description |
---|---|
String |
NodeName.getAnonymizedValue(StatePool statePool,
Configuration conf) |
String |
DefaultAnonymizableDataType.getAnonymizedValue(StatePool statePool,
Configuration conf) |
Properties |
JobProperties.getAnonymizedValue(StatePool statePool,
Configuration conf) |
T |
AnonymizableDataType.getAnonymizedValue(StatePool statePool,
Configuration conf) |
String |
FileName.getAnonymizedValue(StatePool statePool,
Configuration conf) |
protected boolean |
DefaultAnonymizableDataType.needsAnonymization(Configuration conf) |
protected boolean |
ClassName.needsAnonymization(Configuration conf) |
Constructor and Description |
---|
DefaultAnonymizingRumenSerializer(StatePool statePool,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
StatePool.initialize(Configuration conf)
Initialized the
StatePool . |
Modifier and Type | Method and Description |
---|---|
static long |
DistCpUtils.getFileSize(Path path,
Configuration configuration)
Retrieves size of the file at the specified path.
|
static int |
DistCpUtils.getInt(Configuration configuration,
String label)
Utility to retrieve a specified key from a Configuration.
|
static long |
DistCpUtils.getLong(Configuration configuration,
String label)
Utility to retrieve a specified key from a Configuration.
|
static Class<? extends InputFormat> |
DistCpUtils.getStrategy(Configuration conf,
DistCpOptions options)
Returns the class that implements a copy strategy.
|
static <T> void |
DistCpUtils.publish(Configuration configuration,
String label,
T value)
Utility to publish a value to a configuration.
|
static Path |
DistCpUtils.sortListing(FileSystem fs,
Configuration conf,
Path sourceListing)
Sort sequence file containing FileStatus and Text as key and value respecitvely
|
Modifier and Type | Method and Description |
---|---|
Configuration |
TypedBytesWritableInput.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
TypedBytesWritableInput.setConf(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
GenericOptionsParser.getConfiguration()
Get the modified configuration
|
Modifier and Type | Method and Description |
---|---|
static <T> T |
ReflectionUtils.copy(Configuration conf,
T src,
T dst)
Make a copy of the writable object using serialization to a buffer
|
static URL[] |
GenericOptionsParser.getLibJars(Configuration conf)
If libjars are set in the conf, parse the libjars.
|
boolean |
NativeCodeLoader.getLoadNativeLibraries(Configuration conf)
Return if native hadoop libraries, if present, can be used for this job.
|
static <T> T |
ReflectionUtils.newInstance(Class<T> theClass,
Configuration conf)
Create an object for the given class and initialize it from conf
|
static int |
ToolRunner.run(Configuration conf,
Tool tool,
String[] args)
Runs the given
Tool by Tool.run(String[]) , after
parsing with the given generic arguments. |
static void |
ReflectionUtils.setConf(Object theObject,
Configuration conf)
Check and set 'configuration' if necessary.
|
void |
NativeCodeLoader.setLoadNativeLibraries(Configuration conf,
boolean loadNativeLibraries)
Set if native hadoop libraries, if present, can be used for this job.
|
Constructor and Description |
---|
GenericOptionsParser(Configuration conf,
org.apache.commons.cli.Options options,
String[] args)
Create a
GenericOptionsParser to parse given options as well
as generic Hadoop options. |
GenericOptionsParser(Configuration conf,
String[] args)
Create a
GenericOptionsParser |
LineReader(InputStream in,
Configuration conf)
Create a line reader that reads from the given stream using the
io.file.buffer.size specified in the given
Configuration . |
LineReader(InputStream in,
Configuration conf,
byte[] recordDelimiterBytes)
Create a line reader that reads from the given stream using the
io.file.buffer.size specified in the given
Configuration , and using a custom delimiter of array of
bytes. |
Modifier and Type | Method and Description |
---|---|
static int |
Hash.getHashType(Configuration conf)
This utility method converts the name of the configured
hash type to a symbolic constant.
|
static Hash |
Hash.getInstance(Configuration conf)
Get a singleton instance of hash function of a type
defined in the configuration.
|
Constructor and Description |
---|
ApplicationClientProtocolPBClientImpl(long clientVersion,
InetSocketAddress addr,
Configuration conf) |
ApplicationMasterProtocolPBClientImpl(long clientVersion,
InetSocketAddress addr,
Configuration conf) |
ContainerManagementProtocolPBClientImpl(long clientVersion,
InetSocketAddress addr,
Configuration conf) |
Constructor and Description |
---|
Client(Configuration conf) |
Constructor and Description |
---|
UnmanagedAMLauncher(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static RetryPolicy |
RMProxy.createRetryPolicy(Configuration conf) |
static <T> T |
ClientRMProxy.createRMProxy(Configuration conf,
Class<T> protocol) |
static <T> T |
RMProxy.createRMProxy(Configuration conf,
Class<T> protocol,
InetSocketAddress rmAddress) |
Modifier and Type | Method and Description |
---|---|
protected void |
AMRMClientAsyncImpl.serviceInit(Configuration conf) |
protected void |
NMClientAsyncImpl.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected void |
AMRMClientImpl.serviceInit(Configuration conf) |
protected void |
YarnClientImpl.serviceInit(Configuration conf) |
protected void |
NMClientImpl.serviceInit(Configuration conf) |
Constructor and Description |
---|
ContainerManagementProtocolProxy(Configuration conf) |
Constructor and Description |
---|
RMAdminCLI(Configuration conf) |
Modifier and Type | Class and Description |
---|---|
class |
YarnConfiguration |
Constructor and Description |
---|
YarnConfiguration(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected void |
AsyncDispatcher.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Object |
RpcClientFactory.getClient(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf) |
Server |
RpcServerFactory.getServer(Class<?> protocol,
Object instance,
InetSocketAddress addr,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
int numHandlers,
String portRangeConfig) |
Modifier and Type | Method and Description |
---|---|
Object |
RpcClientFactoryPBImpl.getClient(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf) |
Server |
RpcServerFactoryPBImpl.getServer(Class<?> protocol,
Object instance,
InetSocketAddress addr,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
int numHandlers) |
Server |
RpcServerFactoryPBImpl.getServer(Class<?> protocol,
Object instance,
InetSocketAddress addr,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
int numHandlers,
String portRangeConfig) |
Modifier and Type | Method and Description |
---|---|
static RpcClientFactory |
RpcFactoryProvider.getClientFactory(Configuration conf) |
static RecordFactory |
RecordFactoryProvider.getRecordFactory(Configuration conf) |
static RpcServerFactory |
RpcFactoryProvider.getServerFactory(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static YarnRPC |
YarnRPC.create(Configuration conf) |
abstract Object |
YarnRPC.getProxy(Class protocol,
InetSocketAddress addr,
Configuration conf) |
Object |
HadoopYarnProtoRPC.getProxy(Class protocol,
InetSocketAddress addr,
Configuration conf) |
Server |
YarnRPC.getServer(Class protocol,
Object instance,
InetSocketAddress addr,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
int numHandlers) |
abstract Server |
YarnRPC.getServer(Class protocol,
Object instance,
InetSocketAddress addr,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
int numHandlers,
String portRangeConfig) |
Server |
HadoopYarnProtoRPC.getServer(Class protocol,
Object instance,
InetSocketAddress addr,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
int numHandlers,
String portRangeConfig) |
abstract void |
YarnRPC.stopProxy(Object proxy,
Configuration conf) |
void |
HadoopYarnProtoRPC.stopProxy(Object proxy,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
LogCLIHelpers.getConf() |
Modifier and Type | Method and Description |
---|---|
static String |
LogAggregationUtils.getRemoteNodeLogDirSuffix(Configuration conf)
Returns the suffix component of the log dir.
|
void |
LogCLIHelpers.setConf(Configuration conf) |
Constructor and Description |
---|
AggregatedLogFormat.LogReader(Configuration conf,
Path remoteAppLogFile) |
AggregatedLogFormat.LogWriter(Configuration conf,
Path remoteAppLogFile,
UserGroupInformation userUgi) |
Modifier and Type | Method and Description |
---|---|
KerberosInfo |
SchedulerSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
KerberosInfo |
ContainerManagerSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
TokenInfo |
SchedulerSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
TokenInfo |
ContainerManagerSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
Constructor and Description |
---|
AdminACLsManager(Configuration conf)
Constructs and initializes this AdminACLsManager
|
Modifier and Type | Method and Description |
---|---|
KerberosInfo |
AdminSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
TokenInfo |
AdminSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
RMDelegationTokenIdentifier.Renewer.cancel(Token<?> token,
Configuration conf) |
KerberosInfo |
ClientRMSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
TokenInfo |
ClientRMSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
long |
RMDelegationTokenIdentifier.Renewer.renew(Token<?> token,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
KerberosInfo |
RMNMSecurityInfoClass.getKerberosInfo(Class<?> protocol,
Configuration conf) |
TokenInfo |
RMNMSecurityInfoClass.getTokenInfo(Class<?> protocol,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static <T> T |
ServerRMProxy.createRMProxy(Configuration conf,
Class<T> protocol) |
Constructor and Description |
---|
ResourceManagerAdministrationProtocolPBClientImpl(long clientVersion,
InetSocketAddress addr,
Configuration conf) |
ResourceTrackerPBClientImpl(long clientVersion,
InetSocketAddress addr,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
ContainerExecutor.getConf() |
Modifier and Type | Method and Description |
---|---|
protected String |
LinuxContainerExecutor.getContainerExecutorExecutablePath(Configuration conf) |
protected static String[] |
ContainerExecutor.getRunCommand(String command,
String groupId,
Configuration conf)
Return a command to execute the given command in OS shell.
|
protected boolean |
NodeStatusUpdaterImpl.isTokenKeepAliveEnabled(Configuration conf) |
protected void |
NodeHealthScriptRunner.serviceInit(Configuration conf) |
protected void |
NodeManager.serviceInit(Configuration conf) |
protected void |
DeletionService.serviceInit(Configuration conf) |
protected void |
NodeHealthCheckerService.serviceInit(Configuration conf) |
protected void |
LocalDirsHandlerService.serviceInit(Configuration config)
Method which initializes the timertask and its interval time.
|
protected void |
NodeStatusUpdaterImpl.serviceInit(Configuration conf) |
void |
LinuxContainerExecutor.setConf(Configuration conf) |
void |
ContainerExecutor.setConf(Configuration conf) |
static boolean |
NodeHealthScriptRunner.shouldRun(Configuration conf)
Method used to determine if or not node health monitoring service should be
started or not.
|
Constructor and Description |
---|
LocalizationProtocolPBClientImpl(long clientVersion,
InetSocketAddress addr,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected LogHandler |
ContainerManagerImpl.createLogHandler(Configuration conf,
Context context,
DeletionService deletionService) |
void |
AuxServices.serviceInit(Configuration conf) |
void |
ContainerManagerImpl.serviceInit(Configuration conf) |
Constructor and Description |
---|
ContainerImpl(Configuration conf,
Dispatcher dispatcher,
ContainerLaunchContext launchContext,
Credentials creds,
NodeManagerMetrics metrics,
ContainerTokenIdentifier containerTokenIdentifier) |
Modifier and Type | Method and Description |
---|---|
protected void |
ContainersLauncher.serviceInit(Configuration conf) |
Constructor and Description |
---|
ContainerLaunch(Context context,
Configuration configuration,
Dispatcher dispatcher,
ContainerExecutor exec,
Application app,
Container container,
LocalDirsHandlerService dirsHandler,
ContainerManagerImpl containerManager) |
Modifier and Type | Method and Description |
---|---|
void |
ResourceLocalizationService.serviceInit(Configuration conf) |
Constructor and Description |
---|
LocalCacheDirectoryManager(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
KerberosInfo |
LocalizerSecurityInfo.getKerberosInfo(Class<?> protocol,
Configuration conf) |
TokenInfo |
LocalizerSecurityInfo.getTokenInfo(Class<?> protocol,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected FileSystem |
LogAggregationService.getFileSystem(Configuration conf) |
protected void |
LogAggregationService.serviceInit(Configuration conf) |
Constructor and Description |
---|
AppLogAggregatorImpl(Dispatcher dispatcher,
DeletionService deletionService,
Configuration conf,
ApplicationId appId,
UserGroupInformation userUgi,
LocalDirsHandlerService dirsHandler,
Path remoteNodeLogFileForApp,
ContainerLogsRetentionPolicy retentionPolicy,
Map<ApplicationAccessType,String> appAcls) |
Modifier and Type | Method and Description |
---|---|
protected void |
NonAggregatingLogHandler.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected void |
ContainersMonitorImpl.serviceInit(Configuration conf) |
Constructor and Description |
---|
NMContainerTokenSecretManager(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
DefaultLCEResourcesHandler.getConf() |
Configuration |
CgroupsLCEResourcesHandler.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
DefaultLCEResourcesHandler.setConf(Configuration conf) |
void |
CgroupsLCEResourcesHandler.setConf(Configuration conf) |
Constructor and Description |
---|
ApplicationPage.ApplicationBlock(Context nmContext,
Configuration conf) |
ContainerLogsPage.ContainersLogsBlock(Configuration conf,
Context context,
ApplicationACLsManager aclsManager,
LocalDirsHandlerService dirsHandler) |
NavBlock(Configuration conf) |
NMController(Configuration nmConf,
Controller.RequestContext requestContext,
Context nmContext) |
Modifier and Type | Method and Description |
---|---|
protected AMRMTokenSecretManager |
ResourceManager.createAMRMTokenSecretManager(Configuration conf) |
protected RMContainerTokenSecretManager |
ResourceManager.createContainerTokenSecretManager(Configuration conf) |
protected NMTokenSecretManagerInRM |
ResourceManager.createNMTokenSecretManager(Configuration conf) |
protected QueueACLsManager |
ResourceManager.createQueueACLsManager(ResourceScheduler scheduler,
Configuration conf) |
void |
NodesListManager.refreshNodes(Configuration yarnConf) |
void |
ApplicationMasterService.refreshServiceAcls(Configuration configuration,
PolicyProvider policyProvider) |
protected void |
NodesListManager.serviceInit(Configuration conf) |
protected void |
ClientRMService.serviceInit(Configuration conf) |
void |
NMLivelinessMonitor.serviceInit(Configuration conf) |
protected void |
ResourceManager.serviceInit(Configuration conf) |
protected void |
ResourceManager.SchedulerEventDispatcher.serviceInit(Configuration conf) |
void |
AdminService.serviceInit(Configuration conf) |
protected void |
ResourceTrackerService.serviceInit(Configuration conf) |
protected static void |
ResourceManager.validateConfigs(Configuration conf) |
Constructor and Description |
---|
AdminService(Configuration conf,
ResourceScheduler scheduler,
RMContext rmContext,
NodesListManager nodesListManager,
ClientRMService clientRMService,
ApplicationMasterService applicationMasterService,
ResourceTrackerService resourceTrackerService) |
RMAppManager(RMContext context,
YarnScheduler scheduler,
ApplicationMasterService masterService,
ApplicationACLsManager applicationACLsManager,
Configuration conf) |
Constructor and Description |
---|
AMLauncher(RMContext rmContext,
RMAppAttempt application,
AMLauncherEventType eventType,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
SchedulingEditPolicy.init(Configuration config,
EventHandler<ContainerPreemptEvent> dispatcher,
PreemptableResourceScheduler scheduler) |
void |
SchedulingMonitor.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
ProportionalCapacityPreemptionPolicy.init(Configuration config,
EventHandler<ContainerPreemptEvent> disp,
PreemptableResourceScheduler sched) |
Constructor and Description |
---|
ProportionalCapacityPreemptionPolicy(Configuration config,
EventHandler<ContainerPreemptEvent> dispatcher,
CapacityScheduler scheduler) |
ProportionalCapacityPreemptionPolicy(Configuration config,
EventHandler<ContainerPreemptEvent> dispatcher,
CapacityScheduler scheduler,
Clock clock) |
Modifier and Type | Method and Description |
---|---|
static RMStateStore |
RMStateStoreFactory.getStore(Configuration conf) |
void |
FileSystemRMStateStore.initInternal(Configuration conf) |
protected void |
NullRMStateStore.initInternal(Configuration conf) |
void |
MemoryRMStateStore.initInternal(Configuration conf) |
protected abstract void |
RMStateStore.initInternal(Configuration conf)
Derived classes initialize themselves using this method.
|
void |
RMStateStore.serviceInit(Configuration conf) |
Constructor and Description |
---|
RMAppImpl(ApplicationId applicationId,
RMContext rmContext,
Configuration config,
String name,
String user,
String queue,
ApplicationSubmissionContext submissionContext,
YarnScheduler scheduler,
ApplicationMasterService masterService,
long submitTime,
String applicationType) |
Modifier and Type | Method and Description |
---|---|
void |
AMLivelinessMonitor.serviceInit(Configuration conf) |
Constructor and Description |
---|
RMAppAttemptImpl(ApplicationAttemptId appAttemptId,
RMContext rmContext,
YarnScheduler scheduler,
ApplicationMasterService masterService,
ApplicationSubmissionContext submissionContext,
Configuration conf,
String user) |
Modifier and Type | Method and Description |
---|---|
void |
ContainerAllocationExpirer.serviceInit(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static QueueMetrics |
QueueMetrics.forQueue(MetricsSystem ms,
String queueName,
Queue parent,
boolean enableUserMetrics,
Configuration conf) |
static QueueMetrics |
QueueMetrics.forQueue(String queueName,
Queue parent,
boolean enableUserMetrics,
Configuration conf) |
void |
ResourceScheduler.reinitialize(Configuration conf,
RMContext rmContext)
Re-initialize the
ResourceScheduler . |
Constructor and Description |
---|
QueueMetrics(MetricsSystem ms,
String queueName,
Queue parent,
boolean enableUserMetrics,
Configuration conf) |
Modifier and Type | Class and Description |
---|---|
class |
CapacitySchedulerConfiguration |
Modifier and Type | Method and Description |
---|---|
Configuration |
CapacitySchedulerContext.getConf()
Get the yarn configuration.
|
Configuration |
CapacityScheduler.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
CapacityScheduler.reinitialize(Configuration conf,
RMContext rmContext) |
void |
CapacityScheduler.setConf(Configuration conf) |
Constructor and Description |
---|
CapacitySchedulerConfiguration(Configuration configuration) |
Modifier and Type | Class and Description |
---|---|
class |
FairSchedulerConfiguration |
Modifier and Type | Method and Description |
---|---|
static FSQueueMetrics |
FSQueueMetrics.forQueue(String queueName,
Queue parent,
boolean enableUserMetrics,
Configuration conf) |
void |
FairScheduler.reinitialize(Configuration conf,
RMContext rmContext) |
void |
NewAppWeightBooster.setConf(Configuration conf) |
Constructor and Description |
---|
FairSchedulerConfiguration(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
Configuration |
FifoScheduler.getConf() |
Modifier and Type | Method and Description |
---|---|
void |
FifoScheduler.reinitialize(Configuration conf,
RMContext rmContext) |
void |
FifoScheduler.setConf(Configuration conf) |
Modifier and Type | Field and Description |
---|---|
Configuration |
DelegationTokenRenewer.DelegationTokenToRenew.conf |
Modifier and Type | Method and Description |
---|---|
protected void |
DelegationTokenRenewer.serviceInit(Configuration conf) |
Constructor and Description |
---|
AMRMTokenSecretManager(Configuration conf)
Create an
AMRMTokenSecretManager |
DelegationTokenRenewer.DelegationTokenToRenew(ApplicationId jId,
Token<?> token,
Configuration conf,
long expirationDate,
boolean shouldCancelAtEnd) |
NMTokenSecretManagerInRM(Configuration conf) |
QueueACLsManager(ResourceScheduler scheduler,
Configuration conf) |
RMContainerTokenSecretManager(Configuration conf) |
Constructor and Description |
---|
ApplicationACLsManager(Configuration conf) |
BaseContainerTokenSecretManager(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
protected void |
WebAppProxyServer.doSecureLogin(Configuration conf)
Log in as the Kerberose principal designated for the proxy
|
protected void |
WebAppProxyServer.serviceInit(Configuration conf) |
protected void |
WebAppProxy.serviceInit(Configuration conf) |
Constructor and Description |
---|
AppReportFetcher(Configuration conf)
Create a new Connection to the RM to fetch Application reports.
|
AppReportFetcher(Configuration conf,
ApplicationClientProtocol applicationsManager)
Just call directly into the applicationsManager given instead of creating
a remote connection to it.
|
Modifier and Type | Method and Description |
---|---|
void |
AmFilterInitializer.initFilter(FilterContainer container,
Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static ResourceCalculatorPlugin |
ResourceCalculatorPlugin.getResourceCalculatorPlugin(Class<? extends ResourceCalculatorPlugin> clazz,
Configuration conf)
Create the ResourceCalculatorPlugin from the class name and configure it.
|
static ResourceCalculatorProcessTree |
ResourceCalculatorProcessTree.getResourceCalculatorProcessTree(String pid,
Class<? extends ResourceCalculatorProcessTree> clazz,
Configuration conf)
Create the ResourceCalculatorProcessTree rooted to specified process
from the class name and configure it.
|
static void |
RackResolver.init(Configuration conf) |
static Node |
RackResolver.resolve(Configuration conf,
String hostName)
Utility method for getting a hostname resolved to a node in the
network topology.
|
Constructor and Description |
---|
FSDownload(FileContext files,
UserGroupInformation ugi,
Configuration conf,
Path destDirPath,
LocalResource resource) |
Modifier and Type | Method and Description |
---|---|
Configuration |
WebApp.conf() |
Modifier and Type | Method and Description |
---|---|
WebApps.Builder<T> |
WebApps.Builder.with(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
static String |
WebAppUtils.getNMWebAppURLWithoutScheme(Configuration conf) |
static String |
WebAppUtils.getProxyHostAndPort(Configuration conf) |
static String |
WebAppUtils.getResolvedRMWebAppURLWithoutScheme(Configuration conf) |
static String |
WebAppUtils.getResolvedRMWebAppURLWithoutScheme(Configuration conf,
HttpConfig.Policy httpPolicy) |
static String |
WebAppUtils.getResolvedRMWebAppURLWithScheme(Configuration conf) |
static String |
WebAppUtils.getRMWebAppURLWithoutScheme(Configuration conf) |
static String |
WebAppUtils.getRMWebAppURLWithScheme(Configuration conf) |
static void |
WebAppUtils.setNMWebAppHostNameAndPort(Configuration conf,
String hostName,
int port) |
static void |
WebAppUtils.setRMWebAppHostnameAndPort(Configuration conf,
String hostname,
int port) |
static void |
WebAppUtils.setRMWebAppPort(Configuration conf,
int port) |
Copyright © 2013 Apache Software Foundation. All rights reserved.