Package | Description |
---|---|
org.apache.hadoop.examples |
Hadoop example code.
|
org.apache.hadoop.examples.dancing |
This package is a distributed implementation of Knuth's dancing links
algorithm that can run under Hadoop.
|
org.apache.hadoop.examples.pi |
This package consists of a map/reduce application,
distbbp,
which computes exact binary digits of the mathematical constant π.
|
org.apache.hadoop.examples.terasort |
This package consists of 3 map/reduce applications for Hadoop to
compete in the annual terabyte sort
competition.
|
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.fs.s3 |
A distributed, block-based implementation of
FileSystem that uses Amazon S3
as a backing store. |
org.apache.hadoop.ha | |
org.apache.hadoop.hdfs.qjournal.server | |
org.apache.hadoop.hdfs.server.namenode.ha | |
org.apache.hadoop.hdfs.tools | |
org.apache.hadoop.hdfs.tools.offlineEditsViewer | |
org.apache.hadoop.mapred | |
org.apache.hadoop.mapred.gridmix | |
org.apache.hadoop.mapred.pipes | |
org.apache.hadoop.mapreduce.lib.partition | |
org.apache.hadoop.mapreduce.tools | |
org.apache.hadoop.streaming |
Hadoop Streaming is a utility which allows users to create and run
Map-Reduce jobs with any executables (e.g.
|
org.apache.hadoop.tools |
Command-line tools for MapReduce.
|
org.apache.hadoop.tools.rumen |
Rumen is a data extraction and analysis tool built for
Apache Hadoop.
|
org.apache.hadoop.util |
Common utilities.
|
org.apache.hadoop.yarn.client.cli |
Modifier and Type | Class and Description |
---|---|
class |
BaileyBorweinPlouffe
A map/reduce program that uses Bailey-Borwein-Plouffe to compute exact
digits of Pi.
|
class |
DBCountPageView
This is a demonstrative program, which uses DBInputFormat for reading
the input data from a database, and DBOutputFormat for writing the data
to the database.
|
class |
Grep |
class |
Join
Given a set of sorted datasets keyed with the same class and yielding
equal partitions, it is possible to effect a join of those datasets
prior to the map.
|
class |
MultiFileWordCount
MultiFileWordCount is an example to demonstrate the usage of
MultiFileInputFormat.
|
class |
QuasiMonteCarlo
A map/reduce program that estimates the value of Pi
using a quasi-Monte Carlo (qMC) method.
|
class |
RandomTextWriter
This program uses map/reduce to just run a distributed job where there is
no interaction between the tasks and each task writes a large unsorted
random sequence of words.
|
class |
RandomWriter
This program uses map/reduce to just run a distributed job where there is
no interaction between the tasks and each task write a large unsorted
random binary sequence file of BytesWritable.
|
class |
Sort<K,V>
This is the trivial map/reduce program that does absolutely nothing
other than use the framework to fragment and sort the input values.
|
class |
WordMean |
class |
WordMedian |
class |
WordStandardDeviation |
Modifier and Type | Class and Description |
---|---|
class |
DistributedPentomino
Launch a distributed pentomino solver.
|
Modifier and Type | Class and Description |
---|---|
class |
DistBbp
A map/reduce program that uses a BBP-type method to compute exact
binary digits of Pi.
|
class |
DistSum
The main class for computing sums using map/reduce jobs.
|
Modifier and Type | Class and Description |
---|---|
class |
TeraChecksum |
class |
TeraGen
Generate the official GraySort input data set.
|
class |
TeraSort
Generates the sampled split points, launches the job, and waits for it to
finish.
|
class |
TeraValidate
Generate 1 mapper per a file that checks to make sure the keys
are sorted within each file.
|
Modifier and Type | Class and Description |
---|---|
class |
FsShell
Provide command line access to a FileSystem.
|
Modifier and Type | Class and Description |
---|---|
class |
MigrationTool
This class is a tool for migrating data from an older to a newer version
of an S3 filesystem.
|
Modifier and Type | Class and Description |
---|---|
class |
HAAdmin
A command-line tool for making calls in the HAServiceProtocol.
|
Modifier and Type | Class and Description |
---|---|
class |
JournalNode
The JournalNode is a daemon which allows namenodes using
the QuorumJournalManager to log and retrieve edits stored
remotely.
|
Modifier and Type | Class and Description |
---|---|
class |
BootstrapStandby
Tool which allows the standby node's storage directories to be bootstrapped
by copying the latest namespace snapshot from the active namenode.
|
Modifier and Type | Class and Description |
---|---|
class |
DFSAdmin
This class provides some DFS administrative access shell commands.
|
class |
DFSck
This class provides rudimentary checking of DFS volumes for errors and
sub-optimal conditions.
|
class |
DFSHAAdmin
Class to extend HAAdmin to do a little bit of HDFS-specific configuration.
|
class |
GetConf
Tool for getting configuration information from a configuration file.
|
class |
GetGroups
HDFS implementation of a tool for getting the groups which a given user
belongs to.
|
Modifier and Type | Class and Description |
---|---|
class |
OfflineEditsViewer
This class implements an offline edits viewer, tool that
can be used to view edit logs.
|
Modifier and Type | Class and Description |
---|---|
class |
JobClient
JobClient is the primary interface for the user-job to interact
with the cluster. |
Modifier and Type | Class and Description |
---|---|
class |
Gridmix
Driver class for the Gridmix3 benchmark.
|
Modifier and Type | Class and Description |
---|---|
class |
Submitter
The main entry point and job submitter.
|
Modifier and Type | Class and Description |
---|---|
class |
InputSampler<K,V>
Utility for collecting samples and writing a partition file for
TotalOrderPartitioner . |
Modifier and Type | Class and Description |
---|---|
class |
CLI
Interprets the map reduce cli options
|
Modifier and Type | Class and Description |
---|---|
class |
DumpTypedBytes
Utility program that fetches all files that match a given pattern and dumps
their content to stdout as typed bytes.
|
class |
LoadTypedBytes
Utility program that reads typed bytes from standard input and stores them in
a sequence file for which the path is given as an argument.
|
class |
StreamJob
All the client-side work happens here.
|
Modifier and Type | Class and Description |
---|---|
class |
DistCh
A Map-reduce program to recursively change files properties
such as owner, group and permission.
|
class |
DistCp
DistCp is the main driver-class for DistCpV2.
|
class |
DistCpV1
A Map-reduce program to recursively copy directories between
different file-systems.
|
class |
GetGroupsBase
Base class for the HDFS and MR implementations of tools which fetch and
display the groups that users belong to.
|
class |
HadoopArchives
a archive creation utility.
|
Modifier and Type | Class and Description |
---|---|
class |
Anonymizer |
class |
Folder |
class |
HadoopLogsAnalyzer
Deprecated.
|
class |
TraceBuilder
The main driver of the Rumen Parser.
|
Modifier and Type | Method and Description |
---|---|
static int |
ToolRunner.run(Configuration conf,
Tool tool,
String[] args)
Runs the given
Tool by run(String[]) , after
parsing with the given generic arguments. |
static int |
ToolRunner.run(Tool tool,
String[] args)
Runs the
Tool with its Configuration . |
Modifier and Type | Class and Description |
---|---|
class |
ApplicationCLI |
class |
LogsCLI |
class |
NodeCLI |
class |
RMAdminCLI |
class |
YarnCLI |
Copyright © 2013 Apache Software Foundation. All rights reserved.