Package | Description |
---|---|
org.apache.hadoop | |
org.apache.hadoop.examples.terasort |
This package consists of 3 map/reduce applications for Hadoop to
compete in the annual terabyte sort
competition.
|
org.apache.hadoop.mapred | |
org.apache.hadoop.mapreduce | |
org.apache.hadoop.mapreduce.lib.db | |
org.apache.hadoop.mapreduce.lib.map | |
org.apache.hadoop.mapreduce.lib.output | |
org.apache.hadoop.mapreduce.lib.reduce | |
org.apache.hadoop.mapreduce.task | |
org.apache.hadoop.mapreduce.v2.app | |
org.apache.hadoop.mapreduce.v2.app.commit | |
org.apache.hadoop.mapreduce.v2.app.job.event | |
org.apache.hadoop.mapreduce.v2.app.job.impl | |
org.apache.hadoop.tools.mapred |
Modifier and Type | Class and Description |
---|---|
class |
CustomOutputCommitter |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
TeraOutputFormat.getOutputCommitter(TaskAttemptContext context) |
Modifier and Type | Class and Description |
---|---|
class |
OutputCommitter
OutputCommitter describes the commit of task output for a
Map-Reduce job. |
Modifier and Type | Field and Description |
---|---|
protected OutputCommitter |
Task.committer |
Modifier and Type | Method and Description |
---|---|
static <K,V> Task.CombinerRunner<K,V> |
Task.CombinerRunner.create(JobConf job,
TaskAttemptID taskId,
Counters.Counter inputCounter,
Task.TaskReporter reporter,
OutputCommitter committer) |
protected static <INKEY,INVALUE,OUTKEY,OUTVALUE> |
Task.createReduceContext(Reducer<INKEY,INVALUE,OUTKEY,OUTVALUE> reducer,
Configuration job,
TaskAttemptID taskId,
RawKeyValueIterator rIter,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<OUTKEY,OUTVALUE> output,
OutputCommitter committer,
StatusReporter reporter,
RawComparator<INKEY> comparator,
Class<INKEY> keyClass,
Class<INVALUE> valueClass) |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
TaskInputOutputContext.getOutputCommitter()
Get the
OutputCommitter for the task-attempt. |
abstract OutputCommitter |
OutputFormat.getOutputCommitter(TaskAttemptContext context)
Get the output committer for this output format.
|
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
DBOutputFormat.getOutputCommitter(TaskAttemptContext context) |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
WrappedMapper.Context.getOutputCommitter() |
Modifier and Type | Class and Description |
---|---|
class |
FileOutputCommitter
An
OutputCommitter that commits files specified
in job output directory i.e. |
class |
PartialFileOutputCommitter
An
OutputCommitter that commits files specified
in job output directory i.e. |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
NullOutputFormat.getOutputCommitter(TaskAttemptContext context) |
OutputCommitter |
FilterOutputFormat.getOutputCommitter(TaskAttemptContext context) |
OutputCommitter |
FileOutputFormat.getOutputCommitter(TaskAttemptContext context) |
OutputCommitter |
LazyOutputFormat.getOutputCommitter(TaskAttemptContext context) |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
WrappedReducer.Context.getOutputCommitter() |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
TaskInputOutputContextImpl.getOutputCommitter() |
Constructor and Description |
---|
MapContextImpl(Configuration conf,
TaskAttemptID taskid,
RecordReader<KEYIN,VALUEIN> reader,
RecordWriter<KEYOUT,VALUEOUT> writer,
OutputCommitter committer,
StatusReporter reporter,
InputSplit split) |
ReduceContextImpl(Configuration conf,
TaskAttemptID taskid,
RawKeyValueIterator input,
Counter inputKeyCounter,
Counter inputValueCounter,
RecordWriter<KEYOUT,VALUEOUT> output,
OutputCommitter committer,
StatusReporter reporter,
RawComparator<KEYIN> comparator,
Class<KEYIN> keyClass,
Class<VALUEIN> valueClass) |
TaskInputOutputContextImpl(Configuration conf,
TaskAttemptID taskid,
RecordWriter<KEYOUT,VALUEOUT> output,
OutputCommitter committer,
StatusReporter reporter) |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
MRAppMaster.getCommitter() |
Modifier and Type | Method and Description |
---|---|
protected EventHandler<CommitterEvent> |
MRAppMaster.createCommitterEventHandler(AppContext context,
OutputCommitter committer) |
Constructor and Description |
---|
CommitterEventHandler(AppContext context,
OutputCommitter committer,
RMHeartbeatHandler rmHeartbeatHandler) |
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
TaskAttemptRecoverEvent.getCommitter() |
OutputCommitter |
TaskRecoverEvent.getOutputCommitter() |
Constructor and Description |
---|
TaskAttemptRecoverEvent(TaskAttemptId id,
JobHistoryParser.TaskAttemptInfo taInfo,
OutputCommitter committer,
boolean recoverOutput) |
TaskRecoverEvent(TaskId taskID,
JobHistoryParser.TaskInfo taskInfo,
OutputCommitter committer,
boolean recoverTaskOutput) |
Modifier and Type | Method and Description |
---|---|
TaskAttemptStateInternal |
TaskAttemptImpl.recover(JobHistoryParser.TaskAttemptInfo taInfo,
OutputCommitter committer,
boolean recoverOutput) |
Constructor and Description |
---|
JobImpl(JobId jobId,
ApplicationAttemptId applicationAttemptId,
Configuration conf,
EventHandler eventHandler,
TaskAttemptListener taskAttemptListener,
JobTokenSecretManager jobTokenSecretManager,
Credentials jobCredentials,
Clock clock,
Map<TaskId,JobHistoryParser.TaskInfo> completedTasksFromPreviousRun,
MRAppMetrics metrics,
OutputCommitter committer,
boolean newApiCommitter,
String userName,
long appSubmitTime,
List<AMInfo> amInfos,
AppContext appContext,
JobStateInternal forcedState,
String forcedDiagnostic) |
Modifier and Type | Class and Description |
---|---|
class |
CopyCommitter
The CopyCommitter class is DistCp's OutputCommitter implementation.
|
Modifier and Type | Method and Description |
---|---|
OutputCommitter |
CopyOutputFormat.getOutputCommitter(TaskAttemptContext context) |
Copyright © 2013 Apache Software Foundation. All rights reserved.