Package | Description |
---|---|
org.apache.hadoop.examples |
Hadoop example code.
|
org.apache.hadoop.examples.pi |
This package consists of a map/reduce application,
distbbp,
which computes exact binary digits of the mathematical constant π.
|
org.apache.hadoop.examples.terasort |
This package consists of 3 map/reduce applications for Hadoop to
compete in the annual terabyte sort
competition.
|
org.apache.hadoop.mapred | |
org.apache.hadoop.mapred.gridmix | |
org.apache.hadoop.mapred.lib | |
org.apache.hadoop.mapreduce | |
org.apache.hadoop.mapreduce.lib.db | |
org.apache.hadoop.mapreduce.lib.input | |
org.apache.hadoop.mapreduce.lib.join | |
org.apache.hadoop.mapreduce.lib.map | |
org.apache.hadoop.mapreduce.split | |
org.apache.hadoop.mapreduce.task | |
org.apache.hadoop.tools.mapred | |
org.apache.hadoop.tools.mapred.lib | |
org.apache.hadoop.tools.rumen |
Rumen is a data extraction and analysis tool built for
Apache Hadoop.
|
Modifier and Type | Class and Description |
---|---|
static class |
BaileyBorweinPlouffe.BbpSplit
Input split for the
BaileyBorweinPlouffe.BbpInputFormat . |
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
BaileyBorweinPlouffe.BbpInputFormat.getSplits(JobContext context)
Logically split the set of input files for the job.
|
Modifier and Type | Method and Description |
---|---|
RecordReader<LongWritable,IntWritable> |
BaileyBorweinPlouffe.BbpInputFormat.createRecordReader(InputSplit generic,
TaskAttemptContext context)
Create a record reader for a given split.
|
RecordReader<MultiFileWordCount.WordOffset,Text> |
MultiFileWordCount.MyInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
void |
MultiFileWordCount.CombineFileLineRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
Modifier and Type | Class and Description |
---|---|
static class |
DistSum.Machine.SummationSplit
Split for the summations
|
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
DistSum.MapSide.PartitionInputFormat.getSplits(JobContext context)
Partitions the summation into parts and then return them as splits
|
List<InputSplit> |
DistSum.ReduceSide.SummationInputFormat.getSplits(JobContext context) |
Modifier and Type | Method and Description |
---|---|
RecordReader<NullWritable,SummationWritable> |
DistSum.Machine.AbstractInputFormat.createRecordReader(InputSplit generic,
TaskAttemptContext context)
Specify how to read the records
|
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
TeraInputFormat.getSplits(JobContext job) |
Modifier and Type | Method and Description |
---|---|
RecordReader<Text,Text> |
TeraInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
Modifier and Type | Class and Description |
---|---|
class |
MultiFileSplit
A sub-collection of input files.
|
Modifier and Type | Class and Description |
---|---|
static class |
SleepJob.SleepSplit |
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
SleepJob.SleepInputFormat.getSplits(JobContext jobCtxt) |
Modifier and Type | Method and Description |
---|---|
RecordReader<LongWritable,LongWritable> |
SleepJob.SleepInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
Modifier and Type | Method and Description |
---|---|
RecordReader<K,V> |
CombineFileInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
Modifier and Type | Method and Description |
---|---|
InputSplit |
MapContext.getInputSplit()
Get the input split for this map.
|
Modifier and Type | Method and Description |
---|---|
abstract List<InputSplit> |
InputFormat.getSplits(JobContext context)
Logically split the set of input files for the job.
|
Modifier and Type | Method and Description |
---|---|
abstract RecordReader<K,V> |
InputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context)
Create a record reader for a given split.
|
abstract void |
RecordReader.initialize(InputSplit split,
TaskAttemptContext context)
Called once at initialization.
|
Modifier and Type | Class and Description |
---|---|
static class |
DataDrivenDBInputFormat.DataDrivenDBInputSplit
A InputSplit that spans a set of rows
|
static class |
DBInputFormat.DBInputSplit
A InputSplit that spans a set of rows
|
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
DataDrivenDBInputFormat.getSplits(JobContext job)
Logically split the set of input files for the job.
|
List<InputSplit> |
DBInputFormat.getSplits(JobContext job)
Logically split the set of input files for the job.
|
List<InputSplit> |
BigDecimalSplitter.split(Configuration conf,
ResultSet results,
String colName) |
List<InputSplit> |
IntegerSplitter.split(Configuration conf,
ResultSet results,
String colName) |
List<InputSplit> |
FloatSplitter.split(Configuration conf,
ResultSet results,
String colName) |
List<InputSplit> |
DBSplitter.split(Configuration conf,
ResultSet results,
String colName)
Given a ResultSet containing one record (and already advanced to that record)
with two columns (a low value, and a high value, both of the same type), determine
a set of splits that span the given values.
|
List<InputSplit> |
DateSplitter.split(Configuration conf,
ResultSet results,
String colName) |
List<InputSplit> |
TextSplitter.split(Configuration conf,
ResultSet results,
String colName)
This method needs to determine the splits between two user-provided strings.
|
List<InputSplit> |
BooleanSplitter.split(Configuration conf,
ResultSet results,
String colName) |
Modifier and Type | Method and Description |
---|---|
RecordReader<LongWritable,T> |
DBInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context)
Create a record reader for a given split.
|
void |
DBRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
Modifier and Type | Class and Description |
---|---|
class |
CombineFileSplit
A sub-collection of input files.
|
class |
FileSplit
A section of an input file.
|
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
CombineFileInputFormat.getSplits(JobContext job) |
List<InputSplit> |
FileInputFormat.getSplits(JobContext job)
Generate the list of files and make them into FileSplits.
|
List<InputSplit> |
DelegatingInputFormat.getSplits(JobContext job) |
List<InputSplit> |
NLineInputFormat.getSplits(JobContext job)
Logically splits the set of input files for the job, splits N lines
of the input as one split.
|
Modifier and Type | Method and Description |
---|---|
abstract RecordReader<K,V> |
CombineFileInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context)
This is not implemented yet.
|
RecordReader<LongWritable,Text> |
TextInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
RecordReader<K,V> |
SequenceFileInputFilter.createRecordReader(InputSplit split,
TaskAttemptContext context)
Create a record reader for the given split
|
RecordReader<LongWritable,Text> |
CombineTextInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
RecordReader<K,V> |
CombineSequenceFileInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
RecordReader<BytesWritable,BytesWritable> |
SequenceFileAsBinaryInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
RecordReader<K,V> |
DelegatingInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
RecordReader<LongWritable,Text> |
NLineInputFormat.createRecordReader(InputSplit genericSplit,
TaskAttemptContext context) |
RecordReader<K,V> |
SequenceFileInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
RecordReader<Text,Text> |
SequenceFileAsTextInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
RecordReader<Text,Text> |
KeyValueTextInputFormat.createRecordReader(InputSplit genericSplit,
TaskAttemptContext context) |
void |
SequenceFileRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
void |
KeyValueLineRecordReader.initialize(InputSplit genericSplit,
TaskAttemptContext context) |
void |
DelegatingRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
void |
CombineFileRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
void |
SequenceFileAsBinaryInputFormat.SequenceFileAsBinaryRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
void |
SequenceFileAsTextRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
void |
LineRecordReader.initialize(InputSplit genericSplit,
TaskAttemptContext context) |
void |
CombineFileRecordReaderWrapper.initialize(InputSplit split,
TaskAttemptContext context) |
Constructor and Description |
---|
DelegatingRecordReader(InputSplit split,
TaskAttemptContext context)
Constructs the DelegatingRecordReader.
|
Modifier and Type | Class and Description |
---|---|
class |
CompositeInputSplit
This InputSplit contains a set of child InputSplits.
|
Modifier and Type | Method and Description |
---|---|
InputSplit |
CompositeInputSplit.get(int i)
Get ith child InputSplit.
|
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
CompositeInputFormat.getSplits(JobContext job)
Build a CompositeInputSplit from the child InputFormats by assigning the
ith split from each child to the ith composite split.
|
Modifier and Type | Method and Description |
---|---|
void |
CompositeInputSplit.add(InputSplit s)
Add an InputSplit to this collection.
|
abstract ComposableRecordReader<K,V> |
ComposableInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context) |
RecordReader<K,TupleWritable> |
CompositeInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext taskContext)
Construct a CompositeRecordReader for the children of this InputFormat
as defined in the init expression.
|
void |
CompositeRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
void |
WrappedRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
void |
MultiFilterRecordReader.initialize(InputSplit split,
TaskAttemptContext context) |
Modifier and Type | Method and Description |
---|---|
InputSplit |
WrappedMapper.Context.getInputSplit()
Get the input split for this map.
|
Modifier and Type | Method and Description |
---|---|
static <T extends InputSplit> |
JobSplitWriter.createSplitFiles(Path jobSubmitDir,
Configuration conf,
FileSystem fs,
List<InputSplit> splits) |
static <T extends InputSplit> |
JobSplitWriter.createSplitFiles(Path jobSubmitDir,
Configuration conf,
FileSystem fs,
T[] splits) |
Modifier and Type | Method and Description |
---|---|
static <T extends InputSplit> |
JobSplitWriter.createSplitFiles(Path jobSubmitDir,
Configuration conf,
FileSystem fs,
T[] splits) |
Modifier and Type | Method and Description |
---|---|
static <T extends InputSplit> |
JobSplitWriter.createSplitFiles(Path jobSubmitDir,
Configuration conf,
FileSystem fs,
List<InputSplit> splits) |
Constructor and Description |
---|
JobSplit.SplitMetaInfo(InputSplit split,
long startOffset) |
JobSplit.TaskSplitMetaInfo(InputSplit split,
long startOffset) |
Modifier and Type | Method and Description |
---|---|
InputSplit |
MapContextImpl.getInputSplit()
Get the input split for this map.
|
Constructor and Description |
---|
MapContextImpl(Configuration conf,
TaskAttemptID taskid,
RecordReader<KEYIN,VALUEIN> reader,
RecordWriter<KEYOUT,VALUEOUT> writer,
OutputCommitter committer,
StatusReporter reporter,
InputSplit split) |
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
UniformSizeInputFormat.getSplits(JobContext context)
Implementation of InputFormat::getSplits().
|
Modifier and Type | Method and Description |
---|---|
RecordReader<Text,FileStatus> |
UniformSizeInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context)
Implementation of InputFormat::createRecordReader().
|
Modifier and Type | Method and Description |
---|---|
List<InputSplit> |
DynamicInputFormat.getSplits(JobContext jobContext)
Implementation of InputFormat::getSplits().
|
Modifier and Type | Method and Description |
---|---|
RecordReader<K,V> |
DynamicInputFormat.createRecordReader(InputSplit inputSplit,
TaskAttemptContext taskAttemptContext)
Implementation of Inputformat::createRecordReader().
|
void |
DynamicRecordReader.initialize(InputSplit inputSplit,
TaskAttemptContext taskAttemptContext)
Implementation for RecordReader::initialize().
|
Modifier and Type | Method and Description |
---|---|
InputSplit[] |
ZombieJob.getInputSplits() |
InputSplit[] |
JobStory.getInputSplits()
Get the input splits for the job.
|
Copyright © 2013 Apache Software Foundation. All rights reserved.