Package | Description |
---|---|
org.apache.hadoop.examples |
Hadoop example code.
|
org.apache.hadoop.examples.pi |
This package consists of a map/reduce application,
distbbp,
which computes exact binary digits of the mathematical constant π.
|
org.apache.hadoop.examples.terasort |
This package consists of 3 map/reduce applications for Hadoop to
compete in the annual terabyte sort
competition.
|
org.apache.hadoop.mapred.gridmix | |
org.apache.hadoop.mapreduce | |
org.apache.hadoop.mapreduce.lib.db | |
org.apache.hadoop.mapreduce.lib.input | |
org.apache.hadoop.mapreduce.lib.join | |
org.apache.hadoop.mapreduce.lib.map | |
org.apache.hadoop.mapreduce.lib.partition | |
org.apache.hadoop.mapreduce.lib.reduce | |
org.apache.hadoop.mapreduce.task | |
org.apache.hadoop.tools.mapred | |
org.apache.hadoop.tools.mapred.lib | |
org.apache.hadoop.tools.util |
Modifier and Type | Class and Description |
---|---|
static class |
BaileyBorweinPlouffe.BbpInputFormat
Input format for the
BaileyBorweinPlouffe.BbpMapper . |
static class |
MultiFileWordCount.MyInputFormat
To use
CombineFileInputFormat , one should extend it, to return a
(custom) RecordReader . |
Modifier and Type | Class and Description |
---|---|
static class |
DistSum.Machine.AbstractInputFormat
An abstract InputFormat for the jobs
|
static class |
DistSum.MapSide.PartitionInputFormat
An InputFormat which partitions a summation
|
static class |
DistSum.ReduceSide.SummationInputFormat
An InputFormat which returns a single summation.
|
Modifier and Type | Class and Description |
---|---|
class |
TeraInputFormat
An input format that reads the first 10 characters of each line as the key
and the rest of the line as the value.
|
Modifier and Type | Class and Description |
---|---|
static class |
SleepJob.SleepInputFormat |
Modifier and Type | Method and Description |
---|---|
Class<? extends InputFormat<?,?>> |
JobContext.getInputFormatClass()
Get the
InputFormat class for the job. |
Modifier and Type | Method and Description |
---|---|
void |
Job.setInputFormatClass(Class<? extends InputFormat> cls)
Set the
InputFormat for the job. |
Modifier and Type | Class and Description |
---|---|
class |
DataDrivenDBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table.
|
class |
DBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table.
|
class |
OracleDataDrivenDBInputFormat<T extends DBWritable>
A InputFormat that reads input data from an SQL table in an Oracle db.
|
Modifier and Type | Class and Description |
---|---|
class |
CombineFileInputFormat<K,V>
|
class |
CombineSequenceFileInputFormat<K,V>
Input format that is a
CombineFileInputFormat -equivalent for
SequenceFileInputFormat . |
class |
CombineTextInputFormat
Input format that is a
CombineFileInputFormat -equivalent for
TextInputFormat . |
class |
DelegatingInputFormat<K,V>
An
InputFormat that delegates behavior of paths to multiple other
InputFormats. |
class |
FileInputFormat<K,V>
A base class for file-based
InputFormat s. |
class |
KeyValueTextInputFormat
An
InputFormat for plain text files. |
class |
NLineInputFormat
NLineInputFormat which splits N lines of input as one split.
|
class |
SequenceFileAsBinaryInputFormat
InputFormat reading keys, values from SequenceFiles in binary (raw)
format.
|
class |
SequenceFileAsTextInputFormat
This class is similar to SequenceFileInputFormat, except it generates
SequenceFileAsTextRecordReader which converts the input keys and values
to their String forms by calling toString() method.
|
class |
SequenceFileInputFilter<K,V>
A class that allows a map/red job to work on a sample of sequence files.
|
class |
SequenceFileInputFormat<K,V>
An
InputFormat for SequenceFile s. |
class |
TextInputFormat
An
InputFormat for plain text files. |
Modifier and Type | Method and Description |
---|---|
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass)
Add a
Path with a custom InputFormat to the list of
inputs for the map-reduce job. |
static void |
MultipleInputs.addInputPath(Job job,
Path path,
Class<? extends InputFormat> inputFormatClass,
Class<? extends Mapper> mapperClass)
|
Modifier and Type | Class and Description |
---|---|
class |
ComposableInputFormat<K extends WritableComparable<?>,V extends Writable>
Refinement of InputFormat requiring implementors to provide
ComposableRecordReader instead of RecordReader.
|
class |
CompositeInputFormat<K extends WritableComparable>
An InputFormat capable of performing joins over a set of data sources sorted
and partitioned the same way.
|
static class |
Parser.Node |
Modifier and Type | Method and Description |
---|---|
static String |
CompositeInputFormat.compose(Class<? extends InputFormat> inf,
String path)
Convenience method for constructing composite formats.
|
static String |
CompositeInputFormat.compose(String op,
Class<? extends InputFormat> inf,
Path... path)
Convenience method for constructing composite formats.
|
static String |
CompositeInputFormat.compose(String op,
Class<? extends InputFormat> inf,
String... path)
Convenience method for constructing composite formats.
|
Modifier and Type | Method and Description |
---|---|
Class<? extends InputFormat<?,?>> |
WrappedMapper.Context.getInputFormatClass() |
Modifier and Type | Method and Description |
---|---|
K[] |
InputSampler.Sampler.getSample(InputFormat<K,V> inf,
Job job)
For a given job, collect and return a subset of the keys from the
input data.
|
K[] |
InputSampler.SplitSampler.getSample(InputFormat<K,V> inf,
Job job)
From each split sampled, take the first numSamples / numSplits records.
|
K[] |
InputSampler.RandomSampler.getSample(InputFormat<K,V> inf,
Job job)
Randomize the split order, then take the specified number of keys from
each split sampled, where each key is selected with the specified
probability and possibly replaced by a subsequently selected key when
the quota of keys from that split is satisfied.
|
K[] |
InputSampler.IntervalSampler.getSample(InputFormat<K,V> inf,
Job job)
For each split sampled, emit when the ratio of the number of records
retained to the total record count is less than the specified
frequency.
|
Modifier and Type | Method and Description |
---|---|
Class<? extends InputFormat<?,?>> |
WrappedReducer.Context.getInputFormatClass() |
Modifier and Type | Method and Description |
---|---|
Class<? extends InputFormat<?,?>> |
JobContextImpl.getInputFormatClass()
Get the
InputFormat class for the job. |
Modifier and Type | Class and Description |
---|---|
class |
UniformSizeInputFormat
UniformSizeInputFormat extends the InputFormat<> class, to produce
input-splits for DistCp.
|
Modifier and Type | Class and Description |
---|---|
class |
DynamicInputFormat<K,V>
DynamicInputFormat implements the "Worker pattern" for DistCp.
|
Modifier and Type | Method and Description |
---|---|
static Class<? extends InputFormat> |
DistCpUtils.getStrategy(Configuration conf,
DistCpOptions options)
Returns the class that implements a copy strategy.
|
Copyright © 2013 Apache Software Foundation. All rights reserved.