public class TeraOutputFormat extends FileOutputFormat<Text,Text>
FileOutputFormat.Counter
BASE_OUTPUT_NAME, COMPRESS, COMPRESS_CODEC, COMPRESS_TYPE, OUTDIR, PART
Constructor and Description |
---|
TeraOutputFormat() |
Modifier and Type | Method and Description |
---|---|
void |
checkOutputSpecs(JobContext job)
Check for validity of the output-specification for the job.
|
static boolean |
getFinalSync(JobContext job)
Does the user want a final sync at close?
|
OutputCommitter |
getOutputCommitter(TaskAttemptContext context)
Get the output committer for this output format.
|
RecordWriter<Text,Text> |
getRecordWriter(TaskAttemptContext job)
Get the
RecordWriter for the given task. |
getCompressOutput, getDefaultWorkFile, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath
public static boolean getFinalSync(JobContext job)
public void checkOutputSpecs(JobContext job) throws InvalidJobConfException, IOException
OutputFormat
This is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.
checkOutputSpecs
in class FileOutputFormat<Text,Text>
job
- information about the jobIOException
- when output should not be attemptedInvalidJobConfException
public RecordWriter<Text,Text> getRecordWriter(TaskAttemptContext job) throws IOException
OutputFormat
RecordWriter
for the given task.getRecordWriter
in class FileOutputFormat<Text,Text>
job
- the information about the current task.RecordWriter
to write the output for the job.IOException
public OutputCommitter getOutputCommitter(TaskAttemptContext context) throws IOException
OutputFormat
getOutputCommitter
in class FileOutputFormat<Text,Text>
context
- the task contextIOException
Copyright © 2013 Apache Software Foundation. All rights reserved.