public class CopyCommitter extends FileOutputCommitter
PENDING_DIR_NAME, SUCCEEDED_FILE_NAME, SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, TEMP_DIR_NAME
Constructor and Description |
---|
CopyCommitter(Path outputPath,
TaskAttemptContext context)
Create a output committer
|
Modifier and Type | Method and Description |
---|---|
void |
abortJob(JobContext jobContext,
JobStatus.State state)
Delete the temporary directory, including all of the work directories.
|
void |
commitJob(JobContext jobContext)
The job has completed so move all committed tasks to the final output dir.
|
abortTask, abortTask, cleanupJob, commitTask, commitTask, getCommittedTaskPath, getCommittedTaskPath, getCommittedTaskPath, getJobAttemptPath, getJobAttemptPath, getJobAttemptPath, getTaskAttemptPath, getTaskAttemptPath, getWorkPath, isRecoverySupported, needsTaskCommit, needsTaskCommit, recoverTask, setupJob, setupTask
public CopyCommitter(Path outputPath, TaskAttemptContext context) throws IOException
outputPath
- the job's output pathcontext
- the task's contextIOException
- - Exception if anypublic void commitJob(JobContext jobContext) throws IOException
FileOutputCommitter
commitJob
in class FileOutputCommitter
jobContext
- the job's contextIOException
public void abortJob(JobContext jobContext, JobStatus.State state) throws IOException
FileOutputCommitter
abortJob
in class FileOutputCommitter
jobContext
- the job's contextstate
- final runstate of the jobIOException
Copyright © 2013 Apache Software Foundation. All rights reserved.