org.apache.parquet.hadoop

Class ParquetOutputCommitter

java.lang.Object

org.apache.hadoop.mapreduce.OutputCommitter

org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

org.apache.parquet.hadoop.ParquetOutputCommitter

public class ParquetOutputCommitter
extends org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

PENDING_DIR_NAME, SUCCEEDED_FILE_NAME, SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, TEMP_DIR_NAME

Constructor Summary

Constructors

Constructor and Description
ParquetOutputCommitter(org.apache.hadoop.fs.Path outputPath, org.apache.hadoop.mapreduce.TaskAttemptContext context)

Method Summary

Methods

Modifier and Type	Method and Description
void	commitJob(org.apache.hadoop.mapreduce.JobContext jobContext)
static void	writeMetaDataFile(org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path outputPath)

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

abortJob, abortTask, abortTask, cleanupJob, commitTask, commitTask, getCommittedTaskPath, getCommittedTaskPath, getCommittedTaskPath, getJobAttemptPath, getJobAttemptPath, getJobAttemptPath, getTaskAttemptPath, getTaskAttemptPath, getWorkPath, isRecoverySupported, needsTaskCommit, needsTaskCommit, recoverTask, setupJob, setupTask

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetOutputCommitter

public ParquetOutputCommitter(org.apache.hadoop.fs.Path outputPath,
                      org.apache.hadoop.mapreduce.TaskAttemptContext context)
                       throws IOException

Throws:

IOException

Method Detail

commitJob

public void commitJob(org.apache.hadoop.mapreduce.JobContext jobContext)
               throws IOException

Overrides:

commitJob in class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

Throws:

IOException

writeMetaDataFile

public static void writeMetaDataFile(org.apache.hadoop.conf.Configuration configuration,
                     org.apache.hadoop.fs.Path outputPath)