Package | Description |
---|---|
parquet.column | |
parquet.column.impl | |
parquet.hadoop |
Provides classes to store use Parquet files in Hadoop
In a map reduce job:
|
Modifier and Type | Method and Description |
---|---|
static ParquetProperties.WriterVersion |
ParquetProperties.WriterVersion.fromString(String name) |
ParquetProperties.WriterVersion |
ParquetProperties.getWriterVersion() |
static ParquetProperties.WriterVersion |
ParquetProperties.WriterVersion.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static ParquetProperties.WriterVersion[] |
ParquetProperties.WriterVersion.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
Constructor and Description |
---|
ParquetProperties(int dictPageSize,
ParquetProperties.WriterVersion writerVersion,
boolean enableDict) |
Constructor and Description |
---|
ColumnWriteStoreImpl(PageWriteStore pageWriteStore,
int pageSizeThreshold,
int initialSizePerCol,
int dictionaryPageSizeThreshold,
boolean enableDictionary,
ParquetProperties.WriterVersion writerVersion) |
Modifier and Type | Field and Description |
---|---|
static ParquetProperties.WriterVersion |
ParquetWriter.DEFAULT_WRITER_VERSION |
Modifier and Type | Method and Description |
---|---|
static ParquetProperties.WriterVersion |
ParquetOutputFormat.getWriterVersion(org.apache.hadoop.conf.Configuration configuration) |
Constructor and Description |
---|
ParquetRecordWriter(ParquetFileWriter w,
WriteSupport<T> writeSupport,
MessageType schema,
Map<String,String> extraMetaData,
int blockSize,
int pageSize,
CodecFactory.BytesCompressor compressor,
int dictionaryPageSize,
boolean enableDictionary,
boolean validating,
ParquetProperties.WriterVersion writerVersion) |
ParquetWriter(org.apache.hadoop.fs.Path file,
WriteSupport<T> writeSupport,
CompressionCodecName compressionCodecName,
int blockSize,
int pageSize,
int dictionaryPageSize,
boolean enableDictionary,
boolean validating,
ParquetProperties.WriterVersion writerVersion)
Create a new ParquetWriter.
|
ParquetWriter(org.apache.hadoop.fs.Path file,
WriteSupport<T> writeSupport,
CompressionCodecName compressionCodecName,
int blockSize,
int pageSize,
int dictionaryPageSize,
boolean enableDictionary,
boolean validating,
ParquetProperties.WriterVersion writerVersion,
org.apache.hadoop.conf.Configuration conf)
Create a new ParquetWriter.
|
Copyright © 2015. All rights reserved.