Search in sources :

Example 1 with DataPageHeader

use of parquet.format.DataPageHeader in project presto by prestodb.

the class ParquetColumnChunk method readDataPageV1.

private long readDataPageV1(PageHeader pageHeader, int uncompressedPageSize, int compressedPageSize, List<ParquetDataPage> pages) throws IOException {
    DataPageHeader dataHeaderV1 = pageHeader.getData_page_header();
    pages.add(new ParquetDataPageV1(getSlice(compressedPageSize), dataHeaderV1.getNum_values(), uncompressedPageSize, ParquetMetadataReader.readStats(dataHeaderV1.getStatistics(), descriptor.getColumnDescriptor().getType()), getParquetEncoding(Encoding.valueOf(dataHeaderV1.getRepetition_level_encoding().name())), getParquetEncoding(Encoding.valueOf(dataHeaderV1.getDefinition_level_encoding().name())), getParquetEncoding(Encoding.valueOf(dataHeaderV1.getEncoding().name()))));
    return dataHeaderV1.getNum_values();
}
Also used : ParquetDataPageV1(com.facebook.presto.hive.parquet.ParquetDataPageV1) DataPageHeader(parquet.format.DataPageHeader)

Aggregations

ParquetDataPageV1 (com.facebook.presto.hive.parquet.ParquetDataPageV1)1 DataPageHeader (parquet.format.DataPageHeader)1