Search in sources :

Example 6 with DataPageV2

use of org.apache.parquet.column.page.DataPageV2 in project hive by apache.

the class BaseVectorizedColumnReader method readPage.

protected void readPage() throws IOException {
    DataPage page = pageReader.readPage();
    if (page == null) {
        return;
    }
    page.accept(new DataPage.Visitor<Void>() {

        @Override
        public Void visit(DataPageV1 dataPageV1) {
            readPageV1(dataPageV1);
            return null;
        }

        @Override
        public Void visit(DataPageV2 dataPageV2) {
            readPageV2(dataPageV2);
            return null;
        }
    });
}
Also used : DataPage(org.apache.parquet.column.page.DataPage) DataPageV2(org.apache.parquet.column.page.DataPageV2) DataPageV1(org.apache.parquet.column.page.DataPageV1)

Aggregations

DataPageV2 (org.apache.parquet.column.page.DataPageV2)6 DataPage (org.apache.parquet.column.page.DataPage)5 DataPageV1 (org.apache.parquet.column.page.DataPageV1)5 PageReader (org.apache.parquet.column.page.PageReader)2 HashMap (java.util.HashMap)1 ParquetDictionary (org.apache.flink.formats.parquet.vector.ParquetDictionary)1 WritableIntVector (org.apache.flink.table.data.columnar.vector.writable.WritableIntVector)1 FileSystem (org.apache.hadoop.fs.FileSystem)1 Path (org.apache.hadoop.fs.Path)1 BytesInput (org.apache.parquet.bytes.BytesInput)1 HeapByteBufferAllocator (org.apache.parquet.bytes.HeapByteBufferAllocator)1 ColumnDescriptor (org.apache.parquet.column.ColumnDescriptor)1 Encoding (org.apache.parquet.column.Encoding)1 DictionaryPage (org.apache.parquet.column.page.DictionaryPage)1 PageReadStore (org.apache.parquet.column.page.PageReadStore)1 PageWriter (org.apache.parquet.column.page.PageWriter)1 Statistics (org.apache.parquet.column.statistics.Statistics)1 ParquetMetadata (org.apache.parquet.hadoop.metadata.ParquetMetadata)1 MessageType (org.apache.parquet.schema.MessageType)1 Test (org.junit.Test)1