Search in sources :

Example 11 with DataPage

use of org.apache.parquet.column.page.DataPage in project hive by apache.

the class BaseVectorizedColumnReader method readPage.

protected void readPage() throws IOException {
    DataPage page = pageReader.readPage();
    if (page == null) {
        return;
    }
    page.accept(new DataPage.Visitor<Void>() {

        @Override
        public Void visit(DataPageV1 dataPageV1) {
            readPageV1(dataPageV1);
            return null;
        }

        @Override
        public Void visit(DataPageV2 dataPageV2) {
            readPageV2(dataPageV2);
            return null;
        }
    });
}
Also used : DataPage(org.apache.parquet.column.page.DataPage) DataPageV2(org.apache.parquet.column.page.DataPageV2) DataPageV1(org.apache.parquet.column.page.DataPageV1)

Aggregations

DataPage (org.apache.parquet.column.page.DataPage)11 DataPageV1 (org.apache.parquet.column.page.DataPageV1)6 DataPageV2 (org.apache.parquet.column.page.DataPageV2)5 ColumnDescriptor (org.apache.parquet.column.ColumnDescriptor)4 PageReader (org.apache.parquet.column.page.PageReader)4 MessageType (org.apache.parquet.schema.MessageType)3 Test (org.junit.Test)3 ColumnReader (org.apache.parquet.column.ColumnReader)2 DictionaryPage (org.apache.parquet.column.page.DictionaryPage)2 MemPageReader (org.apache.parquet.column.page.mem.MemPageReader)2 MemPageWriter (org.apache.parquet.column.page.mem.MemPageWriter)2 List (java.util.List)1 ParquetDictionary (org.apache.flink.formats.parquet.vector.ParquetDictionary)1 WritableIntVector (org.apache.flink.table.data.columnar.vector.writable.WritableIntVector)1 Util.encodingAsString (org.apache.parquet.cli.Util.encodingAsString)1 Util.minMaxAsString (org.apache.parquet.cli.Util.minMaxAsString)1 PageReadStore (org.apache.parquet.column.page.PageReadStore)1 PageWriter (org.apache.parquet.column.page.PageWriter)1 MemPageStore (org.apache.parquet.column.page.mem.MemPageStore)1 LongStatistics (org.apache.parquet.column.statistics.LongStatistics)1