Examples with DictionaryPageHeader org.apache.parquet.format.DictionaryPageHeader used on opensource projects

Example 1 with DictionaryPageHeader

use of org.apache.parquet.format.DictionaryPageHeader in project parquet-mr by apache.

the class ParquetMetadataConverter method writeDictionaryPageHeader.

public void writeDictionaryPageHeader(int uncompressedSize, int compressedSize, int valueCount, org.apache.parquet.column.Encoding valuesEncoding, OutputStream to) throws IOException {
    PageHeader pageHeader = new PageHeader(PageType.DICTIONARY_PAGE, uncompressedSize, compressedSize);
    pageHeader.setDictionary_page_header(new DictionaryPageHeader(valueCount, getEncoding(valuesEncoding)));
    writePageHeader(pageHeader, to);
}

Example 2 with DictionaryPageHeader

use of org.apache.parquet.format.DictionaryPageHeader in project parquet-mr by apache.

the class ParquetFileReader method readCompressedDictionary.

private DictionaryPage readCompressedDictionary(PageHeader pageHeader, SeekableInputStream fin) throws IOException {
    DictionaryPageHeader dictHeader = pageHeader.getDictionary_page_header();
    int uncompressedPageSize = pageHeader.getUncompressed_page_size();
    int compressedPageSize = pageHeader.getCompressed_page_size();
    byte[] dictPageBytes = new byte[compressedPageSize];
    fin.readFully(dictPageBytes);
    BytesInput bin = BytesInput.from(dictPageBytes);
    return new DictionaryPage(bin, uncompressedPageSize, dictHeader.getNum_values(), converter.getEncoding(dictHeader.getEncoding()));
}