Search in sources :

Example 1 with PageFilePageSourceFactory

use of com.facebook.presto.hive.pagefile.PageFilePageSourceFactory in project presto by prestodb.

the class HiveTestUtils method getDefaultHiveBatchPageSourceFactories.

public static Set<HiveBatchPageSourceFactory> getDefaultHiveBatchPageSourceFactories(HiveClientConfig hiveClientConfig, MetastoreClientConfig metastoreClientConfig) {
    FileFormatDataSourceStats stats = new FileFormatDataSourceStats();
    HdfsEnvironment testHdfsEnvironment = createTestHdfsEnvironment(hiveClientConfig, metastoreClientConfig);
    return ImmutableSet.<HiveBatchPageSourceFactory>builder().add(new RcFilePageSourceFactory(FUNCTION_AND_TYPE_MANAGER, testHdfsEnvironment, stats)).add(new OrcBatchPageSourceFactory(FUNCTION_AND_TYPE_MANAGER, FUNCTION_RESOLUTION, hiveClientConfig, testHdfsEnvironment, stats, new StorageOrcFileTailSource(), StripeMetadataSourceFactory.of(new StorageStripeMetadataSource()))).add(new DwrfBatchPageSourceFactory(FUNCTION_AND_TYPE_MANAGER, FUNCTION_RESOLUTION, hiveClientConfig, testHdfsEnvironment, stats, new StorageOrcFileTailSource(), StripeMetadataSourceFactory.of(new StorageStripeMetadataSource()), NO_ENCRYPTION)).add(new ParquetPageSourceFactory(FUNCTION_AND_TYPE_MANAGER, FUNCTION_RESOLUTION, testHdfsEnvironment, stats, new MetadataReader())).add(new PageFilePageSourceFactory(testHdfsEnvironment, new BlockEncodingManager())).build();
}
Also used : DwrfBatchPageSourceFactory(com.facebook.presto.hive.orc.DwrfBatchPageSourceFactory) BlockEncodingManager(com.facebook.presto.common.block.BlockEncodingManager) OrcBatchPageSourceFactory(com.facebook.presto.hive.orc.OrcBatchPageSourceFactory) StorageOrcFileTailSource(com.facebook.presto.orc.cache.StorageOrcFileTailSource) MetadataReader(com.facebook.presto.parquet.cache.MetadataReader) StorageStripeMetadataSource(com.facebook.presto.orc.StorageStripeMetadataSource) RcFilePageSourceFactory(com.facebook.presto.hive.rcfile.RcFilePageSourceFactory) ParquetPageSourceFactory(com.facebook.presto.hive.parquet.ParquetPageSourceFactory) PageFilePageSourceFactory(com.facebook.presto.hive.pagefile.PageFilePageSourceFactory)

Aggregations

BlockEncodingManager (com.facebook.presto.common.block.BlockEncodingManager)1 DwrfBatchPageSourceFactory (com.facebook.presto.hive.orc.DwrfBatchPageSourceFactory)1 OrcBatchPageSourceFactory (com.facebook.presto.hive.orc.OrcBatchPageSourceFactory)1 PageFilePageSourceFactory (com.facebook.presto.hive.pagefile.PageFilePageSourceFactory)1 ParquetPageSourceFactory (com.facebook.presto.hive.parquet.ParquetPageSourceFactory)1 RcFilePageSourceFactory (com.facebook.presto.hive.rcfile.RcFilePageSourceFactory)1 StorageStripeMetadataSource (com.facebook.presto.orc.StorageStripeMetadataSource)1 StorageOrcFileTailSource (com.facebook.presto.orc.cache.StorageOrcFileTailSource)1 MetadataReader (com.facebook.presto.parquet.cache.MetadataReader)1