Examples with OrcConcatPageSource io.prestosql.plugin.hive.orc.OrcConcatPageSource used on opensource projects

Example 1 with OrcConcatPageSource

use of io.prestosql.plugin.hive.orc.OrcConcatPageSource in project hetu-core by openlookeng.

the class TestOrcPageSourceMemoryTracking method testOrcConcatPageSourceDynamicFilterBlocked.

@Test
public void testOrcConcatPageSourceDynamicFilterBlocked() throws InterruptedException {
    OrcConcatPageSource orcConcatPageSource = getOrcConcatPageSource(1000);
    Page page = orcConcatPageSource.getNextPage();
    assertNull(page);
    TimeUnit.SECONDS.sleep(2);
    page = orcConcatPageSource.getNextPage();
    assertNotNull(page);
}

Example 2 with OrcConcatPageSource

use of io.prestosql.plugin.hive.orc.OrcConcatPageSource in project hetu-core by openlookeng.

the class TestOrcPageSourceMemoryTracking method testOrcConcatPageSourceDynamicFilterNotBlocked.

@Test
public void testOrcConcatPageSourceDynamicFilterNotBlocked() {
    OrcConcatPageSource orcConcatPageSource = getOrcConcatPageSource(0);
    Page page = orcConcatPageSource.getNextPage();
    assertNotNull(page);
}

Example 3 with OrcConcatPageSource

use of io.prestosql.plugin.hive.orc.OrcConcatPageSource in project boostkit-bigdata by kunpengcompute.

the class TestOrcPageSourceMemoryTracking method testOrcConcatPageSourceDynamicFilterNotBlocked.

@Test
public void testOrcConcatPageSourceDynamicFilterNotBlocked() {
    OrcConcatPageSource orcConcatPageSource = getOrcConcatPageSource(0);
    Page page = orcConcatPageSource.getNextPage();
    assertNotNull(page);
}

Example 4 with OrcConcatPageSource

use of io.prestosql.plugin.hive.orc.OrcConcatPageSource in project boostkit-bigdata by kunpengcompute.

the class TestOrcPageSourceMemoryTracking method testOrcConcatPageSourceDynamicFilterBlocked.

@Test
public void testOrcConcatPageSourceDynamicFilterBlocked() throws InterruptedException {
    OrcConcatPageSource orcConcatPageSource = getOrcConcatPageSource(1000);
    Page page = orcConcatPageSource.getNextPage();
    assertNull(page);
    TimeUnit.SECONDS.sleep(2);
    page = orcConcatPageSource.getNextPage();
    assertNotNull(page);
}

Example 5 with OrcConcatPageSource

use of io.prestosql.plugin.hive.orc.OrcConcatPageSource in project hetu-core by openlookeng.

the class TestOrcPageSourceMemoryTracking method getOrcConcatPageSource.

private OrcConcatPageSource getOrcConcatPageSource(long waitTime) {
    HiveConfig config = new HiveConfig();
    FileFormatDataSourceStats stats = new FileFormatDataSourceStats();
    ConnectorSession session = new TestingConnectorSession(new HiveSessionProperties(config, new OrcFileWriterConfig(), new ParquetFileWriterConfig()).getSessionProperties());
    List<ConnectorPageSource> pageSources = new ArrayList<>();
    Supplier<List<Map<ColumnHandle, DynamicFilter>>> supplier = null;
    DynamicFilterSupplier theSupplier = new DynamicFilterSupplier(supplier, System.currentTimeMillis(), waitTime);
    Optional<DynamicFilterSupplier> dynamicFilterSupplier = Optional.of(theSupplier);
    pageSources.add(testPreparer.newPageSource(stats, session, dynamicFilterSupplier));
    OrcConcatPageSource orcConcatPageSource = new OrcConcatPageSource(pageSources);
    return orcConcatPageSource;
}