Search in sources :

Example 1 with PersistentMessageFinder

use of org.apache.pulsar.broker.service.persistent.PersistentMessageFinder in project incubator-pulsar by apache.

the class PersistentMessageFinderTest method findMessage.

CompletableFuture<Void> findMessage(final Result result, final ManagedCursor c1, final long timestamp) {
    PersistentMessageFinder messageFinder = new PersistentMessageFinder("topicname", c1);
    final CompletableFuture<Void> future = new CompletableFuture<>();
    messageFinder.findMessages(timestamp, new AsyncCallbacks.FindEntryCallback() {

        @Override
        public void findEntryComplete(Position position, Object ctx) {
            result.position = position;
            future.complete(null);
        }

        @Override
        public void findEntryFailed(ManagedLedgerException exception, Object ctx) {
            result.exception = exception;
            future.completeExceptionally(exception);
        }
    });
    return future;
}
Also used : CompletableFuture(java.util.concurrent.CompletableFuture) ManagedLedgerException(org.apache.bookkeeper.mledger.ManagedLedgerException) Position(org.apache.bookkeeper.mledger.Position) PersistentMessageFinder(org.apache.pulsar.broker.service.persistent.PersistentMessageFinder) AsyncCallbacks(org.apache.bookkeeper.mledger.AsyncCallbacks)

Example 2 with PersistentMessageFinder

use of org.apache.pulsar.broker.service.persistent.PersistentMessageFinder in project incubator-pulsar by apache.

the class PersistentMessageFinderTest method testPersistentMessageFinder.

@Test
void testPersistentMessageFinder() throws Exception {
    final String ledgerAndCursorName = "testPersistentMessageFinder";
    int entriesPerLedger = 2;
    long beginTimestamp = System.currentTimeMillis();
    ManagedLedgerConfig config = new ManagedLedgerConfig();
    config.setRetentionSizeInMB(10);
    config.setMaxEntriesPerLedger(entriesPerLedger);
    config.setRetentionTime(1, TimeUnit.HOURS);
    ManagedLedger ledger = factory.open(ledgerAndCursorName, config);
    ManagedCursorImpl c1 = (ManagedCursorImpl) ledger.openCursor(ledgerAndCursorName);
    ledger.addEntry(createMessageWrittenToLedger("retained1"));
    // space apart message publish times
    Thread.sleep(100);
    ledger.addEntry(createMessageWrittenToLedger("retained2"));
    Thread.sleep(100);
    Position newPosition = ledger.addEntry(createMessageWrittenToLedger("retained3"));
    Thread.sleep(100);
    long timestamp = System.currentTimeMillis();
    Thread.sleep(10);
    ledger.addEntry(createMessageWrittenToLedger("afterresetposition"));
    Position lastPosition = ledger.addEntry(createMessageWrittenToLedger("not-read"));
    List<Entry> entries = c1.readEntries(3);
    c1.markDelete(entries.get(2).getPosition());
    c1.close();
    ledger.close();
    entries.forEach(e -> e.release());
    // give timed ledger trimming a chance to run
    Thread.sleep(1000);
    ledger = factory.open(ledgerAndCursorName, config);
    c1 = (ManagedCursorImpl) ledger.openCursor(ledgerAndCursorName);
    long endTimestamp = System.currentTimeMillis();
    Result result = new Result();
    CompletableFuture<Void> future = findMessage(result, c1, timestamp);
    future.get();
    assertEquals(result.exception, null);
    assertTrue(result.position != null);
    assertEquals(result.position, newPosition);
    result.reset();
    future = findMessage(result, c1, beginTimestamp);
    future.get();
    assertEquals(result.exception, null);
    assertEquals(result.position, null);
    result.reset();
    future = findMessage(result, c1, endTimestamp);
    future.get();
    assertEquals(result.exception, null);
    assertNotEquals(result.position, null);
    assertEquals(result.position, lastPosition);
    PersistentMessageFinder messageFinder = new PersistentMessageFinder("topicname", c1);
    final AtomicBoolean ex = new AtomicBoolean(false);
    messageFinder.findEntryFailed(new ManagedLedgerException("failed"), new AsyncCallbacks.FindEntryCallback() {

        @Override
        public void findEntryComplete(Position position, Object ctx) {
        }

        @Override
        public void findEntryFailed(ManagedLedgerException exception, Object ctx) {
            ex.set(true);
        }
    });
    assertTrue(ex.get());
    PersistentMessageExpiryMonitor monitor = new PersistentMessageExpiryMonitor("topicname", c1.getName(), c1);
    monitor.findEntryFailed(new ManagedLedgerException.ConcurrentFindCursorPositionException("failed"), null);
    Field field = monitor.getClass().getDeclaredField("expirationCheckInProgress");
    field.setAccessible(true);
    assertEquals(0, field.get(monitor));
    result.reset();
    c1.close();
    ledger.close();
    factory.shutdown();
}
Also used : ManagedCursorImpl(org.apache.bookkeeper.mledger.impl.ManagedCursorImpl) Position(org.apache.bookkeeper.mledger.Position) ManagedLedger(org.apache.bookkeeper.mledger.ManagedLedger) PersistentMessageExpiryMonitor(org.apache.pulsar.broker.service.persistent.PersistentMessageExpiryMonitor) AtomicBoolean(java.util.concurrent.atomic.AtomicBoolean) Field(java.lang.reflect.Field) Entry(org.apache.bookkeeper.mledger.Entry) ManagedLedgerException(org.apache.bookkeeper.mledger.ManagedLedgerException) PersistentMessageFinder(org.apache.pulsar.broker.service.persistent.PersistentMessageFinder) AsyncCallbacks(org.apache.bookkeeper.mledger.AsyncCallbacks) ManagedLedgerConfig(org.apache.bookkeeper.mledger.ManagedLedgerConfig) Test(org.testng.annotations.Test)

Aggregations

AsyncCallbacks (org.apache.bookkeeper.mledger.AsyncCallbacks)2 ManagedLedgerException (org.apache.bookkeeper.mledger.ManagedLedgerException)2 Position (org.apache.bookkeeper.mledger.Position)2 PersistentMessageFinder (org.apache.pulsar.broker.service.persistent.PersistentMessageFinder)2 Field (java.lang.reflect.Field)1 CompletableFuture (java.util.concurrent.CompletableFuture)1 AtomicBoolean (java.util.concurrent.atomic.AtomicBoolean)1 Entry (org.apache.bookkeeper.mledger.Entry)1 ManagedLedger (org.apache.bookkeeper.mledger.ManagedLedger)1 ManagedLedgerConfig (org.apache.bookkeeper.mledger.ManagedLedgerConfig)1 ManagedCursorImpl (org.apache.bookkeeper.mledger.impl.ManagedCursorImpl)1 PersistentMessageExpiryMonitor (org.apache.pulsar.broker.service.persistent.PersistentMessageExpiryMonitor)1 Test (org.testng.annotations.Test)1