Search in sources :

Example 26 with SessionWindow

use of org.apache.kafka.streams.kstream.internals.SessionWindow in project apache-kafka-on-k8s by banzaicloud.

the class CachingSessionStoreTest method shouldClearNamespaceCacheOnClose.

@Test
public void shouldClearNamespaceCacheOnClose() {
    final Windowed<Bytes> a1 = new Windowed<>(keyA, new SessionWindow(0, 0));
    cachingStore.put(a1, "1".getBytes());
    assertEquals(1, cache.size());
    cachingStore.close();
    assertEquals(0, cache.size());
}
Also used : Windowed(org.apache.kafka.streams.kstream.Windowed) Bytes(org.apache.kafka.common.utils.Bytes) SessionWindow(org.apache.kafka.streams.kstream.internals.SessionWindow) Test(org.junit.Test)

Example 27 with SessionWindow

use of org.apache.kafka.streams.kstream.internals.SessionWindow in project apache-kafka-on-k8s by banzaicloud.

the class CachingSessionStoreTest method shouldFetchRangeCorrectlyAcrossSegments.

@Test
public void shouldFetchRangeCorrectlyAcrossSegments() {
    final Windowed<Bytes> a1 = new Windowed<>(keyA, new SessionWindow(0, 0));
    final Windowed<Bytes> aa1 = new Windowed<>(keyAA, new SessionWindow(0, 0));
    final Windowed<Bytes> a2 = new Windowed<>(keyA, new SessionWindow(Segments.MIN_SEGMENT_INTERVAL, Segments.MIN_SEGMENT_INTERVAL));
    final Windowed<Bytes> a3 = new Windowed<>(keyA, new SessionWindow(Segments.MIN_SEGMENT_INTERVAL * 2, Segments.MIN_SEGMENT_INTERVAL * 2));
    final Windowed<Bytes> aa3 = new Windowed<>(keyAA, new SessionWindow(Segments.MIN_SEGMENT_INTERVAL * 2, Segments.MIN_SEGMENT_INTERVAL * 2));
    cachingStore.put(a1, "1".getBytes());
    cachingStore.put(aa1, "1".getBytes());
    cachingStore.put(a2, "2".getBytes());
    cachingStore.put(a3, "3".getBytes());
    cachingStore.put(aa3, "3".getBytes());
    cachingStore.flush();
    final KeyValueIterator<Windowed<Bytes>, byte[]> rangeResults = cachingStore.findSessions(keyA, keyAA, 0, Segments.MIN_SEGMENT_INTERVAL * 2);
    assertEquals(a1, rangeResults.next().key);
    assertEquals(aa1, rangeResults.next().key);
    assertEquals(a2, rangeResults.next().key);
    assertEquals(a3, rangeResults.next().key);
    assertEquals(aa3, rangeResults.next().key);
    assertFalse(rangeResults.hasNext());
}
Also used : Windowed(org.apache.kafka.streams.kstream.Windowed) Bytes(org.apache.kafka.common.utils.Bytes) SessionWindow(org.apache.kafka.streams.kstream.internals.SessionWindow) Test(org.junit.Test)

Example 28 with SessionWindow

use of org.apache.kafka.streams.kstream.internals.SessionWindow in project apache-kafka-on-k8s by banzaicloud.

the class CachingSessionStoreTest method addSingleSession.

private void addSingleSession(final String sessionId, final List<KeyValue<Windowed<Bytes>, byte[]>> allSessions) {
    final int timestamp = allSessions.size() * 10;
    final Windowed<Bytes> key = new Windowed<>(Bytes.wrap(sessionId.getBytes()), new SessionWindow(timestamp, timestamp));
    final byte[] value = "1".getBytes();
    cachingStore.put(key, value);
    allSessions.add(KeyValue.pair(key, value));
}
Also used : Windowed(org.apache.kafka.streams.kstream.Windowed) Bytes(org.apache.kafka.common.utils.Bytes) SessionWindow(org.apache.kafka.streams.kstream.internals.SessionWindow)

Example 29 with SessionWindow

use of org.apache.kafka.streams.kstream.internals.SessionWindow in project apache-kafka-on-k8s by banzaicloud.

the class CompositeReadOnlySessionStoreTest method shouldNotGetValueFromOtherStores.

@Test
public void shouldNotGetValueFromOtherStores() {
    final Windowed<String> expectedKey = new Windowed<>("foo", new SessionWindow(0, 0));
    otherUnderlyingStore.put(new Windowed<>("foo", new SessionWindow(10, 10)), 10L);
    underlyingSessionStore.put(expectedKey, 1L);
    final KeyValueIterator<Windowed<String>, Long> result = sessionStore.fetch("foo");
    assertEquals(KeyValue.pair(expectedKey, 1L), result.next());
    assertFalse(result.hasNext());
}
Also used : Windowed(org.apache.kafka.streams.kstream.Windowed) SessionWindow(org.apache.kafka.streams.kstream.internals.SessionWindow) Test(org.junit.Test)

Example 30 with SessionWindow

use of org.apache.kafka.streams.kstream.internals.SessionWindow in project kafka by apache.

the class WindowedSerdesTest method sessionWindowedSerializerShouldThrowNpeIfNotInitializedProperly.

@Test
public void sessionWindowedSerializerShouldThrowNpeIfNotInitializedProperly() {
    final SessionWindowedSerializer<byte[]> serializer = new SessionWindowedSerializer<>();
    final NullPointerException exception = assertThrows(NullPointerException.class, () -> serializer.serialize("topic", new Windowed<>(new byte[0], new SessionWindow(0, 0))));
    assertThat(exception.getMessage(), equalTo("Inner serializer is `null`. User code must use constructor " + "`SessionWindowedSerializer(final Serializer<T> inner)` instead of the no-arg constructor."));
}
Also used : SessionWindow(org.apache.kafka.streams.kstream.internals.SessionWindow) Test(org.junit.Test)

Aggregations

SessionWindow (org.apache.kafka.streams.kstream.internals.SessionWindow)117 Test (org.junit.Test)107 Windowed (org.apache.kafka.streams.kstream.Windowed)101 Bytes (org.apache.kafka.common.utils.Bytes)50 KeyValue (org.apache.kafka.streams.KeyValue)46 ArrayList (java.util.ArrayList)10 StreamsTestUtils.verifyWindowedKeyValue (org.apache.kafka.test.StreamsTestUtils.verifyWindowedKeyValue)8 LinkedList (java.util.LinkedList)6 Properties (java.util.Properties)6 ReadOnlySessionStoreStub (org.apache.kafka.test.ReadOnlySessionStoreStub)6 HashMap (java.util.HashMap)4 CountDownLatch (java.util.concurrent.CountDownLatch)4 StringDeserializer (org.apache.kafka.common.serialization.StringDeserializer)4 StringSerializer (org.apache.kafka.common.serialization.StringSerializer)4 KeyValueTimestamp (org.apache.kafka.streams.KeyValueTimestamp)4 IntegrationTest (org.apache.kafka.test.IntegrationTest)4 KafkaMetric (org.apache.kafka.common.metrics.KafkaMetric)3 File (java.io.File)2 ByteBuffer (java.nio.ByteBuffer)2 HashSet (java.util.HashSet)2