Examples with ProcessorTopology org.apache.kafka.streams.processor.internals.ProcessorTopology used on opensource projects

Example 61 with ProcessorTopology

use of org.apache.kafka.streams.processor.internals.ProcessorTopology in project apache-kafka-on-k8s by banzaicloud.

the class InternalStreamsBuilderTest method shouldHaveNullTimestampExtractorWhenNoneSupplied.

@Test
public void shouldHaveNullTimestampExtractorWhenNoneSupplied() throws Exception {
    builder.stream(Collections.singleton("topic"), consumed);
    final ProcessorTopology processorTopology = builder.internalTopologyBuilder.build(null);
    assertNull(processorTopology.source("topic").getTimestampExtractor());
}

Example 62 with ProcessorTopology

use of org.apache.kafka.streams.processor.internals.ProcessorTopology in project apache-kafka-on-k8s by banzaicloud.

the class InternalStreamsBuilderTest method ktableShouldUseProvidedTimestampExtractor.

@Test
public void ktableShouldUseProvidedTimestampExtractor() throws Exception {
    final ConsumedInternal<String, String> consumed = new ConsumedInternal<>(Consumed.<String, String>with(new MockTimestampExtractor()));
    builder.table("topic", consumed, materialized);
    final ProcessorTopology processorTopology = builder.internalTopologyBuilder.build(null);
    assertThat(processorTopology.source("topic").getTimestampExtractor(), instanceOf(MockTimestampExtractor.class));
}

Example 63 with ProcessorTopology

use of org.apache.kafka.streams.processor.internals.ProcessorTopology in project apache-kafka-on-k8s by banzaicloud.

the class TopologyBuilderTest method shouldAddTimestampExtractorPerSource.

@Test
public void shouldAddTimestampExtractorPerSource() {
    final TopologyBuilder builder = new TopologyBuilder();
    builder.addSource(new MockTimestampExtractor(), "source", "topic");
    final ProcessorTopology processorTopology = builder.build(null);
    assertThat(processorTopology.source("topic").getTimestampExtractor(), instanceOf(MockTimestampExtractor.class));
}

Example 64 with ProcessorTopology

use of org.apache.kafka.streams.processor.internals.ProcessorTopology in project apache-kafka-on-k8s by banzaicloud.

the class TopologyBuilderTest method shouldAddTimestampExtractorWithPatternPerSource.

@Test
public void shouldAddTimestampExtractorWithPatternPerSource() {
    final TopologyBuilder builder = new TopologyBuilder();
    final Pattern pattern = Pattern.compile("t.*");
    builder.addSource(new MockTimestampExtractor(), "source", pattern);
    final ProcessorTopology processorTopology = builder.build(null);
    assertThat(processorTopology.source(pattern.pattern()).getTimestampExtractor(), instanceOf(MockTimestampExtractor.class));
}

Example 65 with ProcessorTopology

use of org.apache.kafka.streams.processor.internals.ProcessorTopology in project kafka by apache.

the class KStreamImplTest method shouldUseRecordMetadataTimestampExtractorWhenInternalRepartitioningTopicCreated.

@SuppressWarnings("deprecation")
@Test
public void shouldUseRecordMetadataTimestampExtractorWhenInternalRepartitioningTopicCreated() {
    final StreamsBuilder builder = new StreamsBuilder();
    final KStream<String, String> kStream = builder.stream("topic-1", stringConsumed);
    final ValueJoiner<String, String, String> valueJoiner = MockValueJoiner.instance(":");
    final long windowSize = TimeUnit.MILLISECONDS.convert(1, TimeUnit.DAYS);
    final KStream<String, String> stream = kStream.map((key, value) -> KeyValue.pair(value, value));
    stream.join(kStream, valueJoiner, JoinWindows.of(ofMillis(windowSize)).grace(ofMillis(3L * windowSize)), StreamJoined.with(Serdes.String(), Serdes.String(), Serdes.String())).to("output-topic", Produced.with(Serdes.String(), Serdes.String()));
    final ProcessorTopology topology = TopologyWrapper.getInternalTopologyBuilder(builder.build()).setApplicationId("X").buildTopology();
    final SourceNode<?, ?> originalSourceNode = topology.source("topic-1");
    for (final SourceNode<?, ?> sourceNode : topology.sources()) {
        if (sourceNode.name().equals(originalSourceNode.name())) {
            assertNull(sourceNode.getTimestampExtractor());
        } else {
            assertThat(sourceNode.getTimestampExtractor(), instanceOf(FailOnInvalidTimestamp.class));
        }
    }
}