Search in sources :

Example 16 with ExtensionFW

use of io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.ExtensionFW in project zilla by aklivity.

the class KafkaMergedFactory method newStream.

@Override
public MessageConsumer newStream(int msgTypeId, DirectBuffer buffer, int index, int length, MessageConsumer sender) {
    final BeginFW begin = beginRO.wrap(buffer, index, index + length);
    final long routeId = begin.routeId();
    final long initialId = begin.streamId();
    final long authorization = begin.authorization();
    final long affinity = begin.affinity();
    assert (initialId & 0x0000_0000_0000_0001L) != 0L;
    final OctetsFW extension = begin.extension();
    final ExtensionFW beginEx = extensionRO.tryWrap(extension.buffer(), extension.offset(), extension.limit());
    final KafkaBeginExFW kafkaBeginEx = beginEx != null && beginEx.typeId() == kafkaTypeId ? kafkaBeginExRO.tryWrap(extension.buffer(), extension.offset(), extension.limit()) : null;
    assert kafkaBeginEx != null;
    assert kafkaBeginEx.kind() == KafkaBeginExFW.KIND_MERGED;
    final KafkaMergedBeginExFW kafkaMergedBeginEx = kafkaBeginEx.merged();
    final KafkaCapabilities capabilities = kafkaMergedBeginEx.capabilities().get();
    final String16FW beginTopic = kafkaMergedBeginEx.topic();
    final String topicName = beginTopic.asString();
    final KafkaDeltaType deltaType = kafkaMergedBeginEx.deltaType().get();
    MessageConsumer newStream = null;
    final KafkaBindingConfig binding = supplyBinding.apply(routeId);
    if (binding != null && binding.merged(topicName)) {
        final long resolvedId = routeId;
        final ArrayFW<KafkaOffsetFW> partitions = kafkaMergedBeginEx.partitions();
        final KafkaOffsetFW partition = partitions.matchFirst(p -> p.partitionId() == -1L);
        final long defaultOffset = partition != null ? partition.partitionOffset() : HISTORICAL.value();
        final Long2LongHashMap initialOffsetsById = new Long2LongHashMap(-3L);
        partitions.forEach(p -> {
            final long partitionId = p.partitionId();
            if (partitionId >= 0L) {
                final long partitionOffset = p.partitionOffset();
                initialOffsetsById.put(partitionId, partitionOffset);
            }
        });
        newStream = new KafkaMergedStream(sender, routeId, initialId, affinity, authorization, topicName, resolvedId, capabilities, initialOffsetsById, defaultOffset, deltaType)::onMergedMessage;
    }
    return newStream;
}
Also used : ExtensionFW(io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.ExtensionFW) MessageConsumer(io.aklivity.zilla.runtime.engine.binding.function.MessageConsumer) KafkaDeltaType(io.aklivity.zilla.runtime.binding.kafka.internal.types.KafkaDeltaType) OctetsFW(io.aklivity.zilla.runtime.binding.kafka.internal.types.OctetsFW) KafkaMergedBeginExFW(io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.KafkaMergedBeginExFW) BeginFW(io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.BeginFW) KafkaBindingConfig(io.aklivity.zilla.runtime.binding.kafka.internal.config.KafkaBindingConfig) KafkaBeginExFW(io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.KafkaBeginExFW) Long2LongHashMap(org.agrona.collections.Long2LongHashMap) KafkaCapabilities(io.aklivity.zilla.runtime.binding.kafka.internal.types.KafkaCapabilities) KafkaOffsetFW(io.aklivity.zilla.runtime.binding.kafka.internal.types.KafkaOffsetFW) String16FW(io.aklivity.zilla.runtime.binding.kafka.internal.types.String16FW)

Aggregations

OctetsFW (io.aklivity.zilla.runtime.binding.kafka.internal.types.OctetsFW)16 BeginFW (io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.BeginFW)16 ExtensionFW (io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.ExtensionFW)16 KafkaBeginExFW (io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.KafkaBeginExFW)16 MessageConsumer (io.aklivity.zilla.runtime.engine.binding.function.MessageConsumer)16 KafkaBindingConfig (io.aklivity.zilla.runtime.binding.kafka.internal.config.KafkaBindingConfig)13 String16FW (io.aklivity.zilla.runtime.binding.kafka.internal.types.String16FW)13 KafkaRouteConfig (io.aklivity.zilla.runtime.binding.kafka.internal.config.KafkaRouteConfig)11 KafkaCache (io.aklivity.zilla.runtime.binding.kafka.internal.cache.KafkaCache)6 KafkaCacheTopic (io.aklivity.zilla.runtime.binding.kafka.internal.cache.KafkaCacheTopic)6 KafkaCachePartition (io.aklivity.zilla.runtime.binding.kafka.internal.cache.KafkaCachePartition)4 KafkaOffsetFW (io.aklivity.zilla.runtime.binding.kafka.internal.types.KafkaOffsetFW)4 KafkaDeltaType (io.aklivity.zilla.runtime.binding.kafka.internal.types.KafkaDeltaType)3 KafkaDescribeBeginExFW (io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.KafkaDescribeBeginExFW)3 KafkaFetchBeginExFW (io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.KafkaFetchBeginExFW)3 KafkaProduceBeginExFW (io.aklivity.zilla.runtime.binding.kafka.internal.types.stream.KafkaProduceBeginExFW)3 BindingHandler (io.aklivity.zilla.runtime.engine.binding.BindingHandler)3 ArrayList (java.util.ArrayList)3 KafkaTopicConfig (io.aklivity.zilla.runtime.binding.kafka.internal.config.KafkaTopicConfig)2 KafkaOffsetType (io.aklivity.zilla.runtime.binding.kafka.internal.types.KafkaOffsetType)2