Search in sources :

Example 1 with KeyedWindowResultFunction

use of com.hazelcast.jet.function.KeyedWindowResultFunction in project hazelcast-jet by hazelcast.

the class GrAggBuilder method buildStream.

@SuppressWarnings("unchecked")
public <A, R, OUT> StreamStage<OUT> buildStream(@Nonnull AggregateOperation<A, ? extends R> aggrOp, @Nonnull KeyedWindowResultFunction<? super K, ? super R, OUT> mapToOutputFn) {
    List<Transform> upstreamTransforms = upstreamStages.stream().map(s -> s.transform).collect(toList());
    JetEventFunctionAdapter fnAdapter = ADAPT_TO_JET_EVENT;
    // Avoided Stream API here due to static typing issues
    List<DistributedFunction<?, ? extends K>> adaptedKeyFns = new ArrayList<>();
    for (DistributedFunction keyFn : keyFns) {
        adaptedKeyFns.add(adaptKeyFn(keyFn));
    }
    Transform transform = new WindowGroupTransform<K, A, R, JetEvent<OUT>>(upstreamTransforms, wDef, adaptedKeyFns, adaptAggregateOperation(aggrOp), fnAdapter.adaptKeyedWindowResultFn(mapToOutputFn));
    pipelineImpl.connect(upstreamTransforms, transform);
    return new StreamStageImpl<>(transform, fnAdapter, pipelineImpl);
}
Also used : WindowGroupTransform(com.hazelcast.jet.impl.pipeline.transform.WindowGroupTransform) DistributedBiFunction(com.hazelcast.jet.function.DistributedBiFunction) ArrayList(java.util.ArrayList) BatchStage(com.hazelcast.jet.pipeline.BatchStage) Tag.tag(com.hazelcast.jet.datamodel.Tag.tag) KeyedWindowResultFunction(com.hazelcast.jet.function.KeyedWindowResultFunction) AggregateOperation(com.hazelcast.jet.aggregate.AggregateOperation) WindowGroupAggregateBuilder(com.hazelcast.jet.pipeline.WindowGroupAggregateBuilder) StageWithGroupingAndWindow(com.hazelcast.jet.pipeline.StageWithGroupingAndWindow) DistributedFunction(com.hazelcast.jet.function.DistributedFunction) GroupTransform(com.hazelcast.jet.impl.pipeline.transform.GroupTransform) Nonnull(javax.annotation.Nonnull) StreamStage(com.hazelcast.jet.pipeline.StreamStage) WindowDefinition(com.hazelcast.jet.pipeline.WindowDefinition) StageWithGrouping(com.hazelcast.jet.pipeline.StageWithGrouping) JetEventFunctionAdapter.adaptAggregateOperation(com.hazelcast.jet.impl.pipeline.JetEventFunctionAdapter.adaptAggregateOperation) Tag(com.hazelcast.jet.datamodel.Tag) Transform(com.hazelcast.jet.impl.pipeline.transform.Transform) ADAPT_TO_JET_EVENT(com.hazelcast.jet.impl.pipeline.ComputeStageImplBase.ADAPT_TO_JET_EVENT) List(java.util.List) ComputeStageImplBase.ensureJetEvents(com.hazelcast.jet.impl.pipeline.ComputeStageImplBase.ensureJetEvents) Collectors.toList(java.util.stream.Collectors.toList) JetEventFunctionAdapter.adaptKeyFn(com.hazelcast.jet.impl.pipeline.JetEventFunctionAdapter.adaptKeyFn) StreamStageWithGrouping(com.hazelcast.jet.pipeline.StreamStageWithGrouping) GroupAggregateBuilder(com.hazelcast.jet.pipeline.GroupAggregateBuilder) ArrayList(java.util.ArrayList) WindowGroupTransform(com.hazelcast.jet.impl.pipeline.transform.WindowGroupTransform) GroupTransform(com.hazelcast.jet.impl.pipeline.transform.GroupTransform) Transform(com.hazelcast.jet.impl.pipeline.transform.Transform) WindowGroupTransform(com.hazelcast.jet.impl.pipeline.transform.WindowGroupTransform) DistributedFunction(com.hazelcast.jet.function.DistributedFunction)

Aggregations

AggregateOperation (com.hazelcast.jet.aggregate.AggregateOperation)1 Tag (com.hazelcast.jet.datamodel.Tag)1 Tag.tag (com.hazelcast.jet.datamodel.Tag.tag)1 DistributedBiFunction (com.hazelcast.jet.function.DistributedBiFunction)1 DistributedFunction (com.hazelcast.jet.function.DistributedFunction)1 KeyedWindowResultFunction (com.hazelcast.jet.function.KeyedWindowResultFunction)1 ADAPT_TO_JET_EVENT (com.hazelcast.jet.impl.pipeline.ComputeStageImplBase.ADAPT_TO_JET_EVENT)1 ComputeStageImplBase.ensureJetEvents (com.hazelcast.jet.impl.pipeline.ComputeStageImplBase.ensureJetEvents)1 JetEventFunctionAdapter.adaptAggregateOperation (com.hazelcast.jet.impl.pipeline.JetEventFunctionAdapter.adaptAggregateOperation)1 JetEventFunctionAdapter.adaptKeyFn (com.hazelcast.jet.impl.pipeline.JetEventFunctionAdapter.adaptKeyFn)1 GroupTransform (com.hazelcast.jet.impl.pipeline.transform.GroupTransform)1 Transform (com.hazelcast.jet.impl.pipeline.transform.Transform)1 WindowGroupTransform (com.hazelcast.jet.impl.pipeline.transform.WindowGroupTransform)1 BatchStage (com.hazelcast.jet.pipeline.BatchStage)1 GroupAggregateBuilder (com.hazelcast.jet.pipeline.GroupAggregateBuilder)1 StageWithGrouping (com.hazelcast.jet.pipeline.StageWithGrouping)1 StageWithGroupingAndWindow (com.hazelcast.jet.pipeline.StageWithGroupingAndWindow)1 StreamStage (com.hazelcast.jet.pipeline.StreamStage)1 StreamStageWithGrouping (com.hazelcast.jet.pipeline.StreamStageWithGrouping)1 WindowDefinition (com.hazelcast.jet.pipeline.WindowDefinition)1