Search in sources :

Example 1 with SessionWindowExpression

use of io.confluent.ksql.execution.windows.SessionWindowExpression in project ksql by confluentinc.

the class RewrittenAnalysis method getWindowExpression.

@Override
public Optional<WindowExpression> getWindowExpression() {
    final Optional<WindowExpression> windowExpression = original.getWindowExpression();
    final Optional<RefinementInfo> refinementInfo = original.getRefinementInfo();
    /* Return the original window expression, unless there is no grace period provided during a
    suppression, in which case we rewrite the window expression to have a default grace period
    of zero.
    */
    if (!(windowExpression.isPresent() && !windowExpression.get().getKsqlWindowExpression().getGracePeriod().isPresent() && refinementInfo.isPresent() && refinementInfo.get().getOutputRefinement() == OutputRefinement.FINAL)) {
        return original.getWindowExpression();
    }
    final WindowExpression window = original.getWindowExpression().get();
    final KsqlWindowExpression ksqlWindowNew;
    final KsqlWindowExpression ksqlWindowOld = window.getKsqlWindowExpression();
    final Optional<NodeLocation> location = ksqlWindowOld.getLocation();
    final Optional<WindowTimeClause> retention = ksqlWindowOld.getRetention();
    if (ksqlWindowOld instanceof HoppingWindowExpression) {
        ksqlWindowNew = new HoppingWindowExpression(location, ((HoppingWindowExpression) ksqlWindowOld).getSize(), ((HoppingWindowExpression) ksqlWindowOld).getAdvanceBy(), retention, Optional.of(zeroGracePeriod));
    } else if (ksqlWindowOld instanceof TumblingWindowExpression) {
        ksqlWindowNew = new TumblingWindowExpression(location, ((TumblingWindowExpression) ksqlWindowOld).getSize(), retention, Optional.of(zeroGracePeriod));
    } else if (ksqlWindowOld instanceof SessionWindowExpression) {
        ksqlWindowNew = new SessionWindowExpression(location, ((SessionWindowExpression) ksqlWindowOld).getGap(), retention, Optional.of(zeroGracePeriod));
    } else {
        throw new KsqlException("WINDOW type must be HOPPING, TUMBLING, or SESSION");
    }
    return Optional.of(new WindowExpression(original.getWindowExpression().get().getWindowName(), ksqlWindowNew));
}
Also used : HoppingWindowExpression(io.confluent.ksql.execution.windows.HoppingWindowExpression) TumblingWindowExpression(io.confluent.ksql.execution.windows.TumblingWindowExpression) WindowExpression(io.confluent.ksql.parser.tree.WindowExpression) KsqlWindowExpression(io.confluent.ksql.execution.windows.KsqlWindowExpression) SessionWindowExpression(io.confluent.ksql.execution.windows.SessionWindowExpression) HoppingWindowExpression(io.confluent.ksql.execution.windows.HoppingWindowExpression) KsqlException(io.confluent.ksql.util.KsqlException) SessionWindowExpression(io.confluent.ksql.execution.windows.SessionWindowExpression) NodeLocation(io.confluent.ksql.parser.NodeLocation) RefinementInfo(io.confluent.ksql.serde.RefinementInfo) KsqlWindowExpression(io.confluent.ksql.execution.windows.KsqlWindowExpression) WindowTimeClause(io.confluent.ksql.execution.windows.WindowTimeClause) TumblingWindowExpression(io.confluent.ksql.execution.windows.TumblingWindowExpression)

Example 2 with SessionWindowExpression

use of io.confluent.ksql.execution.windows.SessionWindowExpression in project ksql by confluentinc.

the class StreamAggregateBuilderTest method givenSessionWindowedAggregate.

@SuppressWarnings({ "unchecked", "rawtypes" })
private void givenSessionWindowedAggregate() {
    when(materializedFactory.<GenericKey, SessionStore<Bytes, byte[]>>create(any(), any(), any(), any())).thenReturn(sessionWindowMaterialized);
    when(groupedStream.windowedBy(any(SessionWindows.class))).thenReturn(sessionWindowedStream);
    when(sessionWindowedStream.aggregate(any(), any(), any(), any(Materialized.class))).thenReturn(windowed);
    when(windowed.transformValues(any(), any(Named.class))).thenReturn((KTable) windowedWithResults);
    when(windowedWithResults.transformValues(any(), any(Named.class))).thenReturn((KTable) windowedWithWindowBounds);
    windowedAggregate = new StreamWindowedAggregate(new ExecutionStepPropertiesV1(CTX), sourceStep, Formats.of(KEY_FORMAT, VALUE_FORMAT, SerdeFeatures.of(), SerdeFeatures.of()), NON_AGG_COLUMNS, FUNCTIONS, new SessionWindowExpression(Optional.empty(), new WindowTimeClause(WINDOW.getSeconds(), TimeUnit.SECONDS), Optional.of(retentionClause), Optional.of(gracePeriodClause)));
}
Also used : SessionStore(org.apache.kafka.streams.state.SessionStore) Named(org.apache.kafka.streams.kstream.Named) SessionWindows(org.apache.kafka.streams.kstream.SessionWindows) ExecutionStepPropertiesV1(io.confluent.ksql.execution.plan.ExecutionStepPropertiesV1) StreamWindowedAggregate(io.confluent.ksql.execution.plan.StreamWindowedAggregate) WindowTimeClause(io.confluent.ksql.execution.windows.WindowTimeClause) GenericKey(io.confluent.ksql.GenericKey) Materialized(org.apache.kafka.streams.kstream.Materialized) SessionWindowExpression(io.confluent.ksql.execution.windows.SessionWindowExpression)

Aggregations

SessionWindowExpression (io.confluent.ksql.execution.windows.SessionWindowExpression)2 WindowTimeClause (io.confluent.ksql.execution.windows.WindowTimeClause)2 GenericKey (io.confluent.ksql.GenericKey)1 ExecutionStepPropertiesV1 (io.confluent.ksql.execution.plan.ExecutionStepPropertiesV1)1 StreamWindowedAggregate (io.confluent.ksql.execution.plan.StreamWindowedAggregate)1 HoppingWindowExpression (io.confluent.ksql.execution.windows.HoppingWindowExpression)1 KsqlWindowExpression (io.confluent.ksql.execution.windows.KsqlWindowExpression)1 TumblingWindowExpression (io.confluent.ksql.execution.windows.TumblingWindowExpression)1 NodeLocation (io.confluent.ksql.parser.NodeLocation)1 WindowExpression (io.confluent.ksql.parser.tree.WindowExpression)1 RefinementInfo (io.confluent.ksql.serde.RefinementInfo)1 KsqlException (io.confluent.ksql.util.KsqlException)1 Materialized (org.apache.kafka.streams.kstream.Materialized)1 Named (org.apache.kafka.streams.kstream.Named)1 SessionWindows (org.apache.kafka.streams.kstream.SessionWindows)1 SessionStore (org.apache.kafka.streams.state.SessionStore)1