Example 6 with KeyedMapBundleOperator
use of org.apache.flink.table.runtime.operators.bundle.KeyedMapBundleOperator in project flink by apache.
the class RowTimeMiniBatchLatestChangeDeduplicateFunctionTest method createTestHarness.
private OneInputStreamOperatorTestHarness<RowData, RowData> createTestHarness(boolean generateUpdateBefore, boolean generateInsert, boolean keepLastRow) throws Exception {
RowTimeMiniBatchLatestChangeDeduplicateFunction func = new RowTimeMiniBatchLatestChangeDeduplicateFunction(inputRowType, serializer, minTtlTime.toMilliseconds(), rowTimeIndex, generateUpdateBefore, generateInsert, keepLastRow);
CountBundleTrigger trigger = new CountBundleTrigger<RowData>(miniBatchSize);
KeyedMapBundleOperator<RowData, RowData, RowData, RowData> keyedMapBundleOperator = new KeyedMapBundleOperator(func, trigger);
return createTestHarness(keyedMapBundleOperator);
}
Also used :
CountBundleTrigger(org.apache.flink.table.runtime.operators.bundle.trigger.CountBundleTrigger)
RowData(org.apache.flink.table.data.RowData)
KeyedMapBundleOperator(org.apache.flink.table.runtime.operators.bundle.KeyedMapBundleOperator)
Aggregations
KeyedMapBundleOperator (org.apache.flink.table.runtime.operators.bundle.KeyedMapBundleOperator)6
CountBundleTrigger (org.apache.flink.table.runtime.operators.bundle.trigger.CountBundleTrigger)5
RowData (org.apache.flink.table.data.RowData)4
ArrayList (java.util.ArrayList)2
Tuple2 (org.apache.flink.api.java.tuple.Tuple2)2
OperatorSubtaskState (org.apache.flink.runtime.checkpoint.OperatorSubtaskState)2
KeyedProcessOperator (org.apache.flink.streaming.api.operators.KeyedProcessOperator)2
Watermark (org.apache.flink.streaming.api.watermark.Watermark)2
KeyedOneInputStreamOperatorTestHarness (org.apache.flink.streaming.util.KeyedOneInputStreamOperatorTestHarness)2
Transformation (org.apache.flink.api.dag.Transformation)1
OneInputTransformation (org.apache.flink.streaming.api.transformations.OneInputTransformation)1
ExecEdge (org.apache.flink.table.planner.plan.nodes.exec.ExecEdge)1
AggregateInfoList (org.apache.flink.table.planner.plan.utils.AggregateInfoList)1
GeneratedAggsHandleFunction (org.apache.flink.table.runtime.generated.GeneratedAggsHandleFunction)1
RowDataKeySelector (org.apache.flink.table.runtime.keyselector.RowDataKeySelector)1
MiniBatchIncrementalGroupAggFunction (org.apache.flink.table.runtime.operators.aggregate.MiniBatchIncrementalGroupAggFunction)1
