Examples with Twister2SinkFunction org.apache.beam.runners.twister2.translators.functions.Twister2SinkFunction used on opensource projects

Example 1 with Twister2SinkFunction

use of org.apache.beam.runners.twister2.translators.functions.Twister2SinkFunction in project twister2 by DSC-SPIDAL.

the class Twister2TranslationContext method execute.

public void execute() {
    Map<String, CachedTSet> sideInputTSets = new HashMap<>();
    for (Map.Entry<String, BatchTSet<?>> sides : sideInputDataSets.entrySet()) {
        CachedTSet tempCache = (CachedTSet) sides.getValue().cache();
        sideInputTSets.put(sides.getKey(), tempCache);
    }
    for (TSet leaf : leaves) {
        SinkTSet sinkTSet = (SinkTSet) leaf.direct().sink(new Twister2SinkFunction());
        addInputs(sinkTSet, sideInputTSets);
        eval(sinkTSet);
    }
}

Example 2 with Twister2SinkFunction

use of org.apache.beam.runners.twister2.translators.functions.Twister2SinkFunction in project beam by apache.

the class BeamBatchWorker method executePipeline.

public void executePipeline(BatchTSetEnvironment env) {
    Map<String, CachedTSet> sideInputTSets = new HashMap<>();
    for (Map.Entry<String, BatchTSet<?>> sides : sideInputDataSets.entrySet()) {
        BatchTSet<?> sideTSet = sides.getValue();
        addInputs((BaseTSet) sideTSet, sideInputTSets);
        CachedTSet tempCache = (CachedTSet) sideTSet.cache();
        sideInputTSets.put(sides.getKey(), tempCache);
    }
    for (TSet leaf : leaves) {
        SinkTSet sinkTSet = (SinkTSet) leaf.direct().sink(new Twister2SinkFunction());
        addInputs(sinkTSet, sideInputTSets);
        eval(env, sinkTSet);
    }
}