Examples with PythonMapPartition org.apache.flink.python.api.functions.PythonMapPartition used on opensource projects

Example 6 with PythonMapPartition

use of org.apache.flink.python.api.functions.PythonMapPartition in project flink by apache.

the class PythonPlanBinder method createJoinOperation.

@SuppressWarnings("unchecked")
private void createJoinOperation(DatasizeHint mode, PythonOperationInfo info) {
    DataSet op1 = (DataSet) sets.get(info.parentID);
    DataSet op2 = (DataSet) sets.get(info.otherID);
    if (info.usesUDF) {
        sets.put(info.setID, createDefaultJoin(op1, op2, info.keys1, info.keys2, mode, getParallelism(info)).mapPartition(new PythonMapPartition(info.setID, info.types)).setParallelism(getParallelism(info)).name(info.name));
    } else {
        sets.put(info.setID, createDefaultJoin(op1, op2, info.keys1, info.keys2, mode, getParallelism(info)));
    }
}