Examples with Config edu.iu.dsc.tws.common.config.Config used on opensource projects

Example 26 with Config

use of edu.iu.dsc.tws.common.config.Config in project twister2 by DSC-SPIDAL.

the class MPIDataFlowCommunication method allGather.

@Override
public DataFlowOperation allGather(Map<String, Object> properties, MessageType type, int edge1, int edge2, Set<Integer> sourceTasks, Set<Integer> destTasks, int middleTask, MessageReceiver finalRecvr) {
    // merge with the user specified configuration, user specified will take precedence
    Config mergedCfg = Config.newBuilder().putAll(config).putAll(properties).build();
    // create the dataflow operation
    MPIDataFlowAllGather dataFlowOperation = new MPIDataFlowAllGather(channel, sourceTasks, destTasks, middleTask, finalRecvr, edge1, edge2);
    // intialize the operation
    dataFlowOperation.init(mergedCfg, type, instancePlan, edge1);
    return dataFlowOperation;
}

Example 27 with Config

use of edu.iu.dsc.tws.common.config.Config in project twister2 by DSC-SPIDAL.

the class MPIDataFlowCommunication method keyedGather.

@Override
public DataFlowOperation keyedGather(Map<String, Object> properties, MessageType type, Set<Integer> edge, Set<Integer> sourceTasks, Set<Integer> destTasks, MultiMessageReceiver receiver) {
    // merge with the user specified configuration, user specified will take precedence
    Config mergedCfg = Config.newBuilder().putAll(config).putAll(properties).build();
    // create the dataflow operation
    MPIDataFlowMultiGather dataFlowOperation = new MPIDataFlowMultiGather(channel, sourceTasks, destTasks, receiver, edge);
    // intialize the operation
    dataFlowOperation.init(mergedCfg, type, instancePlan, 0);
    return dataFlowOperation;
}

Example 28 with Config

use of edu.iu.dsc.tws.common.config.Config in project twister2 by DSC-SPIDAL.

the class MPIDataFlowCommunication method allReduce.

public DataFlowOperation allReduce(Map<String, Object> properties, MessageType type, int edge1, int edge2, Set<Integer> sourceTasks, Set<Integer> destTasks, int middleTask, ReduceFunction reduceFunction, ReduceReceiver receiver, boolean stream) {
    // merge with the user specified configuration, user specified will take precedence
    Config mergedCfg = Config.newBuilder().putAll(config).putAll(properties).build();
    // create the dataflow operation
    MPIDataFlowAllReduce dataFlowOperation = new MPIDataFlowAllReduce(channel, sourceTasks, destTasks, middleTask, reduceFunction, receiver, edge1, edge2, stream);
    // intialize the operation
    dataFlowOperation.init(mergedCfg, type, instancePlan, 0);
    return dataFlowOperation;
}

Example 29 with Config

use of edu.iu.dsc.tws.common.config.Config in project twister2 by DSC-SPIDAL.

the class MPIDataFlowCommunication method reduce.

public DataFlowOperation reduce(Map<String, Object> properties, MessageType type, int edge, Set<Integer> sourceTasks, int destTask, MessageReceiver reduceReceiver, MessageReceiver partialReceiver) {
    // merge with the user specified configuration, user specified will take precedence
    Config mergedCfg = Config.newBuilder().putAll(config).putAll(properties).build();
    // create the dataflow operation
    MPIDataFlowReduce dataFlowOperation = new MPIDataFlowReduce(channel, sourceTasks, destTask, reduceReceiver, partialReceiver);
    // intialize the operation
    dataFlowOperation.init(mergedCfg, type, instancePlan, edge);
    return dataFlowOperation;
}

Example 30 with Config

use of edu.iu.dsc.tws.common.config.Config in project twister2 by DSC-SPIDAL.

the class MPIDataFlowCommunication method direct.

public DataFlowOperation direct(Map<String, Object> properties, MessageType type, int edge, Set<Integer> sourceTasks, int destTask, MessageReceiver receiver) {
    // merge with the user specified configuration, user specified will take precedence
    Config mergedCfg = Config.newBuilder().putAll(config).putAll(properties).build();
    // create the dataflow operation
    MPIDirectDataFlowCommunication dataFlowOperation = new MPIDirectDataFlowCommunication(channel, sourceTasks, destTask, receiver);
    // intialize the operation
    dataFlowOperation.init(mergedCfg, type, instancePlan, edge);
    return dataFlowOperation;
}