Search in sources :

Example 1 with TWSChannel

use of edu.iu.dsc.tws.api.comms.channel.TWSChannel in project twister2 by DSC-SPIDAL.

the class TaskUtils method execute.

public static void execute(Config config, int workerID, ComputeGraph graph, IWorkerController workerController) {
    RoundRobinTaskScheduler roundRobinTaskScheduler = new RoundRobinTaskScheduler();
    roundRobinTaskScheduler.initialize(config);
    List<JobMasterAPI.WorkerInfo> workerList = null;
    try {
        workerList = workerController.getAllWorkers();
    } catch (TimeoutException timeoutException) {
        LOG.log(Level.SEVERE, timeoutException.getMessage(), timeoutException);
        return;
    }
    WorkerPlan workerPlan = createWorkerPlan(workerList);
    TaskSchedulePlan taskSchedulePlan = roundRobinTaskScheduler.schedule(graph, workerPlan);
    TWSChannel network = Network.initializeChannel(config, workerController);
    ExecutionPlanBuilder executionPlanBuilder = new ExecutionPlanBuilder(workerID, workerList, new Communicator(config, network), workerController.getCheckpointingClient());
    ExecutionPlan plan = executionPlanBuilder.build(config, graph, taskSchedulePlan);
    ExecutorFactory executor = new ExecutorFactory(config, workerID, network);
    executor.getExecutor(config, plan, graph.getOperationMode()).execute();
}
Also used : TaskSchedulePlan(edu.iu.dsc.tws.api.compute.schedule.elements.TaskSchedulePlan) Communicator(edu.iu.dsc.tws.api.comms.Communicator) TWSChannel(edu.iu.dsc.tws.api.comms.channel.TWSChannel) ExecutionPlan(edu.iu.dsc.tws.api.compute.executor.ExecutionPlan) ExecutionPlanBuilder(edu.iu.dsc.tws.executor.core.ExecutionPlanBuilder) ExecutorFactory(edu.iu.dsc.tws.executor.threading.ExecutorFactory) RoundRobinTaskScheduler(edu.iu.dsc.tws.tsched.streaming.roundrobin.RoundRobinTaskScheduler) TimeoutException(edu.iu.dsc.tws.api.exceptions.TimeoutException) WorkerPlan(edu.iu.dsc.tws.api.compute.schedule.elements.WorkerPlan)

Example 2 with TWSChannel

use of edu.iu.dsc.tws.api.comms.channel.TWSChannel in project twister2 by DSC-SPIDAL.

the class TaskUtils method executeBatch.

public static void executeBatch(Config config, int workerID, ComputeGraph graph, IWorkerController workerController) {
    RoundRobinTaskScheduler roundRobinTaskScheduler = new RoundRobinTaskScheduler();
    roundRobinTaskScheduler.initialize(config);
    WorkerPlan workerPlan = null;
    List<JobMasterAPI.WorkerInfo> workerList = null;
    try {
        workerList = workerController.getAllWorkers();
    } catch (TimeoutException timeoutException) {
        LOG.log(Level.SEVERE, timeoutException.getMessage(), timeoutException);
        return;
    }
    workerPlan = createWorkerPlan(workerList);
    TaskSchedulePlan taskSchedulePlan = roundRobinTaskScheduler.schedule(graph, workerPlan);
    TWSChannel network = Network.initializeChannel(config, workerController);
    ExecutionPlanBuilder executionPlanBuilder = new ExecutionPlanBuilder(workerID, workerList, new Communicator(config, network), workerController.getCheckpointingClient());
    ExecutionPlan plan = executionPlanBuilder.build(config, graph, taskSchedulePlan);
    ExecutorFactory executor = new ExecutorFactory(config, workerID, network);
    executor.getExecutor(config, plan, graph.getOperationMode()).execute();
}
Also used : TaskSchedulePlan(edu.iu.dsc.tws.api.compute.schedule.elements.TaskSchedulePlan) Communicator(edu.iu.dsc.tws.api.comms.Communicator) TWSChannel(edu.iu.dsc.tws.api.comms.channel.TWSChannel) ExecutionPlan(edu.iu.dsc.tws.api.compute.executor.ExecutionPlan) ExecutionPlanBuilder(edu.iu.dsc.tws.executor.core.ExecutionPlanBuilder) ExecutorFactory(edu.iu.dsc.tws.executor.threading.ExecutorFactory) RoundRobinTaskScheduler(edu.iu.dsc.tws.tsched.streaming.roundrobin.RoundRobinTaskScheduler) WorkerPlan(edu.iu.dsc.tws.api.compute.schedule.elements.WorkerPlan) TimeoutException(edu.iu.dsc.tws.api.exceptions.TimeoutException)

Example 3 with TWSChannel

use of edu.iu.dsc.tws.api.comms.channel.TWSChannel in project twister2 by DSC-SPIDAL.

the class WordCountWorker method setupNetwork.

private void setupNetwork(IWorkerController controller) {
    TWSChannel twsChannel = Network.initializeChannel(config, controller);
    this.channel = new Communicator(config, twsChannel);
}
Also used : Communicator(edu.iu.dsc.tws.api.comms.Communicator) TWSChannel(edu.iu.dsc.tws.api.comms.channel.TWSChannel)

Aggregations

Communicator (edu.iu.dsc.tws.api.comms.Communicator)3 TWSChannel (edu.iu.dsc.tws.api.comms.channel.TWSChannel)3 ExecutionPlan (edu.iu.dsc.tws.api.compute.executor.ExecutionPlan)2 TaskSchedulePlan (edu.iu.dsc.tws.api.compute.schedule.elements.TaskSchedulePlan)2 WorkerPlan (edu.iu.dsc.tws.api.compute.schedule.elements.WorkerPlan)2 TimeoutException (edu.iu.dsc.tws.api.exceptions.TimeoutException)2 ExecutionPlanBuilder (edu.iu.dsc.tws.executor.core.ExecutionPlanBuilder)2 ExecutorFactory (edu.iu.dsc.tws.executor.threading.ExecutorFactory)2 RoundRobinTaskScheduler (edu.iu.dsc.tws.tsched.streaming.roundrobin.RoundRobinTaskScheduler)2