Search in sources :

Example 6 with Edge

use of edu.iu.dsc.tws.api.compute.graph.Edge in project twister2 by DSC-SPIDAL.

the class KeyedDirectTLink method getEdge.

@Override
public Edge getEdge() {
    // NOTE: There is no keyed direct in the communication layer!!! Hence this is an keyed direct
    // emulation. Therefore, we can not use user provided data types here because we will be using
    // Tuple<K, V> object through a DirectLink here.
    // todo fix this ambiguity!
    Edge e = new Edge(getId(), OperationNames.DIRECT, MessageTypes.OBJECT);
    e.addProperty(CommunicationContext.USE_DISK, this.useDisk);
    TLinkUtils.generateKeyedCommsSchema(getSchema(), e);
    return e;
}
Also used : Edge(edu.iu.dsc.tws.api.compute.graph.Edge)

Example 7 with Edge

use of edu.iu.dsc.tws.api.compute.graph.Edge in project twister2 by DSC-SPIDAL.

the class KeyedGatherUngroupedTLink method getEdge.

@Override
public Edge getEdge() {
    Edge e = new Edge(getId(), OperationNames.KEYED_GATHER, this.getSchema().getDataType());
    e.setKeyed(true);
    e.setKeyType(this.getSchema().getKeyType());
    e.setPartitioner(partitionFunction);
    e.addProperty(CommunicationContext.SORT_BY_KEY, this.keyCompartor != null);
    e.addProperty(CommunicationContext.GROUP_BY_KEY, this.groupByKey);
    if (this.keyCompartor != null) {
        e.addProperty(CommunicationContext.KEY_COMPARATOR, this.keyCompartor);
    }
    e.addProperty(CommunicationContext.USE_DISK, this.useDisk);
    TLinkUtils.generateKeyedCommsSchema(getSchema(), e);
    return e;
}
Also used : Edge(edu.iu.dsc.tws.api.compute.graph.Edge)

Example 8 with Edge

use of edu.iu.dsc.tws.api.compute.graph.Edge in project twister2 by DSC-SPIDAL.

the class KeyedPipeTLink method getEdge.

@Override
public Edge getEdge() {
    // NOTE: There is no keyed direct in the communication layer!!! Hence this is an keyed direct
    // emulation. Therefore, we can not use user provided data types here because we will be using
    // Tuple<K, V> object through a DirectLink here.
    // todo fix this ambiguity!
    Edge e = new Edge(getId(), OperationNames.PIPE, MessageTypes.OBJECT);
    TLinkUtils.generateKeyedCommsSchema(getSchema(), e);
    return e;
}
Also used : Edge(edu.iu.dsc.tws.api.compute.graph.Edge)

Example 9 with Edge

use of edu.iu.dsc.tws.api.compute.graph.Edge in project twister2 by DSC-SPIDAL.

the class ReduceTLink method getEdge.

@Override
public Edge getEdge() {
    Edge e = new Edge(getId(), OperationNames.REDUCE, this.getSchema().getDataType(), reduceFn);
    TLinkUtils.generateCommsSchema(getSchema(), e);
    return e;
}
Also used : Edge(edu.iu.dsc.tws.api.compute.graph.Edge)

Example 10 with Edge

use of edu.iu.dsc.tws.api.compute.graph.Edge in project twister2 by DSC-SPIDAL.

the class SAllGatherTLink method getEdge.

@Override
public Edge getEdge() {
    Edge e = new Edge(getId(), OperationNames.ALLGATHER, this.getSchema().getDataType());
    TLinkUtils.generateCommsSchema(getSchema(), e);
    return e;
}
Also used : Edge(edu.iu.dsc.tws.api.compute.graph.Edge)

Aggregations

Edge (edu.iu.dsc.tws.api.compute.graph.Edge)32 HashSet (java.util.HashSet)2 HashBasedTable (com.google.common.collect.HashBasedTable)1 Table (com.google.common.collect.Table)1 CheckpointingClient (edu.iu.dsc.tws.api.checkpointing.CheckpointingClient)1 Communicator (edu.iu.dsc.tws.api.comms.Communicator)1 LogicalPlan (edu.iu.dsc.tws.api.comms.LogicalPlan)1 ExecutionPlan (edu.iu.dsc.tws.api.compute.executor.ExecutionPlan)1 ExecutorContext (edu.iu.dsc.tws.api.compute.executor.ExecutorContext)1 IExecutionPlanBuilder (edu.iu.dsc.tws.api.compute.executor.IExecutionPlanBuilder)1 INodeInstance (edu.iu.dsc.tws.api.compute.executor.INodeInstance)1 IParallelOperation (edu.iu.dsc.tws.api.compute.executor.IParallelOperation)1 ComputeGraph (edu.iu.dsc.tws.api.compute.graph.ComputeGraph)1 OperationMode (edu.iu.dsc.tws.api.compute.graph.OperationMode)1 Vertex (edu.iu.dsc.tws.api.compute.graph.Vertex)1 ICompute (edu.iu.dsc.tws.api.compute.nodes.ICompute)1 INode (edu.iu.dsc.tws.api.compute.nodes.INode)1 ISource (edu.iu.dsc.tws.api.compute.nodes.ISource)1 TaskInstancePlan (edu.iu.dsc.tws.api.compute.schedule.elements.TaskInstancePlan)1 TaskSchedulePlan (edu.iu.dsc.tws.api.compute.schedule.elements.TaskSchedulePlan)1