Search in sources :

Example 46 with Vertex

use of com.hazelcast.jet.core.Vertex in project hazelcast by hazelcast.

the class CreateDagVisitor method onAggregate.

public Vertex onAggregate(AggregatePhysicalRel rel) {
    AggregateOperation<?, JetSqlRow> aggregateOperation = rel.aggrOp();
    Vertex vertex = dag.newUniqueVertex("Aggregate", ProcessorMetaSupplier.forceTotalParallelismOne(ProcessorSupplier.of(Processors.aggregateP(aggregateOperation)), localMemberAddress));
    connectInput(rel.getInput(), vertex, edge -> edge.distributeTo(localMemberAddress).allToOne(""));
    return vertex;
}
Also used : Vertex(com.hazelcast.jet.core.Vertex) JetSqlRow(com.hazelcast.sql.impl.row.JetSqlRow)

Example 47 with Vertex

use of com.hazelcast.jet.core.Vertex in project hazelcast by hazelcast.

the class CreateDagVisitor method onNestedLoopJoin.

public Vertex onNestedLoopJoin(JoinNestedLoopPhysicalRel rel) {
    assert rel.getRight() instanceof FullScanPhysicalRel : rel.getRight().getClass();
    Table rightTable = rel.getRight().getTable().unwrap(HazelcastTable.class).getTarget();
    collectObjectKeys(rightTable);
    VertexWithInputConfig vertexWithConfig = getJetSqlConnector(rightTable).nestedLoopReader(dag, rightTable, rel.rightFilter(parameterMetadata), rel.rightProjection(parameterMetadata), rel.joinInfo(parameterMetadata));
    Vertex vertex = vertexWithConfig.vertex();
    connectInput(rel.getLeft(), vertex, vertexWithConfig.configureEdgeFn());
    return vertex;
}
Also used : Vertex(com.hazelcast.jet.core.Vertex) HazelcastTable(com.hazelcast.jet.sql.impl.schema.HazelcastTable) Table(com.hazelcast.sql.impl.schema.Table) VertexWithInputConfig(com.hazelcast.jet.sql.impl.connector.SqlConnector.VertexWithInputConfig) HazelcastTable(com.hazelcast.jet.sql.impl.schema.HazelcastTable)

Example 48 with Vertex

use of com.hazelcast.jet.core.Vertex in project hazelcast by hazelcast.

the class CreateDagVisitor method onUpdate.

public Vertex onUpdate(UpdatePhysicalRel rel) {
    Table table = rel.getTable().unwrap(HazelcastTable.class).getTarget();
    Vertex vertex = getJetSqlConnector(table).updateProcessor(dag, table, rel.updates(parameterMetadata));
    connectInput(rel.getInput(), vertex, null);
    return vertex;
}
Also used : Vertex(com.hazelcast.jet.core.Vertex) HazelcastTable(com.hazelcast.jet.sql.impl.schema.HazelcastTable) Table(com.hazelcast.sql.impl.schema.Table) HazelcastTable(com.hazelcast.jet.sql.impl.schema.HazelcastTable)

Example 49 with Vertex

use of com.hazelcast.jet.core.Vertex in project hazelcast by hazelcast.

the class CreateDagVisitor method onSink.

public Vertex onSink(SinkPhysicalRel rel) {
    Table table = rel.getTable().unwrap(HazelcastTable.class).getTarget();
    collectObjectKeys(table);
    Vertex vertex = getJetSqlConnector(table).sinkProcessor(dag, table);
    connectInput(rel.getInput(), vertex, null);
    return vertex;
}
Also used : Vertex(com.hazelcast.jet.core.Vertex) HazelcastTable(com.hazelcast.jet.sql.impl.schema.HazelcastTable) Table(com.hazelcast.sql.impl.schema.Table) HazelcastTable(com.hazelcast.jet.sql.impl.schema.HazelcastTable)

Example 50 with Vertex

use of com.hazelcast.jet.core.Vertex in project hazelcast by hazelcast.

the class CreateDagVisitor method onInsert.

public Vertex onInsert(InsertPhysicalRel rel) {
    Table table = rel.getTable().unwrap(HazelcastTable.class).getTarget();
    collectObjectKeys(table);
    VertexWithInputConfig vertexWithConfig = getJetSqlConnector(table).insertProcessor(dag, table);
    Vertex vertex = vertexWithConfig.vertex();
    connectInput(rel.getInput(), vertex, vertexWithConfig.configureEdgeFn());
    return vertex;
}
Also used : Vertex(com.hazelcast.jet.core.Vertex) HazelcastTable(com.hazelcast.jet.sql.impl.schema.HazelcastTable) Table(com.hazelcast.sql.impl.schema.Table) VertexWithInputConfig(com.hazelcast.jet.sql.impl.connector.SqlConnector.VertexWithInputConfig) HazelcastTable(com.hazelcast.jet.sql.impl.schema.HazelcastTable)

Aggregations

Vertex (com.hazelcast.jet.core.Vertex)189 DAG (com.hazelcast.jet.core.DAG)130 Test (org.junit.Test)95 QuickTest (com.hazelcast.test.annotation.QuickTest)57 Job (com.hazelcast.jet.Job)53 ParallelJVMTest (com.hazelcast.test.annotation.ParallelJVMTest)48 Entry (java.util.Map.Entry)41 List (java.util.List)28 Edge.between (com.hazelcast.jet.core.Edge.between)26 Map (java.util.Map)26 Assert.assertEquals (org.junit.Assert.assertEquals)23 ProcessorMetaSupplier (com.hazelcast.jet.core.ProcessorMetaSupplier)21 IntStream (java.util.stream.IntStream)21 Assert.assertTrue (org.junit.Assert.assertTrue)19 ProcessorSupplier (com.hazelcast.jet.core.ProcessorSupplier)18 Category (org.junit.experimental.categories.Category)18 Collectors.toList (java.util.stream.Collectors.toList)17 Nonnull (javax.annotation.Nonnull)17 FunctionEx (com.hazelcast.function.FunctionEx)15 Edge (com.hazelcast.jet.core.Edge)15