Search in sources :

Example 6 with ISink

use of edu.uci.ics.textdb.api.dataflow.ISink in project textdb by TextDB.

the class Engine method evaluate.

public void evaluate(Plan plan) throws TextDBException {
    ISink root = plan.getRoot();
    root.open();
    root.processTuples();
    root.close();
}
Also used : ISink(edu.uci.ics.textdb.api.dataflow.ISink)

Example 7 with ISink

use of edu.uci.ics.textdb.api.dataflow.ISink in project textdb by TextDB.

the class NewQueryPlanResource method executeQueryPlan.

/**
     * This is the edu.uci.ics.textdb.web.request handler for the execution of a Query Plan.
     * @param logicalPlanJson, the json representation of the logical plan
     * @return - Generic TextdbWebResponse object
     */
@POST
@Path("/execute")
public // TODO: investigate how to use LogicalPlan directly
TextdbWebResponse executeQueryPlan(String logicalPlanJson) {
    try {
        LogicalPlan logicalPlan = new ObjectMapper().readValue(logicalPlanJson, LogicalPlan.class);
        Plan plan = logicalPlan.buildQueryPlan();
        ISink sink = plan.getRoot();
        // send response back to frontend
        if (sink instanceof TupleSink) {
            TupleSink tupleSink = (TupleSink) sink;
            tupleSink.open();
            List<Tuple> results = tupleSink.collectAllTuples();
            tupleSink.close();
            ArrayNode arrayNode = new ObjectMapper().createArrayNode();
            for (Tuple tuple : results) {
                arrayNode.add(tuple.getReadableJson());
            }
            return new TextdbWebResponse(0, new ObjectMapper().writeValueAsString(arrayNode));
        } else {
            // execute the plan and return success message
            Engine.getEngine().evaluate(plan);
            ObjectNode objectNode = new ObjectMapper().createObjectNode();
            objectNode.put("status", "plan sucessfully executed");
            return new TextdbWebResponse(0, new ObjectMapper().writeValueAsString(objectNode));
        }
    } catch (IOException | RuntimeException e) {
        // TODO remove RuntimeException after the exception refactor
        e.printStackTrace();
        throw new TextdbWebException(e.getMessage());
    }
}
Also used : TupleSink(edu.uci.ics.textdb.exp.sink.tuple.TupleSink) TextdbWebResponse(edu.uci.ics.textdb.web.response.TextdbWebResponse) ObjectNode(com.fasterxml.jackson.databind.node.ObjectNode) IOException(java.io.IOException) LogicalPlan(edu.uci.ics.textdb.exp.plangen.LogicalPlan) Plan(edu.uci.ics.textdb.api.engine.Plan) ISink(edu.uci.ics.textdb.api.dataflow.ISink) TextdbWebException(edu.uci.ics.textdb.web.TextdbWebException) LogicalPlan(edu.uci.ics.textdb.exp.plangen.LogicalPlan) ArrayNode(com.fasterxml.jackson.databind.node.ArrayNode) ObjectMapper(com.fasterxml.jackson.databind.ObjectMapper) Tuple(edu.uci.ics.textdb.api.tuple.Tuple) Path(javax.ws.rs.Path) POST(javax.ws.rs.POST)

Example 8 with ISink

use of edu.uci.ics.textdb.api.dataflow.ISink in project textdb by TextDB.

the class LogicalPlanTest method testLogicalPlan2.

/*
     * Test a valid operator graph.
     *                  -> RegexMatcher -->
     * KeywordSource --<                     >-- Join --> TupleSink
     *                  -> NlpEntityOperator -->
     * 
     */
@Test
public void testLogicalPlan2() throws Exception {
    LogicalPlan logicalPlan = getLogicalPlan2();
    Plan queryPlan = logicalPlan.buildQueryPlan();
    ISink tupleSink = queryPlan.getRoot();
    Assert.assertTrue(tupleSink instanceof TupleSink);
    IOperator join = ((TupleSink) tupleSink).getInputOperator();
    Assert.assertTrue(join instanceof Join);
    IOperator joinInput1 = ((Join) join).getInnerInputOperator();
    Assert.assertTrue(joinInput1 instanceof RegexMatcher);
    IOperator joinInput2 = ((Join) join).getOuterInputOperator();
    Assert.assertTrue(joinInput2 instanceof NlpEntityOperator);
    IOperator connectorOut1 = ((RegexMatcher) joinInput1).getInputOperator();
    Assert.assertTrue(connectorOut1 instanceof ConnectorOutputOperator);
    IOperator connectorOut2 = ((NlpEntityOperator) joinInput2).getInputOperator();
    Assert.assertTrue(connectorOut2 instanceof ConnectorOutputOperator);
    HashSet<Integer> connectorIndices = new HashSet<>();
    connectorIndices.add(((ConnectorOutputOperator) connectorOut1).getOutputIndex());
    connectorIndices.add(((ConnectorOutputOperator) connectorOut2).getOutputIndex());
    Assert.assertEquals(connectorIndices.size(), 2);
    OneToNBroadcastConnector connector1 = ((ConnectorOutputOperator) connectorOut1).getOwnerConnector();
    OneToNBroadcastConnector connector2 = ((ConnectorOutputOperator) connectorOut2).getOwnerConnector();
    Assert.assertSame(connector1, connector2);
    IOperator keywordSource = connector1.getInputOperator();
    Assert.assertTrue(keywordSource instanceof KeywordMatcherSourceOperator);
}
Also used : TupleSink(edu.uci.ics.textdb.exp.sink.tuple.TupleSink) IOperator(edu.uci.ics.textdb.api.dataflow.IOperator) Join(edu.uci.ics.textdb.exp.join.Join) Plan(edu.uci.ics.textdb.api.engine.Plan) KeywordMatcherSourceOperator(edu.uci.ics.textdb.exp.keywordmatcher.KeywordMatcherSourceOperator) ISink(edu.uci.ics.textdb.api.dataflow.ISink) ConnectorOutputOperator(edu.uci.ics.textdb.exp.connector.OneToNBroadcastConnector.ConnectorOutputOperator) NlpEntityOperator(edu.uci.ics.textdb.exp.nlp.entity.NlpEntityOperator) RegexMatcher(edu.uci.ics.textdb.exp.regexmatcher.RegexMatcher) OneToNBroadcastConnector(edu.uci.ics.textdb.exp.connector.OneToNBroadcastConnector) HashSet(java.util.HashSet) Test(org.junit.Test)

Aggregations

ISink (edu.uci.ics.textdb.api.dataflow.ISink)8 Plan (edu.uci.ics.textdb.api.engine.Plan)6 IOperator (edu.uci.ics.textdb.api.dataflow.IOperator)5 TupleSink (edu.uci.ics.textdb.exp.sink.tuple.TupleSink)4 Test (org.junit.Test)4 OneToNBroadcastConnector (edu.uci.ics.textdb.exp.connector.OneToNBroadcastConnector)3 Join (edu.uci.ics.textdb.exp.join.Join)3 KeywordMatcherSourceOperator (edu.uci.ics.textdb.exp.keywordmatcher.KeywordMatcherSourceOperator)3 RegexMatcher (edu.uci.ics.textdb.exp.regexmatcher.RegexMatcher)3 HashSet (java.util.HashSet)3 ConnectorOutputOperator (edu.uci.ics.textdb.exp.connector.OneToNBroadcastConnector.ConnectorOutputOperator)2 NlpEntityOperator (edu.uci.ics.textdb.exp.nlp.entity.NlpEntityOperator)2 JsonCreator (com.fasterxml.jackson.annotation.JsonCreator)1 JsonProperty (com.fasterxml.jackson.annotation.JsonProperty)1 ObjectMapper (com.fasterxml.jackson.databind.ObjectMapper)1 ArrayNode (com.fasterxml.jackson.databind.node.ArrayNode)1 ObjectNode (com.fasterxml.jackson.databind.node.ObjectNode)1 PlanGenException (edu.uci.ics.textdb.api.exception.PlanGenException)1 Tuple (edu.uci.ics.textdb.api.tuple.Tuple)1 PredicateBase (edu.uci.ics.textdb.exp.common.PredicateBase)1