Search in sources :

Example 1 with PredicateBase

use of edu.uci.ics.textdb.exp.common.PredicateBase in project textdb by TextDB.

the class SelectStatementTest method testSelectStatementBeansBuilder00.

/**
     * Test the correctness of the generated beans by a SelectStatement without a
     * ProjectPredicate nor ExtractPredicate.
     * Get a graph by calling getInternalPredicateBases() and getInternalLinkBeans()
     * methods and check if the generated path form the node getInputNodeID() to 
     * the node getOutputNodeID() is correct. Also check whether getInputViews()
     * is returning the correct dependencies.  
     */
@Test
public void testSelectStatementBeansBuilder00() {
    SelectStatement selectStatement = new SelectStatement("id", null, null, "tableX", null, null);
    List<PredicateBase> expectedGeneratedBeans = Collections.emptyList();
    List<String> dependencies = Arrays.asList("tableX");
    Assert.assertEquals(selectStatement.getInputViews(), dependencies);
    StatementTestUtils.assertGeneratedBeans(selectStatement, expectedGeneratedBeans);
}
Also used : SelectStatement(edu.uci.ics.textdb.textql.statements.SelectStatement) PredicateBase(edu.uci.ics.textdb.exp.common.PredicateBase) Test(org.junit.Test)

Example 2 with PredicateBase

use of edu.uci.ics.textdb.exp.common.PredicateBase in project textdb by TextDB.

the class SelectStatementTest method testSelectStatementBeansBuilder02.

/**
     * Test the correctness of the generated beans by a SelectStatement with a
     * ProjectSomeFieldsPredicate.
     * Get a graph by calling getInternalPredicateBases() and getInternalLinkBeans()
     * methods and check if the generated path form the node getInputNodeID() to 
     * the node getOutputNodeID() is correct. Also check whether getInputViews()
     * is returning the correct dependencies.  
     */
@Test
public void testSelectStatementBeansBuilder02() {
    ProjectPredicate projectPredicate = new ProjectSomeFieldsPredicate(Arrays.asList("a", "b"));
    SelectStatement selectStatement = new SelectStatement("idX", projectPredicate, null, "from", null, null);
    List<PredicateBase> expectedGeneratedBeans = Arrays.asList(new ProjectionPredicate(Arrays.asList("a", "b")));
    List<String> dependencies = Arrays.asList("from");
    Assert.assertEquals(selectStatement.getInputViews(), dependencies);
    StatementTestUtils.assertGeneratedBeans(selectStatement, expectedGeneratedBeans);
}
Also used : SelectStatement(edu.uci.ics.textdb.textql.statements.SelectStatement) ProjectPredicate(edu.uci.ics.textdb.textql.statements.predicates.ProjectPredicate) PredicateBase(edu.uci.ics.textdb.exp.common.PredicateBase) ProjectSomeFieldsPredicate(edu.uci.ics.textdb.textql.statements.predicates.ProjectSomeFieldsPredicate) ProjectionPredicate(edu.uci.ics.textdb.exp.projection.ProjectionPredicate) Test(org.junit.Test)

Example 3 with PredicateBase

use of edu.uci.ics.textdb.exp.common.PredicateBase in project textdb by TextDB.

the class StatementTestUtils method assertGeneratedBeans.

/**
     * Assert the generated beans by a statement are a valid direct acyclic graph (no cycles nor unreached nodes/links 
     * are present) and that the given list of operators are present in the right order in the path from the initial 
     * node to the final node (while ignoring the PassThroughBean and the value of the ID).
     * The following checks are performed:
     * -Check whether all the build operators have unique IDs (between them).
     * -Check whether the generated links are unique (no duplicate links).
     * -Check whether a path from the initial to the final node exists.
     * -Check whether all the operators in the path between the initial and the final node is are present in
     *     expectedOperators in the same order (ignoring the PassThroughBean)
     * -Check whether all the links connect existing operators.
     * -Check whether all the operator beans are visited once at most (no cycles).
     * -Check whether all the link beans are visited once at most (no cycles).
     * -Check whether all the operators, except for the final operator, have output arity equals to one.
     * -Check whether all the operators beans generated are reachable.
     * -Check whether all the link beans generated are reachable.
     * 
     * @param statement The statement to build the beans to be checked.
     * @param expectedOperators The list of the expected OperatorBeans to be build by the statement.
     */
public static void assertGeneratedBeans(Statement statement, List<PredicateBase> expectedOperators) {
    // Get operators and links from statement
    List<PredicateBase> operators = statement.getInternalOperatorBeans();
    List<OperatorLink> links = statement.getInternalLinkBeans();
    // Assert all statements have an unique id (check whether two operators have the same ID)
    boolean uniqueIds = operators.stream().collect(Collectors.groupingBy(op -> op.getID(), Collectors.counting())).values().stream().allMatch(count -> (count == 1));
    Assert.assertTrue(uniqueIds);
    // Iterate the graph (string of nodes) to look for the expected beans
    HashSet<PredicateBase> visitedOperators = new HashSet<>();
    HashSet<OperatorLink> visitedLinks = new HashSet<>();
    String initialNode = statement.getInputNodeID();
    String finalNode = statement.getOutputNodeID();
    Iterator<PredicateBase> expectedOperatorsIterator = expectedOperators.iterator();
    PredicateBase nextExpectedOperator = null;
    // Start from the initial node and stop when the final node is reached (or an Assert fail)
    String currentBeanId = initialNode;
    while (true) {
        // Get the next expected operator to find (if needed)
        if (nextExpectedOperator == null && expectedOperatorsIterator.hasNext()) {
            nextExpectedOperator = expectedOperatorsIterator.next();
        }
        // Get the current bean by ID
        String currentLookingBeanId = currentBeanId;
        PredicateBase currentOperatorBean = operators.stream().filter(op -> op.getID().equals(currentLookingBeanId)).findAny().orElse(null);
        Assert.assertNotNull(currentOperatorBean);
        // Add the current visited bean to the set of visited beans and assert it hasn't been visited yet (cycle check)
        Assert.assertTrue(visitedOperators.add(currentOperatorBean));
        // Compare the current bean with the next expected bean
        if (nextExpectedOperator != null && currentOperatorBean.getClass() == nextExpectedOperator.getClass()) {
            // Copy the id of the current bean to the bean we are looking for and assert they are equal
            nextExpectedOperator.setID(currentOperatorBean.getID());
            Assert.assertEquals(nextExpectedOperator, currentOperatorBean);
            nextExpectedOperator = null;
        } else if (!(currentOperatorBean instanceof PassThroughPredicate)) {
            // Found a bean that is not PassThrough and is not the expected operator!
            Assert.fail();
        }
        // Break once the final node is visited
        if (currentBeanId.equals(finalNode)) {
            break;
        }
        // Get outgoing links for the current bean
        List<OperatorLink> currentOperatorBeanOutgoingLinks = links.stream().filter(link -> link.getOrigin().equals(currentOperatorBean.getID())).collect(Collectors.toList());
        // Assert there is only one outgoing link
        Assert.assertEquals(currentOperatorBeanOutgoingLinks.size(), 1);
        OperatorLink currentOperatorBeanOutgoingLink = currentOperatorBeanOutgoingLinks.get(0);
        // Add the outgoing link to the set of visited links and assert it hasn't been visited yet (cycle and duplicate check)
        Assert.assertTrue(visitedLinks.add(currentOperatorBeanOutgoingLink));
        // Set the current bean id to the next bean
        currentBeanId = currentOperatorBeanOutgoingLink.getDestination();
    }
    // Assert there are no more expected operators to look for
    Assert.assertFalse(expectedOperatorsIterator.hasNext());
    // Assert all the operators generated by the statement are visited (no unreachable operators)
    Assert.assertTrue(visitedOperators.containsAll(operators));
    // Assert all the links generated by the statement are visited (no unreachable links)
    Assert.assertTrue(visitedLinks.containsAll(links));
}
Also used : HashSet(java.util.HashSet) List(java.util.List) OperatorLink(edu.uci.ics.textdb.exp.plangen.OperatorLink) Iterator(java.util.Iterator) Statement(edu.uci.ics.textdb.textql.statements.Statement) Assert(org.junit.Assert) PassThroughPredicate(edu.uci.ics.textdb.textql.planbuilder.beans.PassThroughPredicate) Collectors(java.util.stream.Collectors) PredicateBase(edu.uci.ics.textdb.exp.common.PredicateBase) OperatorLink(edu.uci.ics.textdb.exp.plangen.OperatorLink) PredicateBase(edu.uci.ics.textdb.exp.common.PredicateBase) PassThroughPredicate(edu.uci.ics.textdb.textql.planbuilder.beans.PassThroughPredicate) HashSet(java.util.HashSet)

Example 4 with PredicateBase

use of edu.uci.ics.textdb.exp.common.PredicateBase in project textdb by TextDB.

the class KeywordExtractPredicateTest method testGeneratePredicateBase01.

/**
     * Test the generatePredicateBase method.
     * Build a KeywordExtractPredicate, invoke the generatePredicateBase and
     * check whether a KeywordMatcherBean with the right attributes is returned.
     * A list with one field is used as the list of fields to perform the match.
     */
@Test
public void testGeneratePredicateBase01() {
    String operatorId = "operator";
    List<String> matchingFields = Arrays.asList("fieldOne");
    String keywords = "keyword(s)";
    String matchingType = KeywordMatchingType.PHRASE_INDEXBASED.toString();
    KeywordExtractPredicate keywordExtractPredicate = new KeywordExtractPredicate(matchingFields, keywords, matchingType);
    PredicateBase computedProjectionBean = keywordExtractPredicate.generateOperatorBean(operatorId);
    PredicateBase expectedProjectionBean = new KeywordPredicate(keywords, matchingFields, null, KeywordMatchingType.fromName(matchingType), operatorId);
    expectedProjectionBean.setID(operatorId);
    Assert.assertEquals(expectedProjectionBean, computedProjectionBean);
}
Also used : PredicateBase(edu.uci.ics.textdb.exp.common.PredicateBase) KeywordPredicate(edu.uci.ics.textdb.exp.keywordmatcher.KeywordPredicate) Test(org.junit.Test)

Example 5 with PredicateBase

use of edu.uci.ics.textdb.exp.common.PredicateBase in project textdb by TextDB.

the class ProjectAllFieldsPredicateTest method testGenerateOperatorBean.

/**
     * Test the generateOperatorBean method.
     * Build a SelectAllFieldsPredicate, invoke the generateOperatorBean and check
     * whether a PassThroughBean with the right attributes is returned.
     */
@Test
public void testGenerateOperatorBean() {
    ProjectAllFieldsPredicate projectAllFieldsPredicate = new ProjectAllFieldsPredicate();
    PredicateBase projectionBean;
    final String operatorId1 = "xxx";
    projectionBean = projectAllFieldsPredicate.generateOperatorBean(operatorId1);
    Assert.assertEquals(projectionBean, new PassThroughPredicate(operatorId1));
    final String operatorId2 = "y0a9";
    projectionBean = projectAllFieldsPredicate.generateOperatorBean(operatorId2);
    Assert.assertEquals(projectionBean, new PassThroughPredicate(operatorId2));
}
Also used : PredicateBase(edu.uci.ics.textdb.exp.common.PredicateBase) PassThroughPredicate(edu.uci.ics.textdb.textql.planbuilder.beans.PassThroughPredicate) Test(org.junit.Test)

Aggregations

PredicateBase (edu.uci.ics.textdb.exp.common.PredicateBase)17 Test (org.junit.Test)15 SelectStatement (edu.uci.ics.textdb.textql.statements.SelectStatement)8 KeywordPredicate (edu.uci.ics.textdb.exp.keywordmatcher.KeywordPredicate)6 ProjectionPredicate (edu.uci.ics.textdb.exp.projection.ProjectionPredicate)5 ProjectPredicate (edu.uci.ics.textdb.textql.statements.predicates.ProjectPredicate)5 ExtractPredicate (edu.uci.ics.textdb.textql.statements.predicates.ExtractPredicate)4 KeywordExtractPredicate (edu.uci.ics.textdb.textql.statements.predicates.KeywordExtractPredicate)4 PassThroughPredicate (edu.uci.ics.textdb.textql.planbuilder.beans.PassThroughPredicate)3 Statement (edu.uci.ics.textdb.textql.statements.Statement)3 ProjectSomeFieldsPredicate (edu.uci.ics.textdb.textql.statements.predicates.ProjectSomeFieldsPredicate)3 CreateViewStatement (edu.uci.ics.textdb.textql.statements.CreateViewStatement)2 ProjectAllFieldsPredicate (edu.uci.ics.textdb.textql.statements.predicates.ProjectAllFieldsPredicate)2 OperatorLink (edu.uci.ics.textdb.exp.plangen.OperatorLink)1 ArrayList (java.util.ArrayList)1 HashSet (java.util.HashSet)1 Iterator (java.util.Iterator)1 List (java.util.List)1 Collectors (java.util.stream.Collectors)1 Assert (org.junit.Assert)1