Search in sources :

Example 1 with ValidationProcessor

use of uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor in project Gaffer by gchq.

the class QueryScannerTest method shouldConstructProcessorsWhenViewIsNull.

@Test
public void shouldConstructProcessorsWhenViewIsNull() throws OperationException, IOException {
    // Given
    final Scan scan = mock(Scan.class);
    given(scan.getAttribute(HBaseStoreConstants.VIEW)).willReturn(null);
    // When
    final List<GafferScannerProcessor> processors = QueryScanner.createProcessors(scan, SCHEMA, serialisation);
    // Then
    assertThat(processors).hasSize(2);
    int i = 0;
    assertTrue(processors.get(i) instanceof StoreAggregationProcessor);
    assertEquals(SCHEMA, ((StoreAggregationProcessor) processors.get(i)).getSchema());
    i++;
    assertTrue(processors.get(i) instanceof ValidationProcessor);
    assertEquals(SCHEMA, ((ValidationProcessor) processors.get(i)).getSchema());
}
Also used : StoreAggregationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.StoreAggregationProcessor) GafferScannerProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GafferScannerProcessor) Scan(org.apache.hadoop.hbase.client.Scan) ValidationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor) Test(org.junit.jupiter.api.Test)

Example 2 with ValidationProcessor

use of uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor in project Gaffer by gchq.

the class StoreScannerTest method shouldConstructProcessors.

@Test
public void shouldConstructProcessors() throws OperationException, IOException {
    // Given
    final Scan scan = mock(Scan.class);
    given(scan.getAttribute(HBaseStoreConstants.VIEW)).willReturn(VIEW.toCompactJson());
    given(scan.getAttribute(HBaseStoreConstants.EXTRA_PROCESSORS)).willReturn(StringUtil.toCsv(ElementDedupeFilterProcessor.class));
    // When
    final List<GafferScannerProcessor> processors = StoreScanner.createProcessors(SCHEMA, serialisation);
    // Then
    assertThat(processors).hasSize(2);
    int i = 0;
    assertTrue(processors.get(i) instanceof StoreAggregationProcessor);
    assertEquals(SCHEMA, ((StoreAggregationProcessor) processors.get(i)).getSchema());
    i++;
    assertTrue(processors.get(i) instanceof ValidationProcessor);
    assertEquals(SCHEMA, ((ValidationProcessor) processors.get(i)).getSchema());
}
Also used : StoreAggregationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.StoreAggregationProcessor) GafferScannerProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GafferScannerProcessor) ElementDedupeFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ElementDedupeFilterProcessor) Scan(org.apache.hadoop.hbase.client.Scan) ValidationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor) Test(org.junit.jupiter.api.Test)

Example 3 with ValidationProcessor

use of uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor in project Gaffer by gchq.

the class StoreScannerTest method shouldConstructProcessorsWithNoAggregation.

@Test
public void shouldConstructProcessorsWithNoAggregation() throws OperationException, IOException {
    // Given
    final Scan scan = mock(Scan.class);
    given(scan.getAttribute(HBaseStoreConstants.VIEW)).willReturn(VIEW.toCompactJson());
    given(scan.getAttribute(HBaseStoreConstants.EXTRA_PROCESSORS)).willReturn(StringUtil.toCsv(ElementDedupeFilterProcessor.class));
    // When
    final List<GafferScannerProcessor> processors = StoreScanner.createProcessors(SCHEMA_NO_AGGREGATION, serialisation);
    // Then
    assertThat(processors).hasSize(1);
    int i = 0;
    assertTrue(processors.get(i) instanceof ValidationProcessor);
    assertEquals(SCHEMA_NO_AGGREGATION, ((ValidationProcessor) processors.get(i)).getSchema());
}
Also used : GafferScannerProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GafferScannerProcessor) ElementDedupeFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ElementDedupeFilterProcessor) Scan(org.apache.hadoop.hbase.client.Scan) ValidationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor) Test(org.junit.jupiter.api.Test)

Example 4 with ValidationProcessor

use of uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor in project Gaffer by gchq.

the class QueryScannerTest method shouldConstructProcessorsWithNoExtras.

@Test
public void shouldConstructProcessorsWithNoExtras() throws OperationException, IOException {
    // Given
    final Scan scan = mock(Scan.class);
    given(scan.getAttribute(HBaseStoreConstants.VIEW)).willReturn(VIEW.toCompactJson());
    given(scan.getAttribute(HBaseStoreConstants.EXTRA_PROCESSORS)).willReturn(null);
    // When
    final List<GafferScannerProcessor> processors = QueryScanner.createProcessors(scan, SCHEMA, serialisation);
    // Then
    assertThat(processors).hasSize(6);
    int i = 0;
    assertTrue(processors.get(i) instanceof GroupFilterProcessor);
    assertEquals(VIEW, ((GroupFilterProcessor) processors.get(i)).getView());
    i++;
    assertTrue(processors.get(i) instanceof StoreAggregationProcessor);
    assertEquals(SCHEMA, ((StoreAggregationProcessor) processors.get(i)).getSchema());
    i++;
    assertTrue(processors.get(i) instanceof ValidationProcessor);
    assertEquals(SCHEMA, ((ValidationProcessor) processors.get(i)).getSchema());
    i++;
    assertTrue(processors.get(i) instanceof PreAggregationFilterProcessor);
    assertEquals(VIEW, ((PreAggregationFilterProcessor) processors.get(i)).getView());
    i++;
    assertTrue(processors.get(i) instanceof QueryAggregationProcessor);
    assertEquals(SCHEMA, ((QueryAggregationProcessor) processors.get(i)).getSchema());
    assertEquals(VIEW, ((QueryAggregationProcessor) processors.get(i)).getView());
    i++;
    assertTrue(processors.get(i) instanceof PostAggregationFilterProcessor);
    assertEquals(VIEW, ((PostAggregationFilterProcessor) processors.get(i)).getView());
}
Also used : StoreAggregationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.StoreAggregationProcessor) PostAggregationFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.PostAggregationFilterProcessor) GafferScannerProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GafferScannerProcessor) GroupFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GroupFilterProcessor) Scan(org.apache.hadoop.hbase.client.Scan) ValidationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor) PreAggregationFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.PreAggregationFilterProcessor) QueryAggregationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.QueryAggregationProcessor) Test(org.junit.jupiter.api.Test)

Example 5 with ValidationProcessor

use of uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor in project Gaffer by gchq.

the class QueryScannerTest method shouldConstructProcessors.

@Test
public void shouldConstructProcessors() throws OperationException, IOException {
    // Given
    final Scan scan = mock(Scan.class);
    given(scan.getAttribute(HBaseStoreConstants.VIEW)).willReturn(VIEW.toCompactJson());
    given(scan.getAttribute(HBaseStoreConstants.EXTRA_PROCESSORS)).willReturn(StringUtil.toCsv(ElementDedupeFilterProcessor.class));
    given(scan.getAttribute(HBaseStoreConstants.DIRECTED_TYPE)).willReturn(Bytes.toBytes(DirectedType.DIRECTED.name()));
    // When
    final List<GafferScannerProcessor> processors = QueryScanner.createProcessors(scan, SCHEMA, serialisation);
    // Then
    assertThat(processors).hasSize(7);
    int i = 0;
    assertTrue(processors.get(i) instanceof GroupFilterProcessor);
    assertEquals(VIEW, ((GroupFilterProcessor) processors.get(i)).getView());
    i++;
    assertTrue(processors.get(i) instanceof ElementDedupeFilterProcessor);
    assertTrue(((ElementDedupeFilterProcessor) processors.get(i)).isEntities());
    assertTrue(((ElementDedupeFilterProcessor) processors.get(i)).isEdges());
    assertTrue(((ElementDedupeFilterProcessor) processors.get(i)).isDirectedEdges());
    assertFalse(((ElementDedupeFilterProcessor) processors.get(i)).isUnDirectedEdges());
    i++;
    assertTrue(processors.get(i) instanceof StoreAggregationProcessor);
    assertEquals(SCHEMA, ((StoreAggregationProcessor) processors.get(i)).getSchema());
    i++;
    assertTrue(processors.get(i) instanceof ValidationProcessor);
    assertEquals(SCHEMA, ((ValidationProcessor) processors.get(i)).getSchema());
    i++;
    assertTrue(processors.get(i) instanceof PreAggregationFilterProcessor);
    assertEquals(VIEW, ((PreAggregationFilterProcessor) processors.get(i)).getView());
    i++;
    assertTrue(processors.get(i) instanceof QueryAggregationProcessor);
    assertEquals(SCHEMA, ((QueryAggregationProcessor) processors.get(i)).getSchema());
    assertEquals(VIEW, ((QueryAggregationProcessor) processors.get(i)).getView());
    i++;
    assertTrue(processors.get(i) instanceof PostAggregationFilterProcessor);
    assertEquals(VIEW, ((PostAggregationFilterProcessor) processors.get(i)).getView());
}
Also used : StoreAggregationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.StoreAggregationProcessor) PostAggregationFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.PostAggregationFilterProcessor) GafferScannerProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GafferScannerProcessor) GroupFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GroupFilterProcessor) ElementDedupeFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ElementDedupeFilterProcessor) Scan(org.apache.hadoop.hbase.client.Scan) ValidationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor) PreAggregationFilterProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.PreAggregationFilterProcessor) QueryAggregationProcessor(uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.QueryAggregationProcessor) Test(org.junit.jupiter.api.Test)

Aggregations

GafferScannerProcessor (uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GafferScannerProcessor)8 ValidationProcessor (uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ValidationProcessor)8 Scan (org.apache.hadoop.hbase.client.Scan)6 Test (org.junit.jupiter.api.Test)6 StoreAggregationProcessor (uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.StoreAggregationProcessor)6 ElementDedupeFilterProcessor (uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.ElementDedupeFilterProcessor)5 GroupFilterProcessor (uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.GroupFilterProcessor)4 PostAggregationFilterProcessor (uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.PostAggregationFilterProcessor)4 PreAggregationFilterProcessor (uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.PreAggregationFilterProcessor)4 QueryAggregationProcessor (uk.gov.gchq.gaffer.hbasestore.coprocessor.processor.QueryAggregationProcessor)3 ArrayList (java.util.ArrayList)2 View (uk.gov.gchq.gaffer.data.elementdefinition.view.View)1