Search in sources :

Example 1 with NamedSink

use of com.airhacks.enhydrator.out.NamedSink in project enhydrator by AdamBien.

the class PumpIT method ignoringPreprocessor.

@Test
public void ignoringPreprocessor() {
    CoffeeTestFixture.insertCoffee("arabica", 2, "hawai", Roast.LIGHT, "nice", "whole");
    CoffeeTestFixture.insertCoffee("niceone", 3, "russia", Roast.MEDIUM, "awful", "java beans");
    NamedSink consumer = getMockedSink();
    Pump pump = new Pump.Engine().from(source).startWith(l -> null).sqlQuery("select * from Coffee").to(consumer).build();
    pump.start();
    verify(consumer, never()).processRow(any(Row.class));
}
Also used : CoreMatchers.is(org.hamcrest.CoreMatchers.is) PipelineTest(com.airhacks.enhydrator.flexpipe.PipelineTest) Assert.assertTrue(org.junit.Assert.assertTrue) Test(org.junit.Test) Mockito.times(org.mockito.Mockito.times) Mockito.when(org.mockito.Mockito.when) Function(java.util.function.Function) ArrayList(java.util.ArrayList) Mockito.verify(org.mockito.Mockito.verify) Assert.assertThat(org.junit.Assert.assertThat) Matchers.any(org.mockito.Matchers.any) List(java.util.List) Mockito.never(org.mockito.Mockito.never) JDBCSource(com.airhacks.enhydrator.in.JDBCSource) After(org.junit.After) NamedSink(com.airhacks.enhydrator.out.NamedSink) Pipeline(com.airhacks.enhydrator.flexpipe.Pipeline) Row(com.airhacks.enhydrator.in.Row) Before(org.junit.Before) Mockito.mock(org.mockito.Mockito.mock) NamedSink(com.airhacks.enhydrator.out.NamedSink) Row(com.airhacks.enhydrator.in.Row) PipelineTest(com.airhacks.enhydrator.flexpipe.PipelineTest) Test(org.junit.Test)

Example 2 with NamedSink

use of com.airhacks.enhydrator.out.NamedSink in project enhydrator by AdamBien.

the class PumpIT method ignoringFilter.

@Test
public void ignoringFilter() {
    CoffeeTestFixture.insertCoffee("arabica", 2, "hawai", Roast.LIGHT, "nice", "whole");
    CoffeeTestFixture.insertCoffee("niceone", 3, "russia", Roast.MEDIUM, "awful", "java beans");
    NamedSink consumer = getMockedSink();
    Pump pump = new Pump.Engine().filter("false").from(source).to(consumer).sqlQuery("select * from Coffee").build();
    long rowCount = pump.start().getProcessedRowCount();
    //counts all rows, not processed rows
    assertThat(rowCount, is(2l));
    verify(consumer, never()).processRow(any(Row.class));
}
Also used : NamedSink(com.airhacks.enhydrator.out.NamedSink) Row(com.airhacks.enhydrator.in.Row) PipelineTest(com.airhacks.enhydrator.flexpipe.PipelineTest) Test(org.junit.Test)

Example 3 with NamedSink

use of com.airhacks.enhydrator.out.NamedSink in project enhydrator by AdamBien.

the class PumpIT method scriptEntryTransformer.

@Test
public void scriptEntryTransformer() {
    CoffeeTestFixture.insertCoffee("arabica", 2, "hawai", Roast.LIGHT, "nice", "whole");
    CoffeeTestFixture.insertCoffee("niceone", 3, "russia", Roast.MEDIUM, "awful", "java beans");
    NamedSink consumer = getMockedSink();
    Pump pump = new Pump.Engine().homeScriptFolder("./src/test/scripts").from(source).withColumnScript("Name", "quote").to(consumer).sqlQuery("select * from Coffee").build();
    pump.start();
    verify(consumer, times(2)).processRow(any(Row.class));
}
Also used : NamedSink(com.airhacks.enhydrator.out.NamedSink) Row(com.airhacks.enhydrator.in.Row) PipelineTest(com.airhacks.enhydrator.flexpipe.PipelineTest) Test(org.junit.Test)

Example 4 with NamedSink

use of com.airhacks.enhydrator.out.NamedSink in project enhydrator by AdamBien.

the class PumpIT method passThrough.

@Test
public void passThrough() {
    CoffeeTestFixture.insertCoffee("arabica", 2, "hawai", Roast.LIGHT, "nice", "whole");
    CoffeeTestFixture.insertCoffee("niceone", 3, "russia", Roast.MEDIUM, "awful", "java beans");
    NamedSink consumer = getMockedSink();
    Pump pump = new Pump.Engine().from(source).to(consumer).sqlQuery("select * from Coffee").build();
    pump.start();
    verify(consumer, times(2)).processRow(any(Row.class));
}
Also used : NamedSink(com.airhacks.enhydrator.out.NamedSink) Row(com.airhacks.enhydrator.in.Row) PipelineTest(com.airhacks.enhydrator.flexpipe.PipelineTest) Test(org.junit.Test)

Example 5 with NamedSink

use of com.airhacks.enhydrator.out.NamedSink in project enhydrator by AdamBien.

the class PipelineTest method getJDBCPipeline.

public static Pipeline getJDBCPipeline() {
    DestinationMapper mapper = new DestinationMapper();
    mapper.addMapping(0, new TargetMapping("*", "*"));
    JDBCSource source = JDBCSourceIT.getSource();
    NamedSink logSink = new LogSink();
    NamedSink jdbcSink = JDBCSinkTest.getSink();
    ColumnTransformation e1 = new ColumnTransformation("name", "convert", true);
    ColumnTransformation e2 = new ColumnTransformation(42, "compress", true);
    Pipeline origin = new Pipeline("jdbc", "src/test/scripts", "select * from Coffee where name like ? and strength = ?", source);
    origin.addSink(logSink);
    origin.addSink(jdbcSink);
    origin.addQueryParam("arabica");
    origin.addQueryParam(2);
    origin.addEntryTransformation(e1);
    origin.addEntryTransformation(e2);
    origin.addPreRowTransformation(mapper);
    origin.addPostRowTransformation(new SkipFirstRow());
    origin.addPreRowTransformation(new NashornRowTransformer("src/test/scripts", "encrypt"));
    origin.addPostRowTransformation(new NashornRowTransformer("src/test/scripts", "compress"));
    Map<String, ColumnCopier.NameList> mappings = new HashMap<>();
    mappings.put("duke", new ColumnCopier.NameList(Arrays.asList("java", "javaee")));
    origin.addPostRowTransformation(new ColumnCopier(mappings));
    origin.addFilter("true");
    origin.addExpression("print($ROW); $ROW");
    return origin;
}
Also used : DestinationMapper(com.airhacks.enhydrator.transform.DestinationMapper) LogSink(com.airhacks.enhydrator.out.LogSink) TargetMapping(com.airhacks.enhydrator.transform.TargetMapping) NashornRowTransformer(com.airhacks.enhydrator.transform.NashornRowTransformer) HashMap(java.util.HashMap) ColumnCopier(com.airhacks.enhydrator.transform.ColumnCopier) NamedSink(com.airhacks.enhydrator.out.NamedSink) JDBCSource(com.airhacks.enhydrator.in.JDBCSource) SkipFirstRow(com.airhacks.enhydrator.transform.SkipFirstRow)

Aggregations

NamedSink (com.airhacks.enhydrator.out.NamedSink)14 PipelineTest (com.airhacks.enhydrator.flexpipe.PipelineTest)9 Row (com.airhacks.enhydrator.in.Row)9 Test (org.junit.Test)9 JDBCSource (com.airhacks.enhydrator.in.JDBCSource)8 Pipeline (com.airhacks.enhydrator.flexpipe.Pipeline)4 LogSink (com.airhacks.enhydrator.out.LogSink)4 DestinationMapper (com.airhacks.enhydrator.transform.DestinationMapper)4 NashornRowTransformer (com.airhacks.enhydrator.transform.NashornRowTransformer)4 TargetMapping (com.airhacks.enhydrator.transform.TargetMapping)4 ArrayList (java.util.ArrayList)4 List (java.util.List)4 Function (java.util.function.Function)4 CoreMatchers.is (org.hamcrest.CoreMatchers.is)4 After (org.junit.After)4 Assert.assertThat (org.junit.Assert.assertThat)4 Assert.assertTrue (org.junit.Assert.assertTrue)4 Before (org.junit.Before)4 Matchers.any (org.mockito.Matchers.any)4 Mockito.mock (org.mockito.Mockito.mock)4