Search in sources :

Example 16 with Cause

use of io.cdap.cdap.etl.api.validation.ValidationFailure.Cause in project hydrator-plugins by cdapio.

the class JoinerConfigTest method testJoinerConfigWithoutSelectedFields.

@Test
public void testJoinerConfigWithoutSelectedFields() {
    JoinerConfig config = new JoinerConfig("film.film_id=filmActor.film_id=filmCategory.film_id&" + "film.film_name=filmActor.film_name=filmCategory.film_name", "", "film,filmActor,filmCategory");
    FailureCollector failureCollector = new MockFailureCollector();
    try {
        config.getSelectedFields(failureCollector);
    } catch (ValidationException e) {
        Assert.assertEquals(1, e.getFailures().size());
        ValidationFailure failure = e.getFailures().get(0);
        Assert.assertEquals(1, failure.getCauses().size());
        Cause cause = failure.getCauses().get(0);
        Assert.assertEquals(JoinerConfig.SELECTED_FIELDS, cause.getAttribute(CauseAttributes.STAGE_CONFIG));
    }
}
Also used : ValidationException(io.cdap.cdap.etl.api.validation.ValidationException) Cause(io.cdap.cdap.etl.api.validation.ValidationFailure.Cause) MockFailureCollector(io.cdap.cdap.etl.mock.validation.MockFailureCollector) FailureCollector(io.cdap.cdap.etl.api.FailureCollector) MockFailureCollector(io.cdap.cdap.etl.mock.validation.MockFailureCollector) ValidationFailure(io.cdap.cdap.etl.api.validation.ValidationFailure) Test(org.junit.Test)

Example 17 with Cause

use of io.cdap.cdap.etl.api.validation.ValidationFailure.Cause in project hydrator-plugins by cdapio.

the class ProjectionTransformTest method testMultipleRenamesToSameField.

@Test
public void testMultipleRenamesToSameField() throws Exception {
    ProjectionTransform.ProjectionTransformConfig config = new ProjectionTransform.ProjectionTransformConfig(null, "x:z,y:z", null, null);
    Transform<StructuredRecord, StructuredRecord> transform = new ProjectionTransform(config);
    TransformContext transformContext = new MockTransformContext();
    try {
        transform.initialize(transformContext);
        Assert.fail();
    } catch (ValidationException e) {
        Assert.assertEquals(1, e.getFailures().size());
        Assert.assertEquals(1, e.getFailures().get(0).getCauses().size());
        Cause expectedCause = new Cause();
        expectedCause.addAttribute(CauseAttributes.STAGE_CONFIG, ProjectionTransform.ProjectionTransformConfig.RENAME);
        expectedCause.addAttribute(STAGE, MOCK_STAGE);
        Assert.assertEquals(expectedCause, e.getFailures().get(0).getCauses().get(0));
    }
}
Also used : MockTransformContext(io.cdap.cdap.etl.mock.transform.MockTransformContext) ValidationException(io.cdap.cdap.etl.api.validation.ValidationException) TransformContext(io.cdap.cdap.etl.api.TransformContext) MockTransformContext(io.cdap.cdap.etl.mock.transform.MockTransformContext) Cause(io.cdap.cdap.etl.api.validation.ValidationFailure.Cause) StructuredRecord(io.cdap.cdap.api.data.format.StructuredRecord) Test(org.junit.Test)

Example 18 with Cause

use of io.cdap.cdap.etl.api.validation.ValidationFailure.Cause in project hydrator-plugins by cdapio.

the class ProjectionTransformTest method testDropFieldsValidations.

@Test
public void testDropFieldsValidations() {
    Schema schema = Schema.recordOf("three", Schema.Field.of("x", Schema.of(Schema.Type.INT)), Schema.Field.of("y", Schema.of(Schema.Type.DOUBLE)), Schema.Field.of("z", Schema.arrayOf(Schema.of(Schema.Type.INT))));
    MockPipelineConfigurer mockConfigurer = new MockPipelineConfigurer(schema, Collections.emptyMap());
    ProjectionTransform.ProjectionTransformConfig config = new ProjectionTransform.ProjectionTransformConfig("x,y,z", null, null, null);
    try {
        new ProjectionTransform(config).configurePipeline(mockConfigurer);
        Assert.fail();
    } catch (ValidationException e) {
        Assert.assertEquals(1, e.getFailures().size());
        Assert.assertEquals(1, e.getFailures().get(0).getCauses().size());
        Cause expectedCause = new Cause();
        expectedCause.addAttribute(CauseAttributes.STAGE_CONFIG, ProjectionTransform.ProjectionTransformConfig.DROP);
        expectedCause.addAttribute(STAGE, MOCK_STAGE);
        Assert.assertEquals(expectedCause, e.getFailures().get(0).getCauses().get(0));
    }
}
Also used : ValidationException(io.cdap.cdap.etl.api.validation.ValidationException) MockPipelineConfigurer(io.cdap.cdap.etl.mock.common.MockPipelineConfigurer) Schema(io.cdap.cdap.api.data.schema.Schema) Cause(io.cdap.cdap.etl.api.validation.ValidationFailure.Cause) Test(org.junit.Test)

Example 19 with Cause

use of io.cdap.cdap.etl.api.validation.ValidationFailure.Cause in project hydrator-plugins by cdapio.

the class XMLReaderConfigTest method testEmptyNodePath.

@Test
public void testEmptyNodePath() {
    XMLReaderBatchSource.XMLReaderConfig config = new XMLReaderBatchSource.XMLReaderConfig("emptyNodePathReference", "/opt/hdfs/catalog.xml", null, "", null, null, "Yes", "XMLTrackingTable", 30, "/tmp");
    FailureCollector collector = new MockFailureCollector();
    config.validate(collector);
    Assert.assertEquals(1, collector.getValidationFailures().size());
    Assert.assertEquals(1, collector.getValidationFailures().get(0).getCauses().size());
    Cause expectedCause = new Cause();
    expectedCause.addAttribute(CauseAttributes.STAGE_CONFIG, XMLReaderBatchSource.XMLReaderConfig.NODE_PATH);
    Assert.assertEquals(expectedCause, collector.getValidationFailures().get(0).getCauses().get(0));
}
Also used : Cause(io.cdap.cdap.etl.api.validation.ValidationFailure.Cause) MockFailureCollector(io.cdap.cdap.etl.mock.validation.MockFailureCollector) MockFailureCollector(io.cdap.cdap.etl.mock.validation.MockFailureCollector) FailureCollector(io.cdap.cdap.etl.api.FailureCollector) Test(org.junit.Test)

Example 20 with Cause

use of io.cdap.cdap.etl.api.validation.ValidationFailure.Cause in project hydrator-plugins by cdapio.

the class XMLReaderConfigTest method testEmptyTemporaryFolder.

@Test
public void testEmptyTemporaryFolder() {
    XMLReaderBatchSource.XMLReaderConfig config = new XMLReaderBatchSource.XMLReaderConfig("emptyNodePathReference", "/opt/hdfs/catalog.xml", null, "/catalog/book/", "Delete", null, "No", "XMLTrackingTable", 30, null);
    FailureCollector collector = new MockFailureCollector();
    config.validate(collector);
    Assert.assertEquals(1, collector.getValidationFailures().size());
    Assert.assertEquals(1, collector.getValidationFailures().get(0).getCauses().size());
    Cause expectedCause = new Cause();
    expectedCause.addAttribute(CauseAttributes.STAGE_CONFIG, XMLReaderBatchSource.XMLReaderConfig.TEMPORARY_FOLDER);
    Assert.assertEquals(expectedCause, collector.getValidationFailures().get(0).getCauses().get(0));
}
Also used : Cause(io.cdap.cdap.etl.api.validation.ValidationFailure.Cause) MockFailureCollector(io.cdap.cdap.etl.mock.validation.MockFailureCollector) MockFailureCollector(io.cdap.cdap.etl.mock.validation.MockFailureCollector) FailureCollector(io.cdap.cdap.etl.api.FailureCollector) Test(org.junit.Test)

Aggregations

Cause (io.cdap.cdap.etl.api.validation.ValidationFailure.Cause)24 Test (org.junit.Test)24 ValidationException (io.cdap.cdap.etl.api.validation.ValidationException)17 Schema (io.cdap.cdap.api.data.schema.Schema)13 FailureCollector (io.cdap.cdap.etl.api.FailureCollector)12 MockPipelineConfigurer (io.cdap.cdap.etl.mock.common.MockPipelineConfigurer)12 MockFailureCollector (io.cdap.cdap.etl.mock.validation.MockFailureCollector)9 StructuredRecord (io.cdap.cdap.api.data.format.StructuredRecord)3 TransformContext (io.cdap.cdap.etl.api.TransformContext)3 AutoJoinerContext (io.cdap.cdap.etl.api.join.AutoJoinerContext)3 MockTransformContext (io.cdap.cdap.etl.mock.transform.MockTransformContext)3 ETLBatchConfig (io.cdap.cdap.etl.proto.v2.ETLBatchConfig)3 JoinStage (io.cdap.cdap.etl.api.join.JoinStage)2 ValidationFailure (io.cdap.cdap.etl.api.validation.ValidationFailure)2 HashMap (java.util.HashMap)2 PipelineConfigurer (io.cdap.cdap.etl.api.PipelineConfigurer)1 MockEmitter (io.cdap.cdap.etl.mock.common.MockEmitter)1