Search in sources :

Example 1 with StageConfigurer

use of co.cask.cdap.etl.api.StageConfigurer in project cdap by caskdata.

the class StringValueFilterCompute method configurePipeline.

@Override
public void configurePipeline(PipelineConfigurer pipelineConfigurer) throws IllegalArgumentException {
    StageConfigurer stageConfigurer = pipelineConfigurer.getStageConfigurer();
    stageConfigurer.setOutputSchema(stageConfigurer.getInputSchema());
}
Also used : StageConfigurer(co.cask.cdap.etl.api.StageConfigurer)

Example 2 with StageConfigurer

use of co.cask.cdap.etl.api.StageConfigurer in project cdap by caskdata.

the class FieldsPrefixTransform method configurePipeline.

@Override
public void configurePipeline(PipelineConfigurer pipelineConfigurer) throws IllegalArgumentException {
    StageConfigurer stageConfigurer = pipelineConfigurer.getStageConfigurer();
    try {
        Schema outSchema = config.getOutputSchema(Schema.parseJson(config.schemaStr));
        stageConfigurer.setOutputSchema(outSchema);
    } catch (Exception e) {
        throw new IllegalArgumentException("Invalid output schema: " + e.getMessage(), e);
    }
}
Also used : StageConfigurer(co.cask.cdap.etl.api.StageConfigurer) Schema(co.cask.cdap.api.data.schema.Schema)

Example 3 with StageConfigurer

use of co.cask.cdap.etl.api.StageConfigurer in project cdap by caskdata.

the class FlattenErrorTransform method configurePipeline.

@Override
public void configurePipeline(PipelineConfigurer pipelineConfigurer) throws IllegalArgumentException {
    StageConfigurer stageConfigurer = pipelineConfigurer.getStageConfigurer();
    Schema inputSchema = stageConfigurer.getInputSchema();
    if (inputSchema != null) {
        stageConfigurer.setOutputSchema(getOutputSchema(inputSchema));
    }
}
Also used : StageConfigurer(co.cask.cdap.etl.api.StageConfigurer) Schema(co.cask.cdap.api.data.schema.Schema)

Example 4 with StageConfigurer

use of co.cask.cdap.etl.api.StageConfigurer in project cdap by caskdata.

the class AllErrorTransform method configurePipeline.

@Override
public void configurePipeline(PipelineConfigurer pipelineConfigurer) throws IllegalArgumentException {
    StageConfigurer stageConfigurer = pipelineConfigurer.getStageConfigurer();
    stageConfigurer.setOutputSchema(stageConfigurer.getInputSchema());
}
Also used : StageConfigurer(co.cask.cdap.etl.api.StageConfigurer)

Example 5 with StageConfigurer

use of co.cask.cdap.etl.api.StageConfigurer in project cdap by caskdata.

the class DropNullTransform method configurePipeline.

@Override
public void configurePipeline(PipelineConfigurer pipelineConfigurer) throws IllegalArgumentException {
    StageConfigurer stageConfigurer = pipelineConfigurer.getStageConfigurer();
    Schema inputSchema = stageConfigurer.getInputSchema();
    if (inputSchema != null) {
        stageConfigurer.setOutputSchema(getOutputSchema(inputSchema));
    }
}
Also used : StageConfigurer(co.cask.cdap.etl.api.StageConfigurer) Schema(co.cask.cdap.api.data.schema.Schema)

Aggregations

StageConfigurer (co.cask.cdap.etl.api.StageConfigurer)15 Schema (co.cask.cdap.api.data.schema.Schema)5