Examples with ChainedTransformer org.apache.hudi.sink.transform.ChainedTransformer used on opensource projects

Example 1 with ChainedTransformer

use of org.apache.hudi.sink.transform.ChainedTransformer in project hudi by apache.

the class ITTestDataStreamWrite method testChainedTransformersBeforeWriting.

@Test
public void testChainedTransformersBeforeWriting() throws Exception {
    Transformer t1 = (ds) -> ds.map((rowdata) -> {
        if (rowdata instanceof GenericRowData) {
            GenericRowData genericRD = (GenericRowData) rowdata;
            // update age field to age + 1
            genericRD.setField(2, genericRD.getInt(2) + 1);
            return genericRD;
        } else {
            throw new RuntimeException("Unrecognized row type : " + rowdata.getClass().getSimpleName());
        }
    });
    ChainedTransformer chainedTransformer = new ChainedTransformer(Arrays.asList(t1, t1));
    testWriteToHoodie(chainedTransformer, EXPECTED_CHAINED_TRANSFORMER);
}