Examples with OverwriteWithLatestAvroPayload org.apache.hudi.common.model.OverwriteWithLatestAvroPayload used on opensource projects

Example 1 with OverwriteWithLatestAvroPayload

use of org.apache.hudi.common.model.OverwriteWithLatestAvroPayload in project hudi by apache.

the class TestAWSDmsAvroPayload method testPreCombineWithDelete.

@Test
public void testPreCombineWithDelete() {
    Schema avroSchema = new Schema.Parser().parse(AVRO_SCHEMA_STRING);
    GenericRecord deleteRecord = new GenericData.Record(avroSchema);
    deleteRecord.put("field1", 4);
    deleteRecord.put("Op", "D");
    GenericRecord oldRecord = new GenericData.Record(avroSchema);
    oldRecord.put("field1", 4);
    oldRecord.put("Op", "I");
    AWSDmsAvroPayload payload = new AWSDmsAvroPayload(Option.of(deleteRecord));
    AWSDmsAvroPayload insertPayload = new AWSDmsAvroPayload(Option.of(oldRecord));
    try {
        OverwriteWithLatestAvroPayload output = payload.preCombine(insertPayload);
        Option<IndexedRecord> outputPayload = output.getInsertValue(avroSchema);
        // expect nothing to be committed to table
        assertFalse(outputPayload.isPresent());
    } catch (Exception e) {
        fail("Unexpected exception");
    }
}